Dan Liew a50a440b7c [lit] Try to remove the flakeyness of shtest-timeout.py and googletest-timeout.py. ... The tests previously relied on the `short.py` and `FirstTest.subTestA` script being executed on a machine within a short time window (1 or 2 seconds). While this "seems to work" it can fail on resource constrained machines. We could bump the timeout a little bit (bumping it too much would mean the test would take a long time to execute) but it wouldn't really solve the problem of the test being prone to failures. This patch tries to remove this flakeyness by separating testing into two separate parts: 1. Testing if a test can hit a timeout. 2. Testing if a test can run to completion in the presence of a timeout. This way we can give (1.) a really short timeout (to make the test run as fast as possible) and (2.) a really long timeout. This means for (2.) we are no longer trying to rely on the "short" test executing within some short time window. Instead the window is now 3600 seconds which should be long enough even for a heavily resource constrained machine to execute the "short" test. Thanks to Julian Lettner for suggesting this approach. This superseeds my original approach in https://reviews.llvm.org/D88807. This patch also changes the command line override test to run the quick test rather than the slow one to make the test run faster. Differential Revision: https://reviews.llvm.org/D89020		2020-10-08 10:46:18 -07:00
..
Inputs	[lit] Try to remove the flakeyness of shtest-timeout.py and googletest-timeout.py.	2020-10-08 10:46:18 -07:00
unit	[lit] Fix handling of various keyword parse errors	2020-06-12 09:37:40 -04:00
.coveragerc
allow-retries.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
boolean-parsing.py
custom-result-category.py	[lit] Improve consistency for showing result groups	2020-06-16 12:40:06 -07:00
discovery.py	[lit] Print substitutions with --show-suites	2020-04-13 12:01:12 -04:00
googletest-discovery-failed.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
googletest-format.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
googletest-timeout.py	[lit] Try to remove the flakeyness of shtest-timeout.py and googletest-timeout.py.	2020-10-08 10:46:18 -07:00
googletest-upstream-format.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
lit-opts.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
lit.cfg	[AIX] Add system-aix to lit config file	2020-07-06 12:54:12 -04:00
lit.site.cfg.in	lit: modernize the lit configuration for the lit tests	2019-05-29 18:07:39 +00:00
max-failures.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
max-time.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
parallelism-groups.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
progress-bar.py	[lit] Refactor ProgressDisplay	2019-10-09 18:23:30 +00:00
selecting.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
shell-parsing.py	[lit] Fix tests to execute lit with same python as invoked with.	2013-08-14 05:07:09 +00:00
show-result-codes.py	[lit] Add --show-xxx command line options	2020-07-08 17:01:05 -07:00
show-used-features.py	[lit] Add an option to print all features used in tests	2020-05-29 07:00:05 -04:00
shtest-encoding.py	[lit] Support parsing scripts with inconsistent or invalid encodings.	2013-08-14 18:22:41 +00:00
shtest-env.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
shtest-format-argv0.py	[AIX] Add system-aix to lit config file	2020-07-06 12:54:12 -04:00
shtest-format.py	[lit] Remove ANSI control characters from xunit output	2020-08-06 09:16:52 +01:00
shtest-inject.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
shtest-keyword-parse-errors.py	[lit] Fix handling of various keyword parse errors	2020-06-12 09:37:40 -04:00
shtest-not.py	[lit] Improve naming of test result categories	2020-06-05 08:14:42 -07:00
shtest-output-printing.py	[lit][tests][AIX] Update expected form of diagnostic messages; use not to normalize non-zero exit values	2019-05-01 15:47:16 +00:00
shtest-recursive-substitution.py	[lit] Don't expand escapes until all substitutions have been applied	2020-07-27 18:09:00 +03:00
shtest-run-at-line.py	[lit] Protect full test suite from FILECHECK_OPTS	2019-11-06 16:25:25 -05:00
shtest-shell.py	[lit] Prevent hang when lit sees non-ASCII characters	2020-07-14 18:41:15 +01:00
shtest-timeout.py	[lit] Try to remove the flakeyness of shtest-timeout.py and googletest-timeout.py.	2020-10-08 10:46:18 -07:00
test-data-micro.py	[lit] - Allow 1 test to report multiple micro-test results to provide support for microbenchmarks.	2018-03-13 16:37:59 +00:00
test-data.py
test-output-micro.py
test-output.py
unittest-adaptor.py	[lit] Add back LitTestCase	2019-10-15 20:57:20 +00:00
unparsed-requirements.py	[lit] Allow for tests to have non-parsed requirements	2020-06-15 16:43:02 -07:00
usage.py	[lit] Refine adoption of argparse --version action	2020-03-31 16:02:16 -07:00
xunit-output.py	[lit] Don't include tests skipped due to sharding in reports	2020-07-26 11:39:22 +01:00