1
0
mirror of https://github.com/RPCS3/llvm-mirror.git synced 2024-11-23 19:23:23 +01:00
llvm-mirror/utils/lit/tests
Dan Liew a50a440b7c [lit] Try to remove the flakeyness of shtest-timeout.py and googletest-timeout.py.
The tests previously relied on the `short.py` and `FirstTest.subTestA`
script being executed on a machine within a short time window (1 or 2
seconds). While this "seems to work" it can fail on resource constrained
machines. We could bump the timeout a little bit (bumping it too
much would mean the test would take a long time to execute) but it wouldn't
really solve the problem of the test being prone to failures.

This patch tries to remove this flakeyness by separating testing into
two separate parts:

1. Testing if a test can hit a timeout.
2. Testing if a test can run to completion in the presence of a
timeout.

This way we can give (1.) a really short timeout (to make the test run
as fast as possible) and (2.) a really long timeout. This means for (2.)
we are no longer trying to rely on the "short" test executing within
some short time window. Instead the window is now 3600 seconds which
should be long enough even for a heavily resource constrained machine to
execute the "short" test.

Thanks to Julian Lettner for suggesting this approach. This superseeds
my original approach in https://reviews.llvm.org/D88807.

This patch also changes the command line override test to run the quick
test rather than the slow one to make the test run faster.

Differential Revision: https://reviews.llvm.org/D89020
2020-10-08 10:46:18 -07:00
..
Inputs [lit] Try to remove the flakeyness of shtest-timeout.py and googletest-timeout.py. 2020-10-08 10:46:18 -07:00
unit
.coveragerc
allow-retries.py
boolean-parsing.py
custom-result-category.py
discovery.py
googletest-discovery-failed.py
googletest-format.py
googletest-timeout.py [lit] Try to remove the flakeyness of shtest-timeout.py and googletest-timeout.py. 2020-10-08 10:46:18 -07:00
googletest-upstream-format.py
lit-opts.py
lit.cfg [AIX] Add system-aix to lit config file 2020-07-06 12:54:12 -04:00
lit.site.cfg.in
max-failures.py
max-time.py
parallelism-groups.py
progress-bar.py
selecting.py
shell-parsing.py
show-result-codes.py [lit] Add --show-xxx command line options 2020-07-08 17:01:05 -07:00
show-used-features.py
shtest-encoding.py
shtest-env.py
shtest-format-argv0.py [AIX] Add system-aix to lit config file 2020-07-06 12:54:12 -04:00
shtest-format.py [lit] Remove ANSI control characters from xunit output 2020-08-06 09:16:52 +01:00
shtest-inject.py
shtest-keyword-parse-errors.py
shtest-not.py
shtest-output-printing.py
shtest-recursive-substitution.py [lit] Don't expand escapes until all substitutions have been applied 2020-07-27 18:09:00 +03:00
shtest-run-at-line.py
shtest-shell.py [lit] Prevent hang when lit sees non-ASCII characters 2020-07-14 18:41:15 +01:00
shtest-timeout.py [lit] Try to remove the flakeyness of shtest-timeout.py and googletest-timeout.py. 2020-10-08 10:46:18 -07:00
test-data-micro.py
test-data.py
test-output-micro.py
test-output.py
unittest-adaptor.py
unparsed-requirements.py
usage.py
xunit-output.py [lit] Don't include tests skipped due to sharding in reports 2020-07-26 11:39:22 +01:00