Joel E. Denny eaa132dc46 [lit] Add --ignore-fail ... For some build configurations, `check-all` calls lit multiple times to run multiple lit test suites. Most recently, I've found this to be true when configuring openmp as part of `LLVM_ENABLE_RUNTIMES`, but this is not the first time. If one test suite fails, none of the remaining test suites run, so you cannot determine if your patch has broken them. It can then be frustrating to try to determine which `check-` targets will run the remaining tests without getting stuck on the failing tests. When such cases arise, it is probably best to adjust the cmake configuration for `check-all` to run all test suites as part of one lit invocation. Because that fix will likely not be implemented and land immediately, this patch introduces `--ignore-fail` to serve as a workaround for developers trying to see test results until it does land: ``` $ LIT_OPTS=--ignore-fail ninja check-all ``` One problem with `--ignore-fail` is that it makes it challenging to detect test failures in a script, perhaps in CI. This problem should serve as motivation to actually fix the cmake configuration instead of continuing to use `--ignore-fail` indefinitely. Reviewed By: jhenderson, thopre Differential Revision: https://reviews.llvm.org/D96371		2021-02-24 13:10:27 -05:00
..
Inputs	[lit] Add --ignore-fail	2021-02-24 13:10:27 -05:00
unit	[LIT] fixed up accidentally committed EOF problems.	2020-10-21 13:29:58 +01:00
.coveragerc
allow-retries.py
boolean-parsing.py
custom-result-category.py
discovery.py	Add lit config for dir with standalone tests	2021-02-17 10:38:58 +00:00
early-tests.py	[lit] Add "early_tests" config option	2021-02-17 06:32:04 -05:00
googletest-discovery-failed.py
googletest-format.py
googletest-timeout.py	[lit] Try to remove the flakeyness of shtest-timeout.py and googletest-timeout.py.	2020-10-08 10:46:18 -07:00
googletest-upstream-format.py
ignore-fail.py	[lit] Add --ignore-fail	2021-02-24 13:10:27 -05:00
lit-opts.py
lit.cfg
lit.site.cfg.in
max-failures.py
max-time.py
parallelism-groups.py
progress-bar.py
selecting.py	[lit] Add --xfail and --filter-out (inverse of --filter)	2021-02-20 05:43:29 -05:00
shell-parsing.py	[lit] Fix tests to execute lit with same python as invoked with.	2013-08-14 05:07:09 +00:00
show-result-codes.py
show-used-features.py
shtest-encoding.py
shtest-env.py
shtest-format-argv0.py
shtest-format.py	[lit] Remove ANSI control characters from xunit output	2020-08-06 09:16:52 +01:00
shtest-inject.py
shtest-keyword-parse-errors.py
shtest-not.py
shtest-output-printing.py
shtest-recursive-substitution.py	[lit] Don't expand escapes until all substitutions have been applied	2020-07-27 18:09:00 +03:00
shtest-run-at-line.py
shtest-shell.py
shtest-timeout.py	Fix shtest-timeout test harder	2020-12-08 00:23:33 -08:00
test-data-micro.py
test-data.py
test-output-micro.py
test-output.py
unittest-adaptor.py
unparsed-requirements.py
usage.py
xfail-cl.py	[lit testing] "END." not "END:"	2021-02-20 09:43:36 -05:00
xunit-output.py	[lit] Don't include tests skipped due to sharding in reports	2020-07-26 11:39:22 +01:00