1
0
mirror of https://github.com/RPCS3/llvm-mirror.git synced 2024-11-22 18:54:02 +01:00
llvm-mirror/utils/lit/tests
Joel E. Denny eaa132dc46 [lit] Add --ignore-fail
For some build configurations, `check-all` calls lit multiple times to
run multiple lit test suites.  Most recently, I've found this to be
true when configuring openmp as part of `LLVM_ENABLE_RUNTIMES`, but
this is not the first time.

If one test suite fails, none of the remaining test suites run, so you
cannot determine if your patch has broken them.  It can then be
frustrating to try to determine which `check-` targets will run the
remaining tests without getting stuck on the failing tests.

When such cases arise, it is probably best to adjust the cmake
configuration for `check-all` to run all test suites as part of one
lit invocation.  Because that fix will likely not be implemented and
land immediately, this patch introduces `--ignore-fail` to serve as a
workaround for developers trying to see test results until it does
land:

```
$ LIT_OPTS=--ignore-fail ninja check-all
```

One problem with `--ignore-fail` is that it makes it challenging to
detect test failures in a script, perhaps in CI.  This problem should
serve as motivation to actually fix the cmake configuration instead of
continuing to use `--ignore-fail` indefinitely.

Reviewed By: jhenderson, thopre

Differential Revision: https://reviews.llvm.org/D96371
2021-02-24 13:10:27 -05:00
..
Inputs [lit] Add --ignore-fail 2021-02-24 13:10:27 -05:00
unit [LIT] fixed up accidentally committed EOF problems. 2020-10-21 13:29:58 +01:00
.coveragerc
allow-retries.py
boolean-parsing.py
custom-result-category.py
discovery.py Add lit config for dir with standalone tests 2021-02-17 10:38:58 +00:00
early-tests.py [lit] Add "early_tests" config option 2021-02-17 06:32:04 -05:00
googletest-discovery-failed.py
googletest-format.py
googletest-timeout.py
googletest-upstream-format.py
ignore-fail.py [lit] Add --ignore-fail 2021-02-24 13:10:27 -05:00
lit-opts.py
lit.cfg
lit.site.cfg.in
max-failures.py
max-time.py
parallelism-groups.py
progress-bar.py
selecting.py [lit] Add --xfail and --filter-out (inverse of --filter) 2021-02-20 05:43:29 -05:00
shell-parsing.py
show-result-codes.py
show-used-features.py
shtest-encoding.py
shtest-env.py
shtest-format-argv0.py
shtest-format.py
shtest-inject.py
shtest-keyword-parse-errors.py
shtest-not.py
shtest-output-printing.py
shtest-recursive-substitution.py
shtest-run-at-line.py
shtest-shell.py
shtest-timeout.py Fix shtest-timeout test harder 2020-12-08 00:23:33 -08:00
test-data-micro.py
test-data.py
test-output-micro.py
test-output.py
unittest-adaptor.py
unparsed-requirements.py
usage.py
xfail-cl.py [lit testing] "END." not "END:" 2021-02-20 09:43:36 -05:00
xunit-output.py