Julian Lettner 95339f1d20 [lit] Better/earlier errors for empty runs ...

Fail early, when we discover no tests at all, or filter out all of them.

There is also `--allow-empty-runs` to disable test to allow workflows
like `LIT_FILTER=abc ninja check-all`.  Apparently `check-all` invokes
lit multiple times if certain projects are enabled, which would produce
unwanted "empty runs". Specify via `LIT_OPTS=--allow-empty-runs`.

There are 3 causes for empty runs:
1) No tests discovered.  This is always an error.  Fix test suite config
   or command line.
2) All tests filtered out.  This is an error by default, but can be
   suppressed via `--alow-empty-runs`.  Should prevent accidentally
   passing empty runs, but allow the workflow above.
3) The number of shards is greater than the number of tests.  Currently,
   this is never an error.  Personally, I think we should consider
   making this an error by default; if this happens, you are doing
   something wrong. I added a warning but did not change the behavior,
   since this warrants more discussion.

Reviewed By: atrick, jdenny

Differential Revision: https://reviews.llvm.org/D70105

2019-11-12 09:11:36 -08:00

..

builtin_commands

[lit] Extend internal diff to support - argument

2019-10-29 15:13:53 -04:00

ExampleTests.ObjDir

…

formats

[lit] Port googletest lit tests to Windows

2017-07-28 01:05:55 +00:00

llvm

Revert "[analyzer] Add test directory for scan-build."

2019-11-05 14:03:36 -08:00

__init__.py

lit: Bump version to 0.10.0

2019-08-08 19:22:23 +00:00

BooleanExpression.py

Reinstate "r292904 - [lit] Allow boolean expressions in REQUIRES and XFAIL

2017-01-25 02:26:03 +00:00

cl_arguments.py

[lit] Better/earlier errors for empty runs

2019-11-12 09:11:36 -08:00

discovery.py

[lit] Remove unnecessary usage of lit.Run

2019-10-16 23:31:32 +00:00

display.py

[lit] Extract Display.print_header function

2019-10-31 11:43:20 -07:00

LitConfig.py

[LitConfig] Silenced notes/warnings on quiet.

2019-10-08 01:31:02 +00:00

LitTestCase.py

[lit] Remove redundancy from names and comments

2019-10-21 21:41:59 +00:00

main.py

[lit] Better/earlier errors for empty runs

2019-11-12 09:11:36 -08:00

ProgressBar.py

[lit] Extract Display.print_header function

2019-10-31 11:43:20 -07:00

run.py

[lit] Better/earlier errors for empty runs

2019-11-12 09:11:36 -08:00

ShCommands.py

Use the current working directory in the glob expansion

2017-03-31 12:46:39 +00:00

ShUtil.py

Teach lit to expand glob expressions.

2017-03-03 18:55:24 +00:00

Test.py

[lit] Add helper for test.result.code.isFailure

2019-10-30 15:09:43 -07:00

TestingConfig.py

[lit] Allow setting parallelism groups to None

2019-02-26 19:03:26 +00:00

TestRunner.py

[lit] Fix not calling internal commands

2019-11-05 14:09:21 -05:00

util.py

[lit] Move sharding logic into separate function

2019-10-25 16:23:52 -07:00

worker.py

[lit] Remove redundancy from names and comments

2019-10-21 21:41:59 +00:00