llvm-mirror/utils/lit/tests/max-time.py

# UNSUPPORTED: system-windows

# Test overall lit timeout (--max-time).
#
# RUN: %{lit} %{inputs}/max-time --max-time=5 2>&1  |  FileCheck %s

# CHECK: reached timeout, skipping remaining tests
# CHECK: Skipped: 1
# CHECK: Passed : 1
[lit] Temporarily disable failing tests on Windows 2020-04-11 05:03:44 +02:00			`# UNSUPPORTED: system-windows`

[lit] Add SKIPPED test result category Track and print the number of skipped tests. Skipped tests are tests that should have been executed but weren't due to: * user interrupt [Ctrl+C] * --max-time (overall lit timeout) * --max-failures This is part of a larger effort to ensure that all discovered tests are properly accounted for. Add test for overall lit timeout feature (`--max-time` option) to observe skipped tests. Extend test for `--max-failures` option. Reviewed By: jdenny Differential Revision: https://reviews.llvm.org/D77819 2019-03-08 05:48:24 +01:00			`# Test overall lit timeout (--max-time).`
			`#`
[lit] Increase sleep time in timeout test Fixup for cbe42a9d5fa. Increase values for testing the overall lit timeout (--max-time) which wasn't enough for the test to complete on very slow build bots. 2020-04-11 01:22:00 +02:00			`# RUN: %{lit} %{inputs}/max-time --max-time=5 2>&1 \| FileCheck %s`
[lit] Add SKIPPED test result category Track and print the number of skipped tests. Skipped tests are tests that should have been executed but weren't due to: * user interrupt [Ctrl+C] * --max-time (overall lit timeout) * --max-failures This is part of a larger effort to ensure that all discovered tests are properly accounted for. Add test for overall lit timeout feature (`--max-time` option) to observe skipped tests. Extend test for `--max-failures` option. Reviewed By: jdenny Differential Revision: https://reviews.llvm.org/D77819 2019-03-08 05:48:24 +01:00
			`# CHECK: reached timeout, skipping remaining tests`
[lit] Improve naming of test result categories Improve consistency when printing test results: Previously we were using different labels for group names (the header for the list of, e.g., failing tests) and summary count lines. For example, "Failing Tests"/"Unexpected Failures". This commit changes lit to label things consistently. Improve wording of labels: When talking about individual test results, the first word in "Unexpected Failures", "Expected Passes", and "Individual Timeouts" is superfluous. Some labels contain the word "Tests" and some don't. Let's simplify the names. Before: ``` Failing Tests (1): ... Expected Passes : 3 Unexpected Failures: 1 ``` After: ``` Failed Tests (1): ... Passed: 3 Failed: 1 ``` Reviewed By: ldionne Differential Revision: https://reviews.llvm.org/D77708 2020-04-08 07:48:39 +02:00			`# CHECK: Skipped: 1`
			`# CHECK: Passed : 1`