mirror of
https://github.com/RPCS3/llvm-mirror.git
synced 2024-11-26 04:32:44 +01:00
643090aa23
Lit as it exists today has three hacks that allow users to run tests earlier: 1) An entire test suite can set the `is_early` boolean. 2) A very recently introduced "early_tests" feature. 3) The `--incremental` flag forces failing tests to run first. All of these approaches have problems. 1) The `is_early` feature was until very recently undocumented. Nevertheless it still lacks testing and is a imprecise way of optimizing test starting times. 2) The `early_tests` feature requires manual updates and doesn't scale. 3) `--incremental` is undocumented, untested, and it requires modifying the *source* file system by "touching" the file. This "touch" based approach is arguably a hack because it confuses editors (because it looks like the test was modified behind the back of the editor) and "touching" the test source file doesn't work if the test suite is read only from the perspective of `lit` (via advanced filesystem/build tricks). This patch attempts to simplify and address all of the above problems. This patch formalizes, documents, tests, and defaults lit to recording the execution time of tests and then reordering all tests during the next execution. By reordering the tests, high core count machines run faster, sometimes significantly so. This patch also always runs failing tests first, which is a positive user experience win for those that didn't know about the hidden `--incremental` flag. Finally, if users want, they can _optionally_ commit the test timing data (or a subset thereof) back to the repository to accelerate bots and first-time runs of the test suite. Reviewed By: jhenderson, yln Differential Revision: https://reviews.llvm.org/D98179
49 lines
1.7 KiB
Python
49 lines
1.7 KiB
Python
# -*- Python -*-
|
|
|
|
# Configuration file for the 'lit' test runner.
|
|
|
|
import os
|
|
import subprocess
|
|
|
|
import lit.formats
|
|
|
|
# name: The name of this test suite.
|
|
config.name = 'LLVM-Unit'
|
|
|
|
# suffixes: A list of file extensions to treat as test files.
|
|
config.suffixes = []
|
|
|
|
# test_source_root: The root path where tests are located.
|
|
# test_exec_root: The root path where tests should be run.
|
|
config.test_exec_root = os.path.join(config.llvm_obj_root, 'unittests')
|
|
config.test_source_root = config.test_exec_root
|
|
|
|
# testFormat: The test format to use to interpret tests.
|
|
config.test_format = lit.formats.GoogleTest(config.llvm_build_mode, 'Tests')
|
|
|
|
# Propagate the temp directory. Windows requires this because it uses \Windows\
|
|
# if none of these are present.
|
|
if 'TMP' in os.environ:
|
|
config.environment['TMP'] = os.environ['TMP']
|
|
if 'TEMP' in os.environ:
|
|
config.environment['TEMP'] = os.environ['TEMP']
|
|
|
|
# Propagate HOME as it can be used to override incorrect homedir in passwd
|
|
# that causes the tests to fail.
|
|
if 'HOME' in os.environ:
|
|
config.environment['HOME'] = os.environ['HOME']
|
|
|
|
# Propagate path to symbolizer for ASan/MSan.
|
|
for symbolizer in ['ASAN_SYMBOLIZER_PATH', 'MSAN_SYMBOLIZER_PATH']:
|
|
if symbolizer in os.environ:
|
|
config.environment[symbolizer] = os.environ[symbolizer]
|
|
|
|
# Win32 seeks DLLs along %PATH%.
|
|
if sys.platform in ['win32', 'cygwin'] and os.path.isdir(config.shlibdir):
|
|
config.environment['PATH'] = os.path.pathsep.join((
|
|
config.shlibdir, config.environment['PATH']))
|
|
|
|
# Win32 may use %SYSTEMDRIVE% during file system shell operations, so propogate.
|
|
if sys.platform == 'win32' and 'SYSTEMDRIVE' in os.environ:
|
|
config.environment['SYSTEMDRIVE'] = os.environ['SYSTEMDRIVE']
|