1
0
mirror of https://github.com/RPCS3/llvm-mirror.git synced 2024-11-25 04:02:41 +01:00
llvm-mirror/docs
Oliver Stannard 901c588c1f Dead Virtual Function Elimination
Currently, it is hard for the compiler to remove unused C++ virtual
functions, because they are all referenced from vtables, which are referenced
by constructors. This means that if the constructor is called from any live
code, then we keep every virtual function in the final link, even if there
are no call sites which can use it.

This patch allows unused virtual functions to be removed during LTO (and
regular compilation in limited circumstances) by using type metadata to match
virtual function call sites to the vtable slots they might load from. This
information can then be used in the global dead code elimination pass instead
of the references from vtables to virtual functions, to more accurately
determine which functions are reachable.

To make this transformation safe, I have changed clang's code-generation to
always load virtual function pointers using the llvm.type.checked.load
intrinsic, instead of regular load instructions. I originally tried writing
this using clang's existing code-generation, which uses the llvm.type.test
and llvm.assume intrinsics after doing a normal load. However, it is possible
for optimisations to obscure the relationship between the GEP, load and
llvm.type.test, causing GlobalDCE to fail to find virtual function call
sites.

The existing linkage and visibility types don't accurately describe the scope
in which a virtual call could be made which uses a given vtable. This is
wider than the visibility of the type itself, because a virtual function call
could be made using a more-visible base class. I've added a new
!vcall_visibility metadata type to represent this, described in
TypeMetadata.rst. The internalization pass and libLTO have been updated to
change this metadata when linking is performed.

This doesn't currently work with ThinLTO, because it needs to see every call
to llvm.type.checked.load in the linkage unit. It might be possible to
extend this optimisation to be able to use the ThinLTO summary, as was done
for devirtualization, but until then that combination is rejected in the
clang driver.

To test this, I've written a fuzzer which generates random C++ programs with
complex class inheritance graphs, and virtual functions called through object
and function pointers of different types. The programs are spread across
multiple translation units and DSOs to test the different visibility
restrictions.

I've also tried doing bootstrap builds of LLVM to test this. This isn't
ideal, because only classes in anonymous namespaces can be optimised with
-fvisibility=default, and some parts of LLVM (plugins and bugpoint) do not
work correctly with -fvisibility=hidden. However, there are only 12 test
failures when building with -fvisibility=hidden (and an unmodified compiler),
and this change does not cause any new failures for either value of
-fvisibility.

On the 7 C++ sub-benchmarks of SPEC2006, this gives a geomean code-size
reduction of ~6%, over a baseline compiled with "-O2 -flto
-fvisibility=hidden -fwhole-program-vtables". The best cases are reductions
of ~14% in 450.soplex and 483.xalancbmk, and there are no code size
increases.

I've also run this on a set of 8 mbed-os examples compiled for Armv7M, which
show a geomean size reduction of ~3%, again with no size increases.

I had hoped that this would have no effect on performance, which would allow
it to awlays be enabled (when using -fwhole-program-vtables). However, the
changes in clang to use the llvm.type.checked.load intrinsic are causing ~1%
performance regression in the C++ parts of SPEC2006. It should be possible to
recover some of this perf loss by teaching optimisations about the
llvm.type.checked.load intrinsic, which would make it worth turning this on
by default (though it's still dependent on -fwhole-program-vtables).

Differential revision: https://reviews.llvm.org/D63932

llvm-svn: 374539
2019-10-11 11:59:55 +00:00
..
_ocamldoc
_static
_templates [Docs] Adds Documentation links to sidebar 2019-10-09 20:26:13 +00:00
_themes/llvm-theme
AMDGPU [AMDGPU][MC][DOC] Updated AMD GPU assembler description. 2019-09-25 12:38:35 +00:00
CommandGuide [FileCheck] Implement --ignore-case option. 2019-10-11 11:59:14 +00:00
DependenceGraphs Data Dependence Graph Basics 2019-09-18 17:43:45 +00:00
Frontend [docs] Remove training whitespaces. NFC 2019-09-20 15:02:32 +00:00
HistoricalNotes
PDB Fix a few spellos in docs. 2019-09-13 14:58:24 +00:00
Proposals Fix the spelling of my name. 2019-10-07 22:55:42 +00:00
TableGen [docs] Fix TableGen/LangRef typos 2019-06-13 18:42:30 +00:00
tutorial Fix a few spellos in docs. 2019-09-13 14:58:24 +00:00
AddingConstrainedIntrinsics.rst [FPEnv] A missing crucial step was undocumented. 2019-06-25 16:09:39 +00:00
AdvancedBuilds.rst
AliasAnalysis.rst
AMDGPUInstructionNotation.rst
AMDGPUInstructionSyntax.rst [AMDGPU][MC][DOC] Updated AMD GPU assembler syntax description. 2019-07-08 16:50:11 +00:00
AMDGPUModifierSyntax.rst [AMDGPU][MC][DOC] Updated AMD GPU assembler description. 2019-09-25 12:38:35 +00:00
AMDGPUOperandSyntax.rst [AMDGPU][MC][DOC] Updated AMD GPU assembler description. 2019-09-25 12:38:35 +00:00
AMDGPUUsage.rst [AMDGPU] gfx908 target 2019-07-09 18:10:06 +00:00
ARM-BE-bitcastfail.png
ARM-BE-bitcastsuccess.png
ARM-BE-ld1.png
ARM-BE-ldr.png
Atomics.rst [NFC] Test commit, deleting some whitespace 2019-09-20 09:43:31 +00:00
Benchmarking.rst
BigEndianNEON.rst
BitCodeFormat.rst [X86] Add new calling convention that guarantees tail call optimization 2019-10-07 22:28:58 +00:00
BlockFrequencyTerminology.rst
BranchWeightMetadata.rst
BugLifeCycle.rst
Bugpoint.rst Reland "[docs][Bugpoint]Add notes about multiple crashes" 2019-09-17 21:09:41 +00:00
BugpointRedesign.md [Bugpoint redesign] Fix nonlocal URI link in doc 2019-08-09 21:48:47 +00:00
BuildingADistribution.rst Fix a few spellos in docs. 2019-09-13 14:58:24 +00:00
CFIVerify.rst
CMake.rst doc update: explain that Z3 is only for clang SA - thanks to LebedevRI for the suggestion 2019-09-05 19:50:56 +00:00
CMakeLists.txt
CMakePrimer.rst
CodeGenerator.rst [X86] Add new calling convention that guarantees tail call optimization 2019-10-07 22:28:58 +00:00
CodeOfConduct.rst
CodingStandards.rst Move to C++14 2019-08-14 17:39:07 +00:00
CommandLine.rst [NFC] fix trivial typos in documents 2019-06-25 07:24:27 +00:00
CompileCudaWithLLVM.rst Adjust documentation for git migration. 2019-01-29 16:37:27 +00:00
CompilerWriterInfo.rst [PowerPC][docs] Update IBM official docs in Compiler Writers Info page 2019-10-10 19:25:30 +00:00
conf.py [Docs] Add a custom sidebar to doc pages 2019-09-20 22:16:39 +00:00
Contributing.rst [Docs] Fixes broken sphinx build - undefined label 2019-10-08 22:45:20 +00:00
Coroutines.rst Extend coroutines to support a "returned continuation" lowering. 2019-08-14 03:53:17 +00:00
CoverageMappingFormat.rst
DebuggingJITedCode.rst [Docs] Modernize references to macOS 2019-05-30 16:46:22 +00:00
DeveloperPolicy.rst docs/DeveloperPolicy: Add instructions for requesting GitHub commit access 2019-10-10 23:36:06 +00:00
Docker.rst [build] Rename clang-headers to clang-resource-headers 2019-03-04 21:19:53 +00:00
doxygen-mainpage.dox
doxygen.cfg.in [NFC] Remove LLVM_ALIGNAS 2019-07-31 03:22:08 +00:00
ExceptionHandling.rst
ExtendedIntegerResults.txt
ExtendingLLVM.rst Note ImmArg in documentation for adding intrinsics 2019-03-14 13:46:17 +00:00
Extensions.rst Add IR support, ELF section and user documentation for partitioning feature. 2019-05-29 03:29:01 +00:00
FAQ.rst Update the FAQ: remove stuff related to the previous license + 2019-10-03 09:43:54 +00:00
FaultMaps.rst
FuzzingLLVM.rst
GarbageCollection.rst
gcc-loops.png
GetElementPtr.rst [DOC] Fix load instructions' syntax, function definition. 2019-06-12 11:24:22 +00:00
GettingInvolved.rst [Docs] Moves Reference docs to new page 2019-09-25 00:49:02 +00:00
GettingStarted.rst [docs] Fix sphinx doc generation errors 2019-08-14 22:18:01 +00:00
GettingStartedTutorials.rst [Docs] Adds Documentation links to sidebar 2019-10-09 20:26:13 +00:00
GettingStartedVS.rst Retire VS2015 Support 2019-07-09 10:10:48 +00:00
GlobalISel.rst [docs] Fix sphinx doc generation errors 2019-08-14 22:18:01 +00:00
GoldPlugin.rst
GwpAsan.rst [docs] Add GwpAsan to toctree. 2019-08-21 18:31:03 +00:00
HowToAddABuilder.rst
HowToBuildOnARM.rst
HowToBuildWithPGO.rst
HowToCrossCompileBuiltinsOnArm.rst
HowToCrossCompileLLVM.rst
HowToReleaseLLVM.rst Remove some autoconf references from docs and comments 2019-07-03 09:57:59 +00:00
HowToSetUpLLVMStyleRTTI.rst
HowToSubmitABug.rst [docs] Prevent O0 optnone for opt input 2019-01-29 22:17:51 +00:00
HowToUseAttributes.rst
HowToUseInstrMappings.rst
InAlloca.rst
index.rst [Docs] Removes Subsystem Documentation page 2019-10-06 22:49:22 +00:00
LangRef.rst Dead Virtual Function Elimination 2019-10-11 11:59:55 +00:00
Lexicon.rst
LibFuzzer.rst [docs] Update structure-aware-fuzzing link. 2019-09-20 19:39:50 +00:00
LinkTimeOptimization.rst
linpack-pc.png
llvm-objdump.1
LLVMBuild.rst
LLVMBuild.txt
LoopTerminology.rst [docs] Fix sphinx doc generation errors 2019-08-14 22:18:01 +00:00
make.bat
Makefile.sphinx
MarkdownQuickstartTemplate.md
MarkedUpDisassembly.rst
MCJIT-creation.png
MCJIT-dyld-load.png
MCJIT-engine-builder.png
MCJIT-load-object.png
MCJIT-load.png
MCJIT-resolve-relocations.png
MCJITDesignAndImplementation.rst
MeetupGuidelines.rst Add guidelines/recommendations for organizers of LLVM Socials 2019-05-14 07:20:58 +00:00
MemorySSA.rst
MergeFunctions.rst
MIRLangRef.rst [LLVM][Alignment] Make functions using log of alignment explicit 2019-09-05 10:00:22 +00:00
NVPTXUsage.rst
OptBisect.rst
ORCv2.rst Fix a few spellos in docs. 2019-09-13 14:58:24 +00:00
Packaging.rst
Passes.rst
Phabricator.rst
ProgrammersManual.rst Fix typo in programmer's manual cantFile -> cantFail 2019-07-18 05:24:22 +00:00
Projects.rst
re_format.7
README.txt [NFC] Test commit, whitespace change 2019-06-06 22:07:14 +00:00
Reference.rst [Docs] Adds section for Additional Topics on Reference page 2019-10-09 21:09:09 +00:00
ReleaseNotes.rst [UBSan][clang][compiler-rt] Applying non-zero offset to nullptr is undefined behaviour 2019-10-10 09:25:02 +00:00
ReleaseProcess.rst [ReleaseProcess] Document requirement to set MACOSX_DEPLOYMENT_TARGET 2019-10-01 17:10:45 +00:00
Remarks.rst Reland: [Remarks] Add an LLVM-bitstream-based remark serializer 2019-07-31 00:13:51 +00:00
ReportingGuide.rst
ScudoHardenedAllocator.rst
SegmentedStacks.rst
SourceLevelDebugging.rst Update link to the DWARF spec. 2019-09-11 19:57:29 +00:00
speculative_load_hardening_microbenchmarks.png
SpeculativeLoadHardening.md Fix a few spellos in docs. 2019-09-13 14:58:24 +00:00
SphinxQuickstartTemplate.rst
StackMaps.rst
StackSafetyAnalysis.rst
Statepoints.rst
SupportLibrary.rst
SystemLibrary.rst
TableGenFundamentals.rst
TestingGuide.rst [Docs] Test commit 2019-08-18 19:07:10 +00:00
TestSuiteGuide.md Adjust documentation for git migration. 2019-01-29 16:37:27 +00:00
TestSuiteMakefileGuide.rst Adjust documentation for git migration. 2019-01-29 16:37:27 +00:00
TransformMetadata.rst
TypeMetadata.rst Dead Virtual Function Elimination 2019-10-11 11:59:55 +00:00
UserGuides.rst [Docs] Adds section for Additional Topics on Reference page 2019-10-09 21:09:09 +00:00
Vectorizers.rst
WritingAnLLVMBackend.rst
WritingAnLLVMPass.rst Attempt to unbreak sphinx build bot by inserting a link. 2019-07-31 22:14:26 +00:00
XRay.rst
XRayExample.rst [XRay][docs] Fix option name 2019-03-12 13:44:42 +00:00
XRayFDRFormat.rst
yaml2obj.rst
YamlIO.rst

LLVM Documentation
==================

LLVM's documentation is written in reStructuredText, a lightweight
plaintext markup language (file extension `.rst`). While the
reStructuredText documentation should be quite readable in source form, it
is mostly meant to be processed by the Sphinx documentation generation
system to create HTML pages which are hosted on <http://llvm.org/docs/> and
updated after every commit. Manpage output is also supported, see below.

If you instead would like to generate and view the HTML locally, install
Sphinx <http://sphinx-doc.org/> and then do:

    cd <build-dir>
    cmake -DLLVM_ENABLE_SPHINX=true -DSPHINX_OUTPUT_HTML=true <src-dir>
    make -j3 docs-llvm-html
    $BROWSER <build-dir>/docs//html/index.html

The mapping between reStructuredText files and generated documentation is
`docs/Foo.rst` <-> `<build-dir>/docs//html/Foo.html` <-> `http://llvm.org/docs/Foo.html`.

If you are interested in writing new documentation, you will want to read
`SphinxQuickstartTemplate.rst` which will get you writing documentation
very fast and includes examples of the most important reStructuredText
markup syntax.

Manpage Output
===============

Building the manpages is similar to building the HTML documentation. The
primary difference is to use the `man` makefile target, instead of the
default (which is `html`). Sphinx then produces the man pages in the
directory `<build-dir>/docs/man/`.

    cd <build-dir>
    cmake -DLLVM_ENABLE_SPHINX=true -DSPHINX_OUTPUT_MAN=true <src-dir>
    make -j3 docs-llvm-man
    man -l >build-dir>/docs/man/FileCheck.1

The correspondence between .rst files and man pages is
`docs/CommandGuide/Foo.rst` <-> `<build-dir>/docs//man/Foo.1`.
These .rst files are also included during HTML generation so they are also
viewable online (as noted above) at e.g.
`http://llvm.org/docs/CommandGuide/Foo.html`.

Checking links
==============

The reachability of external links in the documentation can be checked by
running:

    cd docs/
    make -f Makefile.sphinx linkcheck

Doxygen page Output
==============

Install doxygen <http://www.stack.nl/~dimitri/doxygen/download.html> and dot2tex <https://dot2tex.readthedocs.io/en/latest>.

    cd <build-dir>
    cmake -DLLVM_ENABLE_DOXYGEN=On <llvm-top-src-dir>
    make doxygen-llvm # for LLVM docs
    make doxygen-clang # for clang docs

It will generate html in

    <build-dir>/docs/doxygen/html # for LLVM docs
    <build-dir>/tools/clang/docs/doxygen/html # for clang docs