Updating the Compiler?

Transcription

1 Updating the Compiler? Take Advantage of The New Development Toolchain Andreas Jaeger Product Manager

2 Programming Languages C C++ Fortran And Go 2

3 Why new compiler? Faster applications Support for new CPUs New compiler optimizations Improved compiler optimizations Take advantage of new language features Write better code due to improved diagnostics Easier to spot problems due to improved debugging 3

4 Toolchain Module for SUSE Linux Enterprise 12 Yearly release Deliver new Compiler and toolchain GCC ( GNU Compiler Collection) development tools via Toolchain Module GCC runtime libraries, binutils, gdb as updates for SLE Core Versions for 2016 update of Toolchain Module for SUSE Linux Enterprise 12: GCC 6.2 with C, C++, Fortran support Binutils Gdb Package build compiler (GCC 4.8) stays as default New module is supported (latest version of SW, overlap of 6 months) 4

5 Package Hub - Contains community build software for SUSE Linux Enterprise Including: Google GO compiler and runtime Erlang Glasgow Haskell Compiler ghc R project for statistical computing 5

6 Compare with SUSE Linux Enterprise 11 Update of toolchain with each Service Pack Deliver GCC new development tool via SDK Deliver GCC runtime libraries, binutils, gdb as part of SLE core No support for newer GCC 6

7 How to use new tools? Binutils, gdb: No change GCC: Use XXX-6 instead of XXX, for example: gcc-6 g++-6 7

8 Note: GCC versioning scheme Previously (until GCC 4.9): Major release every year: 4.0, 4.1,... First release: Minor releases: 4.8.1, Now: Major release every year: 5, 6, 7 First release: 5.1 Minor release: 5.2, 5.3 8

9 Advantages of new toolchain 9

10 Why new compiler? Compiler optimizations Support for CPUs New language features Diagnostics and debugging 10

11 Diagnostics and debugging Better display of wrong code 11

12 Diagnostics and debugging Fix-it hints 12

13 Diagnostics and debugging Suggestions for wrong field names 13

14 Diagnostics and debugging Check indentation -Wmisleading-indentation (in -Wall) would have avoided CVE : 14

15 Diagnostics and debugging New warnings -fsanitze=thread UndefinedBehaviorSanitizer (-fsanitize=undefined) enhanced: -fsanitize=bounds-strict: Strict checking of array bounds New warning options: -Wshift-negative-value: Left shifting a negative value. -Wshift-overflow: Left shift overflows (default). -Wtautological-compare: Self-comparison always evaluates to true or false (in -Wall). -Wnull-dereference: Compiler detects paths that trigger erroneous or undefined behavior due to dereferencing a null pointer. -Wduplicated-cond: Duplicated conditions in an if-else-if chain. 15

16 Compiler optimizations in GCC 6 Value Range propagation Cave-at! Value Range propagation: This pointer of C++ member function is considered non-null This breaks non-conforming code like Chromium, KDevelop, Qt-5. Use -fno-delete-null-pointer-checks To identify wrong code: -fsanitize=undefined 16

17 Compiler optimizations in GCC 6 Link Time Optimization Robustness fixes C and Fortran compatibility Smaller LTO objects (11 %) Interprocedural Optimization Function cloning more aggressive Improved heuristics Thread improvements: OpenMP 4.5 OpenACC 2.0a 17

18 Support for newer CPUs X86-64: AVX-512 extensions for Skylake AMD family 17h processors (Zen core) Segment register AArch64: LTO support Processor support: ARM Cortex-A35, ARM Cortex-A53, ARM Cortex-A57, Qualcomm QDF24xx, Samsung Exynos M1 Power: Power9 support Vector support z Systems IBM z13 support 18

19 New language features GNU C 11 is default (ISO C 11 plus GNU extensions)[since GCC 5] GNU C++ 14 is default (ISO C++ 14 plus GNU extensions) 19

20 New libstdc++ Libstdc++ contains Dual ABI: New ABI is C++11 conforming Old ABI for compatibility with previous compilers C++11 conforming std::list with O(1) size() function std::string uses small string optimization instead of copy-on-write reference counting SUSE Linux Enterprise Server 12 uses Old ABI by default, since system libraries are compiled using the Old ABI 20

21 Optimization Tips To optimize for current machine: -march=native To optimize for pool of machines: Use -march=x and select lowest common dominator or don't set it at all Optimization flags: -O2 -O3 -Ofast: includes -O3, -ffast-math, unsafe optimizations Speed optimizations: 1) Use FDO 2) Use FDO+LTO 21

22 Feedback Driven Optimization Use information about common paths from run-time to optimize the common case, including value profiling Usage: Build binary for profiling: $ gcc -Ofast program.c -o program -fprofile-generate Execute binary and create profile data Recompile binary using profile: $ gcc -Ofast program.c -o program -fprofile-use=program.gcda Note: Profiling collection not thread-safe 22

23 Link Time Optimization Whole-program optimization instead of single source file optimization Files get compiled into.o: streaming presentation of internal data Optimization happens at link time for the whole program Allows interprocedural analysis across files 23

24 Link Time Optimization: Usage Build binaries using: $ gcc -Ofast -flto -c file1.c $ gcc -Ofast -flto -c file2.c Link using: $ gcc -flto -o program file1.o file2.o 24

25 Vectorized Math Routines Vectorizer now can use glibc s math vector routines for vector sine etc. Note: Needs Glibc from SLE 12 SP2, supported on x86-64 only 25

26 References

27 Outlook GCC 7 Note: GCC 7 will come out in Q and is under development Further fix-its LTO debugging Experimental C++17 support 27

28 Why new toolchain? GDB: Understand new debug information by compiler Binutils: Support for new toolchain Support for new CPUs 28

29 GDB and Binutils 2.26 GDB: Thread signal handling improved, user gets informed about which thread triggers event More explicit syntax for breakpoints ( break -s main.c -li 3 ) Bug fixes Binutils: Support for compressed DWARF debug format, currently gas, ld IBM z13 support Bug fixes 29

30 Distributing Self-Compiled Software Software build with new Toolchain Module will run on updated SLE 12 systems Need updates for runtime libraries installed 30

31 Support Support via the usual channel Our GCC team needs self-contained code to reproduce issues Concentrate on -g/-g0, -O[0123], -ffast-math, -Ofast 31

32 The Go Programming Language 32

33 Go Go is an open source programming language that makes it easy to build simple, reliable, and efficient software. Created 2007 at Google by Robert Griesemer, Rob Pike, and Ken Thompson. Designed for writing servers. Compiled, statically typed, with garbage collection, memory safety, concurrent features. 33

34 Why developers use Go? Docker and docker eco-system uses Go as main language. Faster than shell scripts More powerful than C Shines: Netowork and Webserver Stand-alone command line programs and scripts Not so good for: Desktop or GUI based apps System level programming 34

35 Where does SUSE use Go? Development of Docker Machinery 35

36 Go 1.7 Release Support now for all our architectures AARCH64, PowerPC64, x86-64, and z Systems. (New: z Systems) New compiler back end. 36

37 PackageHub Go packages are available on the PackageHub Compiler package is named go Add PackageHub to your system via YaST Also, available for opensuse in devel:languages:go project 37

38 Installation 38

39 Modules - Overview Module Name Content (examples) Lifecycle Advanced Systems The configuration management tools cfengine, Continuous Management Module puppet, salt and the new "machinery" tool Integration Container Module Docker and container related functionality such as ECS integration Continuous Integration Legacy Module Sendmail, old IMAP stack, old Java etc. 3 years Public Cloud Module Instance initialization code, command line tools for management Continuous Integration Toolchain Module GCC Yearly delivery Web and Scripting PHP, Python 3 years, 18 months Module overlap 39

40 Module Software Install 40

41