RED HAT SOFTWARE COLLECTIONS RED HAT DEVELOPER TOOLSET Fresh Tools for Developers

Transcription

1 RED HAT SOFTWARE COLLECTIONS RED HAT DEVELOPER TOOLSET Fresh Tools for Developers Dr. Matt Newsome Senior Engineering Manager, Tools v2.3

2 %

3

4 RED HAT SOFTWARE COLLECTIONS RED HAT DEVELOPER TOOLSET YOUR QUESTIONS

5 RED HAT SOFTWARE COLLECTIONS

6 Red Hat Software Collections Delivers the latest stable versions of dynamic languages, web servers and open source databases KEY BENEFITS Choose the runtime versions best suited for your projects Preserve application stability with side-by-side versioning Red Hat Support for 2 or 3 years 6 More up-to-date versions of languages and databases than offered with Red Hat Enterprise Linux

7 Red Hat Developer Toolset Delivers the latest stable versions of GCC for C, C++ and Fortran development as well as debugging and developer performance monitoring tools KEY BENEFITS 7 Choose the Toolchain versions best suited for your projects Preserve application stability with side-by-side versioning Red Hat Developer Support for 2 years.

8 RED HAT ENTERPRISE LINUX TOOLS

9 Toolchain Support RHEL 5 10 YEARS OF SUPPORT RHEL 6 RHEL 7 Fedora VERY HIGH STABILITY LIMITED NEW FEATURES 9

10 Building with RHEL tools (1) Application Sources BUILD Branched Sources BUILD gcc x gcc y DEPLOY DEPLOY RHEL 6 RHEL 7

11 Building with RHEL tools (2) Application Sources x.1 BUILD Sources x.2 gcc x.2 Sources y.2 Sources y.3 BUILD gcc y.1 gcc y.2 gcc y.3 RHEL 6.y RHEL 6.n+1 gcc x.3 Sources x.3 Application Sources y.1 gcc x.1 DEPLOY RHEL 6.n+2 DEPLOY RHEL 7.y RHEL 7.n+1 RHEL 7.n+2

12 Ideal Scenario RHEL 6 Sources Build Latest Tools Test & Deploy RHEL 7

13 RED HAT DEVELOPER TOOLSET

14 What is Red Hat Developer Toolset (DTS)? The latest stable tools for [typically C/C++] developers (Compiler, IDE, performance and other developer tools) An extra set - does not replace your existing RHEL tools DTS 2.1 tools run on RHEL 5 & 6 (DTS 3+: 6 & 7) RHEL 5 RHEL 6 RHEL 7 Applications built with DTS run on the same and following major release of RHEL(*), e.g....build with DTS 2.1 on RHEL 5, run on RHEL 5 & 6...build with DTS-2.1 on RHEL 6, run on RHEL 6 & 7 Available with supported Red Hat Enterprise Linux Server and Workstation subscriptions v2.1 GA and v3.0 Beta available today

15 Developer Toolset (DTS) EL RHEL DTS 2.x: RHEL 5 & 6 DTS 3ß: RHEL 6 & 7 x86-64 C, C++ & Fortran SOFTWARE COLLECTIONS

16 Red Hat Software Collections (RHSCL) EL RHEL RHEL 6 & 7 x86-64 Dynamic Languages ++ SOFTWARE COLLECTIONS

17 SOFTWARE COLLECTIONS Structure for delivering software outside OS /opt (per Filesystem Hierarchy Standard) Different filesystem root per application version Activated via script Allows multiple versions installed in parallel Independent lifecycle from RHEL

18 Developer Toolset is a Software Collection / usr gcc bin lib RHEL x.y System Compiler etc. libc.so Developer Toolset Compiler etc. opt rh dts-2.x root usr dts-3.x Separate tools, not default root enable Lifecycle independent from RHEL gcc etc. enable Special Invocation bin... Internal script invoked via scl utility

19 WHAT'S INCLUDED?

20 What s in Red Hat Software Collections (RHSCL) v1.1? LANGUAGES Ruby Rails Ruby Rails 4.0 node.js 0.10 (Tech Preview) Python 2.7 Python 3.3 PHP 5.4 PHP 5.5 PERL 5.16 DATABASES MySQL 5.5 MariaDB 5.5 PostgreSQL 9.2 MongoDB WEB SERVERS Apache httpd 2.4 Nginx JAVA VM MONITORING Thermostat 1.1 Support for RHEL6 and RHEL7 x86_64 only

21 What s in Red Hat Software Collections (RHSCL) v1.2 Beta? LANGUAGES Ruby Rails Ruby Rails 4.0 node.js 0.10 (Tech Preview) Python 2.7 Python 3.3 PHP 5.4 PHP 5.5 PERL 5.16 JAVA VM MONITORING DATABASES MySQL 5.5 MariaDB 5.5 PostgreSQL 9.2 MongoDB WEB SERVERS Apache httpd 2.4 Nginx 1.6 NEW COLLECTIONS Thermostat 1.2 Maven Developer Assistant v0.9.1

22 What s in Developer Toolset v2.1? CORE TOOLS GCC 4.8 ECLIPSE IDE GDB BINUTILS KEPLER (RHEL 6 ONLY) DEBUG & PERFORMANCE TOOLS SYSTEMTAP 2.1 OPROFILE VALGRIND DYNINST 8.0 STRACE 4.7 DWZ ELFUTILS VERSION CONTROL MEMSTOMP GIT SOFTWARE COLLECTIONS RUNTIME

23 What s in Developer Toolset v2.1? CORE TOOLS GCC 4.8 ECLIPSE IDE GDB BINUTILS SOFTWARE COLLECTIONS RUNTIME KEPLER (RHEL 6 ONLY) DEBUG & PERFORMANCE TOOLS SYSTEMTAP 2.1 OPROFILE VALGRIND DYNINST 8.0 STRACE 4.7 DWZ ELFUTILS VERSION CONTROL MEMSTOMP KEY: UPDATED IN 2.1 GIT NEW IN 2.1

24 Updated Compiler: GCC 4.8 (DTS 2.1) C++11 LRA Performance HTM Leading C++11 language support Guaranteed atomic memory accesses Brand new Local Register Allocator Contributed by Red Hat Compile extremely large functions faster and using less memory Simpler concurrency Atomic execution of source instruction groups

25 Eclipse IDE v4.3.1 ( Kepler ) [RHEL6 only]

26 What s in Developer Toolset v3.0 Beta? CORE TOOLS GCC 4.9 ECLIPSE IDE GDB 7.8 BINUTILS LUNA DEBUG & PERFORMANCE TOOLS SYSTEMTAP 2.5 OPROFILE VALGRIND DYNINST STRACE 4.8 MEMSTOMP DWZ ELFUTILS LTRACE SOFTWARE COLLECTIONS RUNTIME

27 What s in Developer Toolset v3.0 Beta? CORE TOOLS GCC 4.9 ECLIPSE IDE GDB 7.8 BINUTILS 2.24 SOFTWARE COLLECTIONS RUNTIME LUNA DEBUG & PERFORMANCE TOOLS SYSTEMTAP 2.5 OPROFILE VALGRIND DYNINST STRACE 4.8 MEMSTOMP DWZ ELFUTILS LTRACE GIT NOW IN ITS OWN COLLECTION KEY: NEW IN 3.0ß UPDATED IN 3.0ß REMOVED FROM 3.0ß

28 Updated Compiler: GCC 4.9 (DTS-3.0 Beta) ISO C/C++ Stds OpenMP4 / Cilk+ IPA / LTO CPU C++11 library improved, experimental C++14 support Generic lambdas, var-length arrays & digit separators C11: Atomics, generic selections, thread-local storage C and C++ support for OpenMP 4.0 C/C++ language extensions for parallel programming Interprocedural analysis (IPA) improvements Link-Time Optimization (LTO) faster, smaller Intel AVX-512 target architecture support added Advanced Vector Extensions supported in binutils

29 Eclipse IDE v4.4.0 ( Luna ) [RHEL 6 and RHEL 7]

30 Developer Toolset Life Cycle ANNUAL RELEASE DRIVEN BY GCC SPRING SUMMER TOOLSET

31 Developer Toolset Life Cycle v2.0 MID-YEAR v2.1 2.x CRITICAL FIXES AND SECURITY UPDATES 2.x END OF SUPPORT TOOLSET v2.x FIRST YEAR SECOND YEAR Annual major Async updates MID-YEAR Mid-year minor v3.0 v3.1 3.x CRITICAL FIXES & SECURITY UPDATES 3.x END OF SUPPORT TOOLSET v3.x

32 PRACTICALITIES

33 Usage EITHER Subscription # rhn-channel --add --channel=rhel-x86_64-workstation-rhscl-6 # subscription-manager repos --enable rhel-server-rhscl-6-rpms { } Installation # yum install devtoolset-3 Usage EITHER { scl enable devtoolset-3 'gcc...' Click the Developer Toolset Eclipse 3.x Eclipse icon Advanced scl enable devtoolset-3 'bash...' }

34 DEMONSTRATION

35 MEMSTOMP

36 memcpy() calls with overlapping arguments #include <string.h> main() { char src[] = "text-to-copy"; char *dest = src + 2; // call memcpy() with overlapping args memcpy((void*)dest,(void*)src,3); return 0; } [mattn@rhel]$ gcc memcpy_bad.c -o memcpy_bad [mattn@rhel]$./memcpy_bad Segmentation fault (core dumped)

37 memstomp to the rescue! memstomp./memcpy_bad memstomp: successfully initialized for process memcpy_bad (pid 28195). memcpy(dest=0x7fff103cc1c2, src=0x7fff103cc1c0, bytes=3) overlap for memcpy_bad(28195) /.../libmemstomp.so(+0x10a7) [0x7fdb4760a0a7]./memcpy_bad(main+0x45) [0x400795] /lib64/libc.so.6( libc_start_main+0xfd) [0x357fe1ed1d]./memcpy_bad() [0x400669] Indicates overlapping arguments to memcpy()...but also indicates where that call occurs

38 memcpy() calls with overlapping arguments fixed #include <string.h> main() { char src[] = "text-to-copy"; char *dest = src + 5; // no longer overlaps memcpy((void*)dest,(void*)src,3); return 0; } [mattn@rhel]$ gcc memcpy_fixed.c -o memcpy_fixed [mattn@rhel]$./memcpy_fixed [mattn@rhel]$ memstomp./memcpy_fixed memstomp: successfully initialized for process memcpy_fixed (pid 31322).

39 Fixing memcpy() calls The best way: fix memcpy() calls Alternative: replace memcpy() with memmove()

40 UNDER THE HOOD

41 Linkage RHEL glibc libgomp libstdc++ libgcc APPLICATION Dynamic Linkage Newer Symbols Static Linkage BUILD GCC 4.8 GCC 4.9 TOOLSET

42 Regular Linkage with RHEL Toolchain Traditional RHEL Application symbol symbol symbol symbol dynamic linkage libstdc++ (C++ Library) V2 glibc (C Library) libgcc (conversions, etc.) libgomp (OpenMP) Bugs in glibc can be fixed via errata updates to base Red Hat Enterprise Linux

43 Static Linkage of Newer Symbols Archive of newer libstdc++ symbols (.a) static linkage Application Built with Developer Toolset symbol symbol symbol symbol.o newer symbol.o newer symbol dynamic linkage v2 libstdc++ (C++ Library) v2 glibc (C Library) libgcc (conversions, etc.) Some DTS symbols are statically linked RHEL errata updates won't change your binaries libgomp (OpenMP)

44 Security Implications Archive of newer libstdc++ symbols (.a) REBUILD Application Built with Developer Toolset symbol symbol symbol symbol.o newer symbol.o newer symbol Statically linked symbols still contain bug Applications must be rebuilt to fix this Low Risk Alerts via Security Advisory

45 COMMON QUESTIONS

46 Common Questions (1) How do I make Developer Toolset gcc/gdb the default? scl enable devtoolset-3 'bash...' How do I use Developer Toolset gcc to...x? scl enable devtoolset-3 'X'

47 Common Questions (2) Which RHEL versions can I run toolset on? Current minor release of RHEL and supported RHEL EUS releases Today (for DTS-2.1) that's RHEL 5.9 EUS, 5.11, 6.4 EUS, 6.5 Which RHEL versions can I run toolset-built apps on? Current minor, and supported RHEL EUS releases of the same and next major release of RHEL e.g. build on RHEL 6.4 EUS, deploy to 6.4 EUS, 6.5, 7.0 See

48 Common Questions (3) Gotchas and issues? Release notes spell these out Main ones to be aware of C++11/14 & TM are experimental only [use with caution or use C++98] Some base RHEL errata are required for all features Forwards only (don't build on RHEL6 and run on RHEL5) Forwards only (don't build on rhel-6.5 and run on rhel-6.4) Intended for userland development, not kernel rebuilding

49 Common Questions (4) How can I download Red Hat Developer Toolset? Good question...

50 ACCESSING DEVELOPER TOOLSET

51 Access and Installation 1. Access a subscription that includes Red Hat Software Collections

52 How does one access Red Hat Software Collections? Red Hat Developer Toolset (March 2014) STANDARD PREMIUM RED HAT ENTERPRISE LINUX DEVELOPER SUBSCRIPTIONS RED HAT ENTERPRISE LINUX DEVELOPER WORKSTATION RED HAT ENTERPRISE LINUX WORKSTATION RED HAT ENTERPRISE LINUX SERVER RED HAT ENTERPRISE LINUX ACADEMIC SITE SUBSCRIPTIONS Available Only Self Support RED HAT ENTERPRISE LINUX DEVELOPER SUITE Available Only Self Support

53 Access and Installation 1. Access a subscription that includes Red Hat Software Collections 2. If using Satellite, generate a new certificate 3. Register your RHEL system 4. Attach a subscription 5. Add the channel [refer to release notes: red.ht/devtoolset] 6. yum install devtoolset 3

54 Links Developer Program Developer Toolset Documentation This talk/video:

55 Contacts General questions, thoughts, etc. Red Hat Developer Toolset / Software Collections Product Manager Brian Gollaher (bgollahe@redhat.com) Engineering Leads DTS: Martha Benitez (mbenitez@redhat.com) RHSCL: Joe Orton (jorton@redhat.com)

56 YOUR QUESTIONS

57 THANK-YOU

58 BACKUP SLIDES

59 New in 1.2 Beta: Git Git is an open source distributed version control system designed to handle everything from small to very large projects with speed and efficiency KEY FEATURES & BENEFITS Git includes features such as cheap local branching, convenient staging areas and multiple workflows that are not available in other version control systems. Git stands out due to its branching model. Git allows and encourages developers to have multiple local branches that can be entirely independent of each other. The creation, merging, and deletion of those lines of development takes only seconds, much faster than other Source Code Management systems. RHEL 6.5 contains Git

60 New in 1.2 Beta: Developer Assistant DevAssistant was created to assist developers with setting up their development environment, publishing their code, and doing many of the chores that keep developers from the important stuff - writing software. KEY FEATURES & BENEFITS 60 DevAssistant is a project to help developers do more coding and less setting up. DevAssistant supports many popular language choices, including C, C++, Java, and Python with its modular architecture. DevAssistant comes with two interfaces: Graphical and command line. The goal of both is the quickest set up of a development environment as possible. It only takes a couple of clicks to get started with the GUI, or one console command, depending on your preferences. The program is designed with both beginning and seasoned developers in mind.

61 New in 1.2 Beta: Maven 3 Maven is a build automation tool used primarily for Java projects. KEY FEATURES & BENEFITS 61 Maven is a software project management and comprehension tool. Based on the concept of a project object model (POM), Maven can manage a project's build, reporting and documentation from a central piece of information. Maven addresses two aspects of building software, it describes how software is built and it describes the software dependencies.

62 Updated in 1.2 Beta: Thermostat Thermostat is an instrumentation tool for a Hotspot JVM with support for monitoring multiple JVM instances on multiple hosts. KEY FEATURES AND BENEFITS 62 Both high level (uptime, cpu and memory usage) and low level (including hotspot's perf data) information is available using Thermostat. Thermostat uses the MongoDB database, also available in Red Hat Software Collections

63 Updated in 1.2 Beta: Nginx Web Server Nginx is an open source high performance http server and reverse proxy known for high performance and low resource consumption. KEY BENEFITS 63 Nginx doesn't rely on threads to handle requests. Instead it uses a much more scalable event-driven (asynchronous) architecture. This architecture uses small, but more importantly, predictable amounts of memory under load. Users will benefit from Nginx's high-performance and small memory footprint. Nginx scales in all directions: from the smallest VPS all the way up to clusters of servers.

64 PHP 5.5 PHP is a widely-used, easy-to-learn scripting language that can be embedded into HTML to quickly create dynamically generated web pages. New Features in PHP 5.5: Support for generators via the yield keyword A a new password hashing API foreach now supports list() Support for non-scalar keys New OPcache extension empty() support for arbitrary expressions Improvements to the GD extension 64

65 PHP 5.4 PHP is a widely-used, easy-to-learn scripting language that can be embedded into HTML to quickly create dynamically generated web pages. KEY FEATURES & BENEFITS Since 5.3, PHP has added: 65 New language syntax Improved performance and reduced memory consumption A built-in web server in CLI mode to simplify development workflows and testing

66 Ruby 2.0 and Rails 4.0 Ruby is a dynamic general purpose object oriented open source programming language with a focus on simplicity and productivity and an elegant syntax that is natural to read and easy to write. KEY BENEFITS 66 Ruby 2.0 includes substantial performance and reliability improvements. In addition, 2.0 has a number of new features and improved debugging capabilities while maintaining source level backward compatibility with Ruby Rails 4.0 is now a separate collection 4.0 also adds live streaming for persistent connections and Rails 4.0 is now safe for threaded servers out of the box. In addition, 4.0 includes hundreds of new features and fixes.

67 Ruby with Rails Ruby is a dynamic general purpose object oriented open source programming language with a focus on simplicity and productivity and an elegant syntax that is natural to read and easy to write. KEY FEATURES & BENEFITS 67 Delivers substantial performance improvements over Ruby resulting in faster load times, as well as improved unicode support, and improved threading Adds Rails, which is not currently shipping with Red Hat Enterprise Linux, and a large collection of ruby gems. New: The mod_passenger application server for Apache is added to the Ruby collection in RHSCL 1.1.

68 MongoDB MongoDB is a document database that provides high performance, high availability, and easy scalability. KEY BENEFITS 68 Documents have dynamic schema meaning that documents in the same collection do not need to have the same set of fields or structure, and common fields in a collection s documents may hold different types of data. MongoDB 2.4 includes enhanced geospatial support, switch to V8 JavaScript engine, security enhancements, and text search (beta) and hashed index.

69 Apache HTTP Web Server Apache HTTP is a project of the Apache Software Foundation and is the number one http server on the internet. KEY BENEFITS 69 The key focus of Apache 2.4 is improved performance. Included are significant improvements made to Apache httpd's mod_cache mechanism in order to support high traffic environments. Also in 2.4, proxy capabilities have been significantly improved. For existing Apache 2.2.x users, migrating to 2.4 is quite easy as there are minimal configuration changes.

70 Python 2.7 AND Python 3.3 Python is a dynamic, high level programming language designed for code readability and rapid program development. PYTHON 2.7 Ordered dictionary type New unit test features Faster IO Tools and back-ported features from Python 3 to make future migration easier PYTHON 3.3 Easier unicode-handling due to significant changes in how unicode is implemented Changes in how object attributes are stored Reduction in memory use for object-oriented programs No significant change in memory use for other programs, but some speed increases RHEL 6.4 has Python

71 Perl 5.16 Perl is a highly capable, feature-rich programming language suitable for both rapid prototyping and large scale development projects. KEY FEATURES & BENEFITS 71 Gain improvements over Perl 5.10, including: improved unicode support performance enhancements new debugging options improved security and more Also includes a number of utilities, scripts, and database connectors

72 Node.js 0.10 Technology Preview Node.js is a platform built on Chrome's JavaScript runtime for easily building fast, scalable network applications. KEY FEATURES & BENEFITS Node.js uses an event-driven, non-blocking I/O model that makes it lightweight and efficient, designed for dataintensive real-time applications that run across distributed devices. Node.js package manager (npm) for installation of custom development modules. Node.js is new to Red Hat Enterprise Linux subscribers in RHSCL 72

73 PostgreSQL 9.2 PostgreSQL is a powerful, open source object-relational database with a reputation for reliability, data integrity, and correctness. KEY FEATURES & BENEFITS Gain new functionality since PostgreSQL 8.4, including: native JSON support covering indexes 73 significant improvements in replication, high availability and performance

74 MySQL 5.5 MySQL is the world s most popular open source MySQL database. KEY FEATURES & BENEFITS 74 Work with MySQL 5.5, the latest stable version MySQL 5.5 offers performance, scalability, and usability enhancements through the delivery of InnoDB as the default storage engine.

75 MariaDB 5.5 MariaDB is a robust, scalable, and reliable SQL server that is binary compatible with MySQL and can be used as a drop-in replacement. KEY FEATURES & BENEFITS Inclusion of MariaDB 5.5 provides an easy-to-adopt alternative to MySQL for Red Hat Enterprise Linux users. Binary compatibility allows MySQL users to drop-in MariaDB without converting datafiles. MariaDB is new to Red Hat Enterprise Linux subscribers in RHSCL 75

76