Bring order into packaging madness. Marcela Mašláňová Supervisor Software Engineer, Red Hat May 2013

Transcription

1

2 Bring order into packaging madness Marcela Mašláňová Supervisor Software Engineer, Red Hat May 2013

3 Objectives introduce improved packaging system show how to use it show how to create it introduce products using it explain technical details more details on other talks/labs

4 Agenda Packaging Madness Software Collections The scl-utils Products Examples Questions

5 What's the Packaging Madness? installation without RPM is dangerous conflicts of files, overwritten binaries, libraries,... even RPM doesn't have to be safe: install vendor's RPM in standard paths use same package on more OS releases

6 RPM RPM package management system rpm doesn't solve conflicts, yum does ownership of directories verification of content signing of packages some don't use it lot of guidelines require a skill learn something

7 What's the Packaging Madness? installation without RPM is dangerous conflicts of files, overwritten binaries, libraries,... even RPM doesn't have to be safe: install vendor's RPM in standard paths use same package on more OS releases

8 More Versions of Software new version of software can break ABI/API some apps stop working more versions of software it's hard to add another version can cause: conflicts of directories, binaries RPM conflicts

9 3 Different Non-conflicting Versions of Python 6 ~]# python V Python [user@rhel 6 ~]# [user@rhel 6 ~]# python V Python [user@rhel 6 ~]# [user@rhel 6 ~]# python V Python [user@rhel 6 ~]#

10 3 Different Non-conflicting Versions of Python additional versions of software in /opt directory switching among all of them => environment setting 6 ~]# python V Python [user@rhel 6 ~]# [user@rhel 6 ~]# python V Python [user@rhel 6 ~]#

11 Possibilities of /opt Directory there can be: more vendors in /opt more apps in /opt/vendor example: /opt/rh/tcl85_wthreads /opt/rh/tcl85_wothreads /opt/fedora/tcl85

12 3 rd Party Installation Directories often used installation paths: /opt/vendor recommended by FHS /usr/local to build and install on one computer directory based on company policy

13 Technologies Providing More Versions alternatives usually use installation from /usr/local environment modules used with nfs shares special tools for languages eg. perlbrew, rvm

14 SOLUTION Software Collections

15 Software Collections is structural definition for apps independent of OS installed outside of the standard paths is still using RPM, yum, PackageKit provides packaging techniques add additional macros handle environmental variables parallel installation of more versions of the same software

16 Software Collections Offer: specific version of software updated software fast moving software web frameworks one deployment for more OS releases eg. gcc toolchain above OS

17 Migration with Help of Collection can test on your own computer two versions of software on one OS can test your app for old software with new version Python 2 => Python 3 MySQL 5.5 => MariaDB 5.5 Perl => Perl

18 The scl-utils Project enable Software Collections contains set of macros above RPM handles environment settings includes tool for switching collections install by RPM, yum or PackageKit

19 The scl-utils Installation yum install y python27... python el6.x86_64.rpm python27 expat el6.x86_64.rpm python27 python el6.x86_64.rpm python27 python babel el6.noarch.rpm python27 python devel el6.x86_64.rpm python27 runtime 1 3.el6.x86_64.rpm...

20 The scl-utils Example 1 [user@rhel 6 ~]# scl l mariadb55 mysql55 perl516 php54 python27 python33 ruby193

21 The scl-utils Example 2 [user@rhel 6]# scl enable ruby193 rails server [user@rhel 6]# scl enable php54 bash [user@rhel 6]# scl enable perl516 cpan Moose Fetching with LWP:...

22 The scl-utils Example 3: inside of python 3 collection [root@rhel 6 ~]# scl enable python33 bash [root@rhel 6 ~]# easy_install pip Searching for pip Reading Installing pip 3.3 script to /opt/rh/python33/root/usr/bin Installing pip script /opt/rh/python33/root/usr/bin Installed /opt/rh/python33/root/usr/lib/python3.3/site_p ackages/pip py3.3.egg

23 3 Ways of Application with Different #! #!/usr/bin/perl use common::sense; say yes ; #!/usr/bin/env perl use common::sense; say yes ; #!/opt/rh/perl516/root/usr/bin/perl516 perl use common::sense; say yes ;

24 3 Ways of Application with Different #! #!/usr/bin/perl use common::sense; say yes ; good for apps from OS always executes system version

25 3 Ways of Application with Different #! good for developers switch version using environment variable #!/usr/bin/env perl use common::sense; say yes ;

26 3 Ways of Application with Different #! good for deployed apps a wrapper for apps executed in collection environment #!/bin/bash COMMAND="perl $@" scl enable perl516 "$COMMAND" #!/opt/rh/perl516/root/usr/bin/perl516 perl use common::sense; say yes ;

27 How to Create a Package: scl automatic creation: spec2scl or manual creation: meta-package and dependent packages more information on: From Conventional Red Hat Package Manager (RPM) to Software Collections by Thomas Cameron & Bohuslav Kabrda

28 Packaging: Documentation should you need more information: documentation accessible through Customer Portal n-us/red_hat_developer_toolset/1/html/software _Collections_Guide/index.html project page - upstream of collections

29 Available Testing Repositories: Languages Perl Ruby and Rails Python 2.7 and libraries for web frameworks support Python 3.3 and libraries for web frameworks support PHP 5.4 node.js 0.10

30 Available Testing Repositories: Databases MariaDB 5.5 MySQL 5.5 PostgreSQL 9.2 UnixODBC and connectors

31 Available Testing Repositories: Add Repository 1) as a root 2) cd /etc/yum.repos.d/ 3) wget 4) yum install -y python27

32 PRODUCTS Developer Toolset Red Hat Software Collections - Beta OpenShift

33 Products: Developer Toolset consists of a new set of developer tools more up to date versions of toolchain Developer Toolset 1.1 includes gcc Developer Toolset 2.0 includes gcc Developer Toolset: Build, Run, & Analyze Applications On Multiple Versions of Red Hat Enterprise Linux by Matt Newsome, June 13, Thursday 10:40

34 Products: Red Hat Software Collections - Beta delivers the latest stable runtime languages and databases to create modern applications suitable for testing add new software Red Hat Software Collections 1.0 Perl, Python, PHP, Ruby, node.js databases MariaDB, MySQL, PostgreSQL

35 Products: OpenShift PaaS (Platform as a Service) Software collections in OpenShift Online and OpenShift Enterprise Ruby&Rails Python 2.7

36 Summary introduced improved packaging system showed how to use it showed how to create it introduced products using it explained technical details

37 Questions?

38 Thank you Marcela Mašláňová