Buildroot: what s new?

Transcription

1 Embedded Linux Conference 2014 Buildroot: what s new? Thomas Petazzoni Free Electrons thomas.petazzoni@free-electrons.com Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 1/30

2 Thomas Petazzoni CTO and Embedded Linux engineer at Free Electrons Embedded Linux development: kernel and driver development, system integration, boot time and power consumption optimization, consulting, etc. Embedded Linux training, Linux driver development training and Android system development training, with materials freely available under a Creative Commons license. Contributions Kernel support for the Marvell Armada ARM SoCs from Marvell Major contributor to Buildroot, an open-source, simple and fast embedded Linux build system Living in Toulouse, south west of France Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 2/30

3 Introduction to Buildroot Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 3/30

4 Buildroot at a glance Is an embedded Linux build system, builds from source: cross-compilation toolchain root filesystem with many libraries/applications, cross-built kernel and bootloader images Fast, simple root filesystem in minutes Easy to use and understand: kconfig and make Small root filesystem, default 2 MB More than 1000 packages available Generates filesystem images, not a distribution Vendor neutral Active community, regular releases Started in 2001, oldest still maintained build system Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 4/30

5 Who s using Buildroot: a few examples System makers Google Barco Rockwell Collins Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 5/30

6 Who s using Buildroot: a few examples System makers Google Barco Rockwell Collins Processor vendors Analog Devices Imagination Technologies Marvell Atmel Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 5/30

7 Who s using Buildroot: a few examples System makers Google Barco Rockwell Collins Processor vendors Analog Devices Imagination Technologies Marvell Atmel Many, many hobbyists on development boards: Raspberry Pi, BeagleBone Black, etc. Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 5/30

8 Demonstration A demonstration is worth many slides! Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 6/30

9 What s new? Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 7/30

10 Increased activity Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 8/30

11 Architecture support Several new architectures added AArch64 ARC, contributed by Synopsys Blackfin, contributed by Analog Devices Microblaze NIOS II Xtensa, maintained by Tkos Improved ARM support: soft-float, softfp, hardfp, NEON, VFP variants Improved MIPS support, contributed by Imagination Technologies Improved nommu support Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 9/30

12 Toolchain support In the internal toolchain backend Support added for eglibc and glibc Upcoming support for musl Significant cleanup of the backend In the external toolchain backend Support for many additional external toolchains: Linaro, Sourcery, Analog Devices, etc. Dropped support for the Crosstool-NG backend But toolchains generated by Crosstool-NG can still be used as external toolchains Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 10/30

13 New packages Multimedia GStreamer 1.2, XBMC, Wayland, EFL, Qt5, Pulseaudio, Opus, Linphone, tvheadend, etc. Lots of OpenGL improvements Scripting Python 3, nodejs, Lua, Python and PHP modules System Systemd/udev, eudev Databases MySQL server, PostgreSQL Development perf, lttng, trace-cmd, wireshark, etc. 342 packages added since January, 1st Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 11/30

14 GSoC and multimedia In 2013, participated to the GSoC program. One student, Spenser Gilliland, working on ARM multimedia support GPU drivers: PowerVR for TI, Mali for Allwinner, Vivante on i.mx, RaspberryPi Video acceleration: CedarX on Allwinner, VPU on i.mx, Gst-omx on RaspberryPi Enabling of OpenGL ES and EGL in several packages: Qt5, Cairo, etc. Ongoing effort with a new GSoC 2014 project improvement of multimedia support, with Hadrien Boutteville Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 12/30

15 Quality assurance: autobuilders (1) Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 13/30

16 Quality assurance: autobuilders (2) Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 14/30

17 License compliance support (1) Embedded Linux systems integrate dozens of components, each distributed under a given license. Keeping track of the list of all components and their license can be a cumbersome task. Buildroot now has licensing information attached to each package BUSYBOX_LICENSE = GPLv2 BUSYBOX_LICENSE_FILES = LICENSE Given a configuration, such information can be extracted for all the packages used in the generated system. Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 15/30

18 License compliance support (2) $ make legal-info In output/legal-info/, generates: buildroot.config, copy of Buildroot configuration licenses/, directory with the licenses of each target package licenses.txt, file with the licenses of all target packages manifest.csv, CSV file with the description of all target packages sources/, directory with the tarballs Same thing for host packages: host-licenses/, host-licenses.txt, host-manifest.csv. Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 16/30

19 License compliance support (3) $ cat output/legal-info/manifest.csv "PACKAGE","VERSION","LICENSE","LICENSE FILES","SOURCE ARCHIVE" "toolchain-external","undefined","unknown","not saved","ia32-..." "busybox","1.22.1","gplv2","license","busybox tar.bz2" "i2c-tools","3.1.0","gplv2+, GPLv2 (py-smbus)","copying","i2c-..." "kmod","17","lgplv2.1+","libkmod/copying","kmod-17.tar.xz" "lua","5.1.5","mit","copyright","lua tar.gz" Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 17/30

20 Eclipse plugin An Eclipse plugin facilitates the usage of Buildroot toolchains for library and application development. Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 18/30

21 Configurations for boards Predefined configurations for many popular boards have been added. RaspberryPi BeagleBoneBlack CubieBoard Altera SOCKit Wandboard Zedboard... Also lots of pre-defined configurations for QEMU emulated platforms. In total, 63 pre-defined board configurations make <name>_defconfig && make Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 19/30

22 Package infrastructures Buildroot has package infrastructures to factorize common logic between package recipes, and simplify the creation of new packages. Buildroot already had: autotools-package, cmake-package and generic-package Over the last year, several package infrastructures were added: python-package, with major improvements to the Python support perl-package lua-package Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 20/30

23 Dependency graphing Addition of a tool to visualize the dependencies between packages Tied to a given configuration Allows to more easily understand why a given package is brought into the build. Usage: make graph-depends for a full dependency graph make <pkg>-graph-depends for the dependencies of one package ls output/graphs Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 21/30

24 Dependency graphing: example 1 ALL toolchain busybox rootfs-tar toolchain-buildroot host-fakeroot host-makedevs host-mkpasswd host-gcc-final uclibc host-gcc-initial linux-headers host-binutils host-mpc host-mpfr host-gmp host-m4 Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 22/30

25 host-mpc host-gcc-final host-binutils host-mpfr Dependency graphing: example 2 host-gcc-initial toolchain-buildroot glibc host-gmp host-gawk linux-headers ALL toolchain busybox libgtk2 host-libffi host-m4 libffi host-automake host-autoconf libsha1 libglib2 xfont_font-misc-misc host-libglib2 host-gettext host-xapp_mkfontdir host-xproto_fontsproto xfont_font-alias host-xapp_bdftopcf host-freetype host-libgtk2 host-xapp_mkfontscale xfont_font-cursor-misc host-xfont_font-util host-xlib_libxfont host-libpng host-zlib host-libtool host-gdk-pixbuf xfont_font-util host-xfont_encodings host-xlib_libfontenc pixman atk host-intltool host-xlib_xtrans host-perl-xml-parser libpng zlib xkeyboard-config host-expat gdk-pixbuf freetype host-pkgconf pango cairo fontconfig expat host-python host-xapp_xkbcomp host-libxcb host-libxml2 host-xlib_libx11 host-libpthread-stubs host-xlib_libxkbfile host-xproto_xextproto host-xproto_inputproto host-xproto_xf86bigfontproto host-xcb-proto host-xproto_xproto host-libxslt host-xutil_util-macros host-xlib_libxau host-xlib_libxdmcp host-xproto_kbproto xlib_libfontenc xcb-proto xlib_libxfont xfont_encodings xproto_presentproto xlib_libxft libxcb libpthread-stubs xlib_libxinerama xlib_libxcomposite xproto_compositeproto xlib_libxdmcp xutil_util-macros xproto_xineramaproto xlib_libxau xlib_libxrender xlib_libx11 xlib_xtrans xproto_bigreqsproto xlib_libxext xserver_xorg-server xlib_libxi xlib_libxrandr xlib_libxdamage xlib_libxcursor xproto_inputproto xproto_glproto xproto_renderproto xproto_xproto xproto_videoproto xproto_xcmiscproto xproto_xf86dgaproto xproto_randrproto xproto_damageproto xlib_libxfixes xproto_resourceproto xlib_libxkbfile xproto_fontsproto xproto_xextproto xproto_fixesproto mcookie xlib_libxres xproto_xf86bigfontproto xdata_xbitmaps xproto_kbproto xapp_xkbcomp xlib_libxxf86vm xproto_xf86vidmodeproto host-mkpasswd rootfs-tar host-fakeroot host-makedevs Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 23/30

26 Dependency graphing: example 3 libxcb host-libxslt host-xcb-proto xcb-proto libpthread-stubs xlib_libxdmcp xlib_libxau host-libxml2 host-python xproto_xproto xutil_util-macros host-expat host-automake host-zlib host-pkgconf host-autoconf host-m4 host-libtool Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 24/30

27 Build time graphing Buildroot records the duration of each step for each package: extract, patch, configure, build, install, etc. Using this information, it can produce graphs to help analyze the build duration. Useful to understand what is taking the longest to build, and where build time optimizations should be made. After a build, generate a graph with: make graph-build ls output/graphs Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 25/30

28 Build time graphing: example Build time of packages, by build order extract patch configure build install-target install-staging install-images install-host Time (seconds) host-mpc host-mpfr host-gmp host-m4 host-binutils uclibc linux-headers host-gcc-initial toolchain-buildroot host-gcc-final host-gcc-intermediate host-expat host-pkgconf host-gettext gettext host-automake host-autoconf host-libtool argp-standalone toolchain host-zlib host-libffi dbus expat host-intltool host-perl-xml-parser conntrack-tools host-flex host-bison libnetfilter_queue libnetfilter_cttimeout libnetfilter_cthelper libnetfilter_conntrack libmnl libnfnetlink civetweb openssl busybox bluez_utils avahi zlib pcre libglib2 libffi host-libglib2 fmtools dtach directfb freetype dialog ncurses host-ncurses host-lttng-babeltrace host-util-linux host-popt popt lttng-libust util-linux links liburcu libtorrent libtool libtheora libvorbis libsigsegv libsigc libserial libplayer libogg libmms libmatroska libgsasl libgeotiff tiff libfslparser libfribidi liberation libebml libdvdnav libdvdread libaio json-javascript jhead iperf input-event-daemon netperf ncftp nbd nano mtd lzo lzop minicom lttng-tools wvdial wvstreams ux500-firmware speex snowball-init slirp rtptools rng-tools quagga host-gawk poco host-omap-u-boot-utils Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 26/30

29 Build time graphing: example 2 Build time per package gettext host-gcc-final host-gettext host-gcc-intermediate host-libglib2 libglib2 7.2% 4.0% 8.2% 6.8% 12.7% 5.1% 4.4% 3.6% uclibc host-gcc-initial 1.5% 1.1% avahi 1.2% bluez_utils 2.8% busybox 2.9% 1.3% openssl 1.3% 1.3% 2.1% 1.7% 1.5% 3.6% host-bison host-ncurses ncurses freetype directfb libtorrent speex wvstreams 25.7% Other Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 27/30

30 Support for customization Lots of improvements to help customizing the Buildroot build BR2_EXTERNAL: can point to a directory that contains additional package recipes and defconfigs Useful to separate the open-source components (in the core Buildroot) from proprietary/company-specific packages make BR2_EXTERNAL=../foobar foobar/package, foobar/board, foobar/configs Rootfs overlay: a directory copied over the root filesystem after all packages are built, but before the root filesystem image is created. Hook scripts: post-build and post-image scripts can be called to tweak the root filesystem and/or the images. Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 28/30

31 Entering the 21st century Finally, a new web site, and a Google+ page Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 29/30

32 Questions? Thomas Petazzoni Slides under CC-BY-SA Free Electrons. Kernel, drivers and embedded Linux development, consulting, training and support. 30/30