Building a whole distro on top of a minimalistic language

Size: px

Start display at page:

Download "Building a whole distro on top of a minimalistic language"

Ashlie Black
5 years ago
Views:

1 Building a whole distro on top of a minimalistic language Ludovic Courtès FOSDEM, 2 February 2019

2 the GNU/Linux potluck

5 GNU Guix Reference Card forversion Getting Started Toreadtheon-linedocumentationrun info guix orvisit See One-Off Environments guix environment --ad-hoc spec environmentcontaining spec guix environment python environmenttodeveloppythonitself guix environment --ad-hoc python -C -- python3 runpythoninacontainer guix environment -m file createanenvironmentforthepackagesinmanifest file Customizing Packages guix command name --with-source=name=source build namewithadifferentsourceurl guix command spec --with-input=spec1=spec2 replace spec1with spec2inthedependencygraphof spec guix command spec --with-graft=spec1=spec2 graft spec2inlieuof spec1in spec guix command spec --with-branch=branch build specfromthegivengit branch guix command spec --with-commit=commit build specfromthegivengit commit SpecifyingPackages Mostcommandstakea packagespecification denoted specinthe sequel. Herearesomeexamples: emacs Emacspackage,latestversion GCCtoolchain,version7.x gcc-toolchain:debug latestgcctoolchain,debuggingsymbols Managing Packages guix package -s regexp searchforpackages guix package --show=spec showpackageinfo guix package -i spec installpackages guix package -u [regexp] upgradepackages guix package -r name removepackages guix package -m file instantiatefrommanifest guix package --roll-back rollback guix package -l listprofilegenerations guix package --search-paths displaysearchpaths guix package -p profile useadifferentprofile Manifests guix package -mandothercommandstakea manifest filelisting packagesof interest,alongtheselines: (specifications->manifest "openmpi")) Updating Guix guix describe describecurrentguix guix pull updateguix guix pull -l viewhistory guix pull --commit=commit updateto commit guix pull --branch=branch updateto branch guix pull -C file updatethegivenchannels ChannelSpecifications ChannelsspecifyGitrepositorieswhere guix pulllooksforupdates toguixandexternalpackagerepositories. Bydefault guix pull reads ~/.config/guix/channels.scm;with -Citcantakechannel specificationsfromauser-suppliedfilethatlookslikethis: (cons (channel (name guix-hpc) (url " (branch "master")) %default-channels) Managing StorageSpace guix gc collectallgarbage guix gc -C ng collect ngbof garbage guix gc -F ng ensure ngbareavailable guix package -d duration deletegenerationsolderthan duration e.g., 1mforone month guix size spec viewpackagesize guix gc -R /gnu/store/ listrun-timedependencies guix graph -t references spec viewrun-timedependencies Developing Packages guix edit spec guix build spec guix build --log-file spec guix build -K spec guix build -S spec guix build --check spec guix build --target=triplet guix download URL guix hash file guix graph spec dot -Tpdf guix refresh spec guix import repo name Creating ApplicationBundles guix pack spec guix pack -f docker spec guix pack -f squashfs spec guix pack --relocatable spec guix pack -S /bin=bin spec guix pack -m file viewthedefinition buildpackages viewthebuildlog buildpackages,keepbuild treesonfailure obtainthesourceof spec rebuildapackage cross-compileto triplet e.g., arm-linux-gnueabihf downloadfrom URLandprint itssha256hash printthehashof file viewdependencies updatepackagedefinition import namefrom repo createatarball createadockerimage createasingularityimage createarelocatabletarball make /binasymlinktothe packages bindirectory bundlethepackagesfromthe manifestin file

6 (operating-system (host-name "schememachine") (timezone "Europe/Brussels") (locale "fr_be.utf8") (bootloader (bootloader-configuration (bootloader grub-efi-bootloader) (target "/boot/efi"))) (file-systems (cons (file-system (device (file-system-label "my-root")) (mount-point "/") (type "ext4")) %base-file-systems)) (users (cons (user-account (name "charlie") (group "users") (home-directory "/home/charlie")) %base-user-accounts)) (services (cons* (service dhcp-client-service-type) (service openssh-service-type) %base-services)))

7 $ guix system build config.scm... $ guix system vm config.scm... $ guix system container config.scm... $ guix system reconfigure config.scm...

9 Here s one of my favorite features. The new for keyword allows you to iterate over lists and generate lists and maps. This gives you a whole bunch of new flexibility.

10 The truth is that Lisp is not the right language for any particular problem. Rather, Lisp encourages one to attack a new problem by implementing new languages tailored to that problem. Abelson & Sussman, 1987

11 (define hello (package (name "hello") (version "2.8") (source (origin (method url-fetch) (uri (string-append " version ".tar.gz")) (sha256 (base32 "0wqd...dz6")))) (build-system gnu-build-system) (synopsis "An example GNU package") (description "Produce a friendly greeting.") (home-page " (license gpl3+))) ;; Yields: /gnu/store/...-hello-2.8

12 (service openssh-service-type)

13 (service openssh-service-type (openssh-configuration (x11-forwarding? #true) (permit-root-login without-password)))

14 ;; Sets up cgit + nginx + fcgiwrap. (service cgit-service-type (cgit-configuration (repository-directory "/srv/git") (project-list (list "foo" "bar"))))

15 (operating-system ;;... (services (remove (lambda (service) (eq? ntp-service-type (service-kind service))) %desktop-services)))

16 (define %my-services ;; My very own list of services. (modify-services %desktop-services (mingetty-service-type config => (mingetty-configuration (inherit config) (motd (plain-file "motd" "Howdy FOSDEM!")))) (upower-service-type config => (upower-configuration (inherit config) (ignore-lid? #true) (percentage-critical 5.)))))

17 Emacs and Web user interfaces guix refresh package auto-updater guix lint package checker guix graph dependency graph viewer guix system extension-graph service composition viewer...

18 Unification beyond the distro.

19 Nix & string interpolation { fetchurl, stdenv } : } stdenv. mkderivation { name = "hello-2.3"; src = fetchurl { url = mirror://gnu/hello/hello-2.3.tar.bz2; sha256 = "0c7vijq8y68..."; }; meta = { description = "Produces a friendly greeting"; homepage = license = "GPLv3+"; }; function definition function call

20 Nix & string interpolation { fetchurl, stdenv } : stdenv. mkderivation { name = "hello-2.3"; src = fetchurl { url = mirror://gnu/hello/hello-2.3.tar.bz2; sha256 = "0c7vijq8y68..."; }; precheck = "echo Test suite coming up! "; Bash snippet meta = { description = "Produces a friendly greeting"; homepage = license = "GPLv3+"; }; }

22 The Initial RAM Disk

23 The Initial RAM Disk (expression->initrd (with-imported-modules (source-module-closure ((gnu build linux-boot) (guix build utils))) #~ (begin (use-modules (gnu build linux-boot) (guix build utils)) (boot-system #:mounts #$file-systems #:linux-modules #$linux-modules #:linux-module-directory #$kodir)))

24 The Initial RAM Disk code staging (expression->initrd (with-imported-modules (source-module-closure ((gnu build linux-boot) (guix build utils))) #~ (begin (use-modules (gnu build linux-boot) (guix build utils)) (boot-system #:mounts #$file-systems #:linux-modules #$linux-modules #:linux-module-directory #$kodir)))

25 Linux-libre

26 Linux-libre initial RAM disk

27 Linux-libre initial RAM disk Guile

28 Linux-libre initial RAM disk Guile PID 1: GNU Shepherd services...

29 Linux-libre initial RAM disk Guile PID 1: GNU Shepherd services... Guile

30 Linux-libre initial RAM disk Guile PID 1: GNU Shepherd services... Guile applications

31 System Services ;; Service definition for the GNU Shepherd (PID 1) ;; embedded in GuixSD. (shepherd-service (provision (mysql)) (documentation "Run the MySQL server.") (start (let ((my.cnf (mysql-configuration-file config))) #~(make-forkexec-constructor (list (string-append #$mysql "/bin/mysqld") (string-append "--defaults-file=" #$my.cnf)) #:user "mysql" #:group "mysql"))) (stop #~(make-kill-destructor)))

32 ;; Shepherd service to mount/unmount a file system. (with-imported-modules ((gnu build file-systems)) (shepherd-service (provision (file-system-/home)) (start #~(lambda () (mount "/dev/foo" "/home" "ext4"))) (stop #~(lambda () (umount "/home")))))

33 ;; Shepherd service for the BitlBee IRC gateway daemon. (shepherd-service (provision (bitlbee)) (requirement (loopback)) (start #~(make-forkexec-constructor (list #$(file-append bitlbee "/sbin/bitlbee")...))) (stop #~(make-kill-destructor)))

34 ;; Shepherd service for the BitlBee IRC gateway daemon. (with-imported-modules ((gnu build linux-container)) (shepherd-service (provision (bitlbee)) (requirement (loopback)) (start #~(make-forkexec-constructor/container (list #$(file-append bitlbee "/sbin/bitlbee")...))) (stop #~(make-kill-destructor)))) containerized service!

35 Wrap-up.

36 distro & tools as a Scheme library hackability through uniformity code staging techniques to glue it all

37 Join us now, share the parens! install the distribution use it, report bugs, add packages share your ideas!

39 Copyright c 2010, Ludovic Courtès ludo@gnu.org. GNU Guix logo, CC-BY-SA 4.0, Buffet picture under CC-BY-SA 2.0 by PEK, GNU Guix Reference Card under GFDL Copyright of other images included in this document is held by their respective owners. This work is licensed under the Creative Commons Attribution-Share Alike 3.0 License. To view a copy of this license, visit or send a letter to Creative Commons, 171 Second Street, Suite 300, San Francisco, California, 94105, USA. At your option, you may instead copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is available at The source of this document is available from

GNU Guix: Scheme as a uniform OS admin and deployment interface

GNU Guix: Scheme as a uniform OS admin and deployment interface Ludovic Courtès Commercial Users of Functional Programming 24 September 2016, Nara, Japan $ guix package -i gcc-toolchain coreutils sed