Open Build Service in Debian It is impressive how much time and resources a team can save

Transcription

1 Open Build Service in Debian It is impressive how much time and resources a team can save 李健秋 Andrew Lee alee@collabora.com 3/Feb/2018

2 Andrew Lee 李健秋 Years of experience on RPM packaging. Debian Developer since More than 5 years of experience work in Build & Infrastructure team in Collabora. alee@collabora.com Open First

3 Agenda Overview Benefits of using OBS OBS features and workflow The OBS Architecture How to setup OBS Tips for optimization 3

4 Agenda Overview Benefits of using OBS OBS features and workflow The OBS Architecture How to setup OBS Tips for optimization 4

5 Overview Classic Packaging Source 5 1 build amd64 Debian: Jessie Repository Binary Packages

6 Overview Classic Packaging Source 6 2 builds amd64 Debian: Jessie, Stretch Repositories Repository Binary Packages Binary Packages

7 Overview Classic Packaging Source 7 4 builds amd64, i386 Debian: Jessie, Stretch Repositories Repository Repository Binary Packages Repository Binary Packages Binary Packages Binary Packages

8 Overview Classic Packaging Source 8 MESS! How many builds? Amd64, i386, armhf, arm64 Debian: Jessie, Stretch, Sid Ubuntu: 16.04, 16.10, Repositories Repository Repository Binary Packages Repository Repository Binary Packages Repository Repository Binary Packages Repository Binary Packages Repository Binary Packages Binary Packages Binary Packages Binary Packages Binary Packages

9 Let's fix the mess!

10 Overview Packaging with OBS Source 10 Amd64, i386, armhf, arm64 Debian: Jessie, Stretch Ubuntu: 16.04, 16.10, 17.04

11 Overview Packaging with OBS DONE! Source 11 Amd64, i386, armhf, arm64 Debian: Jessie, Stretch Ubuntu: 16.04, 16.10, 17.04

12 Agenda Overview Benefits of using OBS OBS features and workflow The OBS Architecture How to setup OBS Tips for optimization 12

13 The Benefit of Using OBS For existing and new software projects: - One source to multiple distros and archs - Automatically published binary repositories - Workflow for packaging and releasing needs For packagers: - Automatic, consistent and reproducible build For user: - Easy install and keep upgraded via apt-get 13

14 The Benefit of Using OBS For existing and new software projects: - One source to multiple distros and archs - Automatically published binary repositories - Workflow for packaging and releasing needs For packagers: - Automatic, consistent and reproducible build For user: - Easy install and keep upgraded via apt-get 14

15 For existing and new software projects One source to multiple distros and archs. 15

16 For existing and new software projects Automatically published binary repositories. 16

17 For existing and new software projects Workflow for packaging and releasing needs. 17

18 For existing and new software projects Workflow for packaging and releasing needs. 18

19 The Benefit of Using OBS For existing and new software projects: - One source to multiple distros and archs - Automatically published binary repositories - Workflow for packaging and releasing needs For packagers: - Automatic, consistent and reproducible build For user: - Easy install and keep upgraded via apt-get 19

20 For Packagers Automatic, consistent and reproducible build. 20

21 The Benefit of Using OBS For existing and new software projects: - One source to multiple distros and archs - Automatically published binary repositories - Workflow for packaging and releasing needs For packagers: - Automatic, consistent and reproducible build For user: - Easy install and keep upgraded via apt-get 21

22 For Users Easy install and keep Upgrade via apt-get. 22

23 Add repo to source.list: For Users deb target development sdk Easy install and keep Upgrade via apt-get. 23

24 Agenda Overview Benefits of using OBS OBS features and workflow The OBS Architecture How to setup OBS Tips for optimization 24

25 The OBS features and workflow Build against multiple distros and archs Download on Demand Repositories (DoD) Revision control for source package Automatic source package processing Access control for source repositories Request and Review system 25

26 The OBS features and workflow Build against multiple distros and archs Download on Demand Repositories (DoD) Revision control for source package Automatic source package processing Access control for source repositories Request and Review system 26

27 OBS features and workflow Build on multiple distros and archs. 27

28 The OBS features and workflow Build against multiple distros and archs Download on Demand Repositories (DoD) Revision control for source package Automatic source package processing Access control for source repositories Request and Review system 28

29 OBS features and workflow Download on Demand Repositories (DoD). 29

30 OBS features and workflow Download on Demand Repositories (DoD). 30

31 OBS features and workflow Download on Demand Repositories (DoD). 31

32 The OBS features and workflow Build against multiple distros and archs Download on Demand Repositories (DoD) Revision control for source package Automatic source package processing Access control for source repositories Request and Review system 32

33 OBS features and workflow Revision control for source package. 33

34 The OBS features and workflow Build against multiple distros and archs Download on Demand Repositories (DoD) Revision control for source package Automatic source package processing Access control for source repositories Request and Review system 34

35 OBS features and workflow Automatic source package processing. 35

36 OBS features and workflow Automatic source package processing. 36

37 OBS features and workflow Automatic source package processing. 37

38 OBS features and workflow Automatic source package processing. 38

39 OBS features and workflow Automatic source package processing. 39

40 The OBS features and workflow Build against multiple distros and archs Download on Demand Repositories (DoD) Revision control for source package Automatic source package processing Access control for source repositories Request and Review system 40

41 OBS features and workflow Access control for Source repositories. 41

42 The OBS features and workflow Build against multiple distros and archs Download on Demand Repositories (DoD) Revision control for source package Automatic source package processing Access control for source repositories Request and Review system 42

43 OBS features and workflow Request and Review system. 43

44 OBS features and workflow Request and Review system. 44

45 OBS features and workflow Request and Review system. 45

46 Agenda Overview Benefits of using OBS OBS features and workflow The OBS Architecture How to setup OBS Tips for optimization 46

47 The OBS Architecture Backend Services - obs-server - obs-worker Frontend Ruby Rails App - obs-api Command line tools - osc - osc-dput-plugin 47

48 The OBS Architecture 48

49 The OBS Architecture Backend Services - obs-server - obs-worker Frontend Ruby Rails App - obs-api Command line tools - osc - osc-dput-plugin 49

50 The OBS Architecture Backend Services. 50

51 The OBS Architecture Backend Services - obs-server - obs-worker Frontend Ruby Rails App - obs-api Command line tools - osc - osc-dput-plugin 51

52 The OBS Architecture 52

53 The OBS Architecture Frontend Ruby Rails App. 53

54 The OBS Architecture Backend Services - obs-server - obs-worker Frontend Ruby Rails App - obs-api Command line tools - osc - osc-dput-plugin 54

55 The OBS Architecture 55

56 The OBS Architecture Command line tools: osc and osc-dput-plugin 56

57 Let s look at an example. 57

58 The OBS Architecture Command line tools: osc and osc-dput-plugin 58

59 The OBS Architecture Command line tools: osc and osc-dput-plugin 59

60 The OBS Architecture Command line tools: osc and osc-dput-plugin 60

61 The OBS Architecture Command line tools: osc and osc-dput-plugin 61

62 The OBS Architecture Command line tools: osc and osc-dput-plugin 62

63 The OBS Architecture Command line tools: osc and osc-dput-plugin 63

64 The OBS Architecture Command line tools: osc and osc-dput-plugin 64

65 The OBS Architecture Command line tools: osc and osc-dput-plugin 65 Modify your package as usual. Update changelog as usual for a new revision. And then generate source package: $ dpkg-buildpackage -S -us -uc -d

66 The OBS Architecture Command line tools: osc and osc-dput-plugin 66

67 The OBS Architecture Command line tools: osc and osc-dput-plugin 67

68 The OBS Architecture Command line tools: osc and osc-dput-plugin 68

69 The OBS Architecture Command line tools: osc and osc-dput-plugin 69

70 The OBS Architecture Command line tools: osc and osc-dput-plugin 70

71 The OBS Architecture Command line tools: osc and osc-dput-plugin 71

72 The OBS Architecture Command line tools: osc and osc-dput-plugin 72

73 The OBS Architecture Command line tools: osc and osc-dput-plugin 73

74 The OBS Architecture Command line tools: osc and osc-dput-plugin 74 For more information: $ osc help or $ man osc

75 The OBS Architecture Command line tools: osc and osc-dput-plugin 75

76 Agenda Overview Benefits of using OBS OBS features and workflow The OBS Architecture How to setup OBS Tips for optimization 76

77 How to Setup OBS OBS is now available in Debian Stretch! \o/ You need to have Debian Stretch or Sid apt-get install [obs-server obs-api obs-worker] Read the README.Debian for the setup 77

78 How to Setup OBS OBS is now available in Debian Stretch! \o/ You need to have Debian Stretch or Sid apt-get install [obs-server obs-api obs-worker] Read the README.Debian for the setup 78

79 OBS is now in Debian Stretch Years of Debian Packaging efforts for OBS dependencies. 79

80 OBS is now in Debian Stretch \o/ 80

81 How to Setup OBS OBS is now available in Debian Stretch! \o/ You need to have Debian Stretch or Sid apt-get install [obs-server obs-api obs-worker] Read the README.Debian for the setup OBS in container 81

82 OBS install Install obs-server The backend services 82

83 OBS install Install obs-api The ruby rails app frontend 83

84 OBS install Install obs-worker The builders 84

85 How to Setup OBS OBS is now available in Debian Stretch! \o/ You need to have Debian Stretch or Sid apt-get install [obs-server obs-api obs-worker] Read the README.Debian for the setup OBS in container 85

86 OBS Setup Read: /usr/share/obs-api/readme.debian 86

87 OBS in containers We are working on that: cker-obs WIP docker images for obs-server, obs-api and obs-worker containers. 87

88 OBS in containers We are working on that: 88

89 Agenda Overview Benefits of using OBS OBS features and workflow The OBS Architecture How to setup OBS Tips for optimization 89

90 Tips for Optimization Merge-our-misc (MoM) Bug tracker hook Integrate with Jenkins to build package from git Integrate with LAVA to run autotest on actual hardware 90

91 Tips for Optimization Merge-our-misc (MoM) Bug tracker hook Integrate with Jenkins to build package from git Integrate with LAVA to run autotest on actual hardware 91

92 Merge-our-misc Automated continuous package integration. 92

93 Merge-our-misc 3-way merge and submit request with new upstream package with local modifications. 93

94 Tips for Optimization Merge-our-misc (MoM) Bug tracker hook Integrate with Jenkins to build package from git Integrate with LAVA to run autotest on actual hardware 94

95 Bug tracker hook Update bug status after package build. 95

96 Tips for Optimization Merge-our-misc (MoM) Bug tracker hook Integrate with Jenkins to build package from git Integrate with LAVA to run autotest on actual hardware 96

97 Integrate with Jenkins Build packages from git. 97

98 Integrate with Jenkins Build packages from git. 98

99 Integrate with Jenkins Build packages from git. 99

100 Integrate with Jenkins Build images from git. 100

101 Integrate with Jenkins Build images from git. 101

102 Tips for Optimization Merge-our-misc (MoM) Bug tracker hook Integrate with Jenkins to build package from git Integrate with LAVA to run autotest on actual hardware 102

103 Integrate with Jenkins + LAVA Run autotest on actual hardware. 103

104 More details Build a infrastructure of a Debian derivative a Debian-derived platform for infotainment in automotive vehicles Tomorrow 9:00am Same room by Andrew Shadura 104

105 Recap Overview Benefits of using OBS OBS features and workflow The OBS Architecture How to setup OBS Tips for optimization 105

106 We're hiring: col.la/careers Any questions? 106

107 Thank you for everyone who was involved Andrew Shadura, Emanuele Aina, Emilio Pozuelo Monfort, Gustavo Noronha Silva, Gustavo Padovan, Héctor Orón Martínez, Justin Kim, Jordi Mallach, Luis Francisco Araujo Camarillo, Mark Filion, Simon McVittie, Sjoerd Simons, Travis Reitter, Yohei Yasukawa, 劉建緯 and many others. 107

108 Thank you! 李健秋 Andrew Lee 108