General-purpose computing with VirtualBox on Genode/NOVA. Norman Feske

Size: px

Start display at page:

Download "General-purpose computing with VirtualBox on Genode/NOVA. Norman Feske"

Alan Dixon
6 years ago
Views:

1 General-purpose computing with VirtualBox on Genode/NOVA Norman Feske

2 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Transplantation of VirtualBox to NOVA 4. Demo 5. War stories 6. Project Turmvilla 7. The Book Genode Foundations General-purpose computing with VirtualBox on Genode/NOVA 2

3 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Transplantation of VirtualBox to NOVA 4. Demo 5. War stories 6. Project Turmvilla 7. The Book Genode Foundations General-purpose computing with VirtualBox on Genode/NOVA 3

4 Architecture overview config, status SVC VM process xpcom IPCD xpcom VM process xpcom xpcom VBoxManage VirtualBox Application /dev/vboxdrv /dev/vboxdrv General-purpose computing with VirtualBox on Genode/NOVA 4

5 Starting up a VM process VM process open /dev/vboxdrv kernel vboxdrv.ko General-purpose computing with VirtualBox on Genode/NOVA 5

6 VM process running root mode non-root mode VM process load VMMR0 /dev/vboxdrv kernel vboxdrv.ko VMMR0 / Hypervisor General-purpose computing with VirtualBox on Genode/NOVA 6

7 Entering the Guest OS root mode non-root mode VM process /dev/vboxdrv ioctrl VM RUN kernel Guest OS vboxdrv.ko world switch General-purpose computing with VirtualBox on Genode/NOVA 7

8 Flow of a virtualization event root mode non-root mode VM process VM RUN returns /dev/vboxdrv kernel Guest OS vboxdrv.ko yes no VMMR0? world switch General-purpose computing with VirtualBox on Genode/NOVA 8

9 Risks for desktop virtualization General-purpose computing with VirtualBox on Genode/NOVA 9

10 Risks for desktop virtualization root mode non-root mode VM process /dev/vboxdrv kernel Guest OS vboxdrv.ko highly complex VMMR0 / Hypervisor General-purpose computing with VirtualBox on Genode/NOVA 9

11 Risks for desktop virtualization root mode non-root mode VM process /dev/vboxdrv access control? kernel Guest OS vboxdrv.ko highly complex VMMR0 / Hypervisor General-purpose computing with VirtualBox on Genode/NOVA 10

12 Risks for desktop virtualization root mode authorized to change the kernel VM process non-root mode highly complex /dev/vboxdrv access control? kernel Guest OS vboxdrv.ko highly complex VMMR0 / Hypervisor General-purpose computing with VirtualBox on Genode/NOVA 11

13 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Transplantation of VirtualBox to NOVA 4. Demo 5. War stories 6. Project Turmvilla 7. The Book Genode Foundations General-purpose computing with VirtualBox on Genode/NOVA 12

14 NOVA architecture Guest OS Guest OS Guest OS non-root mode root mode VMM VMM VMM Apps 9,000 SLOC Resource management NOVA Microhypervisor Drivers kernel General-purpose computing with VirtualBox on Genode/NOVA 13

15 Flow of a virtualization event User-level VMM Guest OS UTCB VMCS UTCB copy NOVA world switch General-purpose computing with VirtualBox on Genode/NOVA 14

16 Genode OS architecture Application-specific TCB General-purpose computing with VirtualBox on Genode/NOVA 15

17 Genode OS framework General-purpose computing with VirtualBox on Genode/NOVA 16

18 Genode combined with virtualization General-purpose computing with VirtualBox on Genode/NOVA 17

19 Seoul VMM on top of Genode/NOVA Unmodified Guest OS Kernel virtual CPU virtual RAM VMM virtual device Resource Multiplexer Device Driver Init Core User Mode NOVA Hypervisor Privileged Mode General-purpose computing with VirtualBox on Genode/NOVA 18

20 Idea Device models and features of VirtualBox + Security of the Genode/NOVA architecture General-purpose computing with VirtualBox on Genode/NOVA 19

21 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Transplantation of VirtualBox to NOVA 4. Demo 5. War stories 6. Project Turmvilla 7. The Book Genode Foundations General-purpose computing with VirtualBox on Genode/NOVA 20

22 Identify the interesting parts Entire VirtualBox code base > 4 million lines of code (sloccount) Narrowed to the interesting parts > 2 million lines of code src/vbox/vmm src/vbox/main src/vbox/runtime src/vbox/devices src/vbox/storage src/vbox/guesthost src/vbox/disassembler src/vbox/hostservices src/recompiler src/libs/liblzf-3.4 src/libs/liblzf-3.4/cs src/libs/libxml src/libs/zlib include/vbox include/iprt General-purpose computing with VirtualBox on Genode/NOVA 21

23 Porting the VirtualBox Runtime to Genode Facilitate Genode s existing infrastructure 3rd-party software management tools FreeBSD libc Standard C++ library POSIX threads General-purpose computing with VirtualBox on Genode/NOVA 22

24 Porting the VirtualBox Runtime to Genode Facilitate Genode s existing infrastructure 3rd-party software management tools FreeBSD libc Standard C++ library POSIX threads Most parts of the POSIX runtime could be reused General-purpose computing with VirtualBox on Genode/NOVA 22

25 VM process initialization Enable subsystems one by one General-purpose computing with VirtualBox on Genode/NOVA 23

26 VM process initialization Enable subsystems one by one Guest memory (accessed by recompiler and device models) RAM, MMIO General-purpose computing with VirtualBox on Genode/NOVA 23

27 VM process initialization Enable subsystems one by one Guest memory (accessed by recompiler and device models) RAM, MMIO I/O-port handling General-purpose computing with VirtualBox on Genode/NOVA 23

28 VM process initialization Enable subsystems one by one Guest memory (accessed by recompiler and device models) RAM, MMIO I/O-port handling PGM, HWACCM, TM General-purpose computing with VirtualBox on Genode/NOVA 23

29 VM process initialization Enable subsystems one by one Guest memory (accessed by recompiler and device models) RAM, MMIO I/O-port handling PGM, HWACCM, TM Device models, PDM, BIOS General-purpose computing with VirtualBox on Genode/NOVA 23

30 VM process initialization Enable subsystems one by one Guest memory (accessed by recompiler and device models) RAM, MMIO I/O-port handling PGM, HWACCM, TM Device models, PDM, BIOS Host drivers Using the Basic front end Reimplement SDLConsole interface General-purpose computing with VirtualBox on Genode/NOVA 23

31 A look inside a VM process Recompiler Execution Manager Hardware Acceleration Instruction Emulator VM Exit VM Enter General-purpose computing with VirtualBox on Genode/NOVA 24

32 Start with executing the recompiler only Recompiler Execution Manager Hardware Acceleration Instruction Emulator General-purpose computing with VirtualBox on Genode/NOVA 25

33 Simple test scenario FB SDL Framebuffer Input VirtualBox Init ISO image Core ROM Linux kernel General-purpose computing with VirtualBox on Genode/NOVA 26

34 Increasing guest complexity 1. Custom-made Genode OS scenarios General-purpose computing with VirtualBox on Genode/NOVA 27

35 Increasing guest complexity 1. Custom-made Genode OS scenarios 2. Small Linux-based images (Tinycore, GRML) General-purpose computing with VirtualBox on Genode/NOVA 27

36 Increasing guest complexity 1. Custom-made Genode OS scenarios 2. Small Linux-based images (Tinycore, GRML) 3. Windows XP General-purpose computing with VirtualBox on Genode/NOVA 27

37 Windows XP as a guest FB SDL Framebuffer Input VirtualBox VDI image LX Proxy FS File system Init Core Linux kernel General-purpose computing with VirtualBox on Genode/NOVA 28

38 Move scenario to NOVA General-purpose computing with VirtualBox on Genode/NOVA 29

39 Move scenario to NOVA PS/2 driver Input VESA driver Framebuffer VirtualBox Rump FS File system AHCI driver Block VDI image Init Core NOVA kernel General-purpose computing with VirtualBox on Genode/NOVA 29

40 Entering non-root mode Recompiler Execution Manager Hardware Acceleration IRQs Instruction Emulator VM Exit VM Enter General-purpose computing with VirtualBox on Genode/NOVA 30

41 Entering non-root mode VBox VM state NOVA UTCB state General-purpose computing with VirtualBox on Genode/NOVA 31

42 Entering non-root mode VBox VM state NOVA UTCB state Virtualization of guest memory (EPT faults) General-purpose computing with VirtualBox on Genode/NOVA 31

43 Entering non-root mode VBox VM state NOVA UTCB state Virtualization of guest memory (EPT faults) Enter VT-x conservatively (if protected mode and paging enabled) General-purpose computing with VirtualBox on Genode/NOVA 31

44 Entering non-root mode VBox VM state NOVA UTCB state Virtualization of guest memory (EPT faults) Enter VT-x conservatively (if protected mode and paging enabled) Inject IRQs into recompiler General-purpose computing with VirtualBox on Genode/NOVA 31

45 Entering non-root mode VBox VM state NOVA UTCB state Virtualization of guest memory (EPT faults) Enter VT-x conservatively (if protected mode and paging enabled) Inject IRQs into recompiler Later: IRQ injection via NOVA into VT-X General-purpose computing with VirtualBox on Genode/NOVA 31

46 Adding features Additional drivers Networking Guest tools Shared folders Host clock Mouse-pointer synchronization General-purpose computing with VirtualBox on Genode/NOVA 32

47 Update to VirtualBox 4.3 Basic front end no longer supported Use of main front end code to NOVA port Custom console implementation Shortcut XPCOM middleware Support for using.vbox files General-purpose computing with VirtualBox on Genode/NOVA 33

48 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Transplantation of VirtualBox to NOVA 4. Demo 5. War stories 6. Project Turmvilla 7. The Book Genode Foundations General-purpose computing with VirtualBox on Genode/NOVA 34

49 Demo Windows 7 running in VirtualBox directly on top of NOVA General-purpose computing with VirtualBox on Genode/NOVA 35

50 Adaptation of VirtualBox to Genode/NOVA Ported code 400,000 lines of code (sloccount) New code 6,200 lines (sloccount) hm, iommio, ioport, mm, pdm, pgm, sup Modifications of the original code 510 lines added 120 lines removed General-purpose computing with VirtualBox on Genode/NOVA 36

51 Current state and outlook Usable performance, optimization ongoing General-purpose computing with VirtualBox on Genode/NOVA 37

52 Current state and outlook Usable performance, optimization ongoing Focused on VT-X, SVM not regularly tested General-purpose computing with VirtualBox on Genode/NOVA 37

53 Current state and outlook Usable performance, optimization ongoing Focused on VT-X, SVM not regularly tested Reduces TCB complexity to two orders of magnitude General-purpose computing with VirtualBox on Genode/NOVA 37

54 Current state and outlook Usable performance, optimization ongoing Focused on VT-X, SVM not regularly tested Reduces TCB complexity to two orders of magnitude Useful for building appliances in high-security computing General-purpose computing with VirtualBox on Genode/NOVA 37

55 Current state and outlook Usable performance, optimization ongoing Focused on VT-X, SVM not regularly tested Reduces TCB complexity to two orders of magnitude Useful for building appliances in high-security computing Stepping stone for using Genode as a general-purpose OS General-purpose computing with VirtualBox on Genode/NOVA 37

56 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Transplantation of VirtualBox to NOVA 4. Demo 5. War stories 6. Project Turmvilla 7. The Book Genode Foundations General-purpose computing with VirtualBox on Genode/NOVA 38

57 War stories General-purpose computing with VirtualBox on Genode/NOVA 39

58 War stories Invalid guest state General-purpose computing with VirtualBox on Genode/NOVA 39

59 War stories Invalid guest state TLB consistency General-purpose computing with VirtualBox on Genode/NOVA 39

60 War stories Invalid guest state TLB consistency Interrupt handling General-purpose computing with VirtualBox on Genode/NOVA 39

61 War stories Invalid guest state TLB consistency Interrupt handling Large files in shared folders General-purpose computing with VirtualBox on Genode/NOVA 39

62 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Transplantation of VirtualBox to NOVA 4. Demo 5. War stories 6. Project Turmvilla 7. The Book Genode Foundations General-purpose computing with VirtualBox on Genode/NOVA 40

63 Project Turmvilla Use of Genode as our day-to-day OS General-purpose computing with VirtualBox on Genode/NOVA 41

64 Project Turmvilla Use of Genode as our day-to-day OS VirtualBox as migration path General-purpose computing with VirtualBox on Genode/NOVA 41

65 Project Turmvilla Use of Genode as our day-to-day OS VirtualBox as migration path Reference platform: Lenovo Thinkpad x201 General-purpose computing with VirtualBox on Genode/NOVA 41

66 Turmvilla functional requirements Wireless networking General-purpose computing with VirtualBox on Genode/NOVA 42

67 Turmvilla functional requirements Wireless networking Storage (SATA drivers + file system) General-purpose computing with VirtualBox on Genode/NOVA 42

68 Turmvilla functional requirements Wireless networking Storage (SATA drivers + file system) Graphics (driver + GUI stack) General-purpose computing with VirtualBox on Genode/NOVA 42

69 Turmvilla functional requirements Wireless networking Storage (SATA drivers + file system) Graphics (driver + GUI stack) User input (PS/2 and USB HID) General-purpose computing with VirtualBox on Genode/NOVA 42

70 Turmvilla functional requirements Wireless networking Storage (SATA drivers + file system) Graphics (driver + GUI stack) User input (PS/2 and USB HID) Integration of guest OS and Genode General-purpose computing with VirtualBox on Genode/NOVA 42

71 Turmvilla functional requirements Wireless networking Storage (SATA drivers + file system) Graphics (driver + GUI stack) User input (PS/2 and USB HID) Integration of guest OS and Genode A fallback! General-purpose computing with VirtualBox on Genode/NOVA 42

72 Turmvilla dual-boot setup Partitions of physical disk genode ext2 /boot /genode linux.vdi Virtual-machine disks Rich GNU/Linux ext3 home (LUKS encrypted) ext4 home (LUKS encrypted) ext4 boot / rescue ext4 4GiB - GRUB - GNU/Linux - X11 - VirtualBox - mount home - mount genode General-purpose computing with VirtualBox on Genode/NOVA 43

73 Turmvilla Genode scenario timer acpi drv acpi report rom platform drv ahci drv part blk log file terminal log rump fs wifi drv ps2 drv usb drv fb drv rtc drv trace subject reporter input merger report rom nitpicker wm report rom wm layouter decorator vbox pointer shared fs config fs config rom rom cli nit fb cli terminal Nitpicker GUI Window Manager Init VirtualBox CLI monitor Noux General-purpose computing with VirtualBox on Genode/NOVA 44

74 Turmvilla state and current focus Current state: My primary OS since the beginning of June Team at Genode Labs starts migration General-purpose computing with VirtualBox on Genode/NOVA 45

75 Turmvilla state and current focus Current state: My primary OS since the beginning of June Team at Genode Labs starts migration Work in progress: Tiled and tabbed window manager Intel graphics driver NOVA kernel-resource management Capability-based desktop environment General-purpose computing with VirtualBox on Genode/NOVA 45

76 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Transplantation of VirtualBox to NOVA 4. Demo 5. War stories 6. Project Turmvilla 7. The Book Genode Foundations General-purpose computing with VirtualBox on Genode/NOVA 46

77 The Book Genode Foundations GENODE Operating System Framework Foundations Norman Feske General-purpose computing with VirtualBox on Genode/NOVA 47

78 Thank you Genode OS Framework Genode Labs GmbH Source code at GitHub General-purpose computing with VirtualBox on Genode/NOVA 48

Transplantation of VirtualBox to the NOVA microhypervisor. Norman Feske

Transplantation of VirtualBox to the NOVA microhypervisor Norman Feske Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Steps 4. Demo + Outlook 5. War stories