Transplantation of VirtualBox to the NOVA microhypervisor. Norman Feske

Size: px

Start display at page:

Download "Transplantation of VirtualBox to the NOVA microhypervisor. Norman Feske"

Charleen Thompson
5 years ago
Views:

1 Transplantation of VirtualBox to the NOVA microhypervisor Norman Feske

2 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Steps 4. Demo + Outlook 5. War stories Transplantation of VirtualBox to the NOVA microhypervisor 2

3 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Steps 4. Demo + Outlook 5. War stories Transplantation of VirtualBox to the NOVA microhypervisor 3

4 Architecture overview config, status SVC VM process xpcom IPCD xpcom VM process xpcom xpcom VBoxManage VirtualBox Application /dev/vboxdrv /dev/vboxdrv Transplantation of VirtualBox to the NOVA microhypervisor 4

5 Starting up a VM process VM process open /dev/vboxdrv kernel vboxdrv.ko Transplantation of VirtualBox to the NOVA microhypervisor 5

6 VM process running root mode non-root mode VM process load VMMR0 /dev/vboxdrv kernel vboxdrv.ko VMMR0 / Hypervisor Transplantation of VirtualBox to the NOVA microhypervisor 6

7 Entering the Guest OS root mode non-root mode VM process /dev/vboxdrv ioctrl VM RUN kernel Guest OS vboxdrv.ko world switch Transplantation of VirtualBox to the NOVA microhypervisor 7

8 Flow of a virtualization event root mode non-root mode VM process VM RUN returns /dev/vboxdrv kernel Guest OS vboxdrv.ko yes no VMMR0? world switch Transplantation of VirtualBox to the NOVA microhypervisor 8

9 Risks for desktop virtualization root mode non-root mode VM process /dev/vboxdrv kernel Guest OS vboxdrv.ko highly complex VMMR0 / Hypervisor Transplantation of VirtualBox to the NOVA microhypervisor 9

10 Risks for desktop virtualization root mode non-root mode VM process /dev/vboxdrv access control? kernel Guest OS vboxdrv.ko highly complex VMMR0 / Hypervisor Transplantation of VirtualBox to the NOVA microhypervisor 10

11 Risks for desktop virtualization root mode authorized to change the kernel VM process non-root mode highly complex /dev/vboxdrv access control? kernel Guest OS vboxdrv.ko highly complex VMMR0 / Hypervisor Transplantation of VirtualBox to the NOVA microhypervisor 11

12 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Steps 4. Demo + Outlook 5. War stories Transplantation of VirtualBox to the NOVA microhypervisor 12

13 NOVA architecture Guest OS Guest OS Guest OS non-root mode root mode VMM VMM VMM Apps 9,000 SLOC Resource management NOVA Microhypervisor Drivers kernel Transplantation of VirtualBox to the NOVA microhypervisor 13

14 Flow of a virtualization event User-level VMM Guest OS UTCB VMCS UTCB copy NOVA world switch Transplantation of VirtualBox to the NOVA microhypervisor 14

15 Genode OS architecture Application-specific TCB Transplantation of VirtualBox to the NOVA microhypervisor 15

16 Genode OS framework Transplantation of VirtualBox to the NOVA microhypervisor 16

17 Genode combined with virtualization Transplantation of VirtualBox to the NOVA microhypervisor 17

18 Seoul VMM on top of Genode/NOVA Unmodified Guest OS Kernel virtual CPU virtual RAM VMM virtual device Resource Multiplexer Device Driver Init Core User Mode NOVA Hypervisor Privileged Mode Transplantation of VirtualBox to the NOVA microhypervisor 18

19 Idea Device models and features of VirtualBox + Security of the Genode/NOVA architecture Transplantation of VirtualBox to the NOVA microhypervisor 19

20 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Steps 4. Demo + Outlook 5. War stories Transplantation of VirtualBox to the NOVA microhypervisor 20

21 Identify the interesting parts Entire VirtualBox code base > 4 million lines of code (sloccount) Narrowed to the interesting parts > 2 million lines of code src/vbox/vmm src/vbox/main src/vbox/runtime src/vbox/devices src/vbox/storage src/vbox/guesthost src/vbox/disassembler src/vbox/hostservices src/recompiler src/libs/liblzf-3.4 src/libs/liblzf-3.4/cs src/libs/libxml src/libs/zlib include/vbox include/iprt Transplantation of VirtualBox to the NOVA microhypervisor 21

22 Porting the VirtualBox Runtime to Genode Facilitate Genode s existing infrastructure 3rd-party software management tools FreeBSD libc Standard C++ library POSIX threads Most parts of the POSIX runtime could be reused Transplantation of VirtualBox to the NOVA microhypervisor 22

23 VM process initialization Enable subsystems one by one Guest memory (accessed by recompiler and device models) RAM, MMIO I/O-port handling PGM, HWACCM, TM Device models, PDM, BIOS Host drivers Using the Basic front end Reimplement SDLConsole interface Transplantation of VirtualBox to the NOVA microhypervisor 23

24 A look inside a VM process Recompiler Execution Manager Hardware Acceleration Instruction Emulator VM Exit VM Enter Transplantation of VirtualBox to the NOVA microhypervisor 24

25 Start with executing the recompiler only Recompiler Execution Manager Hardware Acceleration Instruction Emulator Transplantation of VirtualBox to the NOVA microhypervisor 25

26 Simple test scenario FB SDL Framebuffer Input VirtualBox Init ISO image Core ROM Linux kernel Transplantation of VirtualBox to the NOVA microhypervisor 26

27 Increasing guest complexity 1. Custom-made Genode OS scenarios 2. Small Linux-based images (Tinycore, GRML) 3. Windows XP Transplantation of VirtualBox to the NOVA microhypervisor 27

28 Windows XP as a guest FB SDL Framebuffer Input VirtualBox VDI image LX Proxy FS File system Init Core Linux kernel Transplantation of VirtualBox to the NOVA microhypervisor 28

29 Move scenario to NOVA PS/2 driver Input VESA driver Framebuffer VirtualBox Rump FS File system AHCI driver Block VDI image Init Core NOVA kernel Transplantation of VirtualBox to the NOVA microhypervisor 29

30 Entering non-root mode Recompiler Execution Manager Hardware Acceleration IRQs Instruction Emulator VM Exit VM Enter Transplantation of VirtualBox to the NOVA microhypervisor 30

31 Entering non-root mode VBox VM state NOVA UTCB state Virtualization of guest memory (EPT faults) Enter VT-x conservatively (if protected mode and paging enabled) Inject IRQs into recompiler Later: IRQ injection via NOVA into VT-X Transplantation of VirtualBox to the NOVA microhypervisor 31

32 Adding features Additional drivers Networking Guest tools Shared folders Host clock Mouse-pointer synchronization Transplantation of VirtualBox to the NOVA microhypervisor 32

33 Update to VirtualBox 4.3 Basic front end no longer supported Use of main front end code to NOVA port Custom console implementation Shortcut XPCOM middleware Support for using.vbox files Transplantation of VirtualBox to the NOVA microhypervisor 33

34 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Steps 4. Demo + Outlook 5. War stories Transplantation of VirtualBox to the NOVA microhypervisor 34

35 Demo Windows 7 running in VirtualBox directly on top of NOVA Transplantation of VirtualBox to the NOVA microhypervisor 35

36 Adaptation of VirtualBox to Genode/NOVA Ported code 400,000 lines of code (sloccount) New code 6,200 lines (sloccount) hm, iommio, ioport, mm, pdm, pgm, sup Modifications of the original code 510 lines added 120 lines removed Transplantation of VirtualBox to the NOVA microhypervisor 36

37 Current state and outlook Usable performance, optimization ongoing Focused on VT-X, SVM not regularly tested Reduces TCB complexity to two orders of magnitude Useful for building appliances in high-security computing Stepping stone for using Genode as a general-purpose OS Transplantation of VirtualBox to the NOVA microhypervisor 37

38 Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Steps 4. Demo + Outlook 5. War stories Transplantation of VirtualBox to the NOVA microhypervisor 38

39 War stories Invalid guest state TLB consistency Interrupt handling Large files in shared folders Transplantation of VirtualBox to the NOVA microhypervisor 39

40 Thank you Genode OS Framework Genode Labs GmbH Source code at GitHub Transplantation of VirtualBox to the NOVA microhypervisor 40

General-purpose computing with VirtualBox on Genode/NOVA. Norman Feske

General-purpose computing with VirtualBox on Genode/NOVA Norman Feske Outline 1. VirtualBox 2. NOVA microhypervisor and Genode 3. Transplantation of VirtualBox to NOVA 4.