Testing System Virtual Machines
|
|
|
- Aron Quinn
- 6 years ago
- Views:
Transcription
1 Testing System Virtual Machines Lorenzo Martignoni 1 Roberto Paleari 2 Giampaolo Fresi Roglia 2 Danilo Bruschi 2 1 Università degli Studi di Udine 2 Università degli Studi di Milano International Conference on Software Testing and Analysis (ISSTA 2010)
2 Virtual machines An efficient, isolated duplicate of a real machine Popek & Goldberg L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 2
3 System virtual machines L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 3
4 System virtual machines A system virtual machine provides a complete system platform which supports the execution of a complete operating system Typically used for: Resources consolidation (e.g., VPS) System integration Development Performance is essential! L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 3
5 Emulation and native execution Emulation: the environment offered by the physical CPU is simulated by emulating all the instructions Native execution: the environment is simulated by executing as much code as possible directly as-is on the host and by using emulation when that is not possible The trick used to natively run guest code efficiently is to execute both user and system code of the guest on the host, in user-mode Emulation is then used to execute only instructions of the system code that cannot be executed natively on the host L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 4
6 Popek & Goldberg requirements for efficient virtualization Privileged instruction: an instruction that traps when executed in user-mode and does not when executed in system-mode Sensitive instruction: an instruction that changes the configuration of the resources in the system or whose behavior depends on the configuration of the resources Recall that the trick used by native execution is to execute both user and system code of the guest on the host, in user-mode L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 5
7 Popek & Goldberg requirements for efficient virtualization Privileged instruction: an instruction that traps when executed in user-mode and does not when executed in system-mode Sensitive instruction: an instruction that changes the configuration of the resources in the system or whose behavior depends on the configuration of the resources Privileged instructions Sensitive instructions All instructions All sensitive instructions trap and can be easily intercepted and emulated L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 5
8 Popek & Goldberg requirements for efficient virtualization Privileged instruction: an instruction that traps when executed in user-mode and does not when executed in system-mode Sensitive instruction: an instruction that changes the configuration of the resources in the system or whose behavior depends on the configuration of the resources Privileged instructions Sensitive instructions All instructions The code must be statically analyzed and patched to ensure that all sensitive instructions can be intercepted L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 5
9 Intel x86 is not virtualization friendly The Intel x86 instruction set of the Pentium processor contains 17 sensitive, but not privileged instructions! L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 6
10 Intel x86 is not virtualization friendly The Intel x86 instruction set of the Pentium processor contains 17 sensitive, but not privileged instructions! An Intel x86 VM based on native execution is as complex as one based on emulation, and prone to the same kind of problems L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 6
11 Intel x86 is not virtualization friendly The Intel x86 instruction set of the Pentium processor contains 17 sensitive, but not privileged instructions! An Intel x86 VM based on native execution is as complex as one based on emulation, and prone to the same kind of problems New Intel x86 CPUs provide hardware facilities for virtualization (VT-x), but traditional native execution is still widely in use L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 6
12 What could go wrong if? No kidding, the risk is real! L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 7
13 What could go wrong if? CVE VMware Workstation 6.5.x..., when Virtual-8086 mode is used, do not properly set the exception code upon a page fault (aka #PF) exception, which allows guest OS users to gain privileges on the guest OS by specifying a crafted value for the cs register. Found by Tavis Ormandy & Julien Tinnes CVE The Virtual Machine Monitor (VMM) in Microsoft Virtual PC..., does not enforce CPU privilege-level requirements for all machine instructions, which allows guest OS users to execute arbitrary kernel-mode code and gain privileges within the guest OS via a crafted application,... Found by Tavis Ormandy & Julien Tinnes L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 8
14 Our contribution A testing methodology to test system virtual machines: does the virtual machine behave exactly as the physical one?? = L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 9
15 Our contribution A testing methodology to test system virtual machines: does the virtual machine behave exactly as the physical one?? = Used to test four system virtual machines: BOCHS, QEMU, VMware, VirtualBox L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 9
16 EmuFuzzer vs KEmuFuzzer EmuFuzzer (ISSTA 09) Testing is performed by comparing the behavior of the CPU of the VM with the behavior of the physical CPU KEmuFuzzer Testing is performed using the same principle, but the methodology is completely different L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 10
17 EmuFuzzer vs KEmuFuzzer EmuFuzzer (ISSTA 09) Testing is performed by comparing the behavior of the CPU of the VM with the behavior of the physical CPU Can test only user-mode code KEmuFuzzer Testing is performed using the same principle, but the methodology is completely different Can test both user-mode and system-mode code L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 10
18 EmuFuzzer vs KEmuFuzzer EmuFuzzer (ISSTA 09) Testing is performed by comparing the behavior of the CPU of the VM with the behavior of the physical CPU Can test only user-mode code Can test only process virtual machines KEmuFuzzer Testing is performed using the same principle, but the methodology is completely different Can test both user-mode and system-mode code Can test system virtual machines L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 10
19 EmuFuzzer vs KEmuFuzzer EmuFuzzer (ISSTA 09) Testing is performed by comparing the behavior of the CPU of the VM with the behavior of the physical CPU Can test only user-mode code Can test only process virtual machines KEmuFuzzer Testing is performed using the same principle, but the methodology is completely different Can test both user-mode and system-mode code Can test system virtual machines The problem is much more challenging! L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 10
20 Modelling the behavior of the CPU We can imagine the CPU as an abstract machine A state s = (pc, R, M, E) of the abstract machine consists of: pc state of the program counter R state of the CPU/FPU registers M state of the (physical) memory E exception state (e.g.,, PF, GPF, UD) L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 11
21 Modelling the behavior of the CPU To execute an instruction means to transition into a new state s = (pc, R, M, E) L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 12
22 Modelling the behavior of the CPU To execute an instruction means to transition into a new state s = (pc, R, M, E) s = (pc, R, M, ) the instruction is successfully executed pc points to the next instruction, R and M are updated according to the semantics of the instruction executed L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 12
23 Modelling the behavior of the CPU To execute an instruction means to transition into a new state s = (pc, R, M, E) s = (pc, R, M, ) the instruction is successfully executed an exception occurred s = (pc, R, M, E ) E denotes the exception occurred, pc, R, and M are not updated since the execution of the instruction is atomic L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 12
24 Transparency to guests? = The guest (OS and applications) must not be able to distinguish between a physical and a virtual machine L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 13
25 Transparency to guests? = The guest (OS and applications) must not be able to distinguish between a physical and a virtual machine Lack of transparency is highly related to the existence of bugs L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 13
26 Transparency to guests s = (pc, R, M, ) L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 13
27 Transparency to guests s = (pc, R, M, ) s = (pc, R, M, E ) s = (pc, R, M, E ) =? L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 13
28 Transparency to guests s = (pc, R, M, ) s = (pc, R, M, E ) s = (pc, R, M, E ) = The VM is transparent to the guest, for the state s, if the state resulting from the execution in the two environments match L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 13
29 Transparency to guests s = (pc, R, M, ) s = (pc, R, M, E ) s = (pc, R, M, E ) The VM is not transparent to the guest, for the state s, if the state resulting from the execution in the two environments differ L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 13
30 Challenges in testing system virtual machines Our definition of transparency assumes that the execution is deterministic: Render the execution as such The state space is enormous: Focus efforts on states that requires emulation Testing of privileged instruction require to execute code in system-mode: Guarantee that we can always regain the control of the execution L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 14
31 Architecture of KEmuFuzzer Test-case s Oracle s Bootable floppy Virtual machine s? = Kernel L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 15
32 Architecture of KEmuFuzzer Test-case s Oracle s Bootable floppy Virtual machine s? = Kernel High-level test-case template A custom compiler mutates and compiles the template L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 15
33 Architecture of KEmuFuzzer Test-case s Oracle s Bootable floppy Virtual machine s? = Kernel Custom kernel used to bootstrap the virtual machine and to executed the test-case L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 15
34 Architecture of KEmuFuzzer Test-case s Oracle s Bootable floppy Virtual machine s? = Kernel Bootable floppy image to boot the kernel in a virtual or physical machine L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 15
35 Architecture of KEmuFuzzer Test-case s Oracle s Bootable floppy Virtual machine s? = Kernel Off-the-shelf VM extended to dump to disk the state of the CPU when a command is received on a specific I/O port L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 15
36 Architecture of KEmuFuzzer Test-case s Oracle s Bootable floppy Virtual machine s? = Kernel Oracle based on a hardware assisted VM (initial state is forced manually) L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 15
37 Architecture of KEmuFuzzer Test-case s Oracle s Bootable floppy Virtual machine s? = Kernel Off-line diffing utility used to compare output states L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 15
38 Mutating test-cases (protocol specific fuzzing) Test-cases contain operations that are believed to be significant for the testing (e.g., that trigger corner-case situations) Symbolic operators (KEF ) allows to generate multiple significant test-cases from the same input L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 16
39 Mutating test-cases (protocol specific fuzzing) Test-cases contain operations that are believed to be significant for the testing (e.g., that trigger corner-case situations) Symbolic operators (KEF ) allows to generate multiple significant test-cases from the same input <testcase start_ring="0"> <ring0> // Register syscall handler... // Jump to ring3 code KEF_JUMP_RING(3); </ring0> <ring3> // Invoke syscall mov $0x25, %eax; KEF_PREFIX sysenter; </ring3> </testcase> <testcase start_ring="0"> <ring0> // Load flat data segment... // Calculate PTE address movl KEF_RING_BASE(3), %eax;...do some math on %eax... addl KEF_PT_BASE, %eax; // Flip some bits in the PTE movl (%eax), %ebx; btc KEF_INTEGER(5), %ebx; movl %ebx, (%eax);... // Jump to ring3 code KEF_JUMP_RING(3); </ring0> <ring3> movb $0x0, 0x0; </ring3> </testcase> L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 16
40 VT-x based oracle Modern x86 CPUs (with VT-x extensions) have built-in support for virtualization L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 17
41 VT-x based oracle Modern x86 CPUs (with VT-x extensions) have built-in support for virtualization Specific assumptions about our peculiar guest allow to develop a minimalistic VT-x based VM that can be used as a oracle L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 17
42 VT-x based oracle User-mode System-mode VM controller GNU/Linux /dev/kvm Oracle VM Test-case Kernel Ring 3 Ring 2 Ring 1 Ring 0 Minimalistic KVM-based VM Non-root mode Root mode L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 17
43 VT-x based oracle User-mode System-mode VM controller GNU/Linux /dev/kvm Oracle VM Test-case Kernel Ring 3 Ring 2 Ring 1 Ring 0 Minimalistic KVM-based VM Non-root mode Root mode Test-case executed as-in in a VM L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 17
44 VT-x based oracle User-mode System-mode VM controller GNU/Linux /dev/kvm Oracle VM Test-case Kernel Ring 3 Ring 2 Ring 1 Ring 0 Minimalistic KVM-based VM Non-root mode Root mode Hardware assisted VM monitor executes in root-mode L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 17
45 VT-x based oracle User-mode System-mode VM controller GNU/Linux /dev/kvm Oracle VM Test-case Kernel Ring 3 Ring 2 Ring 1 Ring 0 Minimalistic KVM-based VM Non-root mode Root mode The user-space controller interacts with the VM monitor to launch the VM and to dump the final state L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 17
46 Experimental evaluation Tested VMs VirtualBox OSE (3.0.8) VMware Workstation (7.0) QEMU (0.11.0) BOCHS (7 nov 2009) Oracle Intel Core2 Duo (3.00GHz) Operating mode 32-bit protected mode L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 18
47 Experimental evaluation Tested VMs VirtualBox OSE (3.0.8) VMware Workstation (7.0) QEMU (0.11.0) BOCHS (7 nov 2009) Oracle Intel Core2 Duo (3.00GHz) Operating mode 32-bit protected mode Test-cases Generated 1915 test-cases from 67 manually written templates Correct instruction decoding and privileges enforcement Behavior of the CPU with abnormal MMU configurations Attempt to execute random code Some of the test-cases used with EmuFuzzer L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 18
48 Templates and test-cases producing differences Templates Test-cases BOCHS QEMU VirtualBox VMware L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 19
49 Templates and test-cases producing differences Templates Test-cases BOCHS QEMU VirtualBox VMware sysenter corrupts the state of a segment, GDT entries are not properly updated L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 19
50 Templates and test-cases producing differences Templates Test-cases BOCHS QEMU VirtualBox VMware Crashes when certain hw breakpoints, raises wrong exceptions, accepts illegal instructions,... L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 19
51 Templates and test-cases producing differences Templates Test-cases BOCHS QEMU VirtualBox VMware Unable to run in native execution mode with KEmuFuzzer s kernel, manifests most of the issues found in QEMU L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 19
52 Templates and test-cases producing differences Templates Test-cases BOCHS QEMU VirtualBox VMware retn instruction might corrupt the stack, GDT entries are not properly updated L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 19
53 CVE Latest version of the kernel supports VM86 tasks/segments L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 20
54 CVE Latest version of the kernel supports VM86 tasks/segments KEmuFuzzer identified the problem in VMware L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 20
55 CVE Latest version of the kernel supports VM86 tasks/segments KEmuFuzzer identified the problem in VMware KEmuFuzzer identified the problem in QEMU as well L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 20
56 CVE Latest version of the kernel supports VM86 tasks/segments KEmuFuzzer identified the problem in VMware KEmuFuzzer identified the problem in QEMU as well We are getting ready for large scale testing of VM86 mode :-) L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 20
57 In summary L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 21
58 In summary L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 21
59 In summary L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 21
60 In summary L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 21
61 In summary L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 21
62 Testing system virtual machines Test-case s Oracle s s? = Bootable floppy Virtual machine Kernel Thank you! Any questions? Lorenzo Martignoni lorenzo.martignoni@uniud.it L. Martignoni, R. Paleari, G. Fresi Roglia, D. Bruschi Testing System Virtual Machines 22
Virtualization. Operating Systems, 2016, Meni Adler, Danny Hendler & Amnon Meisels
Virtualization Operating Systems, 2016, Meni Adler, Danny Hendler & Amnon Meisels 1 What is virtualization? Creating a virtual version of something o Hardware, operating system, application, network, memory,
The Challenges of X86 Hardware Virtualization. GCC- Virtualization: Rajeev Wankar 36
The Challenges of X86 Hardware Virtualization GCC- Virtualization: Rajeev Wankar 36 The Challenges of X86 Hardware Virtualization X86 operating systems are designed to run directly on the bare-metal hardware,
Spring 2017 :: CSE 506. Introduction to. Virtual Machines. Nima Honarmand
Introduction to Virtual Machines Nima Honarmand Virtual Machines & Hypervisors Virtual Machine: an abstraction of a complete compute environment through the combined virtualization of the processor, memory,
Distributed Systems COMP 212. Lecture 18 Othon Michail
Distributed Systems COMP 212 Lecture 18 Othon Michail Virtualisation & Cloud Computing 2/27 Protection rings It s all about protection rings in modern processors Hardware mechanism to protect data and
A Survey on Virtualization Technologies
A Survey on Virtualization Technologies Virtualization is HOT Microsoft acquires Connectix Corp. EMC acquires VMware Veritas acquires Ejascent IBM, already a pioneer Sun working hard on it HP picking up
Virtualization. Adam Belay
Virtualization Adam Belay What is a virtual machine Simulation of a computer Running as an application on a host computer Accurate Isolated Fast Why use a virtual machine? To run multiple
Virtualization. Pradipta De
Virtualization Pradipta De pradipta.de@sunykorea.ac.kr Today s Topic Virtualization Basics System Virtualization Techniques CSE506: Ext Filesystem 2 Virtualization? A virtual machine (VM) is an emulation
Module 1: Virtualization. Types of Interfaces
Module 1: Virtualization Virtualization: extend or replace an existing interface to mimic the behavior of another system. Introduced in 1970s: run legacy software on newer mainframe hardware Handle platform
24-vm.txt Mon Nov 21 22:13: Notes on Virtual Machines , Fall 2011 Carnegie Mellon University Randal E. Bryant.
24-vm.txt Mon Nov 21 22:13:36 2011 1 Notes on Virtual Machines 15-440, Fall 2011 Carnegie Mellon University Randal E. Bryant References: Tannenbaum, 3.2 Barham, et al., "Xen and the art of virtualization,"
W4118: virtual machines
W4118: virtual machines Instructor: Junfeng Yang References: Modern Operating Systems (3 rd edition), Operating Systems Concepts (8 th edition), previous W4118, and OS at MIT, Stanford, and UWisc Virtual
references Virtualization services Topics Virtualization
references Virtualization services Virtual machines Intel Virtualization technology IEEE xplorer, May 2005 Comparison of software and hardware techniques for x86 virtualization ASPLOS 2006 Memory resource
MultiNyx: A Multi-Level Abstraction Framework for Systematic Analysis of Hypervisors. Pedro Fonseca, Xi Wang, Arvind Krishnamurthy
MultiNyx: A Multi-Level Abstraction Framework for Systematic Analysis of Hypervisors Pedro Fonseca, Xi Wang, Arvind Krishnamurthy Hypervisor correctness is critical Hypervisors need to virtualize correctly
Intel s Virtualization Extensions (VT-x) So you want to build a hypervisor?
Intel s Virtualization Extensions (VT-x) So you want to build a hypervisor? Mr. Jacob Torrey May 13, 2014 Dartmouth College 153 Brooks Road, Rome, NY 315.336.3306 http://ainfosec.com @JacobTorrey torreyj@ainfosec.com
Virtual Machines. To do. q VM over time q Implementation methods q Hardware features supporting VM q Next time: Midterm?
Virtual Machines To do q VM over time q Implementation methods q Hardware features supporting VM q Next time: Midterm? *Partially based on notes from C. Waldspurger, VMware, 2010 and Arpaci-Dusseau s Three
Chapter 5 B. Large and Fast: Exploiting Memory Hierarchy
Chapter 5 B Large and Fast: Exploiting Memory Hierarchy Dependability 5.5 Dependable Memory Hierarchy Chapter 6 Storage and Other I/O Topics 2 Dependability Service accomplishment Service delivered as
Virtual Machines. Part 2: starting 19 years ago. Operating Systems In Depth IX 1 Copyright 2018 Thomas W. Doeppner. All rights reserved.
Virtual Machines Part 2: starting 19 years ago Operating Systems In Depth IX 1 Copyright 2018 Thomas W. Doeppner. All rights reserved. Operating Systems In Depth IX 2 Copyright 2018 Thomas W. Doeppner.
Introduction to Virtual Machines. Carl Waldspurger (SB SM 89 PhD 95) VMware R&D
Introduction to Virtual Machines Carl Waldspurger (SB SM 89 PhD 95) VMware R&D Overview Virtualization and VMs Processor Virtualization Memory Virtualization I/O Virtualization Typesof Virtualization Process
Chapter 5 C. Virtual machines
Chapter 5 C Virtual machines Virtual Machines Host computer emulates guest operating system and machine resources Improved isolation of multiple guests Avoids security and reliability problems Aids sharing
Mechanisms for entering the system
Mechanisms for entering the system Yolanda Becerra Fontal Juan José Costa Prats Facultat d'informàtica de Barcelona (FIB) Universitat Politècnica de Catalunya (UPC) BarcelonaTech 2017-2018 QP Content Introduction
Hypervisor security. Evgeny Yakovlev, DEFCON NN, 2017
Hypervisor security Evgeny Yakovlev, DEFCON NN, 2017 whoami Low-level development in C and C++ on x86 UEFI, virtualization, security Jetico, Kaspersky Lab QEMU/KVM developer at Virtuozzo 2 Agenda Why hypervisor
Virtual machines are an interesting extension of the virtual-memory concept: not only do we give processes the illusion that they have all of memory
Virtual machines are an interesting extension of the virtual-memory concept: not only do we give processes the illusion that they have all of memory to themselves, but also we give them the illusion that
Virtualization. Starting Point: A Physical Machine. What is a Virtual Machine? Virtualization Properties. Types of Virtualization
Starting Point: A Physical Machine Virtualization Based on materials from: Introduction to Virtual Machines by Carl Waldspurger Understanding Intel Virtualization Technology (VT) by N. B. Sahgal and D.
Virtualization. ! Physical Hardware Processors, memory, chipset, I/O devices, etc. Resources often grossly underutilized
Starting Point: A Physical Machine Virtualization Based on materials from: Introduction to Virtual Machines by Carl Waldspurger Understanding Intel Virtualization Technology (VT) by N. B. Sahgal and D.
COS 318: Operating Systems
COS 318: Operating Systems OS Structures and System Calls Prof. Margaret Martonosi Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall11/cos318/ Outline Protection
What is KVM? KVM patch. Modern hypervisors must do many things that are already done by OSs Scheduler, Memory management, I/O stacks
LINUX-KVM The need for KVM x86 originally virtualization unfriendly No hardware provisions Instructions behave differently depending on privilege context(popf) Performance suffered on trap-and-emulate
CS5460: Operating Systems. Lecture: Virtualization. Anton Burtsev March, 2013
CS5460: Operating Systems Lecture: Virtualization Anton Burtsev March, 2013 Traditional operating system Virtual machines A bit of history Virtual machines were popular in 60s-70s Share resources of mainframe
Conqueror: tamper-proof code execution on legacy systems
Conqueror: tamper-proof code execution on legacy systems Lorenzo Martignoni 1 Roberto Paleari 2 Danilo Bruschi 2 1 Università degli Studi di Udine 2 Università degli Studi di Milano 7th Conference on Detection
CS370 Operating Systems
CS370 Operating Systems Colorado State University Yashwant K Malaiya Fall 2017 Lecture 27 Virtualization Slides based on Various sources 1 1 Virtualization Why we need virtualization? The concepts and
Lecture 5. KVM for ARM. Christoffer Dall and Jason Nieh. 5 November, Operating Systems Practical. OSP Lecture 5, KVM for ARM 1/42
Lecture 5 KVM for ARM Christoffer Dall and Jason Nieh Operating Systems Practical 5 November, 2014 OSP Lecture 5, KVM for ARM 1/42 Contents Virtualization KVM Virtualization on ARM KVM/ARM: System architecture
OS Virtualization. Why Virtualize? Introduction. Virtualization Basics 12/10/2012. Motivation. Types of Virtualization.
Virtualization Basics Motivation OS Virtualization CSC 456 Final Presentation Brandon D. Shroyer Types of Virtualization Process virtualization (Java) System virtualization (classic, hosted) Emulation
CS-580K/480K Advanced Topics in Cloud Computing. VM Virtualization II
CS-580K/480K Advanced Topics in Cloud Computing VM Virtualization II 1 How to Build a Virtual Machine? 2 How to Run a Program Compiling Source Program Loading Instruction Instruction Instruction Instruction
Virtualization. ...or how adding another layer of abstraction is changing the world. CIS 399: Unix Skills University of Pennsylvania.
Virtualization...or how adding another layer of abstraction is changing the world. CIS 399: Unix Skills University of Pennsylvania April 6, 2009 (CIS 399 Unix) Virtualization April 6, 2009 1 / 22 What
Learning Outcomes. Extended OS. Observations Operating systems provide well defined interfaces. Virtual Machines. Interface Levels
Learning Outcomes Extended OS An appreciation that the abstract interface to the system can be at different levels. Virtual machine monitors (VMMs) provide a lowlevel interface An understanding of trap
Overview of System Virtualization: The most powerful platform for program analysis and system security. Zhiqiang Lin
CS 6V81-05: System Security and Malicious Code Analysis Overview of System Virtualization: The most powerful platform for program analysis and system security Zhiqiang Lin Department of Computer Science
CS370: Operating Systems [Spring 2017] Dept. Of Computer Science, Colorado State University
![CS370: Operating Systems [Spring 2017] Dept. Of Computer Science, Colorado State University](/thumbs/89/100547178.jpg "CS370: Operating Systems [Spring 2017] Dept. Of Computer Science, Colorado State University")
Frequently asked questions from the previous class survey CS 370: OPERATING SYSTEMS [VIRTUALIZATION] Shrideep Pallickara Computer Science Colorado State University Difference between physical and logical
The Architecture of Virtual Machines Lecture for the Embedded Systems Course CSD, University of Crete (April 29, 2014)
The Architecture of Virtual Machines Lecture for the Embedded Systems Course CSD, University of Crete (April 29, 2014) ManolisMarazakis (maraz@ics.forth.gr) Institute of Computer Science (ICS) Foundation
KVM CPU MODEL IN SYSCALL EMULATION MODE ALEXANDRU DUTU, JOHN SLICE JUNE 14, 2015
KVM CPU MODEL IN SYSCALL EMULATION MODE ALEXANDRU DUTU, JOHN SLICE JUNE 14, 2015 AGENDA Background & Motivation Challenges Native Page Tables Emulating the OS Kernel 2 KVM CPU MODEL IN SYSCALL EMULATION
Lecture 7. Xen and the Art of Virtualization. Paul Braham, Boris Dragovic, Keir Fraser et al. 16 November, Advanced Operating Systems
Lecture 7 Xen and the Art of Virtualization Paul Braham, Boris Dragovic, Keir Fraser et al. Advanced Operating Systems 16 November, 2011 SOA/OS Lecture 7, Xen 1/38 Contents Virtualization Xen Memory CPU
CSE543 - Computer and Network Security Module: Virtualization
CSE543 - Computer and Network Security Module: Virtualization Professor Trent Jaeger CSE543 - Introduction to Computer and Network Security 1 1 Operating System Quandary Q: What is the primary goal of
Xen and the Art of Virtualization
Xen and the Art of Virtualization Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian Pratt, Andrew Warfield Presented by Thomas DuBuisson Outline Motivation
COMPUTER ARCHITECTURE. Virtualization and Memory Hierarchy
COMPUTER ARCHITECTURE Virtualization and Memory Hierarchy 2 Contents Virtual memory. Policies and strategies. Page tables. Virtual machines. Requirements of virtual machines and ISA support. Virtual machines:
CIS Operating Systems CPU Mode. Professor Qiang Zeng Spring 2018
CIS 3207 - Operating Systems CPU Mode Professor Qiang Zeng Spring 2018 CPU Modes Two common modes Kernel mode The CPU has to be in this mode to execute the kernel code User mode The CPU has to be in this
Virtual Memory. Patterson & Hennessey Chapter 5 ELEC 5200/6200 1
Virtual Memory Patterson & Hennessey Chapter 5 ELEC 5200/6200 1 Virtual Memory Use main memory as a cache for secondary (disk) storage Managed jointly by CPU hardware and the operating system (OS) Programs
Introduction to Cloud Computing and Virtualization. Mayank Mishra Sujesha Sudevalayam PhD Students CSE, IIT Bombay
Introduction to Cloud Computing and Virtualization By Mayank Mishra Sujesha Sudevalayam PhD Students CSE, IIT Bombay Talk Layout Cloud Computing Need Features Feasibility Virtualization of Machines What
Introduction Construction State of the Art. Virtualization. Bernhard Kauer OS Group TU Dresden Dresden,
Virtualization Bernhard Kauer OS Group TU Dresden bk@vmmon.org Dresden, 2010-07-15 Motivation The vision: general-purpose OS secure trustworthy small fast fancy First problem: Legacy Application Supporting
CrashOS: Hypervisor testing tool
ISSRE 2017 Anaïs GANTET - Airbus Digital Security October 2017 Outline 1 Why CrashOS? 2 CrashOS presentation 3 Vulnerability research and results October 2017 2 ISSRE Outline 1 Why CrashOS? 2 CrashOS presentation
LINUX Virtualization. Running other code under LINUX
LINUX Virtualization Running other code under LINUX Environment Virtualization Citrix/MetaFrame Virtual desktop under Windows NT. aka Windows Remote Desktop Protocol VNC, Dameware virtual console. XWindows
COS 318: Operating Systems
COS 318: Operating Systems OS Structures and System Calls Jaswinder Pal Singh Computer Science Department Princeton University (http://www.cs.princeton.edu/courses/cos318/) Outline Protection mechanisms
1 Virtualization Recap
1 Virtualization Recap 2 Recap 1 What is the user part of an ISA? What is the system part of an ISA? What functionality do they provide? 3 Recap 2 Application Programs Libraries Operating System Arrows?
Virtualization and Virtual Machines. CS522 Principles of Computer Systems Dr. Edouard Bugnion
Virtualization and Virtual Machines CS522 Principles of Computer Systems Dr. Edouard Bugnion Virtualization and Virtual Machines 2 This week Introduction, definitions, A short history of virtualization
Virtual Machine Virtual Machine Types System Virtual Machine: virtualize a machine Container: virtualize an OS Program Virtual Machine: virtualize a process Language Virtual Machine: virtualize a language
Operating Systems 4/27/2015
Virtualization inside the OS Operating Systems 24. Virtualization Memory virtualization Process feels like it has its own address space Created by MMU, configured by OS Storage virtualization Logical view
Background. IBM sold expensive mainframes to large organizations. Monitor sits between one or more OSes and HW
Virtual Machines Background IBM sold expensive mainframes to large organizations Some wanted to run different OSes at the same time (because applications were developed on old OSes) Solution: IBM developed
CSE543 - Computer and Network Security Module: Virtualization
CSE543 - Computer and Network Security Module: Virtualization Professor Trent Jaeger CSE543 - Introduction to Computer and Network Security 1 Operating System Quandary Q: What is the primary goal of system
CprE Virtualization. Dr. Yong Guan. Department of Electrical and Computer Engineering & Information Assurance Center Iowa State University
Virtualization Dr. Yong Guan Department of Electrical and Computer Engineering & Information Assurance Center Iowa State University Outline for Today s Talk Introduction Virtualization Technology Applications
Virtual Memory. Lecture for CPSC 5155 Edward Bosworth, Ph.D. Computer Science Department Columbus State University
Virtual Memory Lecture for CPSC 5155 Edward Bosworth, Ph.D. Computer Science Department Columbus State University Precise Definition of Virtual Memory Virtual memory is a mechanism for translating logical
The Future of Virtualization
The "anyos" paradigm and its implications through virtualization 30 December 2005 22c3 Berlin Introduction Tools The Future Introduction Application Area Theorie What is Virtualization? Virtualization
CS 550 Operating Systems Spring Introduction to Virtual Machines
CS 550 Operating Systems Spring 2018 Introduction to Virtual Machines 1 How to share a physical computer Operating systems allows multiple processes/applications to run simultaneously Via process/memory
CS 5600 Computer Systems. Lecture 11: Virtual Machine Monitors
CS 5600 Computer Systems Lecture 11: Virtual Machine Monitors History In the 70s, there were dozens of OSes Unlike today, where Windows and Android dominate This created many problems Upgrading hardware
CSE 120 Principles of Operating Systems
CSE 120 Principles of Operating Systems Spring 2018 Lecture 16: Virtual Machine Monitors Geoffrey M. Voelker Virtual Machine Monitors 2 Virtual Machine Monitors Virtual Machine Monitors (VMMs) are a hot
Computer Architecture Background
CSE 5095 & ECE 4451 & ECE 5451 Spring 2017 Lecture 2b Computer Architecture Background Marten van Dijk Syed Kamran Haider, Chenglu Jin, Phuong Ha Nguyen Department of Electrical & Computer Engineering
Dan Noé University of New Hampshire / VeloBit
Dan Noé University of New Hampshire / VeloBit A review of how the CPU works The operating system kernel and when it runs User and kernel mode Device drivers Virtualization of memory Virtual memory Paging
CSCI 8530 Advanced Operating Systems. Part 19 Virtualization
CSCI 8530 Advanced Operating Systems Part 19 Virtualization Virtualization This is a very old idea It appears in many different forms A variety of commercial products exist The idea has become hot again
Virtual Machine Security
Virtual Machine Security CSE443 - Spring 2012 Introduction to Computer and Network Security Professor Jaeger www.cse.psu.edu/~tjaeger/cse443-s12/ 1 Operating System Quandary Q: What is the primary goal
Virtualization and memory hierarchy
Virtualization and memory hierarchy Computer Architecture J. Daniel García Sánchez (coordinator) David Expósito Singh Francisco Javier García Blas ARCOS Group Computer Science and Engineering Department
Protection and System Calls. Otto J. Anshus
Protection and System Calls Otto J. Anshus Protection Issues CPU protection Prevent a user from using the CPU for too long Throughput of jobs, and response time to events (incl. user interactive response
DISCO and Virtualization
DISCO and Virtualization 1. Announcements: a. Project now due Friday at 9 pm b. Class moving to CS 1325 starting Thursday. 2. Questions from reviews: a. NFS scalability bottleneck? i. Yes, other things
Cloud and Datacenter Networking
Cloud and Datacenter Networking Università degli Studi di Napoli Federico II Dipartimento di Ingegneria Elettrica e delle Tecnologie dell Informazione DIETI Laurea Magistrale in Ingegneria Informatica
A Software Solution for Hardware Vulnerabilities
A Software Solution for Hardware Vulnerabilities Komail Dharsee University of Rochester Ethan Johnson University of Rochester John Criswell University of Rochester 1 / 22 Hardware Bugs! AMD recently shipped
Virtualization History and Future Trends
Virtualization History and Future Trends Christoffer Dall - Candidacy Exam - January 2013 Columbia University - Computer Science Department IBM Mainframe VMs VMware Workstation x86 Hardware Support Virtual
Chap.6 Limited Direct Execution. Dongkun Shin, SKKU
Chap.6 Limited Direct Execution 1 Problems of Direct Execution The OS must virtualize the CPU in an efficient manner while retaining control over the system. Problems how can the OS make sure the program
[537] Virtual Machines. Tyler Harter
![[537] Virtual Machines. Tyler Harter](/thumbs/78/76966859.jpg "[537] Virtual Machines. Tyler Harter")
[537] Virtual Machines Tyler Harter Outline Machine Virtualization Overview CPU Virtualization (Trap-and-Emulate) CPU Virtualization (Modern x86) Memory Virtualization Performance Challenges Outline Machine
CSE543 - Computer and Network Security Module: Virtualization
CSE543 - Computer and Network Security Module: Virtualization Professor Trent Jaeger CSE543 - Introduction to Computer and Network Security 1 Operating System Quandary Q: What is the primary goal of system
Administrivia. Lab 1 due Friday 12pm. We give will give short extensions to groups that run into trouble. But us:
Administrivia Lab 1 due Friday 12pm. We give will give short extensions to groups that run into trouble. But email us: - How much is done & left? - How much longer do you need? Attend section Friday at
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Computer Systems Engineering: Spring Quiz I Solutions
Department of Electrical Engineering and Computer Science MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.033 Computer Systems Engineering: Spring 2011 Quiz I Solutions There are 10 questions and 12 pages in this
Advanced Operating Systems (CS 202) Virtualization
Advanced Operating Systems (CS 202) Virtualization Virtualization One of the natural consequences of the extensibility research we discussed What is virtualization and what are the benefits? 2 Virtualization
Chapter 5 (Part II) Large and Fast: Exploiting Memory Hierarchy. Baback Izadi Division of Engineering Programs
Chapter 5 (Part II) Baback Izadi Division of Engineering Programs bai@engr.newpaltz.edu Virtual Machines Host computer emulates guest operating system and machine resources Improved isolation of multiple
Virtual Machine Monitors!
ISA 673 Operating Systems Security Virtual Machine Monitors! Angelos Stavrou, George Mason University! Virtual Machine Monitors 2! Virtual Machine Monitors (VMMs) are everywhere! Industry commitment! Software:
Xen is not just paravirtualization
Xen is not just paravirtualization Dongli Zhang Oracle Asia Research and Development Centers (Beijing) dongli.zhang@oracle.com December 16, 2016 Dongli Zhang (Oracle) Xen is not just paravirtualization
Darek Mihocka, Emulators.com Stanislav Shwartsman, Intel Corp. June
Darek Mihocka, Emulators.com Stanislav Shwartsman, Intel Corp. June 21 2008 Agenda Introduction Gemulator Bochs Proposed ISA Extensions Conclusions and Future Work Q & A Jun-21-2008 AMAS-BT 2008 2 Introduction
Virtualization (II) SPD Course 17/03/2010 Massimo Coppola
Virtualization (II) SPD Course 17/03/2010 Massimo Coppola The players The Hypervisor (HV) implements the virtual machine emulation to run a Guest OS Provides resources and functionalities to the Guest
Mechanisms and constructs for System Virtualization
Mechanisms and constructs for System Virtualization Content Outline Design goals for virtualization General Constructs for virtualization Virtualization for: System VMs Process VMs Prevalent trends: Pros
CS 350 Winter 2011 Current Topics: Virtual Machines + Solid State Drives
CS 350 Winter 2011 Current Topics: Virtual Machines + Solid State Drives Virtual Machines Resource Virtualization Separating the abstract view of computing resources from the implementation of these resources
Linux and Xen. Andrea Sarro. andrea.sarro(at)quadrics.it. Linux Kernel Hacking Free Course IV Edition
Linux and Xen Andrea Sarro andrea.sarro(at)quadrics.it Linux Kernel Hacking Free Course IV Edition Andrea Sarro (andrea.sarro(at)quadrics.it) Linux and Xen 07/05/2008 1 / 37 Introduction Xen and Virtualization
CHAPTER 16 - VIRTUAL MACHINES
CHAPTER 16 - VIRTUAL MACHINES 1 OBJECTIVES Explore history and benefits of virtual machines. Discuss the various virtual machine technologies. Describe the methods used to implement virtualization. Show
Virtual Machines and Dynamic Translation: Implementing ISAs in Software
Virtual Machines and Dynamic Translation: Implementing ISAs in Software Krste Asanovic Laboratory for Computer Science Massachusetts Institute of Technology Software Applications How is a software application
Secure Containers with EPT Isolation
Secure Containers with EPT Isolation Chunyan Liu liuchunyan9@huawei.com Jixing Gu jixing.gu@intel.com Presenters Jixing Gu: Software Architect, from Intel CIG SW Team, working on secure container solution
ECE 331 Hardware Organization and Design. UMass ECE Discussion 11 4/12/2018
ECE 331 Hardware Organization and Design UMass ECE Discussion 11 4/12/2018 Today s Discussion Topics Hamming Codes For error detection and correction Virtual Machines Virtual Memory The Hamming SEC Code
CS 252 Graduate Computer Architecture. Lecture 15: Virtual Machines
CS 252 Graduate Computer Architecture Lecture 15: Virtual Machines Krste Asanovic Electrical Engineering and Computer Sciences University of California, Berkeley http://www.eecs.berkeley.edu/~krste http://inst.eecs.berkeley.edu/~cs252
T Jarkko Turkulainen, F-Secure Corporation
T-110.6220 2010 Emulators and disassemblers Jarkko Turkulainen, F-Secure Corporation Agenda Disassemblers What is disassembly? What makes up an instruction? How disassemblers work Use of disassembly In
CS370: Operating Systems [Spring 2017] Dept. Of Computer Science, Colorado State University
![CS370: Operating Systems [Spring 2017] Dept. Of Computer Science, Colorado State University](/thumbs/86/93946155.jpg "CS370: Operating Systems [Spring 2017] Dept. Of Computer Science, Colorado State University")
Frequently asked questions from the previous class survey CS 370: OPERATING SYSTEMS [VIRTUALIZATION] Shrideep Pallickara Computer Science Colorado State University CPU vs Disk I/O contention Local/Global:
Hardware OS & OS- Application interface
CS 4410 Operating Systems Hardware OS & OS- Application interface Summer 2013 Cornell University 1 Today How my device becomes useful for the user? HW-OS interface Device controller Device driver Interrupts
Virtualisation: The KVM Way. Amit Shah
Virtualisation: The KVM Way Amit Shah amit.shah@qumranet.com foss.in/2007 Virtualisation Simulation of computer system in software Components Processor Management: register state, instructions, exceptions
x86 segmentation, page tables, and interrupts 3/17/08 Frans Kaashoek MIT
x86 segmentation, page tables, and interrupts 3/17/08 Frans Kaashoek MIT kaashoek@mit.edu Outline Enforcing modularity with virtualization Virtualize processor and memory x86 mechanism for virtualization
Lecture 5: February 3
CMPSCI 677 Operating Systems Spring 2014 Lecture 5: February 3 Lecturer: Prashant Shenoy Scribe: Aditya Sundarrajan 5.1 Virtualization Virtualization is a technique that extends or replaces an existing
CS370: Operating Systems [Spring 2016] Dept. Of Computer Science, Colorado State University
![CS370: Operating Systems [Spring 2016] Dept. Of Computer Science, Colorado State University](/thumbs/81/84153508.jpg "CS370: Operating Systems [Spring 2016] Dept. Of Computer Science, Colorado State University")
Frequently asked questions from the previous class survey CS 370: OPERATING SYSTEMS [VIRTUALIZATION] Shrideep Pallickara Computer Science Colorado State University RAM: Implications of 3 2GB cards over
Virtualization. Guillaume Urvoy-Keller UNS/I3S
Virtualization Guillaume Urvoy-Keller UNS/I3S Outline Part I What is virtualization : a first definition Why virtualizing? The new features offered by virtualization The various virtualization solutions
BOOTSTRAP, PC BIOS, AND IA32 MEMORY MODES. CS124 Operating Systems Winter , Lecture 5
BOOTSTRAP, PC BIOS, AND IA32 MEMORY MODES CS124 Operating Systems Winter 2015-2016, Lecture 5 2 Bootstrapping All computers have the same basic issue: They require a program to tell them what to do but
A fistful of red-pills: How to automatically generate procedures to detect CPU emulators
A fistful of red-pills: How to automatically generate procedures to detect CPU emulats Roberto Paleari Lenzo Martignoni Giampaolo Fresi Roglia Danilo Bruschi Dipartimento di Infmatica e Comunicazione Dipartimento
Intel VMX technology
Intel VMX technology G. Lettieri 28 Oct. 2015 1 The Virtual Machine Monitor In the context of hardware-assisted virtualization, it is very common to introduce the concept of a Virtual Machine Monitor (VMM).