Virtualiza)on. COMS W4118 Prof. Kaustubh R. Joshi hep://
|
|
|
- Cecil Ellis
- 5 years ago
- Views:
Transcription
1 Virtualiza)on COMS W4118 Prof. Kaustubh R. Joshi hep:// References: Opera)ng Systems Concepts (9e), Linux Kernel Development, previous W4118s Copyright no2ce: care has been taken to use only those web images deemed by the instructor to be in the public domain. If you see a copyrighted image on any slide and are the copyright owner, please contact the instructor. It will be removed. 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 1
2 Outline History and uses How virtualiza)on works Architectures Issues Efficient sharing Isola)on Performance 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 2
3 What s Server Virtualiza)on? Source: VMWare ( 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 3
4 Why Virtualiza)on? Food for thought: recall the func)ons of an OS. What s different? Source: VMWare ( 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 4
5 The birth of virtualiza)on 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 5
6 Early Beginnings: Mainframe Era Share expensive mainframes among mul)ple users Support )mesharing users (MIT, Bell Labs, ) Do research on virtual memory systems 1964: IBM s CP- 40 research OS First support of full virtualiza)on Mul)ple (up to 14) CMS guest VMs supported 1966: IBM s CP- 67 First commercial OS with full VM support 1972: IBM VM/370 First support for nested virtualiza)on (VM in VM) Lives today under z/vm moniker 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 6
7 Late 90 s: Running different Desktop OSes DOS/Windows on Macs 1997: VirtualPC for Mac Windows, Solaris on Linux VMWare Virtual Plajorm But, x86 architecture not easily virtualizable Several tricks to make it work (later) 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 7
8 2000 s: Resurgence: Server Consolida)on Enterprise Services. Reduce server sprawl. DNS DHCP Webserver Databases CRM Windows Linux ERP Accoun)ng, Source: VMWare ( 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 8
9 Nature of Internet Workloads AT&T Jan /29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs.
10 Overprovisioning and Waste Consumed Global Maximum AT&T Jan 2010 CPU percent Waste! /29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs.
11 Virtual Desktop Infrastructure (VDI) Reduce peak power Reduce upgrade costs Mul)plex workloads 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 11
12 Web Server App. Server DB Server Domain- 0 Infrastructure as a Service (IaaS) Clouds VM VM VM OS Image Shared Storage Hypervisor Ac)ve Hosts Mul)- tenant shared environments Spin- up VMs on others infrastructure Amazon, AT&T, Rackspace, Google, Isola)on, security, flexibility 4/29/13 12 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs.
13 Scaling Compute based on Workload 13 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs.
14 Other Virtualiza)on Benefits Checkpoints/snapshots Save en)re machine state and restart it later Create mul)ple copies of same machine Live migra)on Move en)re VM from one host to another High Availability Con)nuous replica)on of a VM on another machine Live cloning Create a running copy of a live VM Par)al VMs Create lightweight machine shims that allocate resources only when needed Security Detect rootkits even if they have compromised kernel 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 14
15 Future uses of virtualiza)on? Diversify from x86 (ARM) Phones VMWare MVP Embedded Systems ATMs, cars, planes, sensors Main driver: security and isola)on 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 15
16 Virtualiza)on Vendors Server/Cloud Virtualiza)on VMWare ESX Citrix XenServer Redhat KVM/QEMU Microsou HyperV IBM z/vm Desktop Virtualiza)on VMWare Desktop Parallels for Mac Oracle Virtualbox VMWare Mobile Virtual Plajorm 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 16
17 Outline History and uses How virtualiza)on works Architectures Issues Efficient sharing Isola)on Performance 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 17
18 Types of Virtualiza)on Type 0 Hardware provides virtual copies (firmware VMM) No OS involvement, e.g., IBM mainframe LPARs Type 1 Hypervisor more privileged than host/dom0 Type 2 Host more (or equally) privileged than hypervisor VM is a process in host OS Emula)on Execute hardware instruc)on in souware (Android emulator) Very flexible but very slow Programming Environment Virtualiza)on Compiler compiles code for special purpose environment (e.g., JVM) OS Containers Lightweight isola)on provided by OS: Linux namespaces, Solaris zones 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 18
19 How does virtualiza)on work? Processor privilege levels 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 19
20 Basic Virtualiza)on Architecture VM Applica)on VM Applica)on Na)ve Applica)ons Guest OS Guest OS OS Abstrac)ons (FS, Devices, etc.) Hypervisor (VMM) Host OS (Na)ve OS) Hardware (CPU, Memory, Interrupts, Disk) 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 20
21 OS vs. VMM OS Thread/Process Address space Signals Filesystem Network sockets Character/Block IO device Synchroniza)on VMM VCPU RAM (virtual) Interrupts (virtual) Virtual disk Virtual network interface card Emulated hardware device Within VM IPI (inter- processor interrupts), between VMs none 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 21
22 Virtualizing Interrupts Interrupts are the easiest Delivered by processor to ring 0 Hypervisor sits in ring 0 Hypervisor can route to guest OS (call appropriate handler in guest s interrupt descriptor table) CPU scheduling between VMs follows Timer interrupts, trapping hlt (idle) instruc)ons Ring 1 Ring 0 Hypervisor VM1 VM2 Memory and I/O, not so easy VM1 Timer )ck interrupts 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 22
23 OS Memory Isola)on: Page Tables Virtual Memory CPU CR3 Register Page Tables (virtual to physical) VA a b c Process 1 Physical Address 1 2 a b c Process FREE PFN/PPN VMM Subsystem 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 23
24 VM Memory Isola)on: Shadow Page Tables Gain control through page faults Page Tables (virtual to physical) CPU a Process 1 Machine Address a b c Process 1 a b c Process 2 GVA Guest Virtual Address Physical Address Shadow Page Tables: another level of indirec)on FREE Guest Phy Addr (PFN) VM Physical Address /29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs Hypervisor c Process 2 Machine Address Shadow page tables 1 2 Host Phy Addr (MFN) Physical to Machine map
25 Anatomy of a Shadow Page Fault Installing a new page 1. Guest applica)on accesses non- existent PTE 2. Host page fault host looks at guest page table 3. If guest page table has PTE a. Compute MFN corresponding to PTE b. Install real PTE in shadow page table c. This is a shadow page fault (guest OS doesn t see) 4. If guest page table has no PTE a. Forward page fault to guest b. Guest OS will install new PTE in guest page table 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 25
26 Modifica)ons to Guest Page Tables What happens when guest OS installs new PTE or changes exis)ng PTE? 1. Host makes Guest OS page table mem read only 2. When guest OS changes PTE, host page faults 3. VMM inspects the fault 4. If guest PTE is changing a. Compute corresponding MFN and the real PTE b. Install real PTE (GVA- >MFN mapping) in shadow page table 5. Emulate the instruc)on a. Install GVA- >PFN mapping in guest page table 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 26
27 Virtualizing I/O When VM executes I/O instruc)on, VM traps because of insufficient privilege VMM examine I/O instruc)on and emulates real device Maintain state of virtual device Predict how the I/O instruc)on would impact real device, and what the return value would be Change the VM s registers appropriately E.g., VM reads from keyboard I/O port If VM is in ac)ve window, then VMM reads real keyboard, returns value in emulated keyboard register If VM is running in a background window (no ac)ve control of keyboard), then VMM returns code for no key press 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 27
28 Virtualizing Storage Support dozens of guests per VMM Standard disk par))oning not sufficient Store as files in file system provided by host OS Duplicate file - > create new guest Move file to another system - > move guest Anatomy of VM file access Guest FS converts to access to virtual disk block Guest block I/O driver issues virtual disk read Host FS translates to access to physical disk block Host block I/O driver issues physical disk read Virtual block addr and physical block addr unrelated 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 28
29 Principles of Virtualiza)on Ring 0: load/store Virtual memory protec)on tables, I/O instruc)ons, privilege level get/set Ring 1: arithme)c, normal memory load or store Requirements for a virtualizable architecture 1974 paper, Popek and Goldberg Privileged instruc)ons (trap in user mode) Sensi)ve instruc)ons (behavior dependent on user/system mode or change resources) Virtualizable if sensi)ve subset of privileged 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 29
30 Trap and Emulate User Processes Privileged Instruction Guest Trap Operating System Return User Mode VMM Kernel Mode Emulate Action Update VCPU VMM 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 30
31 X86 Virtualiza)on x86 is not virtualizable by Popek- Goldberg defini)on 17 sensi)ve but not- privileged instruc)ons Access VMM registers: SGDT, SLDT, SIDT Get protec)on levels: PUSHF, POPF Access sensi)ve memory (page tables): MOV, CALL Hardware extensions to support virtualiza)on Introduced Intel- VTx AMD- V (SVM) Force traps on all privileged instruc)ons Add hardware support for MMU virtualiza)on (EPT) 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 31
32 Binary Transla)on Original x86 virtualiza)on technique Popularized by VMWare (1999) Protect sensi)ve memory by unmapping Dynamic instruc)on rewri)ng Scan machine code in memory before execu)on Replace sensi)ve instruc)ons with traps/emulated instruc)ons Drawbacks Complex Slow Caching of translated blocks to speed up execu)on 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 32
33 Paravirtualiza)on Pioneered by Xen 2003 ACM SOSP paper: Xen and the art of virtualiza)on Observa)on: only guest OS contains sensi)ve instruc)ons Hypercalls: system calls between guest OS and VMM Modify guest OS to avoid sensi)ve instruc)ons Drivers use direct communica)on instead of register by register device emula)on Paging updates, hardware interrupts replaced with hypercalls Fastest performance 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 33
34 Paravirtualiza)on Example: Xen I/O Request Consumer Private pointer in Xen Request Producer Shared pointer updated by guest OS Response Producer Shared pointer updated by Xen Response Consumer Private pointer in guest OS Request queue - Descriptors queued by the VM but not yet accepted by Xen Outstanding descriptors - Descriptor slots awaiting a response from Xen Response queue - Descriptors returned by Xen in response to serviced requests Unused descriptors Xen device drivers don t emulate na)ve hardware. Directly communicate with host OS device drivers 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 34
35 Outline History and uses How virtualiza)on works Architectures Issues Efficient Sharing Isola)on Performance 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 35
36 Type 1 vs. Type 2 Hypervisors Poten)ally more secure (no need to trust host OS) Citrix XenServer VMWare ESX OK Labs OKL4 Microsou Hyper- V IBM z/vm KVM (arguable) VMWare Desktop (GSX) Oracle VirtualBox VMWare MVP 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 36
37 Example: KVM Architecture (Source: hep:// linux- kvm/) 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 37
38 Example: VMWare MVP Type 2 hypervisor for phones and tablets 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 38
39 Example: Xen Type 1 Architecture 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 39
40 Example: Xen Trusted Compu)ng Base Trusted Compu)ng Base: code that a VM must trust to be secure Hypervisor Domain0 Linux Kernel Linux distribu)on Network services Shell Control stack VM mgmt tools Boot- loader Checkpoin)ng 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 40
41 Outline History and uses How virtualiza)on works Architectures Issues Efficient Sharing Isola)on Performance 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 41
42 Key VM Benefit: Resource Mul)plexing Share hardware resources across VMs Overlap resource peaks in some applica)ons with valleys in other CPU easy to is mul)plex 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 42
43 Mul)plexing: The Bad News Memory is not < 2x of peak usage Memory Days 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 43
![Memory Oversubscrip)on Ballooning [Waldspurger 02] VM VM Guest OS Balloon driver](/docs-images/90/103299845/images/44-1.jpg "Infla)ng the Balloon VMM Release pages to VMM Balloon driver Guest OS Allocate pinned")
44 Memory Oversubscrip)on Ballooning [Waldspurger 02] VM VM Guest OS Balloon driver Infla)ng the Balloon VMM Release pages to VMM Balloon driver Guest OS Allocate pinned pages OS paging Respect guest OS paging/swapping policies Allocates memory to free memory 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 44
45 Memory Consolida)on (Copy- on- write) Trade computa)on for memory Physical RAM FREE A D FREE B A B C VMM P2M Map A D B VM 2 Page Table A B C VM 1 Page Table Page Sharing [OSDI 02] VMM fingerprints pages Maps matching pages COW 33% savings Physical RAM Difference Engine [OSDI 08] Iden)fy similar pages Delta compression Up to 75% savings Memory Buddies [VEE 09] Bloom filters to compare cross- machine similarity and find migra)on targets FREE A D FREE B A B C VMM P2M Map A D B VM 2 Page Table A B C VM 1 Page Table 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 45
46 Page- granular VMs On- demand cloning via copy- on- write (VM Fork) Logical replicas State copied on demand Allocated on demand Fast VM Instan)a)on Parent VM: Disk, OS, Processes On- demand fetches Clone Private State VM Descriptor Metadata, Page tables, GDT, vcpu ~1MB for 1GB VM 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 46
47 VM Performance Primary property of VMs is isola)on Illusion of separate machines Different namespaces But S)ll share host OS/drivers S)ll share physical hardware 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 47
48 Virtualiza)on Performance Overhead VMM virtualiza)on Negligible (<5%). Lower with EPT Ring 0 (kernel) code More substan)al Can be eliminated with paravirtualiza)on I/O overhead Network, disk Substan)al 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 48
49 Implica)ons VMs have slow I/O VMs can interfere Cache Disk Network Poor TCP performance Scheduling jieer Kills TCP RTT es)mates 100K 250K 500K 1M Flow Size [Bytes] 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 49 Throughput 14x 12x 10x 8x 6x 4x 2x 0x Vanilla Xen Xen+vFlood
50 I/O Architecture All I/O passes through Dom- 0 (or equivalent) Emula)ng device = mul)ple boundary crossings Data copy overhead Shared boeleneck Paravirtualiza)on minimizes but not eliminates 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 50
51 IO- MMUs (VT- d) Why do we need drivers in the VMM/Dom0? Device memory access, DMA VMs can program devices to overwrite others memory IOMMU provides virtual- physical mappings for devices Page table transla)on for device memory access 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 51
52 PCI Passthrough IOMMU is a core requirement VMs can do DMA directly Drivers reside in VMs Can assign devices to VMs Remove Dom- 0 boeleneck Impact portability, migra)on 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 52
53 Single- root IO Virtualiza)on (SR- IOV) Device implemented virtualiza)on Hardware creates virtual copies of itself 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 53
54 I/O Overhead 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 54
55 Finally, Orchestra)on Frameworks Manage physical infrastructure Inventory of physical machines, storage, networks Monitor hardware usage Manage collec)ons of VMs Scheduling: where to start a new VM? Enough CPU/memory? Resource provisioning: How to start VM? Inventory of running VMs When to move VMs for balancing load? Similarly, manage storage (virtual disks) and network Manage users Who owns what VM? Which VMs are allowed to see what other VMs? Provide web- portals/apis to start/stop/snapshot VMs An OS for VM clusters 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 55
56 Orchestra)on Framework Examples VMWare vsphere VMWare ESX OpenStack Hypervisor agnos)c: KVM, Xen, VMWare, HyperV Eucalyptus OpenNebula CloudStack 4/29/13 COMS W4118. Spring 2013, Columbia University. Instructor: Dr. Kaustubh Joshi, AT&T Labs. 56
Networks and Opera/ng Systems Chapter 21: Virtual Machine Monitors ( )
Networks and Opera/ng Systems Chapter 21: Virtual Machine Monitors (252 0062 00) Donald Kossmann & Torsten Hoefler Frühjahrssemester 2013 Systems Group Department of Computer Science ETH Zürich Last /me:
Background. IBM sold expensive mainframes to large organiza<ons. Monitor sits between one or more OSes and HW
Virtual Machines Background IBM sold expensive mainframes to large organiza
Chapter 5 C. Virtual machines
Chapter 5 C Virtual machines Virtual Machines Host computer emulates guest operating system and machine resources Improved isolation of multiple guests Avoids security and reliability problems Aids sharing
Xen and the Art of Virtualiza2on
Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian PraF, Andrew Warfield University of Cambridge Computer Laboratory Kyle SchuF CS 5204 Virtualiza2on Abstrac2on
CS370 Operating Systems
CS370 Operating Systems Colorado State University Yashwant K Malaiya Fall 2017 Lecture 27 Virtualization Slides based on Various sources 1 1 Virtualization Why we need virtualization? The concepts and
Virtual Machines. Jinkyu Jeong Computer Systems Laboratory Sungkyunkwan University
Virtual Machines Jinkyu Jeong (jinkyu@skku.edu) Computer Systems Laboratory Sungkyunkwan University http://csl.skku.edu Today's Topics History and benefits of virtual machines Virtual machine technologies
Background. IBM sold expensive mainframes to large organiza<ons. Monitor sits between one or more OSes and HW
Virtual Machines Background IBM sold expensive mainframes to large organiza
CHAPTER 16 - VIRTUAL MACHINES
CHAPTER 16 - VIRTUAL MACHINES 1 OBJECTIVES Explore history and benefits of virtual machines. Discuss the various virtual machine technologies. Describe the methods used to implement virtualization. Show
Module 1: Virtualization. Types of Interfaces
Module 1: Virtualization Virtualization: extend or replace an existing interface to mimic the behavior of another system. Introduced in 1970s: run legacy software on newer mainframe hardware Handle platform
Spring 2017 :: CSE 506. Introduction to. Virtual Machines. Nima Honarmand
Introduction to Virtual Machines Nima Honarmand Virtual Machines & Hypervisors Virtual Machine: an abstraction of a complete compute environment through the combined virtualization of the processor, memory,
Virtual Machines. To do. q VM over time q Implementation methods q Hardware features supporting VM q Next time: Midterm?
Virtual Machines To do q VM over time q Implementation methods q Hardware features supporting VM q Next time: Midterm? *Partially based on notes from C. Waldspurger, VMware, 2010 and Arpaci-Dusseau s Three
Virtualization. Introduction. Why we interested? 11/28/15. Virtualiza5on provide an abstract environment to run applica5ons.
Virtualization Yifu Rong Introduction Virtualiza5on provide an abstract environment to run applica5ons. Virtualiza5on technologies have a long trail in the history of computer science. Why we interested?
Virtualization. Starting Point: A Physical Machine. What is a Virtual Machine? Virtualization Properties. Types of Virtualization
Starting Point: A Physical Machine Virtualization Based on materials from: Introduction to Virtual Machines by Carl Waldspurger Understanding Intel Virtualization Technology (VT) by N. B. Sahgal and D.
Virtualization. ! Physical Hardware Processors, memory, chipset, I/O devices, etc. Resources often grossly underutilized
Starting Point: A Physical Machine Virtualization Based on materials from: Introduction to Virtual Machines by Carl Waldspurger Understanding Intel Virtualization Technology (VT) by N. B. Sahgal and D.
CS 550 Operating Systems Spring Introduction to Virtual Machines
CS 550 Operating Systems Spring 2018 Introduction to Virtual Machines 1 How to share a physical computer Operating systems allows multiple processes/applications to run simultaneously Via process/memory
CSE 120 Principles of Operating Systems
CSE 120 Principles of Operating Systems Spring 2018 Lecture 16: Virtual Machine Monitors Geoffrey M. Voelker Virtual Machine Monitors 2 Virtual Machine Monitors Virtual Machine Monitors (VMMs) are a hot
references Virtualization services Topics Virtualization
references Virtualization services Virtual machines Intel Virtualization technology IEEE xplorer, May 2005 Comparison of software and hardware techniques for x86 virtualization ASPLOS 2006 Memory resource
Virtualization. Pradipta De
Virtualization Pradipta De pradipta.de@sunykorea.ac.kr Today s Topic Virtualization Basics System Virtualization Techniques CSE506: Ext Filesystem 2 Virtualization? A virtual machine (VM) is an emulation
Introduction to Virtual Machines. Carl Waldspurger (SB SM 89 PhD 95) VMware R&D
Introduction to Virtual Machines Carl Waldspurger (SB SM 89 PhD 95) VMware R&D Overview Virtualization and VMs Processor Virtualization Memory Virtualization I/O Virtualization Typesof Virtualization Process
What is KVM? KVM patch. Modern hypervisors must do many things that are already done by OSs Scheduler, Memory management, I/O stacks
LINUX-KVM The need for KVM x86 originally virtualization unfriendly No hardware provisions Instructions behave differently depending on privilege context(popf) Performance suffered on trap-and-emulate
VIRTUALIZATION: IBM VM/370 AND XEN
1 VIRTUALIZATION: IBM VM/370 AND XEN CS6410 Hakim Weatherspoon IBM VM/370 Robert Jay Creasy (1939-2005) Project leader of the first full virtualization hypervisor: IBM CP-40, a core component in the VM
OS Virtualization. Why Virtualize? Introduction. Virtualization Basics 12/10/2012. Motivation. Types of Virtualization.
Virtualization Basics Motivation OS Virtualization CSC 456 Final Presentation Brandon D. Shroyer Types of Virtualization Process virtualization (Java) System virtualization (classic, hosted) Emulation
COS 318: Operating Systems. Virtual Machine Monitors
COS 318: Operating Systems Virtual Machine Monitors Prof. Margaret Martonosi Computer Science Department Princeton University http://www.cs.princeton.edu/courses/archive/fall11/cos318/ Announcements Project
Operating Systems 4/27/2015
Virtualization inside the OS Operating Systems 24. Virtualization Memory virtualization Process feels like it has its own address space Created by MMU, configured by OS Storage virtualization Logical view
COMPUTER ARCHITECTURE. Virtualization and Memory Hierarchy
COMPUTER ARCHITECTURE Virtualization and Memory Hierarchy 2 Contents Virtual memory. Policies and strategies. Page tables. Virtual machines. Requirements of virtual machines and ISA support. Virtual machines:
Virtual Machine Monitors (VMMs) are a hot topic in
CSE 120 Principles of Operating Systems Winter 2007 Lecture 16: Virtual Machine Monitors Keith Marzullo and Geoffrey M. Voelker Virtual Machine Monitors Virtual Machine Monitors (VMMs) are a hot topic
Advanced Operating Systems (CS 202) Virtualization
Advanced Operating Systems (CS 202) Virtualization Virtualization One of the natural consequences of the extensibility research we discussed What is virtualization and what are the benefits? 2 Virtualization
Virtualization and Virtual Machines. CS522 Principles of Computer Systems Dr. Edouard Bugnion
Virtualization and Virtual Machines CS522 Principles of Computer Systems Dr. Edouard Bugnion Virtualization and Virtual Machines 2 This week Introduction, definitions, A short history of virtualization
Nested Virtualization and Server Consolidation
Nested Virtualization and Server Consolidation Vara Varavithya Department of Electrical Engineering, KMUTNB varavithya@gmail.com 1 Outline Virtualization & Background Nested Virtualization Hybrid-Nested
The Architecture of Virtual Machines Lecture for the Embedded Systems Course CSD, University of Crete (April 29, 2014)
The Architecture of Virtual Machines Lecture for the Embedded Systems Course CSD, University of Crete (April 29, 2014) ManolisMarazakis (maraz@ics.forth.gr) Institute of Computer Science (ICS) Foundation
Alterna(ve Architectures
Alterna(ve Architectures COMS W4118 Prof. Kaustubh R. Joshi krj@cs.columbia.edu hep://www.cs.columbia.edu/~krj/os References: Opera(ng Systems Concepts (9e), Linux Kernel Development, previous W4118s Copyright
CHAPTER 16 - VIRTUAL MACHINES
CHAPTER 16 - VIRTUAL MACHINES 1 OBJECTIVES Explore history and bene ts of virtual machines. Discuss the various virtual machine technologies. Describe the methods used to implement virtualization. Show
Virtualization History and Future Trends
Virtualization History and Future Trends Christoffer Dall - Candidacy Exam - January 2013 Columbia University - Computer Science Department IBM Mainframe VMs VMware Workstation x86 Hardware Support Virtual
Hardware- assisted Virtualization
Hardware- assisted Virtualization Pra$k Shah (pcshah) Rohan Pa$l (rspa$l) 15-612 Opera,ng System Prac,cum Carnegie Mellon University 1 Agenda Introduc)on to VT- x CPU virtualiza)on with VT- x VMX VMX Transi$ons
Virtual Machines. Part 2: starting 19 years ago. Operating Systems In Depth IX 1 Copyright 2018 Thomas W. Doeppner. All rights reserved.
Virtual Machines Part 2: starting 19 years ago Operating Systems In Depth IX 1 Copyright 2018 Thomas W. Doeppner. All rights reserved. Operating Systems In Depth IX 2 Copyright 2018 Thomas W. Doeppner.
CS370 Operating Systems
CS370 Operating Systems Colorado State University Yashwant K Malaiya Spring 2018 Lecture 26 Virtualization Slides based on Text by Silberschatz, Galvin, Gagne Various sources 1 1 Virtualization Why we
Virtualization. Dr. Yingwu Zhu
Virtualization Dr. Yingwu Zhu Virtualization Definition Framework or methodology of dividing the resources of a computer into multiple execution environments. Types Platform Virtualization: Simulate a
The Challenges of X86 Hardware Virtualization. GCC- Virtualization: Rajeev Wankar 36
The Challenges of X86 Hardware Virtualization GCC- Virtualization: Rajeev Wankar 36 The Challenges of X86 Hardware Virtualization X86 operating systems are designed to run directly on the bare-metal hardware,
Distributed Systems COMP 212. Lecture 18 Othon Michail
Distributed Systems COMP 212 Lecture 18 Othon Michail Virtualisation & Cloud Computing 2/27 Protection rings It s all about protection rings in modern processors Hardware mechanism to protect data and
Cloud Computing Virtualization
Cloud Computing Virtualization Anil Madhavapeddy anil@recoil.org Contents Virtualization. Layering and virtualization. Virtual machine monitor. Virtual machine. x86 support for virtualization. Full and
Lecture 5: February 3
CMPSCI 677 Operating Systems Spring 2014 Lecture 5: February 3 Lecturer: Prashant Shenoy Scribe: Aditya Sundarrajan 5.1 Virtualization Virtualization is a technique that extends or replaces an existing
Background. IBM sold expensive mainframes to large organizations. Monitor sits between one or more OSes and HW
Virtual Machines Background IBM sold expensive mainframes to large organizations Some wanted to run different OSes at the same time (because applications were developed on old OSes) Solution: IBM developed
W4118: virtual machines
W4118: virtual machines Instructor: Junfeng Yang References: Modern Operating Systems (3 rd edition), Operating Systems Concepts (8 th edition), previous W4118, and OS at MIT, Stanford, and UWisc Virtual
Virtualization. Operating Systems, 2016, Meni Adler, Danny Hendler & Amnon Meisels
Virtualization Operating Systems, 2016, Meni Adler, Danny Hendler & Amnon Meisels 1 What is virtualization? Creating a virtual version of something o Hardware, operating system, application, network, memory,
Virtualization. Adam Belay
Virtualization Adam Belay What is a virtual machine Simulation of a computer Running as an application on a host computer Accurate Isolated Fast Why use a virtual machine? To run multiple
Knut Omang Ifi/Oracle 6 Nov, 2017
Software and hardware support for Network Virtualization part 1 Knut Omang Ifi/Oracle 6 Nov, 2017 1 Motivation Goal: Introduction to challenges in providing fast networking to virtual machines Prerequisites:
Virtualization. Guillaume Urvoy-Keller UNS/I3S
Virtualization Guillaume Urvoy-Keller UNS/I3S Outline Part I What is virtualization : a first definition Why virtualizing? The new features offered by virtualization The various virtualization solutions
Virtualization and memory hierarchy
Virtualization and memory hierarchy Computer Architecture J. Daniel García Sánchez (coordinator) David Expósito Singh Francisco Javier García Blas ARCOS Group Computer Science and Engineering Department
Virtualization. ...or how adding another layer of abstraction is changing the world. CIS 399: Unix Skills University of Pennsylvania.
Virtualization...or how adding another layer of abstraction is changing the world. CIS 399: Unix Skills University of Pennsylvania April 6, 2009 (CIS 399 Unix) Virtualization April 6, 2009 1 / 22 What
CS370: Operating Systems [Spring 2017] Dept. Of Computer Science, Colorado State University
![CS370: Operating Systems [Spring 2017] Dept. Of Computer Science, Colorado State University](/thumbs/89/100547178.jpg "CS370: Operating Systems [Spring 2017] Dept. Of Computer Science, Colorado State University")
Frequently asked questions from the previous class survey CS 370: OPERATING SYSTEMS [VIRTUALIZATION] Shrideep Pallickara Computer Science Colorado State University Difference between physical and logical
Multiprocessor Scheduling. Multiprocessor Scheduling
Multiprocessor Scheduling Will consider only shared memory multiprocessor or multi-core CPU Salient features: One or more caches: cache affinity is important Semaphores/locks typically implemented as spin-locks:
CS 350 Winter 2011 Current Topics: Virtual Machines + Solid State Drives
CS 350 Winter 2011 Current Topics: Virtual Machines + Solid State Drives Virtual Machines Resource Virtualization Separating the abstract view of computing resources from the implementation of these resources
Intel s Virtualization Extensions (VT-x) So you want to build a hypervisor?
Intel s Virtualization Extensions (VT-x) So you want to build a hypervisor? Mr. Jacob Torrey May 13, 2014 Dartmouth College 153 Brooks Road, Rome, NY 315.336.3306 http://ainfosec.com @JacobTorrey torreyj@ainfosec.com
Virtual Machine Security
Virtual Machine Security CSE443 - Spring 2012 Introduction to Computer and Network Security Professor Jaeger www.cse.psu.edu/~tjaeger/cse443-s12/ 1 Operating System Quandary Q: What is the primary goal
Virtual Virtual Memory
Virtual Virtual Memory Jason Power 3/20/2015 With contributions from Jayneel Gandhi and Lena Olson 4/17/2015 UNIVERSITY OF WISCONSIN 1 Virtual Machine History 1970 s: VMMs 1997: Disco 1999: VMWare (binary
CS 5600 Computer Systems. Lecture 11: Virtual Machine Monitors
CS 5600 Computer Systems Lecture 11: Virtual Machine Monitors History In the 70s, there were dozens of OSes Unlike today, where Windows and Android dominate This created many problems Upgrading hardware
Virtual Machine Virtual Machine Types System Virtual Machine: virtualize a machine Container: virtualize an OS Program Virtual Machine: virtualize a process Language Virtual Machine: virtualize a language
Advanced Systems Security: Virtual Machine Systems
Systems and Internet Infrastructure Security Network and Security Research Center Department of Computer Science and Engineering Pennsylvania State University, University Park PA Advanced Systems Security:
Advanced Systems Security: Virtual Machine Systems
Systems and Internet Infrastructure Security Network and Security Research Center Department of Computer Science and Engineering Pennsylvania State University, University Park PA Advanced Systems Security:
Today s Objec4ves. Data Center. Virtualiza4on Cloud Compu4ng Amazon Web Services. What did you think? 10/23/17. Oct 23, 2017 Sprenkle - CSCI325
Today s Objec4ves Virtualiza4on Cloud Compu4ng Amazon Web Services Oct 23, 2017 Sprenkle - CSCI325 1 Data Center What did you think? Oct 23, 2017 Sprenkle - CSCI325 2 1 10/23/17 Oct 23, 2017 Sprenkle -
Virtualization, Xen and Denali
Virtualization, Xen and Denali Susmit Shannigrahi November 9, 2011 Susmit Shannigrahi () Virtualization, Xen and Denali November 9, 2011 1 / 70 Introduction Virtualization is the technology to allow two
CS370 Operating Systems
CS370 Operating Systems Colorado State University Yashwant K Malaiya Spring 2018 Lecture 25 RAIDs, HDFS/Hadoop Slides based on Text by Silberschatz, Galvin, Gagne (not) Various sources 1 1 FAQ Striping:
Virtualization with XEN. Trusted Computing CS599 Spring 2007 Arun Viswanathan University of Southern California
Virtualization with XEN Trusted Computing CS599 Spring 2007 Arun Viswanathan University of Southern California A g e n d a Introduction Virtualization approaches Basic XEN Architecture Setting up XEN Bootstrapping
Lecture 7. Xen and the Art of Virtualization. Paul Braham, Boris Dragovic, Keir Fraser et al. 16 November, Advanced Operating Systems
Lecture 7 Xen and the Art of Virtualization Paul Braham, Boris Dragovic, Keir Fraser et al. Advanced Operating Systems 16 November, 2011 SOA/OS Lecture 7, Xen 1/38 Contents Virtualization Xen Memory CPU
24-vm.txt Mon Nov 21 22:13: Notes on Virtual Machines , Fall 2011 Carnegie Mellon University Randal E. Bryant.
24-vm.txt Mon Nov 21 22:13:36 2011 1 Notes on Virtual Machines 15-440, Fall 2011 Carnegie Mellon University Randal E. Bryant References: Tannenbaum, 3.2 Barham, et al., "Xen and the art of virtualization,"
CprE Virtualization. Dr. Yong Guan. Department of Electrical and Computer Engineering & Information Assurance Center Iowa State University
Virtualization Dr. Yong Guan Department of Electrical and Computer Engineering & Information Assurance Center Iowa State University Outline for Today s Talk Introduction Virtualization Technology Applications
Virtualization Introduction
Virtualization Introduction Simon COTER Principal Product Manager Oracle VM & VirtualBox simon.coter@oracle.com https://blogs.oracle.com/scoter November 21 st, 2016 Safe Harbor Statement The following
Virtual Machine Systems
Virtual Machine Systems Question Can a small operating system simulate the hardware of some machine so that Another operating system can run in that simulated hardware? More than one instance of that operating
LINUX Virtualization. Running other code under LINUX
LINUX Virtualization Running other code under LINUX Environment Virtualization Citrix/MetaFrame Virtual desktop under Windows NT. aka Windows Remote Desktop Protocol VNC, Dameware virtual console. XWindows
Xen is not just paravirtualization
Xen is not just paravirtualization Dongli Zhang Oracle Asia Research and Development Centers (Beijing) dongli.zhang@oracle.com December 16, 2016 Dongli Zhang (Oracle) Xen is not just paravirtualization
Xen and the Art of Virtualization. Nikola Gvozdiev Georgian Mihaila
Xen and the Art of Virtualization Nikola Gvozdiev Georgian Mihaila Outline Xen and the Art of Virtualization Ian Pratt et al. I. The Art of Virtualization II. Xen, goals and design III. Xen evaluation
DISCO and Virtualization
DISCO and Virtualization 1. Announcements: a. Project now due Friday at 9 pm b. Class moving to CS 1325 starting Thursday. 2. Questions from reviews: a. NFS scalability bottleneck? i. Yes, other things
Virtualisation: The KVM Way. Amit Shah
Virtualisation: The KVM Way Amit Shah amit.shah@qumranet.com foss.in/2007 Virtualisation Simulation of computer system in software Components Processor Management: register state, instructions, exceptions
[537] Virtual Machines. Tyler Harter
![[537] Virtual Machines. Tyler Harter](/thumbs/78/76966859.jpg "[537] Virtual Machines. Tyler Harter")
[537] Virtual Machines Tyler Harter Outline Machine Virtualization Overview CPU Virtualization (Trap-and-Emulate) CPU Virtualization (Modern x86) Memory Virtualization Performance Challenges Outline Machine
Virtual Machine Monitors!
ISA 673 Operating Systems Security Virtual Machine Monitors! Angelos Stavrou, George Mason University! Virtual Machine Monitors 2! Virtual Machine Monitors (VMMs) are everywhere! Industry commitment! Software:
BUD17-301: KVM/ARM Nested Virtualization. Christoffer Dall
BUD17-301: KVM/ARM Nested Virtualization Christoffer Dall Nested Virtualization VM VM VM App App App App App VM App Hypervisor Hypervisor Hardware Terminology Nested VM VM Nested VM L2 App App App App
The Missing Piece of Virtualization. I/O Virtualization on 10 Gb Ethernet For Virtualized Data Centers
The Missing Piece of Virtualization I/O Virtualization on 10 Gb Ethernet For Virtualized Data Centers Agenda 10 GbE Adapters Built for Virtualization I/O Throughput: Virtual & Non-Virtual Servers Case
VIRTUALIZATION. Dresden, 2011/12/6. Julian Stecklina
Department of Computer Science Institute of Systems Architecture, Operating Systems Group VIRTUALIZATION Julian Stecklina (jsteckli@os.inf.tu-dresden.de) Dresden, 2011/12/6 00 Goals Give you an overview
The only open-source type-1 hypervisor
Monika Danikáková What is Xen? The only open-source type-1 hypervisor For Unix and Unix-like OS Linux, NetBSD and OpenSolaris From ancient greek term Xenos (ξένος), guest-friends Developed by the University
SUSE Linux Enterprise Server: Supported Virtualization Technologies
Technical White Paper Enterprise Linux SUSE Linux Enterprise Server: Supported Virtualization Technologies Table of Contents page Comprehensive Virtualization Support Overview... 2 Upgrade Guidelines...4
Virtualization. Virtualization
Virtualization Virtualization Memory virtualization Process feels like it has its own address space Created by MMU, configured by OS Storage virtualization Logical view of disks connected to a machine
OS History and OS Structures
OS History and OS Structures Karthik Dantu CSE 421/521: Opera>ng Systems Slides adopted from CS162 class at Berkeley, CSE 451 at U-Washington and CSE 421 by Prof Kosar at UB Join Piazza Ac>on Items From
To EL2, and Beyond! connect.linaro.org. Optimizing the Design and Implementation of KVM/ARM
To EL2, and Beyond! Optimizing the Design and Implementation of KVM/ARM LEADING COLLABORATION IN THE ARM ECOSYSTEM Christoffer Dall Shih-Wei Li connect.linaro.org
Introduction to Cloud Computing and Virtualization. Mayank Mishra Sujesha Sudevalayam PhD Students CSE, IIT Bombay
Introduction to Cloud Computing and Virtualization By Mayank Mishra Sujesha Sudevalayam PhD Students CSE, IIT Bombay Talk Layout Cloud Computing Need Features Feasibility Virtualization of Machines What
Fast access ===> use map to find object. HW == SW ===> map is in HW or SW or combo. Extend range ===> longer, hierarchical names
Fast access ===> use map to find object HW == SW ===> map is in HW or SW or combo Extend range ===> longer, hierarchical names How is map embodied: --- L1? --- Memory? The Environment ---- Long Latency
System Virtual Machines
System Virtual Machines Outline Need and genesis of system Virtual Machines Basic concepts User Interface and Appearance State Management Resource Control Bare Metal and Hosted Virtual Machines Co-designed
CIS Operating Systems Memory Management Address Translation. Professor Qiang Zeng Fall 2017
CIS 5512 - Operating Systems Memory Management Address Translation Professor Qiang Zeng Fall 2017 Outline Fixed partitions Dynamic partitions Con$guous alloca$on: Each process occupies a con$guous memory
Lecture 8: Memory Management
Lecture 8: Memory Management CSE 120: Principles of Opera>ng Systems UC San Diego: Summer Session I, 2009 Frank Uyeda Announcements PeerWise ques>ons due tomorrow. Project 2 is due on Friday. Milestone
We ve seen lots of examples of virtualization. This is another: a virtual machine monitor. A VMM virtualizes an entire hardware machine.
Chapter 22 Virtualization We ve seen lots of examples of virtualization. This is another: a virtual machine monitor. A VMM virtualizes an entire hardware machine. We can contrast this OS processes and
NON SCHOLAE, SED VITAE
TDIU11 Operating systems Operating System Structures and Machines [SGG7/8] Chapter 2.7-2.8 [SGG9] Chapter 2.7, 1.11.6 Copyright Notice: The lecture notes are modifications of the slides accompanying the
Distributed Systems. 31. The Cloud: Infrastructure as a Service Paul Krzyzanowski. Rutgers University. Fall 2013
Distributed Systems 31. The Cloud: Infrastructure as a Service Paul Krzyzanowski Rutgers University Fall 2013 December 12, 2014 2013 Paul Krzyzanowski 1 Motivation for the Cloud Self-service configuration
Server Virtualization Approaches
Server Virtualization Approaches Virtual Machine Applications Emulation Replication Composition Emulation: Mix-and-match cross-platform portability Replication: Multiple VMs on single platform Composition:
Overview of System Virtualization: The most powerful platform for program analysis and system security. Zhiqiang Lin
CS 6V81-05: System Security and Malicious Code Analysis Overview of System Virtualization: The most powerful platform for program analysis and system security Zhiqiang Lin Department of Computer Science
CS 152 Computer Architecture and Engineering
CS 152 Computer Architecture and Engineering Lecture 12 -- Virtual Memory 2014-2-27 John Lazzaro (not a prof - John is always OK) TA: Eric Love www-inst.eecs.berkeley.edu/~cs152/ Play: CS 152 L12: Virtual
RED HAT ENTERPRISE VIRTUALIZATION 3.0
RED HAT ENTERPRISE VIRTUALIZATION 3.0 YOUR STRATEGIC VIRTUALIZATION ALTERNATIVE John Rinehart, Product Marke3ng Manager Mark St. Laurent, Senior Solu3on Architect Email: msl@redhat.com March 28, 2012 AGENDA
30 Server Consolidation: Virtualisation and Other Partitioning Techniques
30 Server Consolidation: Virtualisation and Other Partitioning Techniques If you have not read the book check the introduction to More Tasters on the web site http://www.b.king.dsl.pipex.com/ to understand
Originally prepared by Lehigh graduate Greg Bosch; last modified April 2016 by B. Davison
Virtualization Originally prepared by Lehigh graduate Greg Bosch; last modified April 2016 by B. Davison I. Introduction to Virtualization II. Virtual liances III. Benefits to Virtualization IV. Example
CS5460: Operating Systems. Lecture: Virtualization. Anton Burtsev March, 2013
CS5460: Operating Systems Lecture: Virtualization Anton Burtsev March, 2013 Traditional operating system Virtual machines A bit of history Virtual machines were popular in 60s-70s Share resources of mainframe
MASSACHUSETTS INSTITUTE OF TECHNOLOGY Computer Systems Engineering: Spring Quiz I Solutions
Department of Electrical Engineering and Computer Science MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.033 Computer Systems Engineering: Spring 2011 Quiz I Solutions There are 10 questions and 12 pages in this
Xen and CloudStack. Ewan Mellor. Director, Engineering, Open-source Cloud Platforms Citrix Systems
Xen and CloudStack Ewan Mellor Director, Engineering, Open-source Cloud Platforms Citrix Systems Agenda What is CloudStack? Move to the Apache Foundation CloudStack architecture on Xen The future for CloudStack