INNOV-4: Fun With Virtualization. Or, How I learned to love computers that don t really exist...

Size: px

Start display at page:

Download "INNOV-4: Fun With Virtualization. Or, How I learned to love computers that don t really exist..."

Mervin Washington
5 years ago
Views:

1 1 INNOV-4: Fun With Virtualization Or, How I learned to love computers that don t really exist... President, BravePoint, Inc. About Unix user since 1982 Progress developer since 1984 Linux Desktop and Server user since 1995 VMware user since earliest beta in 1999 Contact me: jrh@bravepoint.com 2 INNOV-4: Fun with Virtualization

2 2 About BravePoint IT Services Company Founded in employees Focus on: Progress Software technologies.net MFG/PRO and Manufacturing Managed Database Services Training, Consulting, Development, Support 3 INNOV-4: Fun with Virtualization Background: Virtualization at BravePoint Our Financials run in VMs Most Development/Test Servers run as Virtual Machines in a VMware Server Farm Mac/Linux users use desktop VMs to run Windows Apps Support Desk and Developers use desktop VMs to deal with conflicting customer VPNs Production systems D/R is done via VMs 4 INNOV-4: Fun with Virtualization

3 3 Desktop Virtualization Demo 5 INNOV-4: Fun with Virtualization Disclaimer Virtualization environments out there: HP-UX Mainframes Others... We are focused only on X86 solutions. This topic is a moving target Especially licensing 6 INNOV-4: Fun with Virtualization

4 4 Agenda Intro to Virtualization Benefits of Virtualization Types of Virtualization Virtualization Products Desktop Virtualization Server Virtualization Virtualization Benchmarks 7 INNOV-4: Fun with Virtualization Who is Using Virtualization? Flavor VMware MS Virtual PC/Server Parallels XEN Others... Deployment Development/Test Production D/R 8 INNOV-4: Fun with Virtualization

5 5 What is Virtualization Definition Virtualization is an abstract layer that decouples the physical hardware from the operating system to deliver greater IT resource utilization and flexibility. Introduced in the 1960 s to allow partitioning of large mainframe computers 9 INNOV-4: Fun with Virtualization Benefits of Virtualization Partitioning Multiple applications, operating systems and environments can be supported in a single physical system Allows computing resources to be treated as a uniform pool for allocation Decouples systems and software from hardware and simplifies hardware scalability 10 INNOV-4: Fun with Virtualization

6 6 Benefits of Virtualization Isolation VM is completely isolated from the host machine and other VMs. Reboot or crash of a VM shouldn t affect other VMs. Data is not shared between VMs Applications can only communicate over configured network connections. 11 INNOV-4: Fun with Virtualization Benefits of Virtualization Encapsulation Complete VMs typically exist in 1 or 2 files easily backed up, copied, or moved. The hardware of the VM is standardized compatibility is guaranteed. Upgrades/changes in the real hardware are generally transparent to the VM 12 INNOV-4: Fun with Virtualization

7 7 Emulation -vs- Virtualization Emulation Provides the functionality of a target processor completely in software Virtualization Takes physical processor(s) and partitions them into multiple contexts - all of which run directly in the processor. 13 INNOV-4: Fun with Virtualization Pure Emulation Biggest Plus: Any processor can be emulated Emulators are usually portable Biggest Minus: Almost always is very slow Most rarely even approached 50% of native system speed Examples MS Virtual PC(PPC Mac), Bochs, Rosetta 14 INNOV-4: Fun with Virtualization

8 8 Major Types of Virtualization Terminology and Definitions Product examples Comparisons Pros and Cons 15 INNOV-4: Fun with Virtualization Single Kernel Image Multiple running instances of a single OS. Each instance runs in its own container. Very Fast, no hardware emulation is required. Less flexible, only 1 OS can run in all instances. 16 INNOV-4: Fun with Virtualization

9 9 Single Kernel Image Virtual Instance Virtual Virtual Instance Instance OS Virtualization Layer Standard Host OS Hardware 17 INNOV-4: Fun with Virtualization Full Virtualization VM provides full compatibility with standard (real) hardware environment. Uses combination of emulation and direct hardware access. More emulation required - slower the VM. Guest OS s run without modification. Custom drivers may be available to enhance behavior and performance 18 INNOV-4: Fun with Virtualization

10 10 Full Virtualization VM1 Guest OS VM2 Guest OS VM3 Guest OS Virtual Hardware Virtual Hardware Virtual Machine Monitor Hypervisor or Standard Operating System Hardware Virtual Hardware 19 INNOV-4: Fun with Virtualization Paravirtualization Type of VM presents a software interface similar but not identical to real hardware. Some hardware operations are redirected directly to the VM Monitor (and hence to the hardware) and are very fast. Guest OS s usually must be modified to run in a PVM. 20 INNOV-4: Fun with Virtualization

11 11 ParaVirtualization VM1 VM2 VM3 Mod GuestOS Mod GuestOS Mod GuestOS Virtual Hardware Virtual Hardware Virtual Machine Monitor Hypervisor Hardware Virtual Hardware 21 INNOV-4: Fun with Virtualization Hardware Advances 2 Technologies have impacted the world of x86 VMs Intel VT AMD Pacifica Hardware support for virtualization Generally eliminates need for guest OS changes for ParaVirtualization VMware, Xen, MS Server and Parallels all now use this 22 INNOV-4: Fun with Virtualization

12 12 Virtualization Products Categories Typical Features Desktop Products Server Products 23 INNOV-4: Fun with Virtualization Categories of VM Products Desktop Workstation oriented product Least sophisticated management tools Focus on desktop integration Server Designed to run server OS s Good remote configuration and admin tools Enterprise Server Features...plus... HA Features ie: Migrate running VMs Failover Capabilities 24 INNOV-4: Fun with Virtualization

13 13 Typical VM Features Memory (amount) Number of CPUs (Vmware & Xen) Virtual Hard Drives Preallocated or Growing vscsi or vide (VMware) Shrinkable/Growable (Parallels) Floppy/CD-ROM/DVD File or Device 25 INNOV-4: Fun with Virtualization Typical Features Networking Multiple Cards NAT, Host-Only and Bridged USB Devices Workstation Features Sound Clipboard Integration Shared Folders 3D Video (VMware WS only) Coherence (Parallels only) 26 INNOV-4: Fun with Virtualization

14 14 Desktop Products VMware Workstation Win/Lin/Mac Host Parallels Win/Lin/Mac Host MS Virtual PC Win Host Only All run various guest OS s Each supplies drivers for Windows guests 27 INNOV-4: Fun with Virtualization Using Desktop Virtualization Remote Support Coexistance of Multiple VPNs Development Other OS s (OpenEdge in a VM on a Mac) Testing Multiple Environments (IE6 and IE7 for example) 28 INNOV-4: Fun with Virtualization

15 Desktop OS Licensing Issues 29 INNOV-4: Fun with Virtualization Desktop OS Licensing Issues Primarily impacts MS clients. Very little definitive information on the web.

15 15 Desktop OS Licensing Issues 29 INNOV-4: Fun with Virtualization Desktop OS Licensing Issues Primarily impacts MS clients. Very little definitive information on the web. Vista EULA explicitly forbids virtualization of Vista Home products. According to a Microsoft spokesperson, For production machines and everyday usage, virtualization is a fairly new technology, and one which we think is not mature enough for broad consumer adoption. 30 INNOV-4: Fun with Virtualization

16 16 OpenEdge Licensing in a VM Machine Model A Machine license grants a licensee the right to run a Progress Software server product on a single server. A licensee may not purchase a single Machine license and run it on multiple servers A server with software partitions is considered a single server. Licensees with software partitions are only required to purchase a single Machine license. 31 INNOV-4: Fun with Virtualization Server Products VMware Server (Free, requires host OS) ESX ($, Hypervisor, no host OS) Xen 3.0 (Free, Open Source) OpenVZ Linux only (Free, Open Source) MS Virtual Server (Free, requires MS host) 32 INNOV-4: Fun with Virtualization

17 17 Using Server Virtualization Maximize use of server resources Rapidly stand up additional servers Higher Availability Easy way to test upgrades/changes Simplify Migrations to new servers Security 33 INNOV-4: Fun with Virtualization BravePoint VM Development Environment PowerEdge 2950 RHEL 4 VMware GSX VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM Dev1 /vm1 /vm2 Master VMs SAN CX-300 PowerEdge 2950 RHEL 4 VMware GSX VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM VM Dev2 34 INNOV-4: Fun with Virtualization

18 18 VM Server Demo 35 INNOV-4: Fun with Virtualization VM Server Demo 36 INNOV-4: Fun with Virtualization

19 19 Server OS Licensing Primarily impacts MS server products As of Feb, 2007 Unlimited virtual instances on one physical machine of : Windows Server 2003 R2 Datacenter Edition SQL Server 2005 Enterprise Edition Underlying VM technology doesn t matter 37 INNOV-4: Fun with Virtualization Server Licensing Issues Other MS restrictions Running utilities that convert VHD s (MS VM Format) to other formats deactivates the VM Running VHD s directly in other non-ms VM products deactivates the VM More info at 38 INNOV-4: Fun with Virtualization

20 20 Other VM Utilities Tools to migrate real systems to VMs VMware Converter Parallels Transporter MS systems only Tools to migrate existing VMs VMware Virtual Machine Importer Parallels Sysprep Other tools Xen tools, Xen-shell (xen-tools.org) 39 INNOV-4: Fun with Virtualization What is OE Performance Like in a VM? Numerous nonoe benchmarks published Rarely do they compare equal machines Often RAM is different Don t expect VM to perform at 100% the level of the host system. I ve undertaken 2 relatively simple benchmarks using the ATM and a 50 user load. YMMV 40 INNOV-4: Fun with Virtualization

21 21 ATM Benchmark 1 - Xen System is a Core 2 Duo, 1.86gHz running with RPM SATA drives as 1 LVM OS is always Centos 5 (x86_64) Xen Progress is 10.1A02 (32 bit) Runs compare real, paravirtualized and fully virtualized VMs Ram is always 1 gig in test environment 1 gig total for real machine test 2 gig in VMs with 2 gig in real machine # CPUs is varied in VMs 41 INNOV-4: Fun with Virtualization Benchmark 1 Results TPS Real Para 1 VCPU Para 2 VCPU Virt 1 CPU Virt 2 VCPU 42 INNOV-4: Fun with Virtualization

22 22 ATM Benchmark 2 - VMware Benchmark uses a BravePoint Dell VMware server 16 Gig RAM 32 Bit RHEL 4 (i386) Host OS 32 Bit 10.1A02 First run is done natively in the OS with no VMs running. Second run is done in a VMware VM 1.5 gig of virtual RAM Single Virtual CPU Third run is done in a VMware VM 1.5 gig of virtual RAM Dual Virtual CPUs 43 INNOV-4: Fun with Virtualization ATM Benchmark 2 Tuning Same tuning on all runs 1.6 Gig DB DB/BI/Temp Files all on Same SAN LUN -B (128 Mb) -n 200 -spin bibufs simulated users on all runs All databases were freshly created and index built before first run 44 INNOV-4: Fun with Virtualization

23 23 ATM Benchmark 2 Results (in TPS) TPS st 2nd 3rd 4th 50 User Runs Native Sys VM 1 VCPU VM 2 VCPU 45 INNOV-4: Fun with Virtualization ATM Benchmark 3 XEN -vs- VMware Same hardware and circumstances as Benchmark 1 CentOS 5 Host OS (x86_64) VMware Server Xen 3.01 OE 10.1A02 (32 bit) Just to compare relative performance between Xen and VMware 46 INNOV-4: Fun with Virtualization

24 24 Benchmark 3 Results TPS Real Para 1 VCPU Para 2 VCPU Virt 1 CPU Virt 2 VCPU VMware 47 INNOV-4: Fun with Virtualization Benchmark 3 Comments Xen in Paravirtualized Mode is slightly faster than Vmware running Linux Windows doesn t run in paravirtualized mode VMware is faster than Xen in fully virtualized mode VMware would probably be faster running windows than Xen would YMMV 48 INNOV-4: Fun with Virtualization

25 25 ATM Benchmark 4 Xen -vs- OpenVZ Similar to Benchmark 3 Comparing OpenVZ to Xen (Para virtualized) OpenVZ partitions the Linux kernel and uses the native, host filesystem VE assigned 1 Gig Ram All VMs had 2 CPUs OpenVZ typically is expected to show only 1-3% performance loss over native I was surprised! 49 INNOV-4: Fun with Virtualization Benchmark 4 Results TPS Real-X86_64 XEN Para-x86-64 OpenVZ -i386 OpenVZ-x86_64 50 INNOV-4: Fun with Virtualization

26 26 Readprobe Benchmarks Stock copy of Readprobe Get it at Measures ideal read performance Similar run environments to ATM runs Readprobe does all db creation and tuning All runs occurred on the SAN 10.1A02 used in all environments 51 INNOV-4: Fun with Virtualization Readprobe Results 300 in (000) per second Best Thread Best Rate 0 Native 1 VCPU 2 VCPU 44 Threads 1 Thread 1 Thread 52 INNOV-4: Fun with Virtualization

27 27 Comments on Benchmarks Benchmarks interesting, but not all that useful A real world benchmark would have more than one VM running with various loads. You don t move to a VM environment to improve raw performance. You move to improve stability, uptime, reliability and to reduce administrative load. 53 INNOV-4: Fun with Virtualization Questions 54 INNOV-4: Fun with Virtualization

28 28 55 INNOV-4: Fun with Virtualization 56 INNOV-4: Fun with Virtualization

29 29 57 INNOV-4: Fun with Virtualization 58 INNOV-4: Fun with Virtualization

30 30 59 INNOV-4: Fun with Virtualization 60 INNOV-4: Fun with Virtualization

31 31 61 INNOV-4: Fun with Virtualization 62 INNOV-4: Fun with Virtualization

32 32 63 INNOV-4: Fun with Virtualization 64 INNOV-4: Fun with Virtualization

33 33 65 INNOV-4: Fun with Virtualization

OPS-9: Fun With Virtualization. John Harlow. John Harlow. About John Harlow

OPS-9: Fun With Virtualization President, BravePoint, Inc. About Unix user since 1982 Progress developer since 1984 Linux Desktop and Server user since 1995 VMware user since earliest beta in 1999 Contact