VM Migration Acceleration over 40GigE Meet SLA & Maximize ROI Mellanox Technologies Inc. Motti Beck, Director Marketing Motti@mellanox.com
Topics Introduction to Mellanox Technologies Inc. Why Cloud SLA importance in the Cloud The need for faster VM migration VM migration over 40GigE case study Benchmarks, SLA and ROI benefits Summary
Connectivity Solutions for Efficient Computing Enterprise and Storage High-Performance Computing Cloud Computing Leading Connectivity Solution Provider For Servers and Storage Providing Users Best-in-Class Networking Bandwidth, Application Performance and Response Time
Leading End-to-End Connectivity Solution Provider for Servers and Storage Systems Server / Compute Switch / Gateway Storage Front / Back-End Virtual Protocol Interconnect 40G IB & FCoIB 10/40GigE & FCoE Virtual Protocol Interconnect 40G InfiniBand 10/40GigE Fibre Channel ICs Adapter Cards Mellanox Interconnect Networking Solutions Host/Fabric Software Switches/Gateways Cables
Industry-Firsts Breadth and Leadership: 10 and 40 Gigabit Ethernet Adapters Dual-port PCIe 2.0 10GigE adapters 10/40GigE with FCoE with hardware offload 10/40GigE with RoCE (RDMA over Converged Ethernet) Lowest latency in the Ethernet industry 1.3μs end-to-end latency Enables faster application completion, better server utilization Tremendous ecosystem support momentum Multiple Tier-1 OEM design wins ~10% worldwide market share and growing Servers, LAN on Motherboard (LOM), and storage systems VMware vsphere 4.X certified Citrix XenServer 4.1 in-the-box support Windows Server 2003 & 2008, RedHat 5, SLES 11
High Performance switches Voltaire Vantage 10GbE Portfolio Vantage 6024 Layer 2/3 Low-latency Switch Managed as a single logical switch Vantage 8500 Layer 2 Core Vantage 6048 Layer 2/3 Cloud Switch
IT Centers Spending and Constraints Data center growth 30M servers currently installed, 4x expected growth in the next 10 years 10x increase in digital records retention and online transactions Operating and management cost $8 for maintenance for every $1 spend on new infrastructure Power and cooling costs have doubled since 2000 50 for power/cooling for every $1 spend on server hardware Real-estate restrictions >$1000 per sq ft for construction costs Server utilization Over 50% of CPU time is wasted on non-application activities Source: IDC 7
Spending Constrains Drives IT Managers to Adopt New technologies / Business Models Source: IDC Non-Traditional Options are Being Considered
What is Cloud Computing Consumer and Business Products, Services and Solutions Delivered in Real-Time over the Internet including: Standard shared service built for a market, not a single customer Solution-packaged turnkey integrating appropriate resources Self-service Elastic scaling dynamic and fine-grained Internal Datacenter App App App Service Level Agreement (SLA) use-based pricing Ubiquitous Network Access accessible via the Internet Browser Based standard UI technologies Published API common Internet APIs Internal Cloud IT Efficiency and Business Agility External Cloud
Critical Cloud Computing Foundations Lower TCO On-demand Services Efficient Virtualization Dynamic provisioning, configurations and efficient VM migration
IT Efficiency Through Cloud Computing* *Source: Intalio Cloud efficiency heavily demands on the network performance 11
The Need for On-Demand Services Different user needs At different times of the day App and # of users dictate IT infrastructure Virtual Machines running different applications Physical Sever Physical Sever Physical Sever Customer A Customer B Customer C On Demand exacerbate need for efficient VM migration 12
Importance of Cloud SLAs SLA Characteristics Source: IDC Enterprise Panel, Q3 09, n = 263 Poor SLAs is a significant deterrent to cloud deployments
Improved SLA with Elastic VM Compute unit purchase in cloud is based on VMs app app app Today VMs in cloud aren t that elastic Fixed CPU, memory, storage, I/O per VM instance Tomorrow elastic VM Purchase a VM instance Dynamic resources allocation CPU, Memory, Storage, I/O App App App App Pay based on resources usage Like cell phone payment plans Challenge Elastic VM requires fast VM Migration Minimal VM inactive time CPU CPU CPU CPU
Case Study: VMotion Network over 40GigE Servers CPU: 2 x Intel Xeon X5550 Win2008 VirtualCenter EMC (8M Cache, 2.66 GHz) Disks: 2*146GB (6 disks slots) Mgmt Switch FC SW storage RAM: 24GB NICs ConnectX-2 EN 1/10/40Gb/s PCIe 2.0 1/ 10/ 40GigE (3 cables) Firmware version: 2.7.700 VMware Driver Version: mlx4_en ESX 4.1 Server Storage FC - connected via FC switch to the EMC storage 4Gb/s HBA EMC CX3-40F 1,2,4,8 VMs for Vmotion execution SW ESX4.1 vmotion VI Java API 2.0 hits Beta 2 milestone Guest OS: RH 5.4 15
Size (Gb) vmotion Benchmarks over 40GigE Passive VM (P) - Dirty the VM memory* once Active VM (A) - VM continue to dirt the VM memory* * 16GB per VM 350.00 Data Traffic Size (Gb) 300.00 250.00 200.00 150.00 100.00 50.00 0.00 10GE-P 40GE-P 10GE-A 40GE-A Faster networking speed less memory to migrate
Time (sec) Time (sec) VM Migration Acceleration Faster VM Migration with VMware vmotion over ConnectX-2 EN 40GigE NIC 18.00 16.00 14.00 12.00 10.00 8.00 6.00 4.00 2.00 0.00 Migration of Passive VM 45.00 40.00 35.00 30.00 25.00 20.00 15.00 10.00 5.00 0.00 Migration of Active VM 10GE-P 40GE-P 10GE-A 40GE-A 300% SLA boost in VM migration over 40GigE
VM Cost ($) SLA/ROI* Benefits with VM Migration Acceleration Boosted SLA at a Lower TCO 32 VMs 4 x (8) Cores Servers 10GigE Connectivity 32 VMs 2 x (16 Cores) Servers 40GigE Connectivity $1,600.00 $1,400.00 VM Cost on 10GigE vs 40GigE $1,200.00 $1,000.00 $800.00 $600.00 $400.00 4 x 8 Cores Server 4 x 10GE Ports 4 x 10GE Switch Ports 4 x Cables $15,800 Total Capital Cost $987.50 Capital Cost per VM $528.60 Power Cost per VM (3Y) 2 x 16 cores Server 2 x 40GE Ports 2 x 40GE Switch Ports 2 x Cables $10,700 Total Capital Cost $668.75 Capital Cost per VM $295.65 Power Cost per VM (3Y) $200.00 $- 10GigE CapEx OpEx 40GigE * Single VM Migration with 16GB memory 70%+ Operational cost saving over true 40GigE fabric
Duration [mm:ss] Multiple VM Migration Acceleration Multiple VM Migration with VMware vmotion over ConnectX-2 EN 1/10/40GigE NIC vmotion Average Migration Duration* 03:36 02:53 1GigE 10GigE 40GigE 02:10 01:26 00:43 00:00 1 2 3 4 5 6 7 8 # VM * Preliminary results 1GB per VM. Dirty once High jitter Enabling Concurrent Migration of More VMs over 40GigE
Summary Why 40GE in the Cloud Lower operational cost Lower CapEx Fewer cards, switch port, cables Lower OpEx Lower power, cooling, space SLA boost Faster VM migration Maximized VM performance Higher ROI Improved resources utilization