Intel Graphics Virtualization Technology Kevin Tian Graphics Virtualization Architect
Legal Disclaimer INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS. Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information. The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order. Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or go to: http://www.intel.com/design/literature.htm Intel, Core, Look Inside, and the Intel logo are trademarks of Intel Corporation in the United States and other countries. *Other names and brands may be claimed as the property of others. Copyright 2014 Intel Corporation.
GPU Virtualization VM VM VM Hypervisor 3D Media Compute Intel Processor Graphics 3
GPU Cloud Video Delivery Store/Stream, Transcode Cloud Graphics Gaming, Remote Apps, Rendering Visual Understanding Search, Surveillance GPU-as-a-service GPU Cloud 4
Petabytes per Month Thousands Media Processing Opportunity Consumer Internet Traffic 2011-2018 China Online Video Industry Market Internet Video File Sharing Web, Email and Data Online Gaming Online video market (0.1B) Year on year growth (%) Source: Cisco Systems Inc., Visual Network Index (VNI), 2013, 2015 Source: 2015.1 iresearch Inc., www.iresearch.com.cn Internet video traffic is forecasted to grow at 29% CAGR and will represent 69% of consumer traffic by 2017 5
Media Delivery Example 1 Video files store in cloud storage 2 Media transcoding before deliver to CDN 3 Media transcoding for client in Edge Content Provider Data Center Content Deliver Network Transport Edge (RAN, IP, Cable) Service Provider Laptop Servers Servers VM VM VM VM VM VM Media Cloud OTT, VOD, Offline Video VM VM VM SDN NFV Edge Cloud Realtime, Video Conf, video awareness 6
Requirements of GPU Virtualization hcsvg hb b Performance Direct GPU acceleration Capability Consistent visual experience Sharing Multiple Virtual Machines Intel Confidential
GPU Virtualization Approaches API Forwarding Direct Pass-thru Full GPU Virtualization Pros: Performance Sharing Cons: No media/gpgpu Compatibility Pros: Performance Capability Cons: No sharing Pros: Performance Capability Sharing 8
Intel Graphics Virtualization Technology Intel GVT-s for API level GPU sharing Make existing API forwarding protocols running best on Intel platform Intel GVT-d for direct GPU passthrough Xen GPU passthrough upstreaming in progress KVM PoC patch in community Intel GVT-g for vgpu based sharing Achieve a good balance of performance, feature and sharing Xen implementations (a.k.a XenGT) in production quality on HSW BDW support is in alpha quality in 2015/Q1 release KVM support (a.k.a KVMGT) in prototype quality on HSW 9
Intel GVT-g: Full GPU Virtualization Performance Feature Sharing 3DMark: 80% H.264 transcoding: 90% (of native performance) Native driver DirectX 11.1, OpenGL 4.2, OpenCL 1.2, MediaSDK x.x Simultaneously accelerate multiple VMs HSW BDW SKL
Building Blocks OpenStack * Nova Control point GPU instance Media Server VoD streaming Intel Media SDK Media Server Real Time Transcoding Intel Media SDK Media Server Video Conference Intel Media SDK OpenStack Network node Intel HD Driver Intel HD Driver Intel HD Driver OpenStack Storage/Image ISV Guest OS Ubuntu * 14.04 LTS XenGT Xen * Hypervisor ISV Guest OS Windows * 7 64bit ISV Guest OS Windows 8 32bit KVMGT KVM Hypervisor ISV/Non Intel Intel Hardware Host OS or VM Intel Own Cloud Infrastructure Intel Xeon E3 Processor 4 th generation Intel Core i7 Intel Contributed 11
Video Conference Usage Case 4K Camera Media Server Pool (x86 platform with Intel Processor graphics) 4K Display 1080P Camera Intel Processor graphics-based Encoding, Decoding, and Composing. OpenStack * Media Cloud 4K Video Conferencing on Media Plane NFV Demo @ MWC 15 12
Performance Summary 1400.0 1200.0 1000.0 800.0 600.0 400.0 200.0 High Density workload: 480p transcoding 450.0 400.0 350.0 300.0 250.0 200.0 150.0 100.0 50.0 0.0 High Density workload: 1080p transcoding 0.0 1ch-D1 5ch-D1 10ch-D1 20ch-D1 25ch-D1 30ch-D1 Native vmediaserver native vmediaserver Config: I7 4770, Guest Ubuntu * 14.04LTS, 4GB mem, 1.5G GraphicMem, MediaSDK Avg S90% of native H.264 transcoding performance 13
FPS throughput CPU% utilized CPU Transcoding vs. GPU Transcoding vcpu vs Intel Graphics Virtualization Technology (Intel GVT-g) total fps (1ch x 1080p MPEG2->720p H264 transcoding) 180 160 140 159.448 131.142 137.496 142.4 120.00% 100.00% 120 100 80 60 40 20 22.579 37.426 66.11 60.925 80.00% 60.00% 40.00% 20.00% Performance boost with Intel GVT-g! 0 1 vcpu 2 vcpu 4 vcpu 6 vcpu 0.00% IA Software Solution Intel GVT-g based SW Solution vcpu % Intel GVT vcpu % Lab data. Config: I7 4770, Guest Windows * 7_x64, 4GB mem, 1.5G GraphicMem, MediaSDK 14
Intel Confidential Q&A