OpenCL Press Conference

Transcription

1 Copyright Khronos Group, Page 1 OpenCL Press Conference Tokyo, November 2011 Neil Trevett Vice President Mobile Content, NVIDIA President, The Khronos Group

2 Copyright Khronos Group, Page 2 Agenda Introducing Khronos and announcing OpenCL 1.2! - Neil Trevett, NVIDIA Guest Speakers - Imagination Tony King-Smith - AMD Japan Kazuo Hamaji - Fixstars Akihiko Tomita Q&A

3 Copyright Khronos Group, Page 3 Announcing OpenCL 1.2! OpenCL 1.2 Specification publicly available today! - Significant updates - Khronos being responsive to developer requests - Updated OpenCL 1.2 conformance tests available - Multiple implementations underway Backward compatible upgrade to OpenCL OpenCL 1.2 will run any OpenCL 1.0 and OpenCL 1.1 programs - OpenCL 1.2 platform can contain 1.0, 1.1 and 1.2 devices - Maintains embedded profile for mobile and embedded devices

4 Copyright Khronos Group, Page 4 Khronos - Connecting Software to Silicon Creating open, royalty-free API standards - Focus on graphics, dynamic media, compute and sensor hardware Low-level - just above raw silicon - Foundation functionality needed on every platform Safe forum for industry cooperation - By the industry for the industry - Open to any company to join - IP framework to protect members and industry APIs enable software developers to turn silicon functionality into rich end user experiences

5 Copyright Khronos Group, Page 5 Apple Over 100 members any company worldwide is welcome to join Board of Promoters

6 Authoring and accessibility Application Acceleration Copyright Khronos Group, Page 6 Khronos Family of Standards StreamInput 3D Digital Asset Exchange format Plugin-free 3D Web Content Web Compute Unified Sensor and Input Processing Cross platform desktop 3D Parallel Computing Embedded and Mobile 3D Vector 2D A coordinated ecosystem of compute, graphics and media standards and APIs Streaming Media Advanced Audio Surface Management Khronos creates royalty-free specifications to meet real market needs and helps drive industry adoption across multiple platforms

7 Copyright Khronos Group, Page 7 Processor Parallelism CPUs Multiple cores driving performance increases Emerging Intersection GPUs Increasingly general purpose data-parallel computing Multiprocessor programming e.g. OpenMP Heterogeneous Computing Graphics APIs and Shading Languages OpenCL is a programming framework for heterogeneous compute resources

8 Copyright Khronos Group, Page 8 The BIG Idea behind OpenCL OpenCL execution model - Define N-dimensional computation domain - Execute a kernel at each point in computation domain C Derivative to write kernels based on ISO C99 - APIs to discover devices in a system and distribute work to them Targeting many types of device - GPUs, CPUs, DSPs, embedded systems, mobile phones.. Even FPGAs Traditional loops void trad_mul(int n, const float *a, const float *b, float *c) { int i; for (i=0; i<n; i++) c[i] = a[i] * b[i]; } Data Parallel OpenCL kernel void dp_mul(global const float *a, global const float *b, global float *c) { int id = get_global_id(0); c[id] = a[id] * b[id]; } // execute over n work-items

9 Copyright Khronos Group, Page 9 OpenCL Platform Model One Host + one or more Compute Devices - Each Compute Device is composed of one or more Compute Units - Each Compute Unit is further divided into one or more Processing Elements

10 Copyright Khronos Group, Page 10 Anatomy of OpenCL Platform Layer API - A hardware abstraction layer over diverse computational resources - Query, select and initialize compute devices - Create compute contexts and work-queues Runtime API - Execute compute kernels - Manage scheduling, compute, and memory resources Language Specification - C-based cross-platform programming interface - Subset of ISO C99 with language extensions - familiar to developers - Defined numerical accuracy - IEEE 754 rounding with specified maximum error - Online or offline compilation and build of compute kernel executables - Rich set of built-in functions

11 Copyright Khronos 2009 Group, Page 11 OpenCL Embedded Profile OpenCL 1.0 has Embedded profile - no need for a separate ES spec Almost identical functionality some reduced precision requirements An always-on, connected, mobile device with multiple sensors, graphics and imaging PLUS a supercomputer all in the palm of your hand will create a new wave of application opportunities A concept GPS phone processes images to recognize buildings and landmarks and uses the internet to supply relevant data

12 Copyright Khronos Group, Page 12 OpenCL Working Group Members Diverse industry participation many industry experts - Processor vendors, system OEMs, middleware vendors, application developers - Academia and research labs, FPGA vendors NVIDIA is chair, Apple is specification editor Apple

13 Copyright Khronos Group, Page 13 OpenCL Milestones Six months from proposal to released OpenCL 1.0 specification - Due to a strong initial proposal and a shared commercial incentive Multiple conformant implementations shipping - For CPUs and GPUs on multiple OS 18 month cadence between OpenCL 1.0, OpenCL 1.1 and now OpenCL Backwards compatibility protect software investment OpenCL working group formed Dec08 OpenCL 1.0 conformance tests released Jun10 OpenCL 1.2 Specification and conformance tests released! Jun08 OpenCL 1.0 released May09 OpenCL 1.1 Specification and conformance tests released Nov11

14 Copyright Khronos Group, Page 14 Major New Features in OpenCL 1.2 Partitioning Devices - Applications can partition a device into sub-devices - Enables computation to be assigned to specific compute units - Reserve a part of the device for use for high priority/latency-sensitive tasks or effectively use shared hardware resources such as a cache Separate compilation and linking of objects - Provides the capabilities and flexibility of traditional compilers - Create a library of OpenCL programs that other programs can link to Enhanced Image Support - Added support for 1D images, 1D & 2D image arrays - OpenGL sharing extension now enables an OpenCL image to be created from an OpenGL 1D texture, 1D and 2D texture arrays

15 Copyright Khronos Group, Page 15 More Major New Features in OpenCL 1.2 Custom devices and built-in kernels - Drive specialized custom devices from OpenCL even if not programmable - Can enqueue built-in kernels to custom devices alongside OpenCL kernels DX9 Media Surface Sharing - Efficient sharing between OpenCL and DirectX 9 or DXVA media surfaces DX11 surface sharing - Efficient sharing between OpenCL and DirectX 11 surfaces Installable Client Drivers (optional) - Portably handling multiple installed implementations from multiple vendors And many other updates and additions..

16 Copyright Khronos Group, Page 16 Partitioning Devices Devices can be partitioned into sub-devices - More control over how computation is assigned to compute units Sub-devices may be used just like a normal device - Create contexts, building programs, further partitioning and creating command-queues Three ways to partition a device - Split into equal-size groups - Provide list of group sizes - Group devices sharing a part of a cache hierarchy Compute Device Compute Device Host Compute Device Compute Unit Compute Unit Compute Unit Sub-device #1 Real-time processing tasks Compute Unit Compute Unit Compute Unit Sub-device #2 Mainline processing tasks

17 Copyright Khronos Group, Page 17 Custom Devices and Built-in Kernels Embedded platforms often contain specialized hardware and firmware - That cannot support OpenCL C Built-in kernels can represent these hardware and firmware capabilities - Such as video encode/decode Hardware can be integrated and controlled from the OpenCL framework - Can enqueue built-in kernels to custom devices alongside OpenCL kernels FPGAs are one example of device that can expose built-in kernels - Latest FPGAs can support full OpenCL C as well OpenCL becomes a powerful coordinating framework for diverse resources - Programmable and non-programmable devices controlled by one run-time Built-in kernels enable control of specialized processors and hardware from OpenCL run-time

18 Copyright Khronos Group, Page 18 Installable Client Driver Analogous to OpenGL ICDs in use for many years - Used to handle multiple OpenGL implementations installed on a system Optional extension - Platform vendor will choose whether to use ICD mechanisms Khronos OpenCL installable client driver loader - Exposes multiple separate vendor installable client drivers (Vendor ICDs) Application can access all vendor implementations - The ICD Loader acts as a de-multiplexor Application ICD Loader ICD Loader enables application to use any of the installed implementations Vendor #1 OpenCL Vendor #2 OpenCL Vendor #3 OpenCL ICD Loader ensures multiple implementations are installed cleanly

19 Copyright Khronos Group, Page 19 OpenCL Desktop Implementations

20 Copyright Khronos Group, Page 20 OpenCL Books Available Now! OpenCL Programming Guide - The Red Book of OpenCL - OpenCL in Action - Heterogeneous Computing with OpenCL - The OpenCL Programming Book -

21 Copyright Khronos Group, Page 21 Spec Translations Japanese OpenCL 1.1 spec translation available today Valued partnership between Khronos and CUTT in Japan Working on OpenCL 1.2 specification translations - Japanese, Korean and Chinese

22 Copyright Khronos Group, Page 22 Khronos OpenCL Resources OpenCL is 100% free for developers - Download drivers from your silicon vendor OpenCL Registry - OpenCL 1.2 Reference Card - PDF version - Online Man pages - OpenCL Developer Forums - Give us your feedback! -

23 Copyright Khronos Group, Page 23 Looking Forward OpenCL-HLM (High Level Model) Exploring high-level programming model, unifying host and device execution environments through language syntax for increased usability and broader optimization opportunities Long-term Core Roadmap Exploring enhanced memory and execution model flexibility to catalyze and expose emerging hardware capabilities WebCL Bring parallel computation to the Web through a JavaScript binding to OpenCL OpenCL-SPIR (Standard Parallel Intermediate Representation) Exploring low-level Intermediate Representation for code obfuscation/security and to provide target back-end for alternative high-level languages

24 Copyright Khronos Group, Page 24 Leveraging Native API Investment into HTML5 HTML5 evolving into cross-platform programming platform - Gradually exposing complete system capabilities Opportunity to synergize Web and native APIs development - Leverage native API investments, reduce developer learning cycles Khronos and W3C creating close liaison WebMAX? Camera control and video processing WebAudio Advanced JavaScript Audio HTML and Browser Composition Device and Sensor APIs Device Orientation Working Groups JavaScript StreamInput Native Native APIs shipping or working group underway JavaScript API shipping or working group underway Possible future JavaScript APIs

25 Copyright Khronos Group, Page 25 WebCL Parallel Computing for the Web Khronos launching new WebCL initiative - First announced in March API definition already underway JavaScript binding to OpenCL - Security is top priority Many use cases - Physics engines to complement WebGL - Image and video editing in browser Stay close to the OpenCL standard - Maximum flexibility - Foundation for higher-level middleware

26 Copyright Khronos Group, Page 26 WebCL Security Robustness WebCL will be 100% secure - Just like WebGL essential for any Web API Robustness provided through: - WebCL language restrictions (disallowing pointers) - Memory protection - Provisions for detecting and preventing denial of service OpenCL Robustness Extension - Can be implemented BY or OVER OpenCL - Most efficient if in OpenCL implementation itself WebCL Robustness WebCL Robustness Layer WebCL Robustness Layer - Allows query for OpenCL Robustness extension - Provides software support for features not supported in OpenCL device OpenCL Robustness Layer

27 Copyright Khronos Group, Page 27 WebCL Open Process and Resources Khronos open process to engage Web community - Public specification drafts, mailing lists, forums webcl_public@khronos.org Khronos welcomes new members to define and drive WebCL - info@khronos.org Nokia open sourced prototype for Firefox in May 2011 (LGPL) - Samsung open sourced prototype for WebKit in July 2011 (BSD) - Deformation Demo: Calculates and renders transparent and reflective deformed spheres on top of photo background Performance comparison - JS: ~1 FPS - WebCL: FPS

28 Copyright Khronos Group, Page 28 Visual Computing Ecosystem High performance compute and graphics interop buffer and events Compute and mobile APIs interoperate through EGL JavaScript bindings to OpenCL Parallel computation in HTML5

29 Copyright Khronos Group, Page 29 In Summary OpenCL 1.2 Specification released by Khronos today! - Updates to OpenCL to meet developer needs and requests - Backwards compatible with previous versions Extensive conformance tests already available - Multiple implementations underway OpenCL forms a vital part of the open visual computing ecosystem - Crucial to bring parallel computation to mobile and web platforms Strong ongoing investment in OpenCL s roadmap - Core exploring expanding OpenCL memory and execution models - OpenCL-HLM parallel programming expressed through high-level languages - OpenCL-SPIR low-level intermediate representations - WebCL bring OpenCL capabilities to HTML5 browsers