Working with Metal Overview

Transcription

1 Graphics and Games #WWDC14 Working with Metal Overview Session 603 Jeremy Sandmel GPU Software 2014 Apple Inc. All rights reserved. Redistribution or public display not permitted without written permission from Apple.

2 Metal Dramatically reduced overhead Unified graphics and compute Precompiled shaders Efficient multithreading Designed for A7

3 Agenda Background API concepts Shading language Developer tools

4 Agenda Background API concepts Shading language Developer tools

5 10x more draw calls

6 About Draw Calls

7 About Draw Calls Each draw call requires its own state vector Shaders, states, textures, render targets, etc.

8 About Draw Calls Each draw call requires its own state vector Shaders, states, textures, render targets, etc. Changing state vectors can be expensive Translation to hardware commands

9 About Draw Calls Each draw call requires its own state vector Shaders, states, textures, render targets, etc. Changing state vectors can be expensive for the CPU Translation to hardware commands

10 About Draw Calls Your Application Each draw call requires its own state vector Shaders, states, textures, render targets, etc. Changing state vectors can be expensive for the CPU Translation to hardware commands Set Shaders Set Textures Set Vertex Buffers Draw #1 Set Shaders Set Blend Set Depth Test Draw #2

11 About Draw Calls Your Application Each draw call requires its own state vector Shaders, states, textures, render targets, etc. Set Shaders Set Textures Set Vertex Buffers Draw #1 Changing state vectors can be expensive Translation to hardware commands for the CPU Set Shaders Set Blend Set Depth Test Draw #2 Hardware commands

12 About Draw Calls Your Application Each draw call requires its own state vector Shaders, states, textures, render targets, etc. Set Shaders Set Textures Set Vertex Buffers Draw #1 Changing state vectors can be expensive Translation to hardware commands for the CPU Set Shaders Set Blend Set Depth Test Draw #2 Hardware commands

13 About Draw Calls Your Application Each draw call requires its own state vector Shaders, states, textures, render targets, etc. Set Shaders Set Textures Set Vertex Buffers Draw #1 Changing state vectors can be expensive Translation to hardware commands More draw calls per frame gives you for the CPU Set Shaders Set Blend Set Depth Test Draw #2 More unique objects More visual variety Hardware commands More freedom for game artists and designers

14 Before Metal

15 Before Metal Long history of GPU programming APIs Standards OpenGL, OpenCL Domains High level, low level, 2D, 3D Architectures Platforms, devices, GPUs

16 Before Metal Long history of GPU programming APIs Standards OpenGL, OpenCL Domains High level, low level, 2D, 3D Architectures Platforms, devices, GPUs Something was missing

17 Deep Integration

18 Deep Integration + +

19 Deep Integration + +

20 Deep Integration What if we took the same approach for GPU programming? + +

21 Deep Integration What if we took the same approach for GPU programming? + +

22 Deep Integration What if we took the same approach for GPU programming? + + =

23

24 Metal Design

25 Metal Design Thinnest possible API

26 Metal Design Thinnest possible API Modern GPU features

27 Metal Design Thinnest possible API Modern GPU features Do expensive tasks less often

28 Metal Design Thinnest possible API Modern GPU features Do expensive tasks less often Predictable performance

29 Metal Design Thinnest possible API Modern GPU features Do expensive tasks less often Predictable performance Explicit command submission

30 Metal Design Thinnest possible API Modern GPU features Do expensive tasks less often Predictable performance Explicit command submission Optimized for CPU behavior

31 Your App GPU

32 Your App Scene Graphs SceneKit SpriteKit GPU

33 Your App Scene Graphs 2D Graphics and Imaging SceneKit SpriteKit Core Animation Core Image Core Graphics GPU

34 Your App Scene Graphs 2D Graphics and Imaging Standards-Based 3D Graphics SceneKit SpriteKit Core Animation Core Image Core Graphics OpenGL ES GPU

35 Your App Scene Graphs 2D Graphics and Imaging Standards-Based 3D Graphics High Efficiency GPU Access SceneKit SpriteKit Core Animation Core Image Core Graphics OpenGL ES Metal GPU

36 So how did we do this?

37 Frame Times Many games target frame rate of 30 FPS (33.3 milliseconds/frame)

38 Frame Times Many games target frame rate of 30 FPS (33.3 milliseconds/frame) 0 ms 33.3 ms 66.7 ms 100 ms

39 Frame Times Many games target frame rate of 30 FPS (33.3 milliseconds/frame) 0 ms 33.3 ms 66.7 ms 100 ms CPU work frame N-1 CPU work frame N GPU work frame N-1 GPU work frame N

40 Frame Times Many games target frame rate of 30 FPS (33.3 milliseconds/frame) 0 ms 33.3 ms 66.7 ms 100 ms CPU work frame N-1 CPU work frame N CPU work frame N+1 CPU work frame N+2 GPU work frame N-1 GPU work frame N GPU work frame N+1 GPU work frame N+2

41 One Balanced Frame 0 ms 33.3 ms CPU CPU work frame N GPU GPU work frame N-1

42 CPU Can Take More Time Than GPU 0 ms 33.3 ms CPU CPU work frame N GPU GPU work frame N-1

43 CPU Can Take More Time Than GPU 0 ms 33.3 ms CPU CPU work frame N GPU GPU work frame N-1 GPU idle time GPU utilization = 67%

44 More GPU Work Requires More CPU Work 0 ms 33.3 ms 50 ms CPU CPU work frame N GPU GPU work frame N-1 GPU idle time

45 CPU Time Includes Application and GPU API 0 ms 33.3 ms 50 ms CPU Application frame N CPU work frame N GPU API frame N GPU GPU work frame N-1 GPU idle time

46 Targeting CPU Time Spent in GPU API 0 ms 33.3 ms 50 ms CPU Application frame N GPU API frame N GPU GPU work frame N-1 GPU idle time

47 Metal Dramatically Reduces GPU API Time 0 ms GPU API frame N 20 ms 33.3 ms CPU Application frame N CPU idle time GPU GPU work frame N-1

48 Metal Dramatically Reduces GPU API Time 0 ms GPU API frame N 20 ms 33.3 ms CPU Application frame N CPU idle time GPU GPU work frame N-1

49 Use CPU Time to Improve Your Game 0 ms 20 ms 33.3 ms CPU Application frame N More Physics More AI CPU idle time GPU GPU work frame N-1

50 Use CPU Time to Draw More Objects 0 ms 33.3 ms CPU Application frame N More Physics More AI Up to 10x more draw calls GPU GPU work frame N-1

51 Use CPU Time to Draw More Objects 0 ms 33.3 ms CPU Application frame N More Physics More AI Up to 10x more draw calls GPU GPU work frame N-1

52 Why Is GPU Programming Expensive?

53 Why Is GPU Programming Expensive? State validation Confirming API usage is valid Encoding API state to hardware state

54 Why Is GPU Programming Expensive? State validation Confirming API usage is valid Encoding API state to hardware state Shader compilation Run-time generation of shader machine code Interactions between state and shaders

55 Why Is GPU Programming Expensive? State validation Confirming API usage is valid Encoding API state to hardware state Shader compilation Run-time generation of shader machine code Interactions between state and shaders Sending work to GPU Managing resource residency Batching commands

56 Do Expensive Tasks Less Often When Frequency Application build Content loading Draw time

57 Do Expensive Tasks Less Often When Frequency Application build Never Content loading Draw time

58 Do Expensive Tasks Less Often When Frequency Application build Never Content loading Rare Draw time

59 Do Expensive Tasks Less Often When Frequency Application build Never Content loading Rare Draw time 1000s of times per frame

60 Do Expensive Tasks Less Often When Frequency Before Metal Application build Never Content loading Rare Draw time 1000s of times per frame Shader compilation State validation Start work on GPU

61 Do Expensive Tasks Less Often When Frequency Before Metal After Metal Application build Never Shader compilation Content loading Rare State validation Shader compilation Draw time 1000s of times per frame State validation Start work on GPU Start work on GPU

62 Agenda Background API concepts Shading language Developer tools

63 Metal Objects Objects Purpose

64 Metal Objects Objects Purpose Device The GPU

65 Metal Objects Objects Purpose Device The GPU Command Queue Serial sequence of command buffers

66 Metal Objects Objects Purpose Device The GPU Command Queue Serial sequence of command buffers Command Buffer Contains GPU hardware commands

67 Metal Objects Objects Purpose Device The GPU Command Queue Serial sequence of command buffers Command Buffer Contains GPU hardware commands Command Encoder Translates API commands to GPU hardware commands

68 Metal Objects Objects Purpose Device The GPU Command Queue Serial sequence of command buffers Command Buffer Contains GPU hardware commands Command Encoder Translates API commands to GPU hardware commands State Framebuffer configuration, blend, depth, samplers, etc.

69 Metal Objects Objects Purpose Device The GPU Command Queue Serial sequence of command buffers Command Buffer Contains GPU hardware commands Command Encoder Translates API commands to GPU hardware commands State Framebuffer configuration, blend, depth, samplers, etc. Code Shaders

70 Metal Objects Objects Purpose Device The GPU Command Queue Serial sequence of command buffers Command Buffer Contains GPU hardware commands Command Encoder Translates API commands to GPU hardware commands State Framebuffer configuration, blend, depth, samplers, etc. Code Shaders Resources Textures and Data Buffers (vertices, constants, etc.)

71 Key Resource Code State Device Descriptor System

72 Command Queue Device Key Resource Code State Descriptor System

73 Command Command Command Buffer Buffer Key Resource Code Command Queue Device State Descriptor System

74 Render Command Encoder Render Render Command Command Encoder Encoder Command Command Command Buffer Buffer Key Resource Code Command Queue Device State Descriptor System

75 Data Buffer Resource Data Data Buffer Buffer Resource Resource Render Command Encoder Render Render Command Command Encoder Encoder Command Command Command Buffer Buffer Key Resource Code Command Queue Device State Descriptor System

76 Data Buffer Resource Data Data Buffer Buffer Resource Resource Texture Resource Texture Texture Resource Resource Texture Descriptor Texture Texture Descriptor Descriptor Render Command Encoder Render Render Command Command Encoder Encoder Command Command Command Buffer Buffer Key Resource Code Command Queue Device State Descriptor System

77 Data Buffer Resource Data Data Buffer Buffer Resource Resource Render Command Encoder Render Render Command Command Encoder Encoder Texture Resource Texture Texture Resource Resource Render Pipeline State Texture Descriptor Texture Texture Descriptor Descriptor Render Pipeline Descriptor Vertex Format Vertex Function Fragment Function Vertex Descriptor Function Function Blend Blend Descriptor Command Command Command Buffer Buffer Key Resource Code Command Queue Device State Descriptor System

78 Data Buffer Resource Data Data Buffer Buffer Resource Resource Render Command Encoder Render Render Command Command Encoder Encoder Texture Resource Texture Texture Resource Resource Render Pipeline State Texture Descriptor Texture Texture Descriptor Descriptor Render Pipeline Descriptor Vertex Format Vertex Function Fragment Function Vertex Descriptor Function Function Depth Stencil State Depth Stencil Descriptor Blend Blend Descriptor Command Command Command Buffer Buffer Key Resource Code Command Queue Device State Descriptor System

79 Data Buffer Resource Data Data Buffer Buffer Resource Resource Render Command Encoder Render Render Command Command Encoder Encoder Texture Resource Texture Texture Resource Resource Render Pipeline State Texture Descriptor Texture Texture Descriptor Descriptor Render Pipeline Descriptor Vertex Format Vertex Function Fragment Function Vertex Descriptor Function Function Depth Stencil State Depth Stencil Descriptor Blend Blend Descriptor Render Pass Descriptor Attachment Descriptor Attachment Attachment Descriptor Descriptor Texture Resource Texture Texture Resource Resource Texture Descriptor Texture Texture Descriptor Descriptor Command Command Command Buffer Buffer Key Resource Code Command Queue Device State Descriptor System

80 Data Data Buffer Data Buffer Buffer Resource Resource Resource Texture Texture Texture Resource Resource Resource Render Command Encoder Render Render Command Command Encoder Encoder Render Pipeline State Depth Stencil State Texture Texture Texture Resource Resource Resource Command Command Command Buffer Buffer Command Queue Device

81 Data Data Buffer Data Buffer Buffer Resource Resource Resource Changeable Source Buffers Texture Texture Texture Resource Resource Resource Changeable Source Textures Render Command Encoder Render Render Command Command Encoder Encoder Render Pipeline State Depth Stencil State Texture Texture Texture Resource Resource Resource Command Command Command Buffer Buffer Command Queue Device

82 Data Data Buffer Data Buffer Buffer Resource Resource Resource Changeable Source Buffers Texture Texture Texture Resource Resource Resource Changeable Source Textures Render Command Encoder Render Render Command Command Encoder Encoder Render Pipeline State Depth Stencil State Texture Texture Texture Resource Resource Resource Fixed Render Target Textures Command Command Command Buffer Buffer Command Queue Device

83 Render Command Encoder Render Command Encoder Render Command Encoder Command Buffer Command Queue Device

84 Render Command Encoder Compute Command Encoder Render Command Encoder Command Buffer Command Queue Device

85 Thread #1 Thread #2 Render Command Encoder Compute Command Encoder Render Command Encoder Blit Command Encoder Compute Command Encoder Render Command Encoder Command Buffer Command Buffer Command Queue Device

86 Command Submission Model Command encoders convert API commands into hardware commands

87 Command Submission Model Command encoders convert API commands into hardware commands Hardware commands stored in command buffers

88 Command Submission Model Command encoders convert API commands into hardware commands Hardware commands stored in command buffers Three types of command encoders Render, Compute, Blit Can interleave different types into single command buffer Avoids implicit expensive state save and restore operations

89 Command Submission Model

90 Command Submission Model Explicit command buffer construction and submission App creates many lightweight command buffers App controls command buffer submission Metal signals app when command buffers finish execution

91 Command Submission Model Explicit command buffer construction and submission App creates many lightweight command buffers App controls command buffer submission Metal signals app when command buffers finish execution Command encoders generate commands immediately No deferred state validation Direct call to driver

92 Command Submission Model Multithreaded command encoding Multiple command buffers can be encoded in parallel App decides execution order Very efficient implementation to ensure scalable performance

93 Resource Update Model

94 Resource Update Model Designed for A7 s unified memory system CPU and GPU share same storage No implicit copies Automatic CPU/GPU coherency model - CPU and GPU observe writes at command buffer execution boundaries - No explicit CPU cache management required

95 Resource Update Model Designed for A7 s unified memory system CPU and GPU share same storage No implicit copies Automatic CPU/GPU coherency model - CPU and GPU observe writes at command buffer execution boundaries - No explicit CPU cache management required Significantly higher performance More synchronization responsibilities for you

96 Resource Update Model

97 Resource Update Model Two types of resources Textures (formatted images) - Render targets, texture sources Data buffers (unformatted memory) - a bag of bytes - Vertex data, shader constants, output memory, etc.

98 Resource Update Model Two types of resources Textures (formatted images) - Render targets, texture sources Data buffers (unformatted memory) - a bag of bytes - Vertex data, shader constants, output memory, etc. Resource structure (size, levels, format) can t be changed Avoids costly resource validation Resource contents can be changed

99 Resource Update Model

100 Resource Update Model Updating data buffers Direct access to storage by CPU No lock API needed

101 Resource Update Model Updating data buffers Direct access to storage by CPU No lock API needed Updating textures Implementation private storage Metal provides blazing fast texture update routines

102 Resource Update Model Updating data buffers Direct access to storage by CPU No lock API needed Updating textures Implementation private storage Metal provides blazing fast texture update routines GPU-accelerated and pipelined updates Via Blit command encoder

103 Resource Update Model

104 Resource Update Model Can share texture storage with other textures Interpret as different pixel formats with same pixel size - eg., srgb vs. RGB, or single 32-bit component vs. RGBA8888

105 Resource Update Model Can share texture storage with other textures Interpret as different pixel formats with same pixel size - eg., srgb vs. RGB, or single 32-bit component vs. RGBA8888 Can share texture storage with other buffers Assumes row-linear pixel data

106 Command Encoder Types

107 Command Encoder Types Render command encoder Graphics rendering

108 Command Encoder Types Render command encoder Graphics rendering Compute command encoder Data parallel computations

109 Command Encoder Types Render command encoder Graphics rendering Compute command encoder Data parallel computations Blit command encoder GPU-accelerated resource copy operations

110 Render Command Encoder

111 Render Command Encoder Generates hardware commands for single rendering pass All rendering to single framebuffer object Specifies states for vertex and fragment stages of 3D pipeline Interleaves resources, state changes, and draw calls

112 Render Command Encoder Generates hardware commands for single rendering pass All rendering to single framebuffer object Specifies states for vertex and fragment stages of 3D pipeline Interleaves resources, state changes, and draw calls No draw time compilation App controls when all significant compilation and state validation occurs

113 Render State Objects State Object Description DepthStencil DepthStencil comparison functions and write masks Sampler Filter states, addressing modes, LOD state Render Pipeline Everything else Vertex and pixel shader functions Vertex data layout Multisample state Blend state Color write masks

114 Render States States affecting compilation can t be changed after object creation Inexpensive states can be changed Changeable Render States Vertex and fragment shaders # of render targets, pixel format, color write masks Multisample state Blend state DepthStencil state and write masks Specification of buffers, textures, samplers Cull mode and facing orientation Depth clipping and depth bias Polygon mode Viewport and scissor Occlusion queries

115 Framebuffer Loads and Stores Framebuffer configuration designed for optimal behavior on A7 GPU Tile-based deferred-mode renderer

116 Framebuffer Loads and Stores Framebuffer configuration designed for optimal behavior on A7 GPU Tile-based deferred-mode renderer Explicit control of framebuffer tile cache Load and Store operations Load at start of render pass Store at end of render pass

117 Framebuffer Loads and Stores Framebuffer configuration designed for optimal behavior on A7 GPU Tile-based deferred-mode renderer Explicit control of framebuffer tile cache Load and Store operations Load at start of render pass Store at end of render pass App choses per render target Load Don t care, load, clear Store Don t care, store, multisample resolve

118 Before Metal Framebuffer loads and stores One Frame Color Framebuffer Read Render Pass #1 Write Color Framebuffer Read Render Pass #2 Write Color Framebuffer

119 Before Metal Framebuffer loads and stores One Frame Color Framebuffer Read Write Color Framebuffer Read Write Color Framebuffer Render Pass #1 Render Pass #2

120 Before Metal Framebuffer loads and stores One Frame Color Framebuffer Read Write Color Framebuffer Read Write Color Framebuffer Render Pass #1 Render Pass #2 Depth Framebuffer Read Write Read Write Depth Framebuffer Depth Framebuffer

121 Before Metal Framebuffer loads and stores One Frame Color Framebuffer Read Write Color Framebuffer Read Write Color Framebuffer Render Pass #1 Render Pass #2 Depth Framebuffer Read Write Read Write Depth Framebuffer Depth Framebuffer Framebuffer Memory Bandwidth Color: 2 reads + 2 writes Depth: 2 reads + 2 writes

122 Metal Framebuffer loads and stores One Frame Color Framebuffer Read Write Color Framebuffer Read Write Color Framebuffer Render Pass #1 Render Pass #2 Depth Framebuffer Read Write Read Write Depth Framebuffer Depth Framebuffer

123 Metal Framebuffer loads and stores One Frame Color Framebuffer Don t Care Store Write Color Framebuffer Read Write Color Framebuffer Render Pass #1 Render Pass #2 Depth Framebuffer Read Write Read Write Depth Framebuffer Depth Framebuffer

124 Metal Framebuffer loads and stores One Frame Color Framebuffer Don t Care Store Write Color Read Load Store Framebuffer Write Color Framebuffer Render Pass #1 Render Pass #2 Depth Framebuffer Read Write Read Write Depth Framebuffer Depth Framebuffer

125 Metal Framebuffer loads and stores One Frame Color Framebuffer Don t Care Store Write Color Read Load Store Framebuffer Write Color Framebuffer Render Pass #1 Render Pass #2 Depth Framebuffer Clear Don t Care Depth Framebuffer Read Write Depth Framebuffer

126 Metal Framebuffer loads and stores One Frame Color Framebuffer Don t Care Store Write Color Read Load Store Framebuffer Write Color Framebuffer Render Pass #1 Render Pass #2 Depth Framebuffer Clear Don t Care Depth Framebuffer Clear Don t Care Depth Framebuffer

127 Dramatic Reduction in Memory Traffic One Frame Color Framebuffer Don t Care Store Write Read Load Store Color Framebuffer Write Color Framebuffer Render Pass #1 Render Pass #2 Depth Framebuffer Clear Don t Care Depth Framebuffer Clear Don t Care Depth Framebuffer Framebuffer Memory Bandwidth Color: 1 reads + 2 writes Depth: 0 reads + 0 writes

128 Compute Command Encoder Familiar compute run-time and memory model Textures and data buffers Local and global memory Local atomics Barriers Memory loads and stores User-specified workgroup dimensions

129 Compute Command Encoder

130 Compute Command Encoder Fully integrated with graphics Unified API, shading language and developer tools Efficiently interleaves Compute commands with Render and Blit commands

131 Compute Command Encoder Fully integrated with graphics Unified API, shading language and developer tools Efficiently interleaves Compute commands with Render and Blit commands No execution-time compilation App controls when all significant compilation and validation occurs

132 Compute Command Encoder State Object Description Compute State Compute functions, workgroup configuration Sampler Filter states, addressing modes, LOD state

133 Blit Command Encoder Enables asynchronous copies In parallel with graphics and compute operations

134 Blit Command Encoder Enables asynchronous copies In parallel with graphics and compute operations Texture uploads Copy to/from other texture or data buffer Accelerated mipmap generation

135 Blit Command Encoder Enables asynchronous copies In parallel with graphics and compute operations Texture uploads Copy to/from other texture or data buffer Accelerated mipmap generation Data Buffer updates Copy to/from another data buffer or texture Fill with constant values

136 Agenda Background API concepts Shading language Developer tools

137 Shading Language

138 Shading Language Unified shading language for graphics and compute processing

139 Shading Language Unified shading language for graphics and compute processing Based on C++11 Static subset Built from LLVM and clang

140 Shading Language Unified shading language for graphics and compute processing Based on C++11 Static subset Built from LLVM and clang Additions GPU hardware features (texture sampling, rasterization, compute operations, etc.) Function overloading and templates

141 Shading Language

142 Shading Language Data types for graphics and compute features Scalar, vector and matrix types Samplers and textures

143 Shading Language Data types for graphics and compute features Scalar, vector and matrix types Samplers and textures Attributes Function arguments Sampling and interpolation qualifiers Per-instance inputs, outputs, and built-in graphics variables Programmable blending

144 Shading Language

145 Shading Language Multiple shaders per source file

146 Shading Language Multiple shaders per source file Metal shaders built by Xcode compiler into Metal library files Library contains archive of Metal shaders With run-time APIs - Load a Metal library - Finalize compilation to GPU machine code

147 Shading Language Multiple shaders per source file Metal shaders built by Xcode compiler into Metal library files Library contains archive of Metal shaders With run-time APIs - Load a Metal library - Finalize compilation to GPU machine code Metal includes standard library for graphics and compute functions

148 Argument Tables Textures, buffers, and samplers passed as arguments to functions Vertex, fragment, compute shaders

149 Argument Tables Textures, buffers, and samplers passed as arguments to functions Vertex, fragment, compute shaders Each command encoder includes set of argument tables One table per type (texture, buffer, sampler)

150 Argument Tables Textures, buffers, and samplers passed as arguments to functions Vertex, fragment, compute shaders Each command encoder includes set of argument tables One table per type (texture, buffer, sampler) Metal API and shading language use table index to reference arguments

151 Argument Tables Texture Index ID 0 Texture A 1 Texture B.. Texture.. n Texture Z Command Encoder

152 Argument Tables Texture Index ID 0 Texture A 1 Texture B.. Texture.. n Texture Z Buffer Index ID 0 Buffer A 1 Buffer B.. Buffer.. n Buffer Z Sampler Index ID 0 Sampler A 1 Sampler B.. Sampler.. n Sampler Z Command Encoder

153 Argument Tables vertex VertexOutput smoothtrianglevertex(constant float4 *pos_data [[ buffer(0) ]], constant float2 *uv_data [[ buffer(1) ]], uint vid [[ vertex_id ]]) { VertexOutput out; out.pos = pos_data[vid]; out.uv = uv_data[vid]; return out; }! fragment float4 smoothtrianglefragment(vertexoutput in [[ stage_in ]], texture2d<float> tex [[ texture(1) ]]) { return tex.sample(s, in.uv); } Shader Code Texture Index ID 0 Texture A 1 Texture B.. Texture.. n Texture Z Buffer Index ID 0 Buffer A 1 Buffer B.. Buffer.. n Buffer Z Sampler Index ID 0 Sampler A 1 Sampler B.. Sampler.. n Sampler Z Command Encoder

154 Argument Tables vertex VertexOutput smoothtrianglevertex(constant float4 *pos_data [[ buffer(0) ]], constant float2 *uv_data [[ buffer(1) ]], uint vid [[ vertex_id ]]) { VertexOutput out; out.pos = pos_data[vid]; out.uv = uv_data[vid]; return out; }! fragment float4 smoothtrianglefragment(vertexoutput in [[ stage_in ]], texture2d<float> tex [[ texture(1) ]]) { return tex.sample(s, in.uv); } Shader Code Texture Index ID 0 Texture A 1 Texture B.. Texture.. n Texture Z Buffer Index ID 0 Buffer A 1 Buffer B.. Buffer.. n Buffer Z Sampler Index ID 0 Sampler A 1 Sampler B.. Sampler.. n Sampler Z Command Encoder

155 Argument Tables vertex VertexOutput smoothtrianglevertex(constant float4 *pos_data [[ buffer(0) ]], constant float2 *uv_data [[ buffer(1) ]], uint vid [[ vertex_id ]]) { VertexOutput out; out.pos = pos_data[vid]; out.uv = uv_data[vid]; return out; }! fragment float4 smoothtrianglefragment(vertexoutput in [[ stage_in ]], texture2d<float> tex [[ texture(1) ]]) { return tex.sample(s, in.uv); } Shader Code Texture Index ID 0 Texture A 1 Texture B.. Texture.. n Texture Z Buffer Index ID 0 Buffer A 1 Buffer B.. Buffer.. n Buffer Z Sampler Index ID 0 Sampler A 1 Sampler B.. Sampler.. n Sampler Z Command Encoder

156 Argument Tables vertex VertexOutput smoothtrianglevertex(constant float4 *pos_data [[ buffer(0) ]], constant float2 *uv_data [[ buffer(1) ]], uint vid [[ vertex_id ]]) { VertexOutput out; out.pos = pos_data[vid]; out.uv = uv_data[vid]; return out; }! fragment float4 smoothtrianglefragment(vertexoutput in [[ stage_in ]], texture2d<float> tex [[ texture(1) ]]) { return tex.sample(s, in.uv); } Shader Code Texture Index ID 0 Texture A 1 Texture B.. Texture.. n Texture Z Buffer Index ID 0 Buffer A 1 Buffer B.. Buffer.. n Buffer Z Sampler Index ID 0 Sampler A 1 Sampler B.. Sampler.. n Sampler Z Command Encoder

157 Agenda Background API concepts Shading language Developer tools

158 Metal Shader Compiler Process

159 Metal Shader Compiler Process Metal shader sources compiled to libraries at application build time No need to ship source code with application Shading language errors reported at build time

160 Metal Shader Compiler Process Metal shader sources compiled to libraries at application build time No need to ship source code with application Shading language errors reported at build time Metal libraries compiled to device code at state object creation time No draw time compilation Device code cached after compilation

161 Metal Shader Compiler Process Metal shader sources compiled to libraries at application build time No need to ship source code with application Shading language errors reported at build time Metal libraries compiled to device code at state object creation time No draw time compilation Device code cached after compilation There is also a run-time shader compiler No draw time compilation For best performance, use offline compiler

162 Metal Shader Compiler Process In Xcode Metal Shader Compiler Your Application

163 Metal Shader Compiler Process In Xcode Metal Metal Metal Metal Metal Shader Metal Shader Compiler Your Application

164 Metal Shader Compiler Process In Xcode Metal Metal Metal Metal Metal Shader Metal Shader Compiler Metal Library Your Application

165 Metal Shader Compiler Process In Xcode Metal Metal Metal Metal Metal Shader Metal Shader Compiler Your Application Metal Library

166 Metal Shader Compiler Process In Xcode At application run-time Metal Metal Metal Metal Metal Shader Your Application Metal Library Metal Shader Compiler

167 Metal Shader Compiler Process In Xcode At application run-time Metal Metal Metal Metal Metal Shader Your Application Metal Library Metal Shader Compiler State Vertex Shader Fragment Shader Pipeline Object Creation

168 Metal Shader Compiler Process In Xcode At application run-time Metal Metal Metal Metal Metal Shader Your Application Metal Library Metal Shader Compiler State Vertex Shader Fragment Shader Pipeline Object Creation

169 Metal Shader Compiler Process In Xcode At application run-time Metal Metal Metal Metal Metal Shader Your Application Metal Library Metal Shader Compiler State Vertex Shader Fragment Shader Pipeline Object Creation Shader Cache

170 Metal Shader Compiler Process In Xcode At application run-time Metal Metal Metal Metal Metal Shader Your Application Metal Library Metal Shader Compiler State Vertex Shader Fragment Shader Pipeline Object Creation Shader Cache Metal Device Compiler

171 Metal Shader Compiler Process In Xcode At application run-time Metal Metal Metal Metal Metal Shader Your Application Metal Library Metal Shader Compiler State Vertex Shader Fragment Shader Pipeline Object Creation Shader Cache Metal Device Compiler GPU

172 Metal Tools Fully Integrated into Xcode Visual frame debugger API trace and navigation Shader edit-and-continue Rich source code editing (including shaders) Graphics and compute state inspection Shader compiler Debug mode for Metal framework

173

174 Frame Navigator

175 Framebuffer View

176 Resource View

177 State Inspector

178

179 Performance Report

180

181 Shader Profiler

182 Shader Profiler

183 Shader Profiler

184 Shader Profiler

185 Shader Profiler

186

187 Demo The Collectables on Metal Sean Tracey Crytek

188 Summary

189 Summary Low overhead, high performance GPU programming API

190 Summary Low overhead, high performance GPU programming API Up to 10x more draw calls

191 Summary Low overhead, high performance GPU programming API Up to 10x more draw calls Designed for A7 and ios

192 Summary Low overhead, high performance GPU programming API Up to 10x more draw calls Designed for A7 and ios Streamlined for modern GPU features

193 Summary Low overhead, high performance GPU programming API Up to 10x more draw calls Designed for A7 and ios Streamlined for modern GPU features Fine-grained control

194 Summary Low overhead, high performance GPU programming API Up to 10x more draw calls Designed for A7 and ios Streamlined for modern GPU features Fine-grained control Precompiled shaders

195 Summary Low overhead, high performance GPU programming API Up to 10x more draw calls Designed for A7 and ios Streamlined for modern GPU features Fine-grained control Precompiled shaders Fantastic developer tools

196 Summary Low overhead, high performance GPU programming API Up to 10x more draw calls Designed for A7 and ios Streamlined for modern GPU features Fine-grained control Precompiled shaders Fantastic developer tools Enables entirely new class of games

197 More Information Filip Iliescu Graphics and Games Technologies Evangelist Allan Schaffer Graphics and Games Technologies Evangelist Documentation Apple Developer Forums

198 Related Sessions Working with Metal Fundamentals Pacific Heights Wednesday 10:15AM Working with Metal Advanced Pacific Heights Wednesday 11:30AM

199 Labs Metal Lab Graphics and Games Lab A Wednesday 2:00PM Metal Lab Graphics and Games Lab B Thursday 10:15AM

200