OpenGL Rendering Pipeline and Programmable Shaders

Transcription

1 h gpup Topics OpenGL Rendering Pipeline and Programmable s sh gpup Rendering Pipeline Types OpenGL Language Basics h gpup EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

2 h gpup 2 GPU/CPU Perormance Limiters sh gpup 2 GPU/CPU Perormance Limiters Perormance Limiter: A actor that limits the maximum perormance o a program on a system. A car s maximum speed is the perormance limiter on how long it takes to get somewhere. Perormance limiters are used to set expectations. Example: Program X on computer C runs in 2s. Based on the bandwidth limiter it should run 8s. Based on the computation limiter it should run.2s. Should we be satisied? Yes, 8 is close enough to 2 or us. h gpup 2 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

3 h gpup 3 Two Common Limiters: GPU/CPU Perormance Limiters sh gpup 3 Memory Bandwidth o some part o system. Computation Rate. h gpup 3 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

4 h gpup 4 GPU/CPU Perormance Limiters sh gpup 4 Memory Bandwidth Limiter Applies to some kind o boundary or bus: CPU/Memory Interace. PCIe (used between a motherboard and a plug-in card). Limiter oten gien in GB/s. Example: A program needs to read B o data. It runs on a system with a bandwidth limit o GB/s. Based on bandwidth limiter run time is 3 00 B GB/s = 30s. h gpup 4 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

5 h gpup 5 GPU/CPU Perormance Limiters sh gpup 5 Computation Rate Limiter Applies to rate o some kind o computation: Single-precision loating point operations. SP FLOP Double-precision loating point operations. DP FLOP Instruction execution. IPS Computation rate can apply to each core or all cores on a chip. h gpup 5 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 5

6 h gpup 6 GPU/CPU Perormance Limiters sh gpup 6 Computation Rate Limiter Example Each core o a 4-core processor can execute at 6GFLOP/s = FLOP/s The execution o a program perorms FP operations. What is the execution time bound imposed by the computation limit? I the program uses one core: 24 6 = 4s. I the program uses our cores: = s. h gpup 6 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 6

7 h gpup 7 GPU/CPU Perormance Limiters sh gpup 7 How Perormance Limiters Used Determine limits o hardware (oten rom product speciications). This is easy. Determine computation and communication needs o program. Easy or some programs, hard or others. Determine likeliness that these limits dominate perormance. Program oten must be careully written een or easy cases. Many small actors can push perormance down by 0 or more. h gpup 7 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 7

8 h gpup 8 GPU/CPU Perormance Limiters sh gpup 8 Typical GPU Organization 34. GB/s (i7-6700k) CPU memory interace 5.8 GB/s (PCIex6 3.0) GPU 2.6 SP GFLOP/s 057. GFLOP/s memory interace 480 GB/s Titan X CPU Memory GPU Memory h gpup 8 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 8

9 h gpup 9 Render Rate Limits GPU/CPU Perormance Limiters sh gpup 9 angles sources rom CPU. angles sourced rom buer object on GPU. h gpup 9 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 9

10 gpup 0 Rasterization sh gpup Rasterization: The process o inding the location o pixels coered by a primitie. Rasterization Input: Primitie s ertices. Primitie s attributes. Window-Space Coordinates = (4.,6.7) Rasterization Output: Coordinate o each pixel coered by primitie. Pixel Interpolated attributes or each pixel. ment: Inormation on a pixel coered by a primitie. gpup 0 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

11 gpup Rasterization Question Rasterization sh gpup By how much should pixel be coered by primitie? OpenGL s Answer or angles (Polygons) A ragment is generated i center o pixel is inside primitie. A special case applies i pixel center is on a shared edge. OpenGL has rules or other primities, and can apply antialiasing. 7 = (4.,6.7) For course, only consider triangles without antialiasing. gpup EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

12 gpup 2 Rasterization sh gpup Interpolation o Attributes ment includes attributes (associated data) interpolated rom primitie ertices. Types o Interpolation (OpenGL Language Terminology) smooth (Perspectie Correct) Interpolation: Attribute alue at point o triangle is linearly interpolated rom the attribute alue at each ertex based on object space coordinates. Computationally costly (requires diision), but correct. noperspectie Interpolation: Attribute alue at point o triangle is linearly interpolated rom the attribute alue at each ertex based on projected x and y coordinates (clip space or window space). lat (no) Interpolation: Attribute alue at point o triangle is the alue o the attribute o (the prooking ertex). Saes time when attributes are the same at all three ertices. gpup 2 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

13 gpup 3 Important Point Rasterization sh gpup One primitie can generate many ragments. ment usually carries: Window-space coordinates. (Exact position o pixels.) Interpolated lighted color. For writing to the rame buer. Interpolated z alue. Used to determine whether ragment is under or oer another ragment. gpup 3 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

14 gpup 4 sh gpup Pipeline: An organization or sotware and hardware which deines a ixed sequence o stages. Each stage carries out some operation, receiing its input data rom the prior stage and proiding its output data to the next stage. The order o data in the pipeline cannot change. Rendering Pipeline: An organization or the set o steps needed to conert a set o ertices into a rame buer image. The term rendering pipeline might be used generically or it might reer to something ery speciic. Clipping is the most tedious step in the rendering pipeline.. OpenGL Rendering Pipeline: The sequence o steps deined by OpenGL that start with a ertex and its attributes and usually result in the rame buer being written. Rendering Pass: The use o the rendering pipeline to render some set o primities. gpup 4 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

15 gpup 5 sh gpup Simpliied OpenGL Rendering Pipeline Rendering Pipeline Input (From CPU or Bu er Object) 3 2 Vertex Vtx Vertex Vtx 2 3 Rasterizer >> ment Frame Bu er Update Obj. Space Mat. Color 2 2 x o,y o,z o 3 r m,g m,b m 2 Clip Space Lighted Color 2 3 x c,y c,z c r l,g l,b l Interpolated between and x c,y c,z c r l,g l,b l Frame Bu er Normal x o,y o,z o gpup 5 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

16 gpup 6 sh gpup OpenGL Rendering Pipelines Deined by the OpenGL standard. Current is 4.5. gpup 6 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

17 gpup 7 sh gpup Deinitions Stage: A pipeline section. Programmable Stage (or Unit): An OpenGL RP stage which can perorm its operation by executing user-proided sotware. Fixed-Function Stage (or Unit): An OpenGL RP stage which cannot be programmed, it s unctionality is speciied by the standard and proided by the implementation. : A program set up to run in a programmable stage, or the programmable stage itsel. gpup 7 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

18 gpup 8 sh gpup Less Simpliied OpenGL Rendering Pipeline Programmable Unit Rendering Pipeline Input (From CPU or Buer Object) Vtx Vertex Vtx 2 3 Geometry >= Rasterizer >> Vertex Primitie () ment 0 or Frame Buer Update Fixed Function Unit Input Output ment gpup 8 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

19 gpup 9 Rendering Pass Vtx Vertex Vtx Geometry >= 0 Rasterizer >> sh gpup glbegin(gl_triangle_strip); glcolor3(lsu_spirit_gold); or ( int i=0; i<size; i++ ) ment 0 or Frame Buer Update glnormal3(norms[i].x,norms[i].y,norms[i].z); glvertex3(coords[i].x,coords[i].y,coords[i].z); } glend(); The execution o glbegin starts a rendering pass. Commands such as gldraw also start rendering passes. The rendering pass is complete ater glend inishes. During the rendering pass the CPU sends ertices into the start o the rendering pipeline which results in the rame buering being updated at the RP end. gpup 9 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup

20 gpup 20 Vertex Inputs Vtx Vertex Vtx Geometry >= 0 Rasterizer >> sh gpup 2 glbegin(gl_triangle_strip); glcolor3(lsu_spirit_gold); or ( int i=0; i<size; i++ ) ment 0 or Frame Buer Update glnormal3(norms[i].x,norms[i].y,norms[i].z); glvertex3(coords[i].x,coords[i].y,coords[i].z); } glend(); Each ertex in this example has the ollowing attributes: A coordinate (speciied by glvertex3). A normal (speciied by glnormal3). A color (speciied by glcolor3). Each execution o glvertex3 sends one ertex into the ertex shader. In the diagram a ertex, including all its attributes, shown as,, etc. gpup 20 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

21 gpup 2 The Vertex Vtx Vertex Vtx Geometry >= 0 Rasterizer >> sh gpup 2 Input: One ertex. ment 0 or Frame Buer Update Output: One ertex. Historical Role: Compute lighted color o ertex. Conert object-space coordinates to clip space. Current Role: Proide data or geometry shader (completely user determined). I no geometry shader, output must include clip-space coordinates. gpup 2 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

22 gpup 22 The Geometry Vtx Vertex Vtx Geometry >= 0 Rasterizer >> sh gpup 2 Input: One primitie. ment 0 or Frame Buer Update Output zero or more primities. Input primitie type must be compatible with primitie speciied by glbegin or gldraw. Input data is an array o ertex shader outputs the size o the array is determined by primitie type. Output primitie type can be reely chosen. Current Role: Must write clip-space coordinates to gl Position. Also writes whateer other data ragment shader needs. gpup 22 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

23 gpup 23 Rasterizer Vtx Vertex Vtx Geometry >= 0 Rasterizer >> sh gpup 2 Input: One primitie (type determined by geometry shader). ment 0 or Frame Buer Update Output: Zero or more ragments one ragment or each pixel that the primitie coers. The data or each ragment is some combination o the data or each ertex in the input primitie. The rasterizer cannot be programmed. gpup 23 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

24 gpup 24 ment Vtx Vertex Vtx Geometry >= 0 Rasterizer >> sh gpup 2 Input: One ragment. ment 0 or Frame Buer Update Output: Zero or one ragments. Typical Role: Read texels and blend with lighted color. gpup 24 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

25 gpup 25 Frame Buer Update Vtx Vertex Vtx Geometry >= 0 Rasterizer >> sh gpup 2 Input one ragment. Output: None. ment 0 or Frame Buer Update Typical Role Applies depth, stencil, and other tests to ragment. Blends or writes passing ragment to color plane o rame buer. Frame buer update is not programmable. gpup 25 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

26 gpup 26 Data Access by s Input One set or each ertex. Vertex One set or all ertices. sh gpup 2 Categories inputs and outputs. Uniorm ariables. Buer objects. Inputs and Outputs Vertex Normal Color MultiTexCoord0 my_s_input User-Deined Compatibility Proile-Deined Uniorm Vars glmodelviewmatrix, etc. Buer Object Position FrontColor TeXCoord[] my_s_out Data read and written by shader code. One set o data or each ertex, primitie, or ragment. To aoid waste, should not include alues common to all. For example, don t make color a shader input i all ertices are the same color, use a uniorm instead. gpup 26 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

27 gpup 27 Data Access by s Input One set or each ertex. Vertex One set or all ertices. sh gpup 2 Uniorm Variables One set o data shared by all. Read only. Size is limited, typically 64 kib. Vertex Normal Color MultiTexCoord0 my_s_input User-Deined Compatibility Proile-Deined Usually cached (especially i < 8 kib accessed). Uniorm Vars glmodelviewmatrix, etc. Buer Object Position FrontColor TeXCoord[] my_s_out Data read and written by shader code. gpup 27 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

28 gpup 28 Data Access by s Input One set or each ertex. Vertex One set or all ertices. sh gpup 2 Buer Objects Shared by all (ertices, primities, ragments). Can be read and written, typically as an array. Size is large. Vertex Normal Color MultiTexCoord0 my_s_input User-Deined Compatibility Proile-Deined Uniorm Vars glmodelviewmatrix, etc. Buer Object Position FrontColor TeXCoord[] my_s_out Data read and written by shader code. Usually not cached. gpup 28 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

29 gpup 29 OpenGL s sh gpup 2 Vertex Processor ment Processor Vertex Normal Color MultiTexCoord0 Position FrontColor TeXCoord[] Color TeXCoord[] Color Depth gpup 29 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 2

30 gpup 30 Preparation Major Rendering Pipeline Steps sh gpup 3 These actiities are perormed beore inoking pipeline. CPU speciies transorms, material properties, etc. Calling, say, gltranslate, helps set up pipeline but does not start it running or eed it data. Feed Data to Pipeline Data enters in a unit including a ertex and its attributes. This initiates the steps. gpup 30 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

31 gpup 3 sh gpup 3 Vertex Processing Steps (By GPU or each ertex.) Apply modeliew transorm to ertex. Main result is ertex coordinate in eye space. Compute lighted color o ertex. Main result is lighted color. Apply projection transorm to eye-space ertex. Result is ertex coordinate in clip space. gpup 3 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

32 gpup 32 sh gpup 3 Primitie Assembly Steps These steps operate on a primitie (a group o primities). Primitie Assembly (Group ertices into a primitie). Result is, say, a group o 3 describing a triangle. Clip (remoe) o-screen parts o primitie. Result is ewer and maybe dierent primities. Rasterize Result is the set o ragments (b locations) coered by primitie. gpup 32 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

33 gpup 33 sh gpup 3 ment Processing Steps These steps operate on a ragment. Fetch texels, ilter and blend. Result is a rame-buer ready color. Frame Buer Update I ragment passes depth and other tests, write or blend. gpup 33 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

34 gpup 34 Programmable Units sh gpup 3 Programmable Unit: Part o the pipeline that can be programmed (as deined by some API). Choice o what is and isn t programmable constrained by: Need to allow or parallel (multithreaded, SIMD, MIMD) execution. Simple memory access. gpup 34 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

35 gpup 35 sh gpup 3 Major OpenGL Programmable Units Vertex Processor: Transorm ertex and texture coordinates, compute lighting. Geometry Processor: Using a transormed primitie and its neighbors generates new primities. For example, replace one triangle with many triangles to more closely match a cured surace. ment Processor: Using interpolated coordinates, read iltered texels and combine with colors. gpup 35 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

36 gpup 36 Languages sh gpup 3 : A programmable part o a GPU. The name shader is now misleading but is still in common use. Language: An language or programming shaders. gpup 36 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

37 gpup 37 High-Leel Languages sh gpup 3 High-Leel Languages OpenGL Language OpenGL standard. Syntax ery similar to C. Language designed or ertex and ragment shaders. Cg Originated with ATI, adopted in Direct3D. Syntax ery similar to C. Language designed or stream programs geometry, ertex, and ragment programs can be in stream orm. gpup 37 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

38 gpup 38 OpenGL Language (OGSL) sh gpup 3 OpenGL Language Important Features C-like CPP-like preprocessor directies. Library o useul geometry unctions. Includes ector and matrix types and operators. gpup 38 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

39 gpup 39 Example OGSL Data Types Example sh gpup 3 ec4 ertex_e = gl_modelviewmatrix * o_point; ec3 norm_e = gl_normalmatrix * gl_normal; ec4 light_pos = gl_lightsource[].position; loat phase_light = dot(norm_e, normalize(light_pos - ertex_e).xyz); loat phase_user = dot(norm_e, -ertex_e.xyz); loat phase = sign(phase_light) == sign(phase_user)? abs(phase_light) : 0.0; gpup 39 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 3

40 gpup 40 Storage Qualiiers OGSL Storage Qualiiers sh gpup 4 Used in a ariable declaration, speciies where data stored. Below, in, uniorm, constant, and out are storage qualiiers. in ec4 orce; uniorm loat x; const int sides = 5; out ec2 nudge; // Input to this shader, dierent or each primitie. // Input to shader, alue rarely changed. // Can neer be changed. // Output o this shader (input to some other). gpup 40 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

41 gpup 4 sh gpup 4 Storage Qualiier Types uniorm: Read-only by shader. Written by client, change is time consuming. Typical use: transormation matrices. in: Input to shader. Read-only by shader that made the in declaration. Value is set either by client (using glvertexattrib and riends) or by a prior stage shader (by writing an out ariable. Typical uses: ertex material properties (color), normal. out: Output o shader. Value is written by shader in which out declaration appears and read by shader in subsequent stage. sampler: Read-only by ertex and ragment shader. A handle to a texture unit, used by texture access unctions. gpup 4 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

42 gpup 42 sh gpup 4 Interpolation Qualiiers Used or ragment shader inputs. Speciy how alue should be interpolated. lat: No interpolation. smooth: Perspectie-correct interpolation. noperspectie: Linear interpolation. gpup 42 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

43 gpup 43 sh gpup 4 Deprecated Storage Qualiiers. These were used in earlier ersions o OGSL. They hae been replaced by in and out. attribute: Deprecated. Like an in but only can be used or ertex shader. arying: Deprecated. When used in a ertex shader is the same as out, when used in a ragment shader is the same as in. gpup 43 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

44 gpup 44 sh gpup 4 Storage Qualiier Example // For ertex and ragment shaders: uniorm ec3 graity_orce; uniorm loat gs_constant; uniorm ec2 ball_size; // Vertex Only in loat step_last_time; in ec4 position_let, position_right, position_aboe, position_below; in ec3 ball_speed; out ec4 out_position; out ec3 out_elocity; // ment Only // in ec4 out_position; in ec3 out_elocity; gpup 44 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

45 gpup 45 Function Parameters OGSL Functions sh gpup 4 OpenGL Shading Language.30 Section 4.4 Call by alue. Parameter Qualiiers: in (deault) out inout Built In Functions See OpenGL Shading Language.30 Section 8 gpup 45 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

46 gpup 46 OpenGL Shading Language Use sh gpup 4 Steps or adding a typical shader to existing OpenGL code: Deine what the shader is supposed to do. Identiy appropriate programmable units (ertex, geometry, ragment, etc). Identiy data that shaders will use. I data rom client (CPU) determine whether attribute or uniorm. For attributes and uniorms, determine i pre-deined or user-deined. Write shader code. In CPU code ollow steps or installing shader. (E.g., use p). Get names o any new uniorms and attributes. As necessary, initialize uniorms and attributes. Turn shader on and o as necessary. gpup 46 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

47 gpup 47 Example Phong sh gpup 4 Phong : A lighting model in which the lighted color is computed at each ragment. (Otherwise the lighted color is computed at each ertex o a primitie and those lighted colors are interpolated across the ragments.) Phong Steps Deine what shader does. Computes lighting at ragment using interpolated normal... Identiy appropriate units. For computing lighting: ragment shader. For passing along normal and color ino, ertex shader. Identiy data that shaders use. VS: Lighting data, normal. (All pre-deined.) FS: Normal (interpolated), eye-space ertex coordinates. User de. gpup 47 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

48 gpup 48 sh gpup 4 OpenGL Calls, rom Initialization to Use (See OGL 4.3 Chapter 7) Create Program Object (Once) pobject = glcreateprogram() For Each (Vertex, Geometry, ment, etc.): Create Object sobject = glcreate(gl VERTEX SHADER) Proide Source Code to Object and Compile glsource(sobject,,&shader text lines,null); glcompile(sobject); Attach glattach(pobject,sobject); Link (Once) gllinkprogram(pobject); Use (Many Times, e.g., once per rame.) gluseprogram(pobject); gpup 48 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4

49 gpup 49 OGSL Use sh gpup 4 Obtaining and Using Variable Reerences At run time ariables identiied by number. At Initialization get location (index) o attributes and uniorms: sal pinnacle = glgetattriblocation(pobject,name); sun ball size = glgetuniormlocation(pobject,name); During Render (Inrequently) Change Uniorm Value (Using location) gluniorm2(sun ball size,ball size,ball size sq); During Render (Per Vertex Okay) Change Attribute Value (Using location) glvertexattrib4(sal pinnacle,pinnacle.x,pinnacle.y,pinnacle.z,radius); Done beore each glvertex. Same options as ertex, such as client and buer object arrays. gpup 49 EE Lecture Transparency. Formatted 8:59, 29 September 206 rom rendering-pipeline. sh gpup 4