The OpenGL Shading Language

Transcription

1 The OpenGL Shading Language

2 GLSL In the previous lecture we looked at the process of loading shaders into the programmable hardware (GPU) The actual language syntax of GLSL and the principles behind it will be covered in this lecture First we will look at the different processors in the GPU

3 Geometric Data Passed as generic vertex attributes Vertex Shading Tessellation Shading Geometry Shading Rasterizer Fragment Shading Pixel Data Textures or Texture buffer objects Tessellation Shading Tessellation control Shader new in OpenGL 4.3 Compute Shading Primitive Generator Tessellation Evaluation Shader

4 Vertex Processor The vertex processor is a programmable unit that operates on incoming vertices and their associated data. Compilation units written in the OpenGL Shading Language to run on this processor are called vertex shaders. The vertex processor operates on one vertex at a time. It does not replace graphics operations that require knowledge of several vertices at a time.

5 Vertex processor (Rost 2009)

6 Geometry Processor The geometry processor is a programmable unit that operates on data for incoming vertices for a primitive assembled after vertex processing and outputs a sequence of vertices forming output primitives. A single invocation of the geometry shader executable on the geometry processor will operate on a declared input primitive with a fixed number of vertices. This single invocation can emit a variable number of vertices that are assembled into primitives of a declared output primitive type and passed to subsequent pipeline stages.

7 Fragment Processor The fragment processor is a programmable unit that operates on fragment values and their associated data A fragment shader cannot change a fragment's (x, y) position. Access to neighbouring fragments is not allowed. The values computed by the fragment shader are ultimately used to update framebuffer memory or texture memory, depending on the current OpenGL state and the OpenGL command that caused the fragments to be generated.

8 The Fragment (2) Processor (Rost 2009)

9 Vertex Processor Input Vertex shader is executed once each time a vertex position is specified gldrawarrays or other vertex array calls Per-vertex input values are called attributes colour, normal, position, arbitrary values Change every vertex Passed through normal OpenGL mechanisms (per-vertex API or vertex arrays) More persistent input values are called uniforms lights, material properties, arbitrary values Constant across at least one primitive, typically constant for many primitives Passed through new OpenGL API calls (gluniform...)

10 Vertex Processor Output Vertex shader uses input values to compute output values Vertex shader must compute gl_position Mandatory, needed by the rasterizer Usually this will be transformed by our own MVP matrix Vertex shader may compute: gl_clipvertex (if user clipping is to be performed) gl_pointsize (if point parameters are to be used)

11 Vertex Processor Output Other output values are called varying variables E.g., colour, texture co-ordinates, arbitrary data Will be interpolated in a perspective-correct fashion across the primitives Defined by the vertex shader Can be of type float, vec2, vec3, vec4, mat2, mat3, mat4, or arrays of these Output of vertex processor feeds into OpenGL fixed functionality If a fragment shader is active, output of vertex shader must match input of fragment shader If no fragment shader is active, output of vertex shader must match the needs of fixed functionality fragment processing

12 Fragment Processor Input At it s simplest level the output of the Vertex Processor is the input to the fragment (if we ignore geo and tess shaders) Compatibility is checked when linking occurs Compatibility between the two is based on varying variables that are defined in both shaders and that match in type and name Fragment shader is executed for each fragment produced by rasterization For each fragment, fragment shader has access to the interpolated value for each varying variable Colour, normal, texture coordinates, arbitrary values

13 Fragment Processor Input Fragment shader may access: gl_frontfacing contains facingness of primitive that produced the fragment gl_fragcoord contains computed window relative coordinates x, y, z, 1/w Uniform variables are also available

14 Fragment Processor Output Output of the fragment processor goes on to the fixed function fragment operations and frame buffer operations using built-in variables gl_fragcolor computed R, G, B, A for the fragment gl_fragdepth computed depth value for the fragment Both values are destined for writing into the frame buffer if back end tests all pass Clamping or format conversion to the target buffer is done automatically outside of the fragment shader

15 Fragment Processor The fragment processor executes the fragment shader The fragment processor has knowledge of only the current fragment An implementation may have multiple fragment processors operating in parallel The fragment processor in glsl 150 and above use generic output attributes, by default the first attribute is the fragment colour, however we can bind different attributes using glbindfragdatalocation(program, 0, "fragcolor");

16 GLSL Language Syntax GLSL Language syntax is very similar to that of Renderman SL Most of the usual data types are present Other elements are available to fit into the GL pipeline

17 Shader Basic Structure A shader is a sequence of declarations and function bodies Curly braces are used to group sequences of statements A shader must have a main function Statements end with a semi-colon

18 pre-processor The GLSL compiler has a pre-processor just like a normal C compiler. It has the following keywords #define #undef #if #ifdef #ifndef #else #elif #endif #error #pragma #extension #version #line

19 #version #version is used to determine what version of GLSL is the minimum required to compile the shader. The language version a shader is written to is specified by #version number (optional) profile If the optional profile argument is provided, it must be the name of an OpenGL profile. Currently, there are three choices: core compatibility es

20 #pragma Used to enable compiler options / features Common ones used are #pragma optionnv(fastmath on) #pragma optionnv(fastprecision on) #pragma optionnv(ifcvt none) #pragma optionnv(inline all) #pragma optionnv(strict on) #pragma optionnv(unroll all)

21 Type Qualifiers There are many different type qualifiers in GLSL for a thorough examination of them see Typical use for these qualifiers are to tell glsl what direction the data is coming from (in / out) How it changes as the shader is executed How and if interpolation should be used. Some versions of GLSL (ES for example) will need these specified by default.

22 Vertex shader attribute index Vertex shader inputs can specify the attribute index that the particular input uses. This is done with this syntax: layout(location = attribute index) in vec3 position; This means that we don t need to use glbindattriblocation If you try to combine the two and they conflict, the layout qualifier always wins.

23 Vertex shader attribute index Attributes that take up multiple attribute slots will be given a sequential block of that number of attributes in order starting with the given attribute. For example: layout(location = 2) in vec3 values[4]; This will allocate the attribute indices 2, 3, 4, and 5.

24 Scalars The basic non-tuple data types in GLSL are uint: an unsigned 32-bit integer float: a floating point number bool: conditional type, values may be either true or false int: a signed, two's complement, 32-bit integer double: a double-precision floating-point number

25 Vectors Each of the scalar types, including booleans, have 2, 3, and 4-component vector equivalents. The n digit below can be 2, 3, or 4: bvecn : a vector of booleans ivecn : a vector of signed integers uvecn : a vector of unsigned integers vecn : a vector of single-precision floating-point numbers dvecn : a vector of double-precision floating-point numbers

26 Swizzling Vector component access can be achieved in a number of ways You can use x, y, z, or w, referring to the first, second, third, and fourth components, respectively. vec4 somevec; somevec.x + somevec.y; vec2 somevec; vec4 othervec = somevec.xyxx; vec3 thirdvec = othervec.zyy; vec4 somevec; somevec.wzyx = vec4(1.0, 2.0, 3.0, 4.0); somevec.zx = vec2(3.0, 5.0);

27 Swizzling You cannot use the same swizzle component twice. So somevec.xx = vec2(4.0, 4.0); is not allowed. Additionally, there are 3 sets of swizzle masks. You can use xyzw, rgba (for colors), or stpq (for texture coordinates). These three sets have no actual difference they're just syntactic sugar. (but try and use the correct one in context) You cannot combine names from different sets in a single swizzle operation. So ".xrs" is not a valid swizzle mask.

28 Swizzling Vector components can be referred to using array syntax or a single letter: [0], [1], [2], [3] r, g, b, a x, y, z, w s, t, p, q This syntax can be used to extract, duplicate, or swizzle components 1 vec4 pos = vec4(1.0, 2.0, 3.0, 4.0); 2 vec4 swiz= pos.wzyx; // swiz = (4.0, 3.0, 2.0, 1.0) 3 vec4 dup = pos.xxyy; // dup = (1.0, 1.0, 2.0, 2.0) 4 5 pos.xw = vec2(5.0, 6.0); // pos = (5.0, 2.0, 3.0, 6.0) 6 pos.wx = vec2(7.0, 8.0); // pos = (8.0, 2.0, 3.0, 7.0) 7 pos.xx = vec2(3.0, 4.0); // illegal - 'x' used twice

29 Matrices All matrix types are floating-point, either single-precision or double-precision. Matrix types are as follows, where n and m can be the numbers 2, 3, or 4: matnxm : A matrix with n columns and m rows. OpenGL uses column-major matrices, which is standard for mathematics users. Example: mat3x4. matn : A matrix with n columns and n rows. Shorthand for matnxn

30 Matrices Swizzling does not work with matrices. Instead [] array access is used mat3 m1; m1[1] = vec3(1.0, 2.0, 0.0); m1[2][0] = 16.0; mat3 m1; m1[1].yzx = vec3(3.0, 1.0, 2.0);

31 Matrix Components Matrix components can be accessed using array subscripting syntax A single subscript selects a single column A second subscript selects a component within a column 1 mat4 m; 2 m[1] = vec4(2.0); // sets the second column to all m[0][0] = 1.0; // sets the upper left element to m[2][3] = 2.0; // sets the 4th element of the third 5 // column to 2.0

32 structs 1 struct surfacematerial 2 { 3 float ambient; 4 float diffuse; 5 float specular; 6 vec3 basecolor; 7 } surf; 8 9 surfmaterial surf1, surf2; User-defined types can be created using struct with previously defined types Creates a new type called surfacematerial Defines variables of this type called surf, surf1, and surf2 Structures can include arrays Fields are selected using the period (. )

33 Structure Constructors Constructor for a structure is available once structure is defined Example: 1 struct light 2 { 3 float intensity; 4 vec3 position; 5 }; 6 7 light newlight = light(3.0, vec3(1.0, 2.0, 3.0));

34 1 float ramp[10]; 2 vec4 colors[4]; 3 bool results[3]; Arrays structures can be aggregated into arrays Only 1D arrays are supported (GLSL 4.3 has multidimensional arrays but not all gpu s support this) Size of array can be expressed as an integral constant expression within square brackets ([ ]) Arrays can be declared without a size, and then redeclared later with the same type and a size Using an index that goes beyond an array s bounds results in undefined behaviour

35 Arrays The length of an array variable can be computed with the.length() function. uniform float myvalues[12];... myvalues.length(); //Returns 12

36 Type Qualifiers const variable is a constant and can only be written during its declaration in per-vertex data values provided to the vertex shader out per-vertex data values passed from vertex to fragment shader uniform (relatively) constant data provided by the application or by OpenGL for use in the shader in for function parameters copied into a function, but not copied out out for function parameters copied out of a function, but not copied in

37 Function Examples Declaration Definition 1 vec3 computecolor (in vec3 c1, in vec3 c2); 2 float radians (float degrees); 1 float myfunc (in float f1, // f1 is copied in 2 inout float f2) // f2 is copied in and out 3 { 4 float myresult; 5 6 // do computations 7 8 return myresult; 9 }

38 Vertex Shader Built-in Variables The following special variables are available in a vertex shader: 1 vec4 gl_position; // must be written to 2 float gl_pointsize; // may be written to 3 vec4 gl_clipvertex; // may be written to Every execution of a vertex shader must write the homogeneous vertex position into gl_position Vertex shaders may write the size of points to be rasterized (measured in pixels) into the built-in variable gl_pointsize Vertex shaders may write the transformed coordinate to be used in conjunction with user clipping planes into gl_clipvertex

39 Vertex Shader Built-in Attributes The following are available from a vertex shader for accessing standard OpenGL vertex attributes, however they are deprecated in the latest standard. 1 attribute vec4 gl_color; 2 attribute vec4 gl_secondarycolor; 3 attribute vec3 gl_normal; 4 attribute vec4 gl_vertex; 5 attribute vec4 gl_multitexcoord0; 6 attribute vec4 gl_multitexcoord1; 7 attribute vec4 gl_multitexcoord2; 8 attribute vec4 gl_multitexcoord3; 9 attribute vec4 gl_multitexcoord4; 10 attribute vec4 gl_multitexcoord5; 11 attribute vec4 gl_multitexcoord6; 12 attribute vec4 gl_multitexcoord7; 13 attribute float gl_fogcoord;

40 Built-in Functions Trigonometry/angle radians, degrees, sin, cos, tan, asin, acos, atan Exponential pow, exp2, log2, sqrt, inversesqrt Common abs, sign, floor, ceil, fract, mod, min, max, clamp, mix, step, smoothstep Geometric and matrix length, distance, dot, cross, normalize, ftransform, faceforward, reflect, matrixcompmult Vector relational lessthan, lessthanequal, greaterthan, greaterthanequal, equal, any, all Texture lookup texture1d/2d/3d, texture1d/2d/3dproj, texturecube, texture1d/2dshadow, texture1d/2dshadowproj Fragment shader only dfdx, dfdy, fwidth Noise noise1/2/3/4 (Never seen this implemented!)

41 Accessing Built In Pipeline GLSL has the ability to access the built in Light and Material Properties however these are now deprecated and we will discuss other ways of accessing this in a later lecture Two main structures for this are gl_frontmaterial gl_lightsource[gl_maxlights]

42 Geometry Shaders The geometry processor is a programmable unit that operates on data for incoming vertices for a primitive assembled after vertex processing and outputs a sequence of vertices forming output primitives. A single invocation of the geometry shader executable on the geometry processor will operate on a declared input primitive with a fixed number of vertices. This single invocation can emit a variable number of vertices that are assembled into primitives of a declared output primitive type and passed to subsequent pipeline stages.

43 Geometry shaders Unlike Vertex and Fragment shaders, Geo shaders have access to the whole primitive (triangle, line or point) at once The geo shader can change the amount of data in the OpenGL pipeline This is in contrast with the vertex shader which works in a one in / one out form or the fragment shader which can only discard a fragment if it doesn t want to process it.

44 Basic pass through #version 150 layout (triangles) in; layout (triangle_strip) out; layout (max_vertices=3) out; void main(void) { for(int i=0; i<gl_in.length(); ++i) { gl_position=gl_in[i].glposition; EmitVertex(); } EndPrimitive(); }

45 pass through This shader just sends the input to the output and doesn t generate any new geometry The first elements of the shader are know as layout qualifiers These inform the shader what the input will be, the output format of the geometry and the max number of vertices that may be generated This have the following type

46 in layout qualifiers Shader Input points lines triangles lines_adjacency triangles_adjacency Draw Modes GL_POINTS GL_LINES, GL_LINE_LOOP,GL_LINE_STRIP GL_TRIANGLES,GL_TRIANGLE_FAN,GL_TRIANGLE _STRIP GL_LINES_ADJACENCY GL_TRIANGLES_ADJACENCY

47 output qualifiers The geometry shader can only output the following primitive types points line_strip triangle_strip The max_vertices value is used to indicate the max size that may be output, this should be kept to a minimum as OpenGL may allocate buffer space for this and will reduce performance

48 Geometry Shaders Geo shaders uses a the following structures to receive and emit vertices in gl_pervertex { vec4 gl_position; float gl_pointsize; float gl_clipdistance[]; } gl_in[]; in int gl_primitiveidin; out gl_pervertex { vec4 gl_position; float gl_pointsize; float gl_clipdistance[]; };

49 Size of input array Input primitive Size of array points 1 lines 2 triangles 3 lines_adjacency 4 triangles_adjacency 6

50 EmitVertex() EmitVertex tells the geometry shader that all the information for the current vertex has been filled in Any other variables set at this stage will be passed to the fragment shader (for example colour) Other attributes active at this stage will also be passed onto the fragment shader EmitVertex() can be called as many times as you like as long as it doesn t reach the max_vertices value

51 EmitPrimitive() EmitPrimitive() indicates that we have finished emitting vertices. It is important that enough vertices have been created for the primitive type specified in the layout qualifier

52 Visualising Normals The following geometry shader is used to draw both face and vertex normals The shader is split into 3 parts and loaded using ngl::shaderlib

53 Vertex Shader #version 150 precision highp float; the vertex passed in in vec3 invert; the normal passed in in vec3 innormal; the in uv in vec2 inuv; uniform mat4 MVP; uniform float normalsize; uniform vec4 vertnormalcolour; uniform vec4 facenormalcolour; out vec4 normal; uniform bool drawfacenormals; uniform bool drawvertexnormals; void main(void) { gl_position = MVP*vec4(inVert,1); normal=mvp*vec4(innormal,0); }

54 Fragment Shader #version 150 our output fragment colour out vec4 fragcolour; in vec4 pernormalcolour; void main () { fragcolour = pernormalcolour; }

55 #version 150 layout(triangles) in; layout(line_strip, max_vertices = 8) out; in vec4 normal[]; uniform float normalsize; uniform vec4 vertnormalcolour; uniform vec4 facenormalcolour; uniform bool drawfacenormals; uniform bool drawvertexnormals; out vec4 pernormalcolour; void main() { if (drawvertexnormals == true) { pernormalcolour=vertnormalcolour; for(int i = 0; i<gl_in.length(); ++i) { gl_position = gl_in[i].gl_position; EmitVertex(); gl_position = gl_in[i].gl_position + normal[i] * abs(normalsize); EmitVertex(); EndPrimitive(); } } if (drawfacenormals == true) { pernormalcolour=facenormalcolour; vec4 cent = (gl_in[0].gl_position + gl_in[1].gl_position + gl_in[2].gl_position) / 3.0; vec3 face_normal = normalize(cross(gl_in[2].gl_position.xyz - gl_in[0].gl_position.xyz, gl_in[1].gl_position.xyz - gl_in[0].gl_position.xyz)); } } gl_position = cent; EmitVertex(); gl_position = (cent + vec4(face_normal * abs(normalsize), 0.0)); EmitVertex(); EndPrimitive();

56 loading shader Adding a geometry shader is the same as any other ngl::shader we just set the type to ngl::geometry as shown shader->attachshader("normalgeo",ngl::geometry); shader->loadshadersource("normalgeo","shaders/normalgeo.gs"); shader->compileshader("normalgeo"); shader->attachshadertoprogram("normalshader","normalgeo");

57 references pdf Tutorial:_OpenGL_3.1_The_First_Triangle_(C%2B %2B/Win) 3DLabs OpenGL Shading Language Master Class Lecture Notes 2004

58 References Rost, R, Licea-Kane B (2009). OpenGL Shading Language. 3rd. ed. New York: Addison Wesley. OpenGL Architecture Review Board, OpenGL Reference Manual, Fourth Edition: The Official Reference to OpenGL, Version 1.4, Editor: Dave Shreiner, Addison- Wesley, Reading, Massachusetts, Segal, Mark, and Kurt Akeley, The OpenGL Graphics System: A Specification (Version 3.1), Editor (v1.1): Chris Frazier, (v ): Jon Leech, (v2.0): Jon Leech and Pat Brown, March spec.html