The Effects Framework. October 31, Composed of the following components:

Size: px

Start display at page:

Download "The Effects Framework. October 31, Composed of the following components:"

Tracey Robbins
6 years ago
Views:

1 Game Programming The Effects Framework October 31, 2005 Rendering Effect Composed of the following components: one ore more rendering passes a list of device states a vertex and/or pixel shader Effect file can be changed without recompiling source code encapsulate a complete effect including possible hardware fallbacks ASCII file format just like HLSL programs

$Effect Edit DXSDK \Samples \C++ \Direct3D \Bin Objectives To gain an understanding of the structure and organization of an effect file To find out about some additional intrinsic objects in$

2 Effect Edit DXSDK \Samples \C++ \Direct3D \Bin Objectives To gain an understanding of the structure and organization of an effect file To find out about some additional intrinsic objects in HLSL To learn how device states are specified in an effect file To learn how to create and use an effect To gain some experience working with the effects framework by studying some sample programs

3 Techniques and Passes (1) Technique particular way of rendering some special effect Why Why the the need for for several different implementations of of the the same effect? Some HW might not support a particular implementation of an effect Rendering pass encapsulate the device states, samplers, and/or shaders can use fixed function pipeline Techniques and Passes (2) ex) // effect.txt... technique T0 // first and only pass for this technique pass P0... [specify pass device states, shaders, samplers, etc.] technique T1 // first pass pass P0... [specify pass device states, shaders, samplers, etc.] // second pass pass P1... [specify pass device states, shaders, samplers, etc.]

4 More HLSL Intrinsic Objects Texture objects Sampler objects and sampler states Vertex and pixel shader objects Strings Annotations Texture Objects texture type represent an IDirect3DTexture9 object associate the texture for a particular sampler stage directly in the effect file Data members: type the type of texture (e.g. 2D, 3D) format the pixel format of the texture width the width of the texture in pixels height the height of the texture in pixels depth the depth (if a 3D a volume texture) of the texture in pixels

5 Sampler Objects and Sampler States sampler type sampler_state type ex) initialize a sampler object texture Tex; sampler S0 = sampler_state Texture = (Tex MinFilter = LINEAR; MagFilter = LINEAR; MipFilter = LINEAR; ; Vertex and Pixel Shader Objects vertexshader and pixelshader HLSL intrinsic types represent vertex and pixel shaders respectively can be written directly into the effect file compile keyword ex) // Define Main: PS_OUTPUT PS_Main(PS_INPUT input)... // Compile Main: pixelshader ps = compile ps_2_0 PS_Main( // Define Main: VS_OUTPUT VS_Main(VS_INPUT input)... technique T0 pass P0 vertexshader vs = compile vs_1_1 VS_Main(...

6 Strings and Annotations string type ex) to encapsulating references to data files <annotation> syntax ex) string filename = texname.bmp ; texture tex0 < string filename = texname.bmp >; to associate a string with the variable (namely the filename that stores the texture data) can be accessed by the application ID3DXEffect::GetAnnotationByName( hobject, hobject, LPCSTR LPCSTR pname pname Device States in an Effect File Setting device states: ex) render states, texture states, materials, lights, and textures FillMode = WIREFRAME; FillMode = POINT; FillMode = SOLID; State State = Value; Value; same values without D3DFILL_ prefix DirectX SDK documentation DirectX Graphics \ Reference \ Effect Reference \ Effect Format \ Effect States

Creating an Effect ex) WINAPI WINAPI D3DXCreateEffectFromFile( D3DXCreateEffectFromFile( LPDIRECT3DDEVICE9 LPDIRECT3DDEVICE9 pdevice, pdevice, LPCTSTR LPCTSTR psrcfile, psrcfile, const const

7 Creating an Effect ex) WINAPI WINAPI D3DXCreateEffectFromFile( D3DXCreateEffectFromFile( LPDIRECT3DDEVICE9 LPDIRECT3DDEVICE9 pdevice, pdevice, LPCTSTR LPCTSTR psrcfile, psrcfile, const const D3DXMACRO D3DXMACRO *pdefines, *pdefines, LPD3DXINCLUDE LPD3DXINCLUDE pinclude, pinclude, DWORD DWORD Flags, Flags, LPD3DXEFFECTPOOL LPD3DXEFFECTPOOL ppool, ppool, LPD3DXEFFECT LPD3DXEFFECT *ppeffect, *ppeffect, LPD3DXBUFFER LPD3DXBUFFER *ppcompilationerrors *ppcompilationerrors ID3DXEffect* Effect = 0; ID3DXBuffer* errorbuffer = 0; hr = D3DXCreateEffectFromFile( Device, // associated device "effect.txt", // effect filename 0, // no preprocessor definitions 0, // no ID3DXInclude interface D3DXSHADER_DEBUG,// compile flags 0, // don't share parameters &Effect, // return effect &errorbuffer // return error messages // output any error messages if( errorbuffer ) ::MessageBox(0,(char*)errorBuffer->GetBufferPointer(),0,0 d3d::release<id3dxbuffer*>(errorbuffer if(failed(hr)) ::MessageBox(0,"D3DXCreateEffectFromFile() - FAILED",0,0 return false;

8 Setting Constants (1) Intrinsic methods for setting variables instead of using a constant table ID3DXEffect::SetFloat( ID3DXEffect::SetFloat( FLOAT FLOAT f f ID3DXEffect::SetString( ID3DXEffect::SetString( CONST CONST LPCSTR LPCSTR pstring pstring ID3DXEffect::SetVector( ID3DXEffect::SetVector( CONST CONST D3DXVECTOR4 D3DXVECTOR4 *pvector *pvector ID3DXEffect::SetMatrix( ID3DXEffect::SetMatrix( CONST CONST D3DXMATRIX D3DXMATRIX *pmatrix *pmatrix ID3DXEffect::SetTexture( ID3DXEffect::SetTexture( LPDIRECT3DBASETEXTURE9 LPDIRECT3DBASETEXTURE9 ptexture ptexture ID3DXEffect::SetVertexShader( ID3DXEffect::SetVertexShader( LPDIRECT3DVERTEXSHADER9 LPDIRECT3DVERTEXSHADER9 pvshader pvshader ID3DXEffect::SetPixelShader( ID3DXEffect::SetPixelShader( LPDIRECT3DPIXELSHADER9 LPDIRECT3DPIXELSHADER9 ppshader ppshader Setting Constants (2) Obtaining handles to variables ex) ID3DXEffect::GetParameterByName ( hconstant, hconstant, LPCSTR LPCSTR pname pname D3DXMATRIX M; D3DXMatrixIdentity(&M D3DXVECTOR4 color(1.0f, 0.0f, 1.0f, 1.0f IDirect3DTexture9 *tex = 0; D3DXCreateTextureFromFile(Device, shade.bmp, &tex MatrixHandle MtrlHandle TexHandle = Effect->GetParameterByName(0, "Matrix" = Effect->GetParameterByName(0, "Mtrl" = Effect->GetParameterByName(0, "Tex" Effect->SetMatrix(MatrixHandle, &M Effect->SetVector(MtrlHandle, &color Effect->SetTexture(TexHandle, tex

9 Using an Effect (1) Obtain a handle to the technique in the effect file Activate the desired technique Begin the currently active technique For each rendering pass in the active technique, render the desired geometry End the currently active technique Using an Effect (2) Obtaining a handle to an effect ID3DXEffect::GetTechniqueByName ( LPCSTR LPCSTR pname pname Activating an effect ID3DXEffect::SetTechnique ( htechnique htechnique validating a technique with the current device ID3DXEffect::ValidateTechnique ( htechnique htechnique

10 Using an Effect (3) Beginning an effect Setting the current rendering pass Ending an effect ID3DXEffect::Begin ( UINT UINT *ppasses, *ppasses, DWORD DWORD Flags Flags ID3DXEffect::Pass ( UINT UINT ipass, ipass, ID3DXEffect::End(VOID Example Using an Effect // In effect file: technique T0 pass P0... // In application code: // Get technique handle htech = 0; htech = Effect->GetTechniqueByName( T0 // Activate technique Effect->SetTechnique(hTech // Begin the active technique UINT numpasses = 0; Effect->Begin(&numPasses, 0 // For each rendering pass for(int i=0; i<numpasses; i++) // Set the current pass Effect->Pass(i // Render the geometry for the ith pass Sphere->Draw( // End the effect Effect->End(

11 Sample: Lighting and Texturing in an Effect File Shader: light_tex.txt (1) matrix WorldMatrix; matrix ViewMatrix; matrix ProjMatrix; texture Tex; sampler S0 = sampler_state Texture = (Tex MinFilter = LINEAR; MagFilter = LINEAR; MipFilter = LINEAR; ; technique LightAndTexture pass P0 pixelshader = null; vertexshader = null; fvf = XYZ Normal Tex1; Lighting = true; NormalizeNormals = true; SpecularEnable = false; WorldTransform[0] = (WorldMatrix ViewTransform = (ViewMatrix ProjectionTransform = (ProjMatrix

12 Shader: light_tex.txt (2) LightType[0] = Directional; LightAmbient[0] = 0.2f, 0.2f, 0.2f, 1.0f; LightDiffuse[0] = 1.0f, 1.0f, 1.0f, 1.0f; LightSpecular[0] = 0.0f, 0.0f, 0.0f, 1.0f; LightDirection[0] = 1.0f, -1.0f, 1.0f, 0.0f; LightPosition[0] = 0.0f, 0.0f, 0.0f, 0.0f; LightFalloff[0] = 0.0f; LightRange[0] = 0.0f; LightTheta[0] = 0.0f; LightPhi[0] = 0.0f; LightAttenuation0[0] = 1.0f; LightAttenuation1[0] = 0.0f; LightAttenuation2[0] = 0.0f; LightEnable[0] = true; MaterialAmbient = 1.0f, 1.0f, 1.0f, 1.0f; MaterialDiffuse = 1.0f, 1.0f, 1.0f, 1.0f; MaterialEmissive = 0.0f, 0.0f, 0.0f, 0.0f; MaterialPower = 1.0f; MaterialSpecular = 1.0f, 1.0f, 1.0f, 1.0f; Sampler[0] = (S0 Global Variables IDirect3DDevice9* Device = 0; const int Width = 640; const int Height = 480; ID3DXMesh* Mesh = 0; std::vector<d3dmaterial9> Mtrls(0 std::vector<idirect3dtexture9*> Textures(0 ID3DXEffect* LightTexEffect = 0; WorldMatrixHandle = 0; ViewMatrixHandle = 0; ProjMatrixHandle = 0; TexHandle = 0; LightTexTechHandle = 0;

13 Creating an Effect bool Setup() hr = 0; // Load the XFile data: code snipped... ID3DXBuffer* errorbuffer = 0; hr = D3DXCreateEffectFromFile( Device, "light_tex.txt", 0, // no preprocessor definitions 0, // no ID3DXInclude interface D3DXSHADER_DEBUG, // compile flags 0, // don't share parameters &LightTexEffect, &errorbuffer if( errorbuffer ) ::MessageBox(0, (char*)errorbuffer->getbufferpointer(), 0, 0 d3d::release<id3dxbuffer*>(errorbuffer if(failed(hr)) ::MessageBox(0, "D3DXCreateEffectFromFile() - FAILED", 0, 0 return false; Obtaining Handles and Initializing Effect Parameters WorldMatrixHandle ViewMatrixHandle ProjMatrixHandle TexHandle = LightTexEffect->GetParameterByName(0, "WorldMatrix" = LightTexEffect->GetParameterByName(0, "ViewMatrix" = LightTexEffect->GetParameterByName(0, "ProjMatrix" = LightTexEffect->GetParameterByName(0, "Tex" LightTexTechHandle = LightTexEffect->GetTechniqueByName("LightAndTexture" D3DXMATRIX W, P; D3DXMatrixIdentity(&W LightTexEffect->SetMatrix( WorldMatrixHandle, &W D3DXMatrixPerspectiveFovLH( &P, D3DX_PI * 0.25f, // 45 - degree (float)width / (float)height, 1.0f, f LightTexEffect->SetMatrix( ProjMatrixHandle, &P IDirect3DTexture9* tex = 0; D3DXCreateTextureFromFile(Device, "Terrain_3x_diffcol.jpg", &tex LightTexEffect->SetTexture(TexHandle, tex d3d::release<idirect3dtexture9*>(tex return true;

14 Display ( ) bool Display(float timedelta) if( Device ) // Update the scene: code snipped... Device->Clear(0, 0, D3DCLEAR_TARGET D3DCLEAR_ZBUFFER, 0xffffffff, 1.0f, 0 Device->BeginScene( LightTexEffect->SetTechnique( LightTexTechHandle UINT numpasses = 0; LightTexEffect->Begin(&numPasses, 0 for(int i = 0; i < numpasses; i++) LightTexEffect->Pass(i for(int j = 0; j < Mtrls.size( j++) Mesh->DrawSubset(j LightTexEffect->End( Device->EndScene( Device->Present(0, 0, 0, 0 return true; Cleanup ( ) void Cleanup() d3d::release<id3dxmesh*>(mesh for(int i = 0; i < Textures.size( i++) d3d::release<idirect3dtexture9*>( Textures[i] d3d::release<id3dxeffect*>(lighttexeffect

15 Sample: Fog Effect Direct3D Fog Vertex fog part of the fixed function pipeline Fog functions FogVertexMode = LINEAR end d f = end start FogVertexMode = EXP 1 d f = d ( density ) = e e FogVertexMode = EXP2 f = e ( d ( density )) 2 ( density ) 1 density = e ( d ( )) 2 d: distance from the viewpoint

16 Shader: fog.txt technique Fog pass P0 // Set Misc render states. pixelshader = null; vertexshader = null; fvf = XYZ Normal; Lighting = true; NormalizeNormals = true; SpecularEnable = false; // Fog States FogVertexMode = LINEAR; // linear fog function FogStart = 50.0f; // fog starts 50 units away from viewpoint FogEnd = 300.0f; // fog ends 300 units away from viewpoint FogColor = 0x00CCCCCC; // gray FogEnable = true; // enable Global Variables #include "d3dutility.h" #include "terrain.h" #include "camera.h" IDirect3DDevice9* Device = 0; const int Width = 640; const int Height = 480; Terrain* TheTerrain = 0; Camera TheCamera(Camera::AIRCRAFT ID3DXEffect* FogEffect = 0; FogTechHandle = 0; bool Setup() hr = 0; D3DXVECTOR3 lightdirection(0.0f, 1.0f, 0.0f TheTerrain = new Terrain(Device, "coastmountain64.raw", 64, 64, 6, 0.5f TheTerrain->genTexture(&lightDirection Device->SetSamplerState(0, D3DSAMP_MAGFILTER, D3DTEXF_LINEAR Device->SetSamplerState(0, D3DSAMP_MINFILTER, D3DTEXF_LINEAR Device->SetSamplerState(0, D3DSAMP_MIPFILTER, D3DTEXF_LINEAR D3DXVECTOR3 pos(100.0f, 100.0f, f TheCamera.setPosition(&pos

17 Creating an Effect and Initializing Effect Parameters ID3DXBuffer* errorbuffer = 0; hr = D3DXCreateEffectFromFile( Device, "fog.txt", 0, // no preprocessor definitions 0, // no ID3DXInclude interface D3DXSHADER_DEBUG, // compile flags 0, // don't share parameters &FogEffect, &errorbuffer if( errorbuffer ) ::MessageBox(0, (char*)errorbuffer->getbufferpointer(), 0, 0 d3d::release<id3dxbuffer*>(errorbuffer if(failed(hr)) ::MessageBox(0, "D3DXCreateEffectFromFile() - FAILED", 0, 0 return false; FogTechHandle = FogEffect->GetTechniqueByName("Fog" D3DXMATRIX P; D3DXMatrixPerspectiveFovLH( &P, D3DX_PI * 0.25f, // 45 - degree (float)width / (float)height, 1.0f, f Device->SetTransform(D3DTS_PROJECTION, &P return true; Display ( ) bool Display(float timedelta) if( Device ) // Update the scene: code snipped... Device->Clear(0, 0, D3DCLEAR_TARGET D3DCLEAR_ZBUFFER, 0xffffffff, 1.0f, 0 Device->BeginScene( FogEffect->SetTechnique( FogTechHandle UINT numpasses = 0; FogEffect->Begin(&numPasses, 0 D3DXMATRIX I; D3DXMatrixIdentity(&I for(int i = 0; i < numpasses; i++) FogEffect->Pass(i if( TheTerrain ) TheTerrain->draw(&I, false FogEffect->End( Device->EndScene( Device->Present(0, 0, 0, 0 return true;

18 Cleanup ( ) void Cleanup() d3d::delete<terrain*>(theterrain d3d::release<id3dxeffect*>(fogeffect Sample: Cartoon Effect

19 Shader: tooneffect.txt (1) extern matrix WorldViewMatrix; extern matrix WorldViewProjMatrix; extern vector Color; extern vector LightDirection; extern texture ShadeTex; struct VS_INPUT vector position POSITION; vector normal : NORMAL; ; struct VS_OUTPUT vector position POSITION; float2 uvcoords TEXCOORD; vector diffuse : COLOR; ; VS_OUTPUT Main(VS_INPUT input) VS_OUTPUT output = (VS_OUTPUT)0; output.position mul(input.position, WorldViewProjMatrix LightDirection.w = 0.0f; input.normal.w LightDirection input.normal 0.0f; mul(lightdirection, WorldViewMatrix = mul(input.normal, WorldViewMatrix float u = dot(lightdirection, input.normal if( u < 0.0f ) u = 0.0f; float v = 0.5f; output.uvcoords.x = u; output.uvcoords.y = v; output.diffuse = Color; return output; Shader: tooneffect.txt (2) sampler ShadeSampler = sampler_state Texture = (ShadeTex MinFilter = POINT; // no filtering for cartoon shading MagFilter = POINT; MipFilter = NONE; ; technique Toon pass P0 vertexshader = compile vs_1_1 Main( Sampler[0] = (ShadeSampler

20 Global Variables IDirect3DDevice9* Device = 0; const int Width = 640; const int Height = 480; ID3DXEffect* ToonEffect = 0; ID3DXMesh* Meshes[4] = 0, 0, 0, 0; D3DXMATRIX WorldMatrices[4]; D3DXVECTOR4 MeshColors[4]; D3DXMATRIX ProjMatrix; IDirect3DTexture9* ShadeTex = 0; WorldViewHandle = 0; WorldViewProjHandle = 0; ColorHandle = 0; LightDirHandle = 0; ShadeTexHandle = 0; ToonTechHandle = 0; Creating an Effect bool Setup() hr = 0; // Create geometry: code snipped... ID3DXBuffer* errorbuffer = 0; hr = D3DXCreateEffectFromFile( Device, // associated device "tooneffect.txt", // effect filename 0, // no preprocessor definitions 0, // no ID3DXInclude interface D3DXSHADER_DEBUG, // compile flags 0, // don't share parameters &ToonEffect, // return effect &errorbuffer // return error messages if( errorbuffer ) ::MessageBox(0, (char*)errorbuffer->getbufferpointer(), 0, 0 d3d::release<id3dxbuffer*>(errorbuffer if(failed(hr)) ::MessageBox(0, "D3DXCreateEffectFromFile() - FAILED", 0, 0 return false;

21 Obtaining Handles and Initializing Effect Parameters ToonTechHandle = ToonEffect->GetTechniqueByName("Toon" ShadeTexHandle = ToonEffect->GetParameterByName(0, "ShadeTex" WorldViewHandle = ToonEffect->GetParameterByName(0, "WorldViewMatrix" WorldViewProjHandle = ToonEffect->GetParameterByName(0, "WorldViewProjMatrix" ColorHandle = ToonEffect->GetParameterByName(0, "Color" LightDirHandle = ToonEffect->GetParameterByName(0, "LightDirection" D3DXMatrixPerspectiveFovLH( &ProjMatrix, D3DX_PI * 0.25f, // 45 - degree (float)width / (float)height, 1.0f, f D3DXVECTOR4 lightdirection(-0.57f, 0.57f, -0.57f, 0.0f ToonEffect->SetVector(LightDirHandle, &lightdirection IDirect3DTexture9* tex = 0; D3DXCreateTextureFromFile(Device, "toonshade.bmp", &tex ToonEffect->SetTexture(ShadeTexHandle, tex d3d::release<idirect3dtexture9*>(tex return true; Display ( ) bool Display(float timedelta) if( Device ) // Update the scene: code snipped... Device->Clear(0, 0, D3DCLEAR_TARGET D3DCLEAR_ZBUFFER, 0xffffffff, 1.0f, 0 Device->BeginScene( ToonEffect->SetTechnique( ToonTechHandle UINT numpasses = 0; ToonEffect->Begin(&numPasses, 0 D3DXMATRIX WorldView; D3DXMATRIX WorldViewProj; for(int i = 0; i < numpasses; i++) ToonEffect->Pass(i for(int j = 0; j < 4; j++) WorldView = WorldMatrices[j] * view; WorldViewProj = WorldMatrices[j] * view * ProjMatrix; ToonEffect->SetMatrix(WorldViewHandle, &WorldView ToonEffect->SetMatrix(WorldViewProjHandle, &WorldViewProj ToonEffect->SetVector(ColorHandle, &MeshColors[j] Meshes[j]->DrawSubset(0 ToonEffect->End( Device->EndScene( Device->Present(0, 0, 0, 0 return true;

22 Cleanup ( ) void Cleanup() for(int i = 0; i < 4; i++) d3d::release<id3dxmesh*>(meshes[i] d3d::release<idirect3dtexture9*>(shadetex d3d::release<id3dxeffect*>(tooneffect Exercise Modify your program for Phong shading using an effect (Chap18.zip)

Environmental Maps Obtaining an image that approximates the

reflections that mirror the environment 2 steps: to obtain

onto the surface Cube Map Compute 6 projections Cube

23 Environmental Maps Obtaining an image that approximates the desired reflection highly reflective surfaces specular reflections that mirror the environment 2 steps: to obtain environment images without objects to project the scene onto the surface Cube Map Compute 6 projections Cube Environmental map was computed on a box and then mapped to Geri s glasses

Shaders Part II. Traditional Rendering Pipeline

Shaders Part II. Traditional Rendering Pipeline Shaders Part II Doron Nussbaum Doron Nussbaum COMP 3501 - Shaders Part II 1 Traditional Rendering Pipeline Traditional pipeline (older graphics cards) restricts developer to texture and the 3-term lighting