Graphics for VEs. Ruth Aylett

Transcription

1 Graphics for VEs Ruth Aylett

2 Overview VE Software Graphics for VEs The graphics pipeline Projections Lighting Shading

3 Runtime VR systems Two major parts: initialisation and update loop. Initialisation executed once at program start-up time generates or loads a run-time world database containing description of all entities in the virtual world. Usually read from a file Generated by separate authoring or modelling program Import formats supported must be known also loads lighting models, checks input/output devices are working.

4 Cyclic executive Check and initialise hardware Import or create 3D world Create view points Render world Check input devices Software architecture can be used to implement simple runtime VR systems. Main loop simulation update loop continues forever until program is halted Each loop represents one time step for simulation Renders current state of the virtual world Checks input devices and implements changes to world

5 Tasks within an update loop Updating state: reading values from input devices applying those values to the objects being controlled by each device (including the participant's viewpoint or body positions). For entities with autonomous behaviours: execute algorithms to calculate behaviours for current time step e.g., computing new position and orientation of falling or tumbling object, self-propelled object, intelligent object. If support for collision detection, must check all possible collisions and adjust object movements as needed

6 Game Engines Increasing recent use of 3D game engines Doom, Quake, Unreal Tournament, Half-Life, NeverWinter Nights Now the Unity engine: New commercial model Games engines have optimised 3D engine features Also large user communities for support Supply of generic toolkits helps cut development time supports collision detection, physics-based models, AI behaviours, multiplayer client/server modes etc. Downsides include licensing problems Also turning off the shooting Proprietary formats for models and scripting

7 Free Runtime Software A number of open source systems VR Juggler: with a separate scenegraph system Virtual Rendering System VRS3D. OpenSG OpenSceneGraph Open source games engines - e.g Ogre3D 3dml Java 3D extension API to core Java SDK probably fundamentally too slow to be a serious tool for the development of professional VEs On the web badly impacted by extension status and lack of browser functionality (especially MS IE)

8 Graphics Pipeline 3D DATA TRANSFORM 3D DATA IN CAMERA COORDS TRANSFORM 2D DATA IN SCREEN COORDS HIDDEN SURFACE & RENDER DATA FULLY ON SCREEN

9 Scenegraph and pipelines

10 Scene Description Z World Cartesian Coordinates 2 Dimensions (X,Y) 3 Dimensions (X,Y,Z) Y X Z Objects Shape Colour Location X Y

11 Object Representation POINTS LINES (X,Y,Z) (X 1,Y 1,Z 1 ), (X 2,Y 2,Z 2 ) POLYGONS (X 1,Y 1,Z 1 ) (X n,y n,z n ) MESHES Set of Vertices V 1 = (X 1,Y 1,Z 1 ) V n = (X n,y n,z n ) Set of Polygons P1, P2, Pm Each Polygon Pm is represented as ordered list of vertices

12 Object Colour RGB System Red - Green - Blue Additive Light System Colour Represented as (R,G,B) blue Examples (1, 1, 0) Yellow (0, 0, 0) black (1, 1, 0) green red green

13 Building a World Built from a set of objects Objects translated into position Objects rotated as appropriate Include light sources Ambient Non-directional Spotlight

14 Transforming objects Translation Add an offset to every vertex on an object Rotation Use trigonometry to calculate new position of each vertex Allow rotation around each cartesian axis May be represented as matrices Scale Multiply each vertex by constant scale factor Always apply before object put into scene

15 Translation An object is translated by adding an offset to every vertex Y (x+t x, y+t y ) (x, y) (T x, T y ) X

16 Matrix Rotation: 2 dimensions Y (X, Y) a (X 1, Y 1 ) X (X 1, Y 1 ) = cos(a) - sin(a) sin(a) - cos(a) X Y

17 Matrix Rotation: 3 dimensions X Rotation (X 1, Y 1, Z 1 ) = X 0 cos(a) -sin(a) Y 0 sin(a) cos(a) Z Z Y Rotation (X 1, Y 1, Z 1 ) = cos(a) 0 sin(a) X Y -sin(a) 0 cos(a) Z Z Rotation (X 1, Y 1, Z 1 ) = cos(a) -sin(a) 0 X sin(a) cos(a) 0 Y Z X Y

18 Projection Objects exist in 3 dimensions, final image is in 3 dimensions Projection reduces the dimensions by one to two Perspective projection mimics scaling of distance eye Isometric projection does not scale with distance

19 Clipping Projected objects may lie: Totally on screen Partially on screen Completely off screen Polygons clipped to sides of screen Must make sure new polygons are complete Remaining polygons may obscure each other screen

20 Polygon Sorting & Printing Aim to identify which parts of a polygon are visible Many solutions developed for special cases Consider two methods: Painters algorithm Z buffer algorithm

21 Screen Picture is drawn in a frame buffer Frame buffer is an area of memory Think of the screen as a grid of squares Each square represents a pixel Every pixel can hold a colour (R, G,B) Drawing a picture is just colouring the squares

22 Painters algorithm Method Generate all the polygons Order wrt distance from camera Draw polygons furthest away first and move towards viewer Visible polygons drawn over distant polygons Works when polygons are well-ordered Some cases cannot be solved

23 Z-buffer algorithm Method: Retain distance information for each vertex Frame-buffer extended to have a depth-buffer Whilst drawing the polygon, calculate the pixel depth for each pixel For each pixel in polygon Calculate depth of pixel in polygon Compare depth with current frame-buffer depth IF polygon pixel distance less the one stored in frame buffer THEN save polygon colour and depth in frame buffer NEXT pixel

24 Illumination Model The illumination model allows the colour to be calculated at a surface Approximates the behaviour of light within a scene Approximate since only considers individual surfaces Does not model reflections between them The Phong model is typically used

25 Phong Model A simple model that can be computed rapidly Three lighting components Diffuse Specular Ambient Uses four vectors To source (light) To viewer Normal Perfect reflector

26 Phong Illumination Model The 3 types of lighting: Ambient: constant background illumination Same value for all objects in scene Gives constant shading Diffuse: light widely scattered by surface Depends only on angle between light and surface and surface material Specular: highlights on object Depends both on position of light wrt surface and position of viewer wrt surface As well as surface material

27 Diffuse Reflection Mathematical Description N normal to object at intersection L i vector from intersection to light I i intensity of light from light I K d coefficient of diffuse reflection a i angle between Li and N L a Object N eye Component is given by: - k d ( l 1 cos(a 1 ) + l 2 cos(a 2 ) + l 3 cos(a 3 ) + )

28 Specular Reflection Mathematical Description k s L i I i R n normal to object at intersection vector from intersection to light i intensity of light from light I direction of reflection incident level of specularity R L q eye Specular component given by: - k s (I 1 ( L 1 *R) n + I 2 (l 2 *R) n + )

29 Light Sources In the Phong Model, we add the results from each light source Each light source has separate diffuse, specular, and ambient terms to allow for maximum flexibility even though this form does not have a physical justification Separate red, green and blue components Hence, 9 coefficients for each point source I dr, I dg, I db, I sr, I sg, I sb, I ar, I ag, I ab

30 Partial Illumination Model Illumination Model Ambient light Ambient light diffuse reflections single source, k s = 0 Full Illumination Model Ambient light diffuse reflections specular reflections I r = I a k ar +I i (k dr (L i *N)+k s (L i *R) n ) I g = I a k ag +I i (k dg (L i *N)+k s (L i *R) n ) I b = I a k ab +I i (k db (L i *N)+k s (L i *R) n )

31 Object Shading Flat Shading Gouraud Shading Phong Shading

32 Object Shading Flat Shading Gouraud Shading Phong Shading Simplest way to shade a polygon Apply the Phong shading model once All pixel polygons are shaded the same Quick but limited realism of meshes Flat (R 2,G 2,B 2 ) (R 1,G 1,B 1 ) (R 3,G 3,B 3 )

33 Object Shading Flat Shading Gouraud Shading Phong Shading Gouraud Normal to each polygon vertex (r, g, b) colour computed for each vertex Pixel colour calculated by linear interpolation Slower, smooth appearance across polygon (R 2,G 2,B 2 ) (R 1,G 1,B 1 ) Colour is linear function of (R i,g i,b i ) (R 3,G 3,B 3 )

34 Object Shading Flat Shading Gouraud Shading Phong Shading Phong Normal to each polygon vertex Interpolate normals along edges (r, g, b) colour computed for each normal Interpolate colour across polygon Very slow, smooth appearance, good quality (R 2,G 2,B 2 ) (R 1,G 1,B 1 ) (R 3,G 3,B 3 ) Normal N is linear function of N i, colour is computed using N fo illumination model

35 Projections: plane map V object 1 image U 1

36 Projections: cylindrical map Theory: (u,v) - (r*cos(2*pi*u), r*sin(2*pi*u),h*v V 1 image U h 1

37 Projections: spherical map Theory (u,v) - (r*cos(2*pi*u)*cos(pi*v), r*sin(2*pi*u)*cos(pi*v), r*sin(pi*v)) V 1 image U

38 3D Texturing 3 Dimensional Texturing 2 Dimensional textures only cover the surface of an object 3 Dimensional textures are defined for all points in space Objects are cut from the texture space - much like sculpting a statue from marble

39 Alternative rendering techniques Raytracing Aims to improve realism of image Slower than polygon rendering Suitable for producing still images and animations Radiosity Further improvement of the shading model Attempts to improve the treatment of ambient light Slow, but can be pre-computed and used with polygon rendering or raytracing

40 Problems of the graphics pipeline Difficult to achieve realism Reflections and transparency are not accurate Real shadows increase rendering time Polygonal objects are not smooth Gouraud/Phong shading needed to increase quality Difficult to render shapes defined mathematically The pipeline is not a natural approach