Computer Graphics Software & Hardware. NBAY 6120 Lecture 6 Donald P. Greenberg March 16, 2016

Transcription

1 Computer Graphics Software & Hardware NBAY 6120 Lecture 6 Donald P. Greenberg March 16, 2016

2 Recommended Readings for Lecture 6 Mike Seymour. The State of Rendering, Part 1, fxguide.com, July 15, FXGuide. Mike Seymour. The State of Rendering, Part 2, fxguide.com, July 17, FXGuide.

3 Why Is It Important? % of our information intake is pictorial through our eyes Educational Modules Entertainment Games Advertising Medical Computer Aided Design Data Visualization

4 Ivan Sutherland 163

5 Program of Computer Graphics, Cornell University General Electric - 167

6 Program of Computer Graphics, Cornell University DPG - 167

7 Cornell in Perspective Film 172 Program of Computer Graphics, Cornell University

8

9 Gouraud Flat Polygon Shading 172 Each polygon is shaded based on a single normal. Gouraud Thesis

10 Gouraud Smooth Shading 172 Each pixel is shaded by interpolating intensities computed in each of the polygon s vertices. Gouraud Thesis

11 Phong Shading 174

12 Environment Model Geometry & topology Material properties >Color, reflectance, textures >(Cost, strength, thermal properties) Lighting Geometry & position Intensity, spectral distribution Direction, spatial distribution Model Camera Perspective Raster Operations Image Storage Display

13 Camera Model Viewer Position Viewer direction Field of view Wide angle Telephoto Depth of focus Near Far Camera Perspective Raster Operations Image Storage Display

14 Perspective Model Transformation Perspective transformation Matrix multiplication (4 x 4) Clipping objects outside of the field of view Camera Perspective Raster Operations Image Storage Culling back-facing surfaces Display

15 Hidden Line Algorithm

16 Hidden Line Algorithm

17 Raster Operations Model Conversion from polygons to pixels Color computation Hidden surface removal (z-buffer) Camera Perspective Raster Operations Image Storage Display

18 Image Storage Model Typical frame buffer 1280 x 1024 pixels 3 channels (red, green, blue) 1 byte/channel Total memory 3 3/4 megabytes - single buffer 7 1/2 megabytes - double buffer Camera Perspective Raster Operations Image Storage Display

19 Display Digital to analog conversion 1280 x 1024 resolution 60 frames per second Total data rate 1 1/4 million pixels x 3 bytes/pixel x 60 frames/second = 225 megabytes/second = 1.8 gigabits/second Model Camera Perspective Raster Operations Image Storage Display

20 Direct Model Illumination User Input Camera Perspective Raster Operations Image Storage Display

21 Phong Model: Variations of Specular Exponent Roy Hall

22 Reflectance Three Approximate Components Ideal diffuse (Lambertian) Ideal specular Directional diffuse

23 Cook-Torrance Renderings 17

24 The geometry of scattering from a layered surface acm Computer Graphics, Siggraph 13 p. 166

25 Henrik Wann Jensen, Stephen R. Marschner, Marc Levoy, Pat Hanrahan. A Practical Model for Subsurface Light Transport, ACM Siggraph 2001, August 2001, Los Angeles, CA, pp

26 Direct Lighting and Indirect Lighting Direct Indirect Direct

27 Direct Lighting Only

28 Global Illumination

29

30 Ray Tracing Eric Haines 185

31 Radiosity 184

32 Radiosity Eric Chen 186

33 Radiosity 10s

34 Rendering Framework 17

35 Example: Automobile Pipeline Automobile takes 8 minutes to make, but the assembly line makes a car every two minutes. Build frame Add engine Add windows Paint body 2 minutes 2 minutes 2 minutes 2 minutes Stage 1 Stage 2 Stage 3 Stage 4 A B C D E A B C D A B C A B Time (minutes) Donald P. Greenberg - Cornell Program of Computer Graphics

36 Graphics Hardware circa 170 Model P-xform Clipping Lighting Rasterize System Memory (16 scanlines) Film Recorder CPU System used to generate Phong goblet

37 Graphics Hardware circa 180 Model P-xform Clipping Lighting Rasterize Frame Buffer Display CPU Graphics Hardware Cost of Memory was Prohibitive 512x480x8 bit frame buffer cost $80,000! No z-buffer (at 24 or 32 bits/pixel, it requires even more memory than FB) Only single frame buffer All work done in CPU until frame buffer(slow!)

38 Graphics Hardware circa 186 Model Lighting P-xform Clipping Rasterize Z-Buffer Frame Frame Buffer Buffer Display CPU Graphics Hardware Added Z-Buffer Added Double Frame Buffer Rasterization and visible surface computations performed in hardware

39 Graphics Hardware 1 Model P-xform Texture Frame Lighting Rasterize Z-Buffer Clipping Frame Mapping Buffer Display Buffer CPU Graphics Hardware Addition of texture mapping units With texturing, high resolution detail is possible with relatively simple geometry

40 Multipass Example: Light Maps Two separate textures, one for the material s composition, one for the lighting X = J.L.Mitchell, M. Tatro, and I. Bullard

41 Castle s Geometry Agata & Andrzej Wojaczek, Advanced Graphics Applications Inc.

42 Reflection Example - Castle Agata & Andrzej Wojaczek, Advanced Graphics Applications Inc.

43 Graphics Hardware 2000 Model Vertex Buffer Lighting P-xform Clipping Texture Mapping CPU Rasterize Z-Buffer Graphics Hardware Frame Frame Buffer Buffer Display Vertex buffer (model data) added to reduce bandwidth requirements between CPU and graphics board

44 Graphics Pipeline s M L P S D V M Model L Lighting P Perspective/Clipping S Scan Conversion/Z-buffer D Display Storage V Video Donald P. Greenberg - Cornell Program of Computer Graphics

45 Graphics Pipeline M L P T S D V M Model L Lighting P Perspective/Clipping T Texturing S Scan Conversion/Z-buffer D Display Storage V Video Donald P. Greenberg - Cornell Program of Computer Graphics

46 Graphics Hardware 2003 Model Vertex Buffer Lighting Vertex Operations P-xform Clipping Texture Mapping CPU Rasterize Z-Buffer Pixel Operations Frame Frame Buffer Buffer Display Early GPU s performed lighting and clipping operations on locally stored model

47 Graphics Hardware 200 CPU Model Graphics Processing Unit GPU Rasterize Z-Buffer CPU Model Graphics Processing Unit GPU Rasterize Z-Buffer CPU Model Graphics Processing Unit GPU Rasterize Z-Buffer Frame Buffer Display CPU Model Graphics Processing Unit GPU Rasterize Z-Buffer

48 Faster than Moore s Law 10 One-pixel polygons (~10M 30Hz) nvidia G70 10 Peak Performance ( 's/sec) UNC Pxpl4 HP CRX 10 4 Flat shading SGI Iris HP VRX SGI GT Slope ~2.4x/year (Moore's Law ~ 1.7x/year) UNC Pxpl5 SGI SkyWriter SGI VGX HP TVRX Stellar GS1000 Gouraud shading SGI RE1 E&S F Year SGI RE2 Antialiasing UNC/HP PixelFlow Division Pxpl6 Textures SGI IR Accel/VSIS Megatek E&S Freedom Division VPX E&S Harmony Voodoo Graph courtesy of Professor John Poulton (from Eric Haines) SGI R-Monster Nvidia TNT GeForce 3DLabs SGI Glint Cobalt PC Graphics ATI Radeon

49 nvidia s Kepler Chip 2012

50 NVIDIA s new Maxwell Chip processor cores (rumor) 20 nm Q4 2014

51 Moore s Law GPU Transistor Counts Processor Transistor count Date of introduction Manufacturer Process Area R ,000, AMD 0 nm 288 mm² R ,000, AMD 0 nm 352 mm² G80 681,000, NVIDIA 0 nm 480 mm² R600 Pele 700,000, AMD 80 nm 420 mm² G2 754,000, NVIDIA 65 nm 324 mm² RV70XT Spartan 5,000, AMD 55 nm 282 mm² GT200 Tesla 1,400,000, NVIDIA 65 nm 576 mm² Cypress RV870 2,154,000, AMD 40 nm 334 mm² Cayman RV70 2,640,000, AMD 40 nm 38 mm² GF100 Fermi 3,200,000,000 Mar 2010 NVIDIA 40 nm 526 mm² GF110 Fermi 3,000,000,000 Nov 2010 NVIDIA 40 nm 520 mm² GK104 Kepler 3,540,000, NVIDIA 28 nm 24 mm² Tahiti RV1070 4,312,711, AMD 28 nm 365 mm² GK110 Kepler 7,080,000, NVIDIA 28 nm 561 mm² RV100 Hawaii 6,300,000, AMD 28 nm 438 mm² GM204 Maxwell 5,200,000, NVIDIA 28 nm 38 mm² GM200 Maxwell 8,100,000, NVIDIA 28 nm 601 mm² Fiji 8,00,000, AMD 28 nm 56 mm²

52 nvidia iray 2012 nvidia has designed a series of rackable Tesla servers for very fast computation using parallel sets of their GPU hardware They developed a novel programming language (CUDA) to take advantage of their unique hardware architectures. This can be used for many other disciplines They now offer a product called Iray which computes photorealistic imagery on a cloud

53 Intel Integrated Graphics 2013

54 AMD Integrated Graphics 2013

55 AMD Integrated Graphics 2014 Kaveri 28 nm 47% GPU 47% GPU

56 Mobile GPU market share 2013 All GPU Suppliers All GPU IP Suppliers NVIDIA 3% Qualcomm 33% ZiiLabs 0.10% Takumi 2.70% Broadcom 0.20% Vivante 4.80% Takumi 4.30% Vivante ARM 4.20% 7.50% DMP 5.20% Imagination 50.10% Imagination 78.80% ARM 2.60% DMP 3.30% Source: Imagination Technologies, via

57 End...