Real-Time Rendering of a Scene With Many Pedestrians
|
|
- Rodney Fisher
- 5 years ago
- Views:
Transcription
1 Real-Time Rendering of a Scene With Many Pedestrians Va clav Pfudl Abstract The aim of this text was to describe implementation of software that would be able to simulate a scene with walking characters in real-time with emphasis on rendering level of realism. The application should be then able to record video sequences of such simulated scenes. Such video sequences could be used as an input (test data) for people counting systems. The problem was divided into three major subproblems: character animation, artificial intelligence for character movement and advanced rendering techniques. The character animation problem is solved by creating a model of the character and using skeletal animation. To achieve characters moving in a scene autonomously path finding (A* algorithm) and group behaviors (steering behaviors) were implemented. Realism in a scene is added by implemented rendering methods such as normal-mapping, shadow-mapping, deffered rendering, skydome, lens flare effect and screen space ambient occlusion. Rendering stage of a scene can be easily parametrized through implemented GUI. Implemented application provides user with easy way of setting a scene with walking pedestrians, setting its visualization and to record the result. Keywords: real-time rendering, normal-mapping, shadow-mapping, lens-flare, screen space ambient occlusion, skydome, skeletal animation, movement artificial intelligence, group behaviors Supplementary Material: Demonstration Video *xpfudl01@stud.fit.vutbr.cz, Faculty of Information Technology, Brno University of Technology 1. Introduction The motivation behind this paper was to develop an application that would be able to record video sequences of scenes with walking chracters in high level of realism so the video sequences could be used as an input (test data) for people counting systems. The developed application itself could serve as a tool for other purposes like making preanimated scenes for games and movies. The desired output of such application should be a program with graphical user interface which would allow users to parametrize visualization of a scene (scene made of imported models) as well as customize characters movement according to required simulation. The output should be recorded with higher frame rates, althought overall quality of visualization is preferred over frame rates. The development of such application was divided into three major groups: character animations, artificial intelligence for movement of characters and advanced real-time rendering techniques. When rendering a scene with walking pedestrians, first that scene needs to be populated with animated character models. Blender 1 was used to create such 1 for more info visit
2 models (not only character models but also static scene models) along with their animations (skeletal animation, section 2.1). Then we need a tool to import geometry, animations and material data of these models into our application. When choosing which tool to use we need to consider which file formats this tool can work with along with what that certain file format can describe (animations, textures, materials, lights etc). A convenient tool for our purposes is ASSIMP (Open Asset Import Library) along with COLLADA file format. Each character needs to act autonomously, how to get to their desired location and react dynamically to the surrounding environment (avoid static and dynamic obstacles). Most of path finding algorithms are based on Dijkstra s algorithm [1]. For most cases A* algorithm [2] is the one most effective and our case is not different. Our agent (character) needs to percieve its environment to avoid other characters or to group up with other characters etc. In modern game engines or in applications simulating group behavior, algorithms are based on algorithmic steering behaviors for animated characters, which were developed by Craig Reynolds in late 1980s [3, p ]. Considering visualization of whole scene, at the moment there are two main 3D rendering API including DirectX and OpenGL. For the sake of our application we use OpenGL mainly becasue it is multiplatform API. To visualize scene in more realistic manner we need to program how rendering pipeline will process vertices and fragments of our models we export from Blender and import to our application. For these purposes GLSL (OpenGL shading language) is available, which is the language that allow us to program various stages of rendering pipeline including vertex shaders, tesselation shader, geometry shaders, fragment shaders etc. This allows to produce some advanced shader effects and even postprocess rendered output (bloom effect, antialiasing, lens flare etc.). Our application successfully encapsulates above described functionality into graphical user interface that provides users to set various scenarios with walking pedestrians, enables to set group behaviors of these pedestrians along with how the whole scene will be visualized (which shader effects scene uses, lighting of the scene etc.). Application also allows to record these animated scenes. 2. Moving characters around Our implemented application includes the following methods and techniques ensuring autonomous movement of character in dynamic environment. 2.1 Skeletal animation To animate model of a character skeleton of this model (this skeleton is commonly called rig) was created in Blender. Each bone of this skeleton is then assigned with vertices this bone should have control over (these vertices are weighted, figure 1). Then set of frames is created and each frame carries information of a pose of the model in the way it makes consecutive movement (walking, running etc.) after interpolating between frames. This information of bones, influenced vertices and animations is then imported into application using ASSIMP library and model is animated in vertex shader program. In each rendered frame we calculate current pose of each bone (transformation matrix) of character s skeleton and then we multiply this matrix with vertices according to which bone they belong to. Figure 1. This figure demonstrates weighted skeleton created in Blender, particulary how vertices around chest are influenced by chest bone. 2.2 Artificial intelligence for character movement As the pathfinding algorithm we chose A* algorithm for its efficiency and flexible use in wide range of contexts. Map representation we chose is demonstrated in figure 2. Navigation mesh [4] allows characters move much smoother without zig-zag movement (in context of a triangular area character can move in straight line) and it also solves static obstacle avoidance. To make sure characters act autonomously steering behaviors [3]. Steering behaviors allow characters to percieve their surrounding environment (position vectors, acceleration vectors, etc. are available) and act to avoid obstacles or collisions with other characters by applying vector forces to their current acceleration. Characters in our application are divided into groups
3 and each group can be parametrized to set behaviors of characters in that particular group. Behaviors are vector forces applied and calculated for every single character. Figure 3. The part of low poly character model lit by Phong lighting model on the left and then the same model lit by Phong model with use of normal-mapping, which is rendered with more details (shows bumpy surfaces around character s eyes, nose etc.). Figure 2. Automatically generated navigation mesh [4] in Blender. In triangular areas characters can move in straight lines (no need to calculate path), edges serve as portals into other triangular areas and vertices are nodes which we search paths in (in case we can t move in straight line to our target). by itself does not produce realistic shadows (example in the picture 4), it only produces hard shadows and suffers from artifacts (more in section 4). 3. Realistic scene rendering In order to visualize scene with higher level of realism and to render scene in real-time (more than 25 frames per second) we implemented following techniques. 3.1 Normal-mapping Rendering scene with Phong lighting model interpolates light nicely and conveys a sense of desired realism, however it can not simulate bumpy surfaces without use of high amount of extra vertices (inappropriate for real-time). Therefore we used normal-mapping [5] technique applied to low-poly (model composed of low amount of polygons) models. Using this technique is suitable for real-time applications because at run time it costs one texture lookup more than simple Phong model and offers big amount of detail contributing to realistic look of models. Figure 3 shows the impact of normal-mapping used on low-poly model of a character. 3.2 Shadow-mapping To aproximate realism we need objects to cast shadows. To achieve this effect we use shadow-mapping [6]. This technique itself requires two pass rendering which means we have to render our scene twice. This would imply that we get frame rate dropped by half, however during first pass we only need to right down a depth information of vertices and there is no need to deal with lighting calculations. This makes this technique viable for real-time shadow casting. This technique Figure 4. The group of characters casting shadows produced by basic implementation of shadow-mapping. 3.3 Deferred rendering This technique [7] provides significantly better performance when rendering a scene with many lights than forward rendering and we can make use of it even when rendering outdoor scene affected only by one directional light. That is mainly because of the fact that during the process of this technique we create and fill so called G-buffer with geometry data (figure 5), which lighting or other (for example postprocessing) effects can profit from. 3.4 Screen space ambient occlusion Screen space ambient occlusion (SSAO) [8] is approximation of how each vertex of scene is exposed to ambient lighting. This technique is suitable for realtime rendering because it is implemented without CPU overhead inside of fragment shader program and therefore it is completely executed on the GPU side. Our implementation samples each pixel with 4x4 texture
4 Figure 5. The content of G-buffer (information saved in set of textures) used in our application: top left: vertex positions, top right: normals, bottom left: specular color with shininess in alpha channel, bottom right: diffuse color. ing distant buildings, mountains, etc. using geometry would be inefficient. Instead we can project these surroundings in a texture mapped on simple cube or other geometry like sphere/hemisphere (skydome). Figure 7 shows the power of skydome. In our application we use skydome instead of skybox, it requires more geometry to render but on the other hand it provides more flexible way of creating textures for skydomes (a panoramic picture can be transformed using polar coordinates into texture for skydome). reads (texture holding position of sampled pixels) and then calculates occlusion factor based on position of these surrounding pixels. This technique offers more realistic depth look of models (figure 6) at a cost of six percent frame rate drop 2 which is negligible for our purposes. Figure 7. The scene rendered without skydome (top) and the same scene rendered with skydome (bottom), which makes the scene look bigger and more realistic with cost of rendering only extra 128 vertices. Figure 6. A model of a house rendered without SSAO (top) and the same house rendered with SSAO (bottom), where we can see added depth mainly around windows and door. 3.5 Skybox Skybox [9] creates illusion of distant 3D surroundings of scene, makes scene look bigger than it is. Render sampling kernel, resolution , NVidiA GeForce 840M 3.6 Lens flare Implementing lens flare [10] into our engine adds more dynamic range look of the scene. We simulated light scattering in lens system by postprocessing final image of rendering pipeline by sampling the brightest pixels in the centre of current frame along the vector from that pixel to the center of screen. This is multipass process in which we first generate lens features, after that we multiply the result with radial blur kernel and finally we blur the result. 4. Conclusions This article presents methods and techniques used in developped application for character animations, autonomous behaviors of these characters and rendering technique to make scene look more realistic including advanced lighting effects and postprocessing effects
5 Figure 8. This figure shows the final application, rendered scene with all implemented effects and implemented GUI. Figure 9. The result of postprocessing lens flare In conclusion implemented application is able to generate video sequences of easily customized scenes with walking pedestrians. It is able to render simulated character movement in real-time (up to 40 characters in more than 25 frames per second), thanks to generating videos frame by frame even really low frames per seconds in bigger scenes is not an issue. In the future work I would like to implement more shader effects (bloom effect, antialiasing, etc.) along with optimalizations including space partitioning, level of detail, etc. implementation. References (figure 9 shows implemented application at run time). We accomplished our goal to provide users with GUI for customizing visual appearance of rendered scene, customizing group behaviors and paths of walking pedestrians and posibility to record animated scene. Implemented GUI allows to import models (ASSIMP library supported file formats) to create custom scenes as well as import character models with their animations. Characters can be assigned to different groups and for each group properties like start, goal of the path, behaviors of characters in that group (characters keeping distance between each other, avoid collisions, etc.) can be customized. GUI also provides an easy way of customizing textures and visualization of meshes which create imported models. Another part of implemented GUI is customization of methods like lens flare effect, screen space abient occlusion, etc. [1] Jing chao Chen. Dijkstra s shortest path algorithm, [2] Bryan Stout. Game Programming Gems, chapter The Basics of A* for Path Planning. Charles River Media, Inc., [3] Daniel Shiffman. The Nature of Code ISBN: [4] Steven White. Game Programming Gems 3, chapter A Fast Approach to Navigation Meshes. Charles River Media, Inc., [5] Yanni Hajioannou. Gamedev glossary: What is a normal map? Game Development, [6] Anirudh.S Shastry. Soft-edged shadows. Graphics Programming and Theory, 2005.
6 [7] Brent Owens. Forward rendering vs. deferred rendering. Game Development, [8] John Chapman. Ssao tutorial. john-chapmangraphics, [9] Etay Meiri. Tutorial 25: Skybox. OGLdev - Modern OpenGL Tutorials, [10] John Chapman. Pseudo lens flare. john-chapmangraphics, 2013.
TSBK03 Screen-Space Ambient Occlusion
TSBK03 Screen-Space Ambient Occlusion Joakim Gebart, Jimmy Liikala December 15, 2013 Contents 1 Abstract 1 2 History 2 2.1 Crysis method..................................... 2 3 Chosen method 2 3.1 Algorithm
More informationScreen Space Ambient Occlusion TSBK03: Advanced Game Programming
Screen Space Ambient Occlusion TSBK03: Advanced Game Programming August Nam-Ki Ek, Oscar Johnson and Ramin Assadi March 5, 2015 This project report discusses our approach of implementing Screen Space Ambient
More informationZ-Buffer hold pixel's distance from camera. Z buffer
Z-Buffer hold pixel's distance from camera Z buffer Frustrum Culling and Z-buffering insufficient Given a large enough set of polygons, no matter how fast the graphics card, sending it too many hidden
More informationCMSC427 Advanced shading getting global illumination by local methods. Credit: slides Prof. Zwicker
CMSC427 Advanced shading getting global illumination by local methods Credit: slides Prof. Zwicker Topics Shadows Environment maps Reflection mapping Irradiance environment maps Ambient occlusion Reflection
More informationDEFERRED RENDERING STEFAN MÜLLER ARISONA, ETH ZURICH SMA/
DEFERRED RENDERING STEFAN MÜLLER ARISONA, ETH ZURICH SMA/2013-11-04 DEFERRED RENDERING? CONTENTS 1. The traditional approach: Forward rendering 2. Deferred rendering (DR) overview 3. Example uses of DR:
More informationCS 354R: Computer Game Technology
CS 354R: Computer Game Technology Texture and Environment Maps Fall 2018 Texture Mapping Problem: colors, normals, etc. are only specified at vertices How do we add detail between vertices without incurring
More informationThe Rasterization Pipeline
Lecture 5: The Rasterization Pipeline Computer Graphics and Imaging UC Berkeley CS184/284A, Spring 2016 What We ve Covered So Far z x y z x y (0, 0) (w, h) Position objects and the camera in the world
More informationBringing Hollywood to Real Time. Abe Wiley 3D Artist 3-D Application Research Group
Bringing Hollywood to Real Time Abe Wiley 3D Artist 3-D Application Research Group Overview > Film Pipeline Overview and compare with Games > The RhinoFX/ATI Relationship > Ruby 1 and 2 The Movies > Breakdown
More informationReal-Time Universal Capture Facial Animation with GPU Skin Rendering
Real-Time Universal Capture Facial Animation with GPU Skin Rendering Meng Yang mengyang@seas.upenn.edu PROJECT ABSTRACT The project implements the real-time skin rendering algorithm presented in [1], and
More informationDominic Filion, Senior Engineer Blizzard Entertainment. Rob McNaughton, Lead Technical Artist Blizzard Entertainment
Dominic Filion, Senior Engineer Blizzard Entertainment Rob McNaughton, Lead Technical Artist Blizzard Entertainment Screen-space techniques Deferred rendering Screen-space ambient occlusion Depth of Field
More information3D Programming. 3D Programming Concepts. Outline. 3D Concepts. 3D Concepts -- Coordinate Systems. 3D Concepts Displaying 3D Models
3D Programming Concepts Outline 3D Concepts Displaying 3D Models 3D Programming CS 4390 3D Computer 1 2 3D Concepts 3D Model is a 3D simulation of an object. Coordinate Systems 3D Models 3D Shapes 3D Concepts
More informationChapter 7 - Light, Materials, Appearance
Chapter 7 - Light, Materials, Appearance Types of light in nature and in CG Shadows Using lights in CG Illumination models Textures and maps Procedural surface descriptions Literature: E. Angel/D. Shreiner,
More informationDynamic Ambient Occlusion and Indirect Lighting. Michael Bunnell NVIDIA Corporation
Dynamic Ambient Occlusion and Indirect Lighting Michael Bunnell NVIDIA Corporation Environment Lighting Environment Map + Ambient Occlusion + Indirect Lighting New Radiance Transfer Algorithm Useful for
More informationDeus Ex is in the Details
Deus Ex is in the Details Augmenting the PC graphics of Deus Ex: Human Revolution using DirectX 11 technology Matthijs De Smedt Graphics Programmer, Nixxes Software Overview Introduction DirectX 11 implementation
More informationScalable multi-gpu cloud raytracing with OpenGL
Scalable multi-gpu cloud raytracing with OpenGL University of Žilina Digital technologies 2014, Žilina, Slovakia Overview Goals Rendering distant details in visualizations Raytracing Multi-GPU programming
More informationComputer Graphics (CS 543) Lecture 10: Soft Shadows (Maps and Volumes), Normal and Bump Mapping
Computer Graphics (CS 543) Lecture 10: Soft Shadows (Maps and Volumes), Normal and Bump Mapping Prof Emmanuel Agu Computer Science Dept. Worcester Polytechnic Institute (WPI) Shadow Buffer Theory Observation:
More informationReal-Time Rendering (Echtzeitgraphik) Michael Wimmer
Real-Time Rendering (Echtzeitgraphik) Michael Wimmer wimmer@cg.tuwien.ac.at Walking down the graphics pipeline Application Geometry Rasterizer What for? Understanding the rendering pipeline is the key
More informationPipeline Operations. CS 4620 Lecture Steve Marschner. Cornell CS4620 Spring 2018 Lecture 11
Pipeline Operations CS 4620 Lecture 11 1 Pipeline you are here APPLICATION COMMAND STREAM 3D transformations; shading VERTEX PROCESSING TRANSFORMED GEOMETRY conversion of primitives to pixels RASTERIZATION
More informationEnhancing Traditional Rasterization Graphics with Ray Tracing. October 2015
Enhancing Traditional Rasterization Graphics with Ray Tracing October 2015 James Rumble Developer Technology Engineer, PowerVR Graphics Overview Ray Tracing Fundamentals PowerVR Ray Tracing Pipeline Using
More informationCS230 : Computer Graphics Lecture 4. Tamar Shinar Computer Science & Engineering UC Riverside
CS230 : Computer Graphics Lecture 4 Tamar Shinar Computer Science & Engineering UC Riverside Shadows Shadows for each pixel do compute viewing ray if ( ray hits an object with t in [0, inf] ) then compute
More informationComputergrafik. Matthias Zwicker. Herbst 2010
Computergrafik Matthias Zwicker Universität Bern Herbst 2010 Today Bump mapping Shadows Shadow mapping Shadow mapping in OpenGL Bump mapping Surface detail is often the result of small perturbations in
More informationModels and Architectures
Models and Architectures Objectives Learn the basic design of a graphics system Introduce graphics pipeline architecture Examine software components for an interactive graphics system 1 Image Formation
More informationCS451Real-time Rendering Pipeline
1 CS451Real-time Rendering Pipeline JYH-MING LIEN DEPARTMENT OF COMPUTER SCIENCE GEORGE MASON UNIVERSITY Based on Tomas Akenine-Möller s lecture note You say that you render a 3D 2 scene, but what does
More informationModule Contact: Dr Stephen Laycock, CMP Copyright of the University of East Anglia Version 1
UNIVERSITY OF EAST ANGLIA School of Computing Sciences Main Series PG Examination 2013-14 COMPUTER GAMES DEVELOPMENT CMPSME27 Time allowed: 2 hours Answer any THREE questions. (40 marks each) Notes are
More informationMattan Erez. The University of Texas at Austin
EE382V: Principles in Computer Architecture Parallelism and Locality Fall 2008 Lecture 10 The Graphics Processing Unit Mattan Erez The University of Texas at Austin Outline What is a GPU? Why should we
More informationDeferred Renderer Proof of Concept Report
Deferred Renderer Proof of Concept Report Octavian Mihai Vasilovici 28 March 2013 Bournemouth University 1. Summary This document aims at explaining the methods decide to be used in creating a deferred
More informationThe Application Stage. The Game Loop, Resource Management and Renderer Design
1 The Application Stage The Game Loop, Resource Management and Renderer Design Application Stage Responsibilities 2 Set up the rendering pipeline Resource Management 3D meshes Textures etc. Prepare data
More informationPipeline Operations. CS 4620 Lecture 14
Pipeline Operations CS 4620 Lecture 14 2014 Steve Marschner 1 Pipeline you are here APPLICATION COMMAND STREAM 3D transformations; shading VERTEX PROCESSING TRANSFORMED GEOMETRY conversion of primitives
More informationCS 4620 Program 3: Pipeline
CS 4620 Program 3: Pipeline out: Wednesday 14 October 2009 due: Friday 30 October 2009 1 Introduction In this assignment, you will implement several types of shading in a simple software graphics pipeline.
More informationGame Technology. Lecture Physically Based Rendering. Dipl-Inform. Robert Konrad Polona Caserman, M.Sc.
Game Technology Lecture 7 4.12.2017 Physically Based Rendering Dipl-Inform. Robert Konrad Polona Caserman, M.Sc. Prof. Dr.-Ing. Ralf Steinmetz KOM - Multimedia Communications Lab PPT-for-all v.3.4_office2010
More informationCS GAME PROGRAMMING Question bank
CS6006 - GAME PROGRAMMING Question bank Part A Unit I 1. List the different types of coordinate systems. 2. What is ray tracing? Mention some applications of ray tracing. 3. Discuss the stages involved
More informationGraphics Performance Optimisation. John Spitzer Director of European Developer Technology
Graphics Performance Optimisation John Spitzer Director of European Developer Technology Overview Understand the stages of the graphics pipeline Cherchez la bottleneck Once found, either eliminate or balance
More informationCHAPTER 1 Graphics Systems and Models 3
?????? 1 CHAPTER 1 Graphics Systems and Models 3 1.1 Applications of Computer Graphics 4 1.1.1 Display of Information............. 4 1.1.2 Design.................... 5 1.1.3 Simulation and Animation...........
More informationComputer Graphics Seminar
Computer Graphics Seminar MTAT.03.305 Spring 2015 Raimond Tunnel Conclusion Geometry Point location in space Vector direction in space Polygons Simple vs non-simple Convex vs concave F ce a f t ron e?
More informationComputer Graphics (CS 543) Lecture 10: Normal Maps, Parametrization, Tone Mapping
Computer Graphics (CS 543) Lecture 10: Normal Maps, Parametrization, Tone Mapping Prof Emmanuel Agu Computer Science Dept. Worcester Polytechnic Institute (WPI) Normal Mapping Store normals in texture
More informationRender all data necessary into textures Process textures to calculate final image
Screenspace Effects Introduction General idea: Render all data necessary into textures Process textures to calculate final image Achievable Effects: Glow/Bloom Depth of field Distortions High dynamic range
More informationDirect Rendering of Trimmed NURBS Surfaces
Direct Rendering of Trimmed NURBS Surfaces Hardware Graphics Pipeline 2/ 81 Hardware Graphics Pipeline GPU Video Memory CPU Vertex Processor Raster Unit Fragment Processor Render Target Screen Extended
More informationProgramming Graphics Hardware
Tutorial 5 Programming Graphics Hardware Randy Fernando, Mark Harris, Matthias Wloka, Cyril Zeller Overview of the Tutorial: Morning 8:30 9:30 10:15 10:45 Introduction to the Hardware Graphics Pipeline
More informationShaders. Slide credit to Prof. Zwicker
Shaders Slide credit to Prof. Zwicker 2 Today Shader programming 3 Complete model Blinn model with several light sources i diffuse specular ambient How is this implemented on the graphics processor (GPU)?
More informationGUERRILLA DEVELOP CONFERENCE JULY 07 BRIGHTON
Deferred Rendering in Killzone 2 Michal Valient Senior Programmer, Guerrilla Talk Outline Forward & Deferred Rendering Overview G-Buffer Layout Shader Creation Deferred Rendering in Detail Rendering Passes
More informationReal-time Shadow Mapping
Electrical Engineering Faculty Technion Israel Institute of Technology Haifa, ISRAEL Real-time Shadow Mapping Joined Project in Computer Graphics for Rafael Armament Development Authority Igor Naigovzin
More informationDive into Mobile VR/AR Games
Pre-Meeting Practical Course SS 2015 24th March, 2015 1 Meeting Outline 1. Course Goal 2. Organizational stuff 3. Important Dates 4. Intro to VR/AR 5. Introducing Dive 6. Tasks per Team 7. Tasks Samples
More information3D Computer Games Technology and History. Markus Hadwiger VRVis Research Center
3D Computer Games Technology and History VRVis Research Center Lecture Outline Overview of the last ten years A look at seminal 3D computer games Most important techniques employed Graphics research and
More informationDeferred Rendering Due: Wednesday November 15 at 10pm
CMSC 23700 Autumn 2017 Introduction to Computer Graphics Project 4 November 2, 2017 Deferred Rendering Due: Wednesday November 15 at 10pm 1 Summary This assignment uses the same application architecture
More informationRendering Algorithms: Real-time indirect illumination. Spring 2010 Matthias Zwicker
Rendering Algorithms: Real-time indirect illumination Spring 2010 Matthias Zwicker Today Real-time indirect illumination Ray tracing vs. Rasterization Screen space techniques Visibility & shadows Instant
More informationRecall: Indexing into Cube Map
Recall: Indexing into Cube Map Compute R = 2(N V)N-V Object at origin Use largest magnitude component of R to determine face of cube Other 2 components give texture coordinates V R Cube Map Layout Example
More informationAdvanced Deferred Rendering Techniques. NCCA, Thesis Portfolio Peter Smith
Advanced Deferred Rendering Techniques NCCA, Thesis Portfolio Peter Smith August 2011 Abstract The following paper catalogues the improvements made to a Deferred Renderer created for an earlier NCCA project.
More informationCS427 Multicore Architecture and Parallel Computing
CS427 Multicore Architecture and Parallel Computing Lecture 6 GPU Architecture Li Jiang 2014/10/9 1 GPU Scaling A quiet revolution and potential build-up Calculation: 936 GFLOPS vs. 102 GFLOPS Memory Bandwidth:
More informationCom S 336 Final Project Ideas
Com S 336 Final Project Ideas Deadlines These projects are to be done in groups of two. I strongly encourage everyone to start as soon as possible. Presentations begin four weeks from now (Tuesday, December
More informationShadows. COMP 575/770 Spring 2013
Shadows COMP 575/770 Spring 2013 Shadows in Ray Tracing Shadows are important for realism Basic idea: figure out whether a point on an object is illuminated by a light source Easy for ray tracers Just
More informationGraphics and Interaction Rendering pipeline & object modelling
433-324 Graphics and Interaction Rendering pipeline & object modelling Department of Computer Science and Software Engineering The Lecture outline Introduction to Modelling Polygonal geometry The rendering
More informationRendering Objects. Need to transform all geometry then
Intro to OpenGL Rendering Objects Object has internal geometry (Model) Object relative to other objects (World) Object relative to camera (View) Object relative to screen (Projection) Need to transform
More informationTexture Mapping II. Light maps Environment Maps Projective Textures Bump Maps Displacement Maps Solid Textures Mipmaps Shadows 1. 7.
Texture Mapping II Light maps Environment Maps Projective Textures Bump Maps Displacement Maps Solid Textures Mipmaps Shadows 1 Light Maps Simulates the effect of a local light source + = Can be pre-computed
More informationMany rendering scenarios, such as battle scenes or urban environments, require rendering of large numbers of autonomous characters.
1 2 Many rendering scenarios, such as battle scenes or urban environments, require rendering of large numbers of autonomous characters. Crowd rendering in large environments presents a number of challenges,
More informationRender methods, Compositing, Post-process and NPR in NX Render
Render methods, Compositing, Post-process and NPR in NX Render Overview What makes a good rendered image Render methods in NX Render Foregrounds and backgrounds Post-processing effects Compositing models
More informationLast Time. Why are Shadows Important? Today. Graphics Pipeline. Clipping. Rasterization. Why are Shadows Important?
Last Time Modeling Transformations Illumination (Shading) Real-Time Shadows Viewing Transformation (Perspective / Orthographic) Clipping Projection (to Screen Space) Graphics Pipeline Clipping Rasterization
More informationReal-Time Shadows. Last Time? Today. Why are Shadows Important? Shadows as a Depth Cue. For Intuition about Scene Lighting
Last Time? Real-Time Shadows Today Why are Shadows Important? Shadows & Soft Shadows in Ray Tracing Planar Shadows Projective Texture Shadows Shadow Maps Shadow Volumes Why are Shadows Important? Depth
More informationCOMP 4801 Final Year Project. Ray Tracing for Computer Graphics. Final Project Report FYP Runjing Liu. Advised by. Dr. L.Y.
COMP 4801 Final Year Project Ray Tracing for Computer Graphics Final Project Report FYP 15014 by Runjing Liu Advised by Dr. L.Y. Wei 1 Abstract The goal of this project was to use ray tracing in a rendering
More informationCGDD 4113 Final Review. Chapter 7: Maya Shading and Texturing
CGDD 4113 Final Review Chapter 7: Maya Shading and Texturing Maya topics covered in this chapter include the following: Shader Types Shader Attributes Texturing the Axe Life, Love, Textures and Surfaces
More informationDrawing a Crowd. David Gosselin Pedro V. Sander Jason L. Mitchell. 3D Application Research Group ATI Research
Drawing a Crowd David Gosselin Pedro V. Sander Jason L. Mitchell 3D Application Research Group ATI Research Introduction In this chapter, we present a technique for efficiently rendering a large crowd
More informationHands-On Workshop: 3D Automotive Graphics on Connected Radios Using Rayleigh and OpenGL ES 2.0
Hands-On Workshop: 3D Automotive Graphics on Connected Radios Using Rayleigh and OpenGL ES 2.0 FTF-AUT-F0348 Hugo Osornio Luis Olea A P R. 2 0 1 4 TM External Use Agenda Back to the Basics! What is a GPU?
More informationApplications of Explicit Early-Z Culling
Applications of Explicit Early-Z Culling Jason L. Mitchell ATI Research Pedro V. Sander ATI Research Introduction In past years, in the SIGGRAPH Real-Time Shading course, we have covered the details of
More informationComputer Graphics. Lecture 14 Bump-mapping, Global Illumination (1)
Computer Graphics Lecture 14 Bump-mapping, Global Illumination (1) Today - Bump mapping - Displacement mapping - Global Illumination Radiosity Bump Mapping - A method to increase the realism of 3D objects
More informationEECS 487: Interactive Computer Graphics
Shadow Mapping EECS 487: Interactive Computer Graphics Lecture 32: Interactive Visual Effects Shadow Map Ambient Occlusion A point is lit if it is visible from the light source similar to visible surface
More informationOrthogonal Projection Matrices. Angel and Shreiner: Interactive Computer Graphics 7E Addison-Wesley 2015
Orthogonal Projection Matrices 1 Objectives Derive the projection matrices used for standard orthogonal projections Introduce oblique projections Introduce projection normalization 2 Normalization Rather
More informationPoint based global illumination is now a standard tool for film quality renderers. Since it started out as a real time technique it is only natural
1 Point based global illumination is now a standard tool for film quality renderers. Since it started out as a real time technique it is only natural to consider using it in video games too. 2 I hope that
More informationPer-Pixel Lighting and Bump Mapping with the NVIDIA Shading Rasterizer
Per-Pixel Lighting and Bump Mapping with the NVIDIA Shading Rasterizer Executive Summary The NVIDIA Quadro2 line of workstation graphics solutions is the first of its kind to feature hardware support for
More informationCS354R: Computer Game Technology
CS354R: Computer Game Technology Real-Time Global Illumination Fall 2018 Global Illumination Mirror s Edge (2008) 2 What is Global Illumination? Scene recreates feel of physically-based lighting models
More informationSpring 2009 Prof. Hyesoon Kim
Spring 2009 Prof. Hyesoon Kim Application Geometry Rasterizer CPU Each stage cane be also pipelined The slowest of the pipeline stage determines the rendering speed. Frames per second (fps) Executes on
More informationShadow Techniques. Sim Dietrich NVIDIA Corporation
Shadow Techniques Sim Dietrich NVIDIA Corporation sim.dietrich@nvidia.com Lighting & Shadows The shadowing solution you choose can greatly influence the engine decisions you make This talk will outline
More informationInteractive Computer Graphics A TOP-DOWN APPROACH WITH SHADER-BASED OPENGL
International Edition Interactive Computer Graphics A TOP-DOWN APPROACH WITH SHADER-BASED OPENGL Sixth Edition Edward Angel Dave Shreiner Interactive Computer Graphics: A Top-Down Approach with Shader-Based
More informationFor Intuition about Scene Lighting. Today. Limitations of Planar Shadows. Cast Shadows on Planar Surfaces. Shadow/View Duality.
Last Time Modeling Transformations Illumination (Shading) Real-Time Shadows Viewing Transformation (Perspective / Orthographic) Clipping Projection (to Screen Space) Graphics Pipeline Clipping Rasterization
More informationGetting fancy with texture mapping (Part 2) CS559 Spring Apr 2017
Getting fancy with texture mapping (Part 2) CS559 Spring 2017 6 Apr 2017 Review Skyboxes as backdrops Credits : Flipmode 3D Review Reflection maps Credits : NVidia Review Decal textures Credits : andreucabre.com
More informationNVIDIA nfinitefx Engine: Programmable Pixel Shaders
NVIDIA nfinitefx Engine: Programmable Pixel Shaders The NVIDIA nfinitefx Engine: The NVIDIA nfinitefx TM engine gives developers the ability to program a virtually infinite number of special effects and
More informationLevel of Details in Computer Rendering
Level of Details in Computer Rendering Ariel Shamir Overview 1. Photo realism vs. Non photo realism (NPR) 2. Objects representations 3. Level of details Photo Realism Vs. Non Pixar Demonstrations Sketching,
More information3D Production Pipeline
Overview 3D Production Pipeline Story Character Design Art Direction Storyboarding Vocal Tracks 3D Animatics Modeling Animation Rendering Effects Compositing Basics : OpenGL, transformation Modeling :
More informationSpring 2011 Prof. Hyesoon Kim
Spring 2011 Prof. Hyesoon Kim Application Geometry Rasterizer CPU Each stage cane be also pipelined The slowest of the pipeline stage determines the rendering speed. Frames per second (fps) Executes on
More informationAdaptive Point Cloud Rendering
1 Adaptive Point Cloud Rendering Project Plan Final Group: May13-11 Christopher Jeffers Eric Jensen Joel Rausch Client: Siemens PLM Software Client Contact: Michael Carter Adviser: Simanta Mitra 4/29/13
More informationCS GPU and GPGPU Programming Lecture 2: Introduction; GPU Architecture 1. Markus Hadwiger, KAUST
CS 380 - GPU and GPGPU Programming Lecture 2: Introduction; GPU Architecture 1 Markus Hadwiger, KAUST Reading Assignment #2 (until Feb. 17) Read (required): GLSL book, chapter 4 (The OpenGL Programmable
More informationGraphics for VEs. Ruth Aylett
Graphics for VEs Ruth Aylett Overview VE Software Graphics for VEs The graphics pipeline Projections Lighting Shading Runtime VR systems Two major parts: initialisation and update loop. Initialisation
More informationCS 130 Final. Fall 2015
CS 130 Final Fall 2015 Name Student ID Signature You may not ask any questions during the test. If you believe that there is something wrong with a question, write down what you think the question is trying
More informationWednesday, July 24, 13
The Chase Pushing the Limits of Modern Mobile GPU Renaldas Zioma, Unity Technologies Ole Ciliox, Unity Technologies The Chase High-End Mobile Demo Built with off-the-shelf Unity 4.2 The Chase Goals Impressive
More informationIntroduction to Computer Graphics with WebGL
Introduction to Computer Graphics with WebGL Ed Angel Professor Emeritus of Computer Science Founding Director, Arts, Research, Technology and Science Laboratory University of New Mexico Models and Architectures
More informationEvolution of GPUs Chris Seitz
Evolution of GPUs Chris Seitz Overview Concepts: Real-time rendering Hardware graphics pipeline Evolution of the PC hardware graphics pipeline: 1995-1998: Texture mapping and z-buffer 1998: Multitexturing
More informationHardware-Assisted Relief Texture Mapping
EUROGRAPHICS 0x / N.N. and N.N. Short Presentations Hardware-Assisted Relief Texture Mapping Masahiro Fujita and Takashi Kanai Keio University Shonan-Fujisawa Campus, Fujisawa, Kanagawa, Japan Abstract
More informationAdvanced Computer Graphics (CS & SE ) Lecture 7
Advanced Computer Graphics (CS & SE 233.420) Lecture 7 CREDITS Bill Mark, NVIDIA Programmable Graphics Technology, SIGGRAPH 2002 Course. David Kirk, GPUs and CPUs:The Uneasy Alliance, Panel Presentation,
More informationrendering rasterization based rendering pipelined architecture, parallel mostly triangles (lines and points possible too)
Rendering Scena 3D rendering Immagine screen buffer ( array 2D di pixel ) Rendering in games Real-time (20 or) 30 or 60 FPS Algorithm: rasterization based rendering Hardware based pipelined architecture,
More informationModels and Architectures. Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico
Models and Architectures Ed Angel Professor of Computer Science, Electrical and Computer Engineering, and Media Arts University of New Mexico 1 Objectives Learn the basic design of a graphics system Introduce
More informationChapter 23- UV Texture Mapping
Chapter 23- UV Texture Mapping Since games need to be able to process operations as fast as possible, traditional rendering techniques (specular, ray tracing reflections and refractions) cannot typically
More informationOptimizing and Profiling Unity Games for Mobile Platforms. Angelo Theodorou Senior Software Engineer, MPG Gamelab 2014, 25 th -27 th June
Optimizing and Profiling Unity Games for Mobile Platforms Angelo Theodorou Senior Software Engineer, MPG Gamelab 2014, 25 th -27 th June 1 Agenda Introduction ARM and the presenter Preliminary knowledge
More informationReal - Time Rendering. Graphics pipeline. Michal Červeňanský Juraj Starinský
Real - Time Rendering Graphics pipeline Michal Červeňanský Juraj Starinský Overview History of Graphics HW Rendering pipeline Shaders Debugging 2 History of Graphics HW First generation Second generation
More informationThe Rasterization Pipeline
Lecture 5: The Rasterization Pipeline (and its implementation on GPUs) Computer Graphics CMU 15-462/15-662, Fall 2015 What you know how to do (at this point in the course) y y z x (w, h) z x Position objects
More informationReal - Time Rendering. Pipeline optimization. Michal Červeňanský Juraj Starinský
Real - Time Rendering Pipeline optimization Michal Červeňanský Juraj Starinský Motivation Resolution 1600x1200, at 60 fps Hw power not enough Acceleration is still necessary 3.3.2010 2 Overview Application
More informationThe Shadow Rendering Technique Based on Local Cubemaps
The Shadow Rendering Technique Based on Local Cubemaps Content 1. Importing the project package from the Asset Store 2. Building the project for Android platform 3. How does it work? 4. Runtime shadows
More informationAchieving Real Time Ray Tracing Effects Through GPGPU Acceleration
University of Pennsylvania Senior Project: Achieving Real Time Ray Tracing Effects Through GPGPU Acceleration Matthew J. Vucurevich mjvucure@seas.upenn.edu Advisor: Camillo J. Taylor cjtaylor@central.cis.upenn.edu
More informationPowerVR Hardware. Architecture Overview for Developers
Public Imagination Technologies PowerVR Hardware Public. This publication contains proprietary information which is subject to change without notice and is supplied 'as is' without warranty of any kind.
More informationLast Time. Reading for Today: Graphics Pipeline. Clipping. Rasterization
Last Time Modeling Transformations Illumination (Shading) Real-Time Shadows Viewing Transformation (Perspective / Orthographic) Clipping Projection (to Screen Space) Scan Conversion (Rasterization) Visibility
More informationThe Graphics Pipeline
The Graphics Pipeline Ray Tracing: Why Slow? Basic ray tracing: 1 ray/pixel Ray Tracing: Why Slow? Basic ray tracing: 1 ray/pixel But you really want shadows, reflections, global illumination, antialiasing
More informationMulti-View Soft Shadows. Louis Bavoil
Multi-View Soft Shadows Louis Bavoil lbavoil@nvidia.com Document Change History Version Date Responsible Reason for Change 1.0 March 16, 2011 Louis Bavoil Initial release Overview The Multi-View Soft Shadows
More informationReal-Time Shadows. Last Time? Textures can Alias. Schedule. Questions? Quiz 1: Tuesday October 26 th, in class (1 week from today!
Last Time? Real-Time Shadows Perspective-Correct Interpolation Texture Coordinates Procedural Solid Textures Other Mapping Bump Displacement Environment Lighting Textures can Alias Aliasing is the under-sampling
More information