High Dynamic Range Lighting Paul Debevec, USC Institute for Creative Technologies. March 24, Game Developer s Conference 1
|
|
- Martin Richards
- 6 years ago
- Views:
Transcription
1 March 4, 004 High Dynamic Range Lighting Paul Debevec University of Southern California Institute for Creative Technologies March 4, 004 5:30 6:30 pm Scenes lit with point light sources lack realism Real-World HDR Lighting Environments Funston Beach Eucalyptus Grove Illuminating Objects using Measurements of Real Light Uffizi Gallery Grace Cathedral Lighting Environments from the Light Probe Image Gallery: Object Light Environment assigned glow material property in Greg Ward s RADIANCE system. Elements of HDRI and IBL High Dynamic Range (HDR) Images Pixels beyond 0-55 Pixel proportional to light levels Light Probe Images Omnidirectional HDR images, or HDR environment maps Lighting with real illumination environments yields greater realism Global Illumination Illuminating CG objects with images of incident illumination 004 Game Developer s Conference 1
2 March 4, 004 IBL Tutorial Dynamic Range in the Real World In Jan/Feb Computer Graphics and Applications and the SIGGRAPH 00 IBL Course Notes Sony VX000 video camera Office interior Indirect light from window 1/60 th sec shutter f/5.6 aperture 0 ND filters 0dB gain Dynamic Range in the Real World Outside in the shade 1/1000 th sec shutter f/5.6 aperture 0 ND filters 0dB gain Dynamic Range in the Real World Outside in the sun 1/1000 th sec shutter f/11 aperture 0 ND filters 0dB gain 16 times the light as inside 64 times the light as inside Dynamic Range in the Real World Straight at the sun 1/10,000 th sec shutter f/11 aperture 13 stops ND filters 0dB gain Dynamic Range in the Real World Very dim room 1/4 th sec shutter f/1.6 aperture 0 stops ND filters 18dB gain 5,000,000 times the light as inside 1/1500 th the light than inside 004 Game Developer s Conference
3 March 4, 004,000,000, ,000 Dynamic Range in the Real World High-Dynamic Range Photography 5, Debevec and Malik, Recovering High Dynamic Range Radiance Maps from Photographs, SIGGRAPH ,000 : 1 Visualization: Greg Ward Chris Tchou and Paul Debevec. HDR Shop. SIGGRAPH 001 Technical Sketch A m o u n t o f L i g h t Gamma. graph Pixel Value 55 Implications: 18 is less than ¼ as bright as is more than 4 times as bright as is twice as bright as is half as bright as = / = 93 See also Charles Poynton s Gamma FAQ: DirectX 9 HDR Data Formats 3-bit floating point textures D3DFMT_A3B3G3R3F / D3DFMT_R3F IEEE compatible 16-bit floating point textures D3DFMT_A16B16G16R16F saves memory bandwidth often sufficient dynamic range and precision HDR Image File Formats 004 Game Developer s Conference 3
4 March 4, 004 HDR Formats: RADIANCE Format (.pic,.hdr) Greg Ward s Real Pixels format 3 bits / pixel HDR Formats: Portable FloatMap (.pfm) 1 bytes per pixel, 4 for each channel Red Green Blue Exponent (145, 15, 87, 149) = (145, 15, 87, 103) = (145, 15, 87) * ^(149-18) = (145, 15, 87) * ^(103-18) = ( , , ) ( , , ) Ward, Greg. "Real Pixels," in Graphics Gems IV, edited by James Arvo, Academic Press, 1994 sign exponent mantissa Text header similar to Jeff Poskanzer s.ppm image format: Floating Point TIFF similar PF <binary image data> HDR Formats: ILM s OpenEXR (.exr) 6 bytes per pixel, for each channel, compressed sign exponent mantissa Several lossless compression options, :1 typical Compatible with the half datatype in NVidia's Cg Supported natively on GeForce FX and Quadro FX Available at: HDR Formats: Ward s LogLuv TIFF based on human color perception 4 bits:10 for log luminance 14 for chromaticity index 3 bits:15 log luminance 8 u chrominance 8 v chrominance 1 sign Larson, G.W., Overcoming Gamut and Dynamic Range Limitations in Digital Images, Proceedings of the Sixth Color Imaging Conference, November Panoramic (Omnidirectional) Photography Light Probe Images: Capturing Real-World Illumination Other techniques: - Panoramic Stitching (Realviz Stitcher) -Fisheye Images - Scanning Panoramic Cameras (Panoscan, Spheron) 004 Game Developer s Conference 4
5 March 4, 004 HDR Image of a Mirrored Ball Comparison: HDRI versus single image lighting (60,40,35) (18,17,19) (60,890,1300) Assembled from ten digital images, t = 1/4 to 1/10000 sec (5700,8400,11800) (11700,7300,600) Image-Based Lighting: Illuminating Synthetic Objects with Real Light Acquiring the Light Probe Rendering with Natural Light, SIGGRAPH 98 Assembling the Light Probe RNL Environment mapped onto interior of large cube 004 Game Developer s Conference 5
6 March 4, 004 RNL Example RNL Example Renderer Output Defocus & Glare Added RNL Example RNL Example Soft Focus Added Light Falloff (Vignetting) Added Real-Time RNL Jason Mitchell, John Isidoro, Alex Vlachos Rendered in Real Time on ATI RADEON Game Developer s Conference 6
7 March 4, 004 HDR Rendering Process Building the Scene Scene Geometry lit with HDR Light Probes HDR Scene Bloom Filter + Tone Map Displayable Image Render reflected scene into HDR planar reflection map for table top HDR light probe for distant environment HDR environment maps for local reflections from balls on pedestals Postprocess to get glows Tone map to displayable image Local Reflection Distant HDR Light probe is always sampled with reflection vector in pixel shader Local environment map is sampled with a blend of the surface normal (N) and the reflection vector (R) 100% R Blend between R and N 100% N Up Frame Postprocessing HDR Scene ¼ Size Frame Horizontal 3-Gaussian Filters Vertical 3- Gaussian Filters Filter 50x50 pixel region with sum of three Gaussians Gaussians are σ=, σ=6 and σ=14 + Tone Map Displayable Image Real Time Tone Mapping Masaki Kawase DirectX 9 Demo Very Underexposed Underexposed Good exposure Overexposed Game Developer s Conference 7
8 March 4, 004 Clipped Light Probe (sun too bright) Capturing Light Probes in the Sun How bright is the sun? Radius = 695,000 km Distance = 149,600,000 km => degrees in diameter seen from earth = radians radius 1/ = 46,334 times brighter than white Can we recover the sun? + α + α Shoot Diffuse Sphere Solve for Sun Scaling Factor + α Diffuse Ball α α = (1.166, 0.973, 0.701) 004 Game Developer s Conference 8
9 March 4, 004 Verify composite probe matches diffuse ball + = Lit with Sun Lit with Probe Real Diffuse = Real Diffuse Rendered Diffuse Avg. Error (0.5%, 0.3%, 0.%) RMS Error = (.%, 1.8%, 1.3%) Background plate Synthetic objects added Lighting Entire Environments with Outdoor Light Probes Rendered in Arnold by Marcos Fajardo. 004 Game Developer s Conference 9
10 March 4, Samples per Pixel 6h, min Rendered in Arnold by Marcos Fajardo. Rendered in Arnold by Marcos Fajardo. 4 Samples per Pixel 6h, min Making High Dynamic Range Lighting Efficient Rendering Light Probes as Light Sources LightGen by Jon Cohen et al. at Supports Maya, RADIANCE, Mental Ray, Lightwave Game Developer s Conference 10
11 March 4, 004 Structured Importance Sampling of Environment Maps Importance Sampling 3000 samples Noisy and slow! Sameer Agarwal Henrik Wann Jensen Serge Belongie Ravi Ramamoorthi Structured Importance Sampling of Environment Maps Sameer Agarwal Serge Belongie Henrik Wann Jensen Ravi Ramamoorthi Structured Importance Sampling 300 samples Yay! Approximating Environments Step 1) Partition into regions of increasing brightness Step ) Use Hochbaum-Schmoys Algorithm to place samples in the brightest region(s) Step 3) Repeat for the next brightest region, but make sure you consider the samples you added above first Step 4) Repeat until you ve covered the whole environment. Light Stage 1.0 The Light Stage: 60-second exposure Debevec, Hawkins, Tchou, Duiker, Sarokin, and Sagar. Acquiring the Reflectance Field of a Human Face. SIGGRAPH Game Developer s Conference 11
12 High Dynamic Range Lighting Light Stage 4D Reflectance Field Light Stage Results March 4, 004 Modulated Images Lighting Reflectance Functions 1 normalized light map reflectance function lighting product Environments from the Light Probe Image Gallery rendered pixel 1 DCT Basis Smith Smith and and Rowe. Rowe. Compressed Compressed domain domain processing processing of of JPEG-encoded JPEG-encoded images. images Real-Time IBL with Spherical Harmonics Frequency Space Environment Map Rendering Ravi Ramamoorthi, Pat Hanrahan, SIGGRAPH00 Interactive Interactive Lighting Lighting Demo Demo Chris Chris Tchou, Tchou, Dan Dan Maas Maas SIGGRAPH SIGGRAPH Creative Creative Applications Applications Laboratory Laboratory Game Developer s Conference Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments Peter-Pike Sloan, Jan Kautz, John Snyder, SIGGRAPH00 1
13 High Dynamic Range Lighting Real-time IBL Techniques for Complex BRDFs Ramamoorthi and Hanrahan, March 4, 004 Real-time IBL Techniques P.-P. Sloan, J. Kautz, J. Snyder, Precomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments, SIGGRAPH 00 An Efficient Representation for Irradiance Environment Maps, Siggraph 001. Ramamoorthi and Hanrahan, Frequency Space Environment Map Rendering, Siggraph 00. Excellent Overview: Robin Green, Spherical Harmonic Lighting: The Gritty Details, GDC 003. All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation Ren Ng Stanford University Ravi Ramamoorthi Columbia University Pat Hanrahan Stanford University Non-linear Lighting Approximation All frequencies! D Harr transform - orthonormal basis Approx. lighting L (EM) in (non-linear) wavelet basis Weighting (error minimization) Unweighted Transport weighted Area weighted Light transport T as sparse matrix B = TL (sparse matrix-vector mult.) Better than spherical harmonics! - blurred lighting - soft shadows High energy lights (> 104) SH (100) Wavelets (100) Low energy lights (< 10) Further investigation required! Weighting scheme Spherical wavelets Image-Relighting Comparison IMAGE-BASED LIGHTING IN FIAT LUX Paul Debevec, Tim Hawkins, Westley Sarokin, H. P. Duiker, Christine Cheng, Tal Garfinkel, Jenny Huang SIGGRAPH 99 Electronic Theater 004 Game Developer s Conference 13
14 March 4, 004 Assembled Panorama Light Probe Images Lighting Calculation Impostor light sources Interior of St. Peter s reconstructed from one viewpoint Debevec, Taylor, and Malik. Modeling and Rendering Architecture from Photographs. SIGGRAPH 96 Renderings made with Radiance: HDR Lighting Real-World Reflectance Properties Recovered Ward Model Reflectance Parameters ρ d ρs α Gardner, Tchou, Hawkins, and Debevec SIGGRAPH 003 ρ t N D 004 Game Developer s Conference 14
15 March 4, 004 The Ward Model with Translucency (Single Light Source) δ exp tan I cosθ + ( + ) + α i ρ d cosθi ρt cos θi π ρs π cosθ 4α r Note: all cosines are clamped to be non-negative In terms of vectors I ρd π Where: δ = cos ρ ρ exp tan ρ ρ ρ ρ L N + ρ ρ ρ t s V N 4α ( L N ) + ρ ( L N ) ( L + V N ) = cos ( H N ) 1 1 = half angle δ α Interpolated / Constant Values I ρd π ρ ρ exp tan ρ ρ ρ ρ L N + ρ ρ ρ t s V N 4α ( L N ) + ρ ( L N ) I = light intensity L = light direction vector V = view (camera) direction vector H = half angle vector δ α HDR Texture Maps I ρd π ρ ρ exp tan ρ ρ ρ ρ L N + ρ ρ ρ t s V N 4α ( L N ) + ρ ( L N ) ρ d ρ t ρ s α N = Diffuse reflectance (RGB) = Translucent transmission (RGB) = Specular reflectance (RGB) = Specular roughness (A) = Surface normal (XYZ) δ α Gaussian Specular Lobe Table LLS Real-Time Demo I ρd π ρ ρ exp tan ρ ρ ρ ρ L N + ρ ρ ρ t s V N 4α ( L N ) + ρ ( L N ) δ α Stored in a texture map indexed by ( α, H N ) 004 Game Developer s Conference 15
16 March 4, 004 High Dynamic Range Display System High Dynamic Range Display System Emerging Technologies Helge Seetzen Lorne Whitehead Dept. of Physics of Astronomy University of British Columbia Wolfgang Stuerzlinger Andrejs Vorozcovs Dept. of Computer Science York University Greg Ward AnyHere Consulting Thanks! Jason Mitchell, Chris Brennan, Masaki Kawase Chris Tchou, Andrew Gardner, Tim Hawkins, H.P. Duiker, Westley Sarokin Sponsors: National Science Foundation, Interactive Pictures Corporation, Interval Research Corporation, the US Army, TOPPAN Printing Co. Inc., and the University of Southern California Game Developer s Conference 16
The 7d plenoptic function, indexing all light.
Previous Lecture The 7d plenoptic function, indexing all light. Lightfields: a 4d (not 5d!) data structure which captures all outgoing light from a region and permits reconstruction of arbitrary synthetic
More informationImage-Based Lighting : Computational Photography Alexei Efros, CMU, Fall Eirik Holmøyvik. with a lot of slides donated by Paul Debevec
Image-Based Lighting Eirik Holmøyvik with a lot of slides donated by Paul Debevec 15-463: Computational Photography Alexei Efros, CMU, Fall 2011 Inserting Synthetic Objects Why does this look so bad? Wrong
More informationImage-based Lighting (Part 2)
Image-based Lighting (Part 2) 10/19/17 T2 Computational Photography Derek Hoiem, University of Illinois Many slides from Debevec, some from Efros, Kevin Karsch Today Brief review of last class Show how
More informationGreg Ward / SIGGRAPH 2003
Global Illumination Global Illumination & HDRI Formats Greg Ward Anyhere Software Accounts for most (if not all) visible light interactions Goal may be to maximize realism, but more often visual reproduction
More informationReflection Mapping
Image-Based Lighting A Photometric Approach to Rendering and Compositing Paul Debevec Computer Science Division University of California at Berkeley http://www.cs.berkeley.edu/~debevec August 1999 Reflection
More informationImage-Based Lighting
Image-Based Lighting Eirik Holmøyvik CS194: Image Manipulation & Computational Photography with a lot of slides Alexei Efros, UC Berkeley, Fall 2014 donated by Paul Debevec Inserting Synthetic Objects
More informationImage-Based Lighting. Eirik Holmøyvik. with a lot of slides donated by Paul Debevec
Image-Based Lighting Eirik Holmøyvik with a lot of slides donated by Paul Debevec 15-463: Computational Photography Alexei Efros, CMU, Fall 2006 Inserting Synthetic Objects Why does this look so bad? Wrong
More informationImage-Based Lighting. Inserting Synthetic Objects
Image-Based Lighting 15-463: Rendering and Image Processing Alexei Efros with a lot of slides donated by Paul Debevec Inserting Synthetic Objects Why does this look so bad? Wrong camera orientation Wrong
More informationRecap of Previous Lecture
Recap of Previous Lecture Matting foreground from background Using a single known background (and a constrained foreground) Using two known backgrounds Using lots of backgrounds to capture reflection and
More informationHigh Dynamic Range Images
High Dynamic Range Images Alyosha Efros with a lot of slides stolen from Paul Debevec and Yuanzhen Li, 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 The Grandma Problem Problem: Dynamic
More informationImage Based Lighting with Near Light Sources
Image Based Lighting with Near Light Sources Shiho Furuya, Takayuki Itoh Graduate School of Humanitics and Sciences, Ochanomizu University E-mail: {shiho, itot}@itolab.is.ocha.ac.jp Abstract Recent some
More informationImage Based Lighting with Near Light Sources
Image Based Lighting with Near Light Sources Shiho Furuya, Takayuki Itoh Graduate School of Humanitics and Sciences, Ochanomizu University E-mail: {shiho, itot}@itolab.is.ocha.ac.jp Abstract Recent some
More informationHigh Dynamic Range Image Texture Mapping based on VRML
High Dynamic Range Image Texture Mapping based on VRML Sung-Ye Kim and Byoung-Tae Choi 3D Graphics Research Team, Virtual Reality Research and Development Department, Computer Software Research Laboratory,
More informationResearch White Paper WHP 143. Multi-camera radiometric surface modelling for image-based re-lighting BRITISH BROADCASTING CORPORATION.
Research White Paper WHP 143 11 January 2007 Multi-camera radiometric surface modelling for image-based re-lighting Oliver Grau BRITISH BROADCASTING CORPORATION Multi-camera radiometric surface modelling
More informationCMSC427 Advanced shading getting global illumination by local methods. Credit: slides Prof. Zwicker
CMSC427 Advanced shading getting global illumination by local methods Credit: slides Prof. Zwicker Topics Shadows Environment maps Reflection mapping Irradiance environment maps Ambient occlusion Reflection
More informationStochastic Path Tracing and Image-based lighting
EDA101 : Advanced Shading and Rendering Stochastic Path Tracing and Image-based lighting Michael Doggett 2008 Tomas Akenine-Möller 1 This is what we want: Courtesy of Henrik Wann Jensen Courtesy of Paul
More informationRecent Advances in Monte Carlo Offline Rendering
CS294-13: Special Topics Lecture #6 Advanced Computer Graphics University of California, Berkeley Monday, 21 September 2009 Recent Advances in Monte Carlo Offline Rendering Lecture #6: Monday, 21 September
More informationDynamic range Physically Based Rendering. High dynamic range imaging. HDR image capture Exposure time from 30 s to 1 ms in 1-stop increments.
Dynamic range Ambient luminance levels for some common lighting environments: 094 Physically Based Rendering Sun and Sky and Colour and Environment Maps Jeppe Revall Frisvad Condition Illumination cd/m
More informationReal-Time Image Based Lighting in Software Using HDR Panoramas
Real-Time Image Based Lighting in Software Using HDR Panoramas Jonas Unger, Magnus Wrenninge, Filip Wänström and Mark Ollila Norrköping Visualization and Interaction Studio Linköping University, Sweden
More informationIntroduction to Game FX (1/2) Improve the visual & sound game effects Includes : Combat FX Environment FX Character FX Scene FX Sound FX Post-processi
Game FX 1 Introduction to Game FX (1/2) Improve the visual & sound game effects Includes : Combat FX Environment FX Character FX Scene FX Sound FX Post-processing after rendering FX editor needed General
More informationCS : Assignment 2 Real-Time / Image-Based Rendering
CS 294-13: Assignment 2 Real-Time / Image-Based Rendering Ravi Ramamoorthi 1 Introduction In this assignment, you will implement some of the modern techniques for real-time and/or image-based rendering.
More informationCSCI 1290: Comp Photo
CSCI 1290: Comp Photo Fall 2018 @ Brown University James Tompkin Many slides thanks to James Hays old CS 129 course, along with all of its acknowledgements. Feedback from Project 0 MATLAB: Live Scripts!=
More informationSpherical Harmonic Gradients for Mid-Range Illumination
Eurographics Symposium on Rendering (2004) H. W. Jensen, A. Keller (Editors) Spherical Harmonic Gradients for Mid-Range Illumination Thomas Annen 1 Jan Kautz 2 Frédo Durand 2 Hans-Peter Seidel 1 1 MPI
More informationCS 283: Assignment 3 Real-Time / Image-Based Rendering
CS 283: Assignment 3 Real-Time / Image-Based Rendering Ravi Ramamoorthi 1 Introduction In this assignment, you will implement some of the modern techniques for real-time and/or image-based rendering. To
More informationHigh dynamic range imaging
High dynamic range imaging Digital Visual Effects Yung-Yu Chuang with slides by Fredo Durand, Brian Curless, Steve Seitz, Paul Debevec and Alexei Efros Camera is an imperfect device Camera is an imperfect
More informationPrecomputed Radiance Transfer: Theory and Practice
1 Precomputed Radiance Transfer: Peter-Pike Sloan Microsoft Jaakko Lehtinen Helsinki Univ. of Techn. & Remedy Entertainment Jan Kautz MIT 2 Introduction Jan Kautz MIT 3 Introduction We see here an example
More informationPrecomputation-Based Real-Time Rendering
CS294-13: Advanced Computer Graphics Lecture #11 Real-Time Rendering University of California, Berkeley Precomputation-Based Real-Time Rendering Lecture #11: Wednesday, 7 October 2009 Lecturer: Ravi Ramamoorthi
More informationCS4670/5760: Computer Vision
CS4670/5760: Computer Vision Kavita Bala! Lecture 28: Photometric Stereo Thanks to ScoC Wehrwein Announcements PA 3 due at 1pm on Monday PA 4 out on Monday HW 2 out on weekend Next week: MVS, sfm Last
More informationMotivation. My General Philosophy. Assumptions. Advanced Computer Graphics (Spring 2013) Precomputation-Based Relighting
Advanced Computer Graphics (Spring 2013) CS 283, Lecture 17: Precomputation-Based Real-Time Rendering Ravi Ramamoorthi http://inst.eecs.berkeley.edu/~cs283/sp13 Motivation Previously: seen IBR. Use measured
More informationSubtractive Shadows: A Flexible Framework for Shadow Level of Detail
jgt 2008/3/21 15:26 page 45 #1 Vol. 13, No. 1: 45 56 Subtractive Shadows: A Flexible Framework for Shadow Level of Detail Christopher DeCoro and Szymon Rusinkiewicz Princeton University Abstract. We explore
More informationShadow and Environment Maps
CS294-13: Special Topics Lecture #8 Advanced Computer Graphics University of California, Berkeley Monday, 28 September 2009 Shadow and Environment Maps Lecture #8: Monday, 28 September 2009 Lecturer: Ravi
More informationBioTechnology. An Indian Journal FULL PAPER. Trade Science Inc. A wavelet based real-time rendering technology for indoor mixed reality ABSTRACT
[Type text] [Type text] [Type text] ISSN : 0974-7435 Volume 10 Issue 24 2014 BioTechnology An Indian Journal FULL PAPER BTAIJ, 10(24), 2014 [15095-15100] A wavelet based real-time rendering technology
More informationShading / Light. Thanks to Srinivas Narasimhan, Langer-Zucker, Henrik Wann Jensen, Ravi Ramamoorthi, Hanrahan, Preetham
Shading / Light Thanks to Srinivas Narasimhan, Langer-Zucker, Henrik Wann Jensen, Ravi Ramamoorthi, Hanrahan, Preetham Phong Illumination Model See Shirley, Ch 10 and http://en.wikipedia.org/wiki/phong_shading
More informationImage-based Lighting
Image-based Lighting 10/17/15 T2 Computational Photography Derek Hoiem, University of Illinois Many slides from Debevec, some from Efros Next week Derek away for ICCV (Venice) Zhizhong and Aditya will
More informationFaces and Image-Based Lighting
Announcements Faces and Image-Based Lighting Project #3 artifacts voting Final project: Demo on 6/25 (Wednesday) 13:30pm in this room Reports and videos due on 6/26 (Thursday) 11:59pm Digital Visual Effects,
More informationRendering Synthetic Objects into Real Scenes. based on [Debevec98]
Rendering Synthetic Objects into Real Scenes based on [Debevec98] Compositing of synthetic objects Geometry consistency needed: geometric model of synthetic objects needed: (coarse) geometric model of
More informationRecovering illumination and texture using ratio images
Recovering illumination and texture using ratio images Alejandro Troccoli atroccol@cscolumbiaedu Peter K Allen allen@cscolumbiaedu Department of Computer Science Columbia University, New York, NY Abstract
More informationLighting & 3D Graphics. Images from 3D Creative Magazine
Lighting & 3D Graphics Images from 3D Creative Magazine Contents Introduction Definitions 3D Lighting Basics 3D Light Sources Lighting Controls & Effects Brightness & Colour Shadows Hotspot And Falloff
More informationComputergrafik. Matthias Zwicker Universität Bern Herbst 2016
Computergrafik Matthias Zwicker Universität Bern Herbst 2016 Today More shading Environment maps Reflection mapping Irradiance environment maps Ambient occlusion Reflection and refraction Toon shading
More informationReal-time High Dynamic Range Image-based Lighting
Real-time High Dynamic Range Image-based Lighting César Palomo Department of Computer Science PUC-Rio, Rio de Janeiro, Brazil ABSTRACT In this work we present a real time method of lighting virtual objects
More informationGeneral mental ray questions
HDRI For Artists Siggraph 2008 mental ray HDRI FAQ By Håkan Zap Andersson, mental images version 4.1: April 25, 2008 General mental ray questions What is/are the primary reasons I should use mental ray
More informationRendering Algorithms: Real-time indirect illumination. Spring 2010 Matthias Zwicker
Rendering Algorithms: Real-time indirect illumination Spring 2010 Matthias Zwicker Today Real-time indirect illumination Ray tracing vs. Rasterization Screen space techniques Visibility & shadows Instant
More informationRelighting for an Arbitrary Shape Object Under Unknown Illumination Environment
Relighting for an Arbitrary Shape Object Under Unknown Illumination Environment Yohei Ogura (B) and Hideo Saito Keio University, 3-14-1 Hiyoshi, Kohoku, Yokohama, Kanagawa 223-8522, Japan {y.ogura,saito}@hvrl.ics.keio.ac.jp
More informationEFFICIENT REPRESENTATION OF LIGHTING PATTERNS FOR IMAGE-BASED RELIGHTING
EFFICIENT REPRESENTATION OF LIGHTING PATTERNS FOR IMAGE-BASED RELIGHTING Hyunjung Shim Tsuhan Chen {hjs,tsuhan}@andrew.cmu.edu Department of Electrical and Computer Engineering Carnegie Mellon University
More informationReal Time Relighting with Dynamic Light Environment Using an RGB-D Camera
Real Time Relighting with Dynamic Light Environment Using an RGB-D Camera Takuya Ikeda, Francois de Sorbier and Hideo Saito Graduate School of Science and Technology Keio University, 3 14 1, Hiyoshi, Kouhoku
More informationBiased Monte Carlo Ray Tracing
Biased Monte Carlo Ray Tracing Filtering, Irradiance Caching, and Photon Mapping Henrik Wann Jensen Stanford University May 23, 2002 Unbiased and Consistent Unbiased estimator: E{X} =... Consistent estimator:
More informationCSE 167: Lecture #7: Color and Shading. Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2011
CSE 167: Introduction to Computer Graphics Lecture #7: Color and Shading Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2011 Announcements Homework project #3 due this Friday,
More informationThe Shading Probe: Fast Appearance Acquisition for Mobile AR
The Shading Probe: Fast Appearance Acquisition for Mobile AR Dan Andrei Calian * Kenny Mitchell Derek Nowrouzezahrai Jan Kautz * * University College London Disney Research Zürich University of Montreal
More informationRe-rendering from a Dense/Sparse Set of Images
Re-rendering from a Dense/Sparse Set of Images Ko Nishino Institute of Industrial Science The Univ. of Tokyo (Japan Science and Technology) kon@cvl.iis.u-tokyo.ac.jp Virtual/Augmented/Mixed Reality Three
More informationAnalysis of Planar Light Fields from Homogeneous Convex Curved Surfaces Under Distant Illumination
Analysis of Planar Light Fields from Homogeneous Convex Curved Surfaces Under Distant Illumination Ravi Ramamoorthi and Pat Hanrahan {ravir,hanrahan}@graphics.stanford.edu http://graphics.stanford.edu/papers/planarlf/
More informationA New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction
A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction Jaemin Lee and Ergun Akleman Visualization Sciences Program Texas A&M University Abstract In this paper we present a practical
More informationBiased Monte Carlo Ray Tracing:
Biased Monte Carlo Ray Tracing: Filtering, Irradiance Caching and Photon Mapping Dr. Henrik Wann Jensen Stanford University May 24, 2001 Unbiased and consistent Monte Carlo methods Unbiased estimator:
More informationlucille: Open Source Global Illumination Renderer
lucille: Open Source Global Illumination Renderer http://lucille.sourceforge.net Masahiro Fujita Keio University Graduate School of Media and Governance email: syoyo@sfc.keio.ac.jp Takashi Kanai Keio University
More informationDiscussion. Smoothness of Indirect Lighting. History and Outline. Irradiance Calculation. Irradiance Caching. Advanced Computer Graphics (Spring 2013)
Advanced Computer Graphics (Spring 2013 CS 283, Lecture 12: Recent Advances in Monte Carlo Offline Rendering Ravi Ramamoorthi http://inst.eecs.berkeley.edu/~cs283/sp13 Some slides/ideas courtesy Pat Hanrahan,
More informationCSE 163: Assignment 3 Final Project
CSE 163: Assignment 3 Final Project Ravi Ramamoorthi The final project is a chance to showcase what you ve learned in the course, to develop a project of your choice. We provide some options here, both
More informationToday. Global illumination. Shading. Interactive applications. Rendering pipeline. Computergrafik. Shading Introduction Local shading models
Computergrafik Matthias Zwicker Universität Bern Herbst 2009 Today Introduction Local shading models Light sources strategies Compute interaction of light with surfaces Requires simulation of physics Global
More informationLighting and Shadows. Lecture #11. Thanks to Langer-Zucker, Henrik Wann Jensen, Ravi Ramamoorthi, Hanrahan, Preetham
Lighting and Shadows Lecture #11 Thanks to Langer-Zucker, Henrik Wann Jensen, Ravi Ramamoorthi, Hanrahan, Preetham Appearance of An Outdoor Scene Illumination Spectrum Reflectance (BRDF, BTF) Illumination
More informationMotivation. Advanced Computer Graphics (Fall 2009) CS 283, Lecture 11: Monte Carlo Integration Ravi Ramamoorthi
Advanced Computer Graphics (Fall 2009) CS 283, Lecture 11: Monte Carlo Integration Ravi Ramamoorthi http://inst.eecs.berkeley.edu/~cs283 Acknowledgements and many slides courtesy: Thomas Funkhouser, Szymon
More informationTraditional Image Generation. Reflectance Fields. The Light Field. The Light Field. The Light Field. The Light Field
Traditional Image Generation Course 10 Realistic Materials in Computer Graphics Surfaces + BRDFs Reflectance Fields USC Institute for Creative Technologies Volumetric scattering, density fields, phase
More informationRendering Light Reflection Models
Rendering Light Reflection Models Visual Imaging in the Electronic Age Donald P. Greenberg October 3, 2017 Lecture #13 Program of Computer Graphics, Cornell University General Electric - 167 Cornell in
More informationx ~ Hemispheric Lighting
Irradiance and Incoming Radiance Imagine a sensor which is a small, flat plane centered at a point ~ x in space and oriented so that its normal points in the direction n. This sensor can compute the total
More informationShading in Valve s Source Engine SIGGRAPH Jason Mitchell Valve Valve Corporation. All Rights Reserved.
Shading in Valve s Source Engine SIGGRAPH 2006 Jason Mitchell Valve World Lighting Radiosity Normal Mapping Specular Lighting Model lighting Irradiance Volume Half-Lambert Phong terms High Dynamic Range
More informationProgrammable GPUS. Last Time? Reading for Today. Homework 4. Planar Shadows Projective Texture Shadows Shadow Maps Shadow Volumes
Last Time? Programmable GPUS Planar Shadows Projective Texture Shadows Shadow Maps Shadow Volumes frame buffer depth buffer stencil buffer Stencil Buffer Homework 4 Reading for Create some geometry "Rendering
More informationAdding Spherical Harmonic Lighting to the Sushi Engine. Chris Oat 3D Application Research Group. ATI Research, Inc.
Adding Spherical Harmonic Lighting to the Sushi Engine Chris Oat 3D Application Research Group ATI Research, Inc. Overview Introduction & Motivation Quick Review of PRT Case Study : ATI s demo engine Sushi
More informationRender all data necessary into textures Process textures to calculate final image
Screenspace Effects Introduction General idea: Render all data necessary into textures Process textures to calculate final image Achievable Effects: Glow/Bloom Depth of field Distortions High dynamic range
More informationSpherical Harmonic Lighting: The Gritty Details Robin Green
Spherical Harmonic Lighting: The Gritty Details Robin Green R&D Programmer Sony Computer Entertainment America What This Talk Is About Advanced Lecture Explicit equations will be shown This talk is one
More informationImportance Sampling Spherical Harmonics
Importance Sampling Spherical Harmonics Wojciech Jarosz 1,2 Nathan A. Carr 2 Henrik Wann Jensen 1 1 University of California, San Diego 2 Adobe Systems Incorporated April 2, 2009 Spherical Harmonic Sampling
More informationConsider a partially transparent object that is illuminated with two lights, one visible from each side of the object. Start with a ray from the eye
Ray Tracing What was the rendering equation? Motivate & list the terms. Relate the rendering equation to forward ray tracing. Why is forward ray tracing not good for image formation? What is the difference
More informationGlobal Illumination CS334. Daniel G. Aliaga Department of Computer Science Purdue University
Global Illumination CS334 Daniel G. Aliaga Department of Computer Science Purdue University Recall: Lighting and Shading Light sources Point light Models an omnidirectional light source (e.g., a bulb)
More informationComputer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier
Computer Vision 2 SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung Computer Vision 2 Dr. Benjamin Guthier 3. HIGH DYNAMIC RANGE Computer Vision 2 Dr. Benjamin Guthier Pixel Value Content of this
More informationAnnouncement. Lighting and Photometric Stereo. Computer Vision I. Surface Reflectance Models. Lambertian (Diffuse) Surface.
Lighting and Photometric Stereo CSE252A Lecture 7 Announcement Read Chapter 2 of Forsyth & Ponce Might find section 12.1.3 of Forsyth & Ponce useful. HW Problem Emitted radiance in direction f r for incident
More informationToday. Global illumination. Shading. Interactive applications. Rendering pipeline. Computergrafik. Shading Introduction Local shading models
Computergrafik Thomas Buchberger, Matthias Zwicker Universität Bern Herbst 2008 Today Introduction Local shading models Light sources strategies Compute interaction of light with surfaces Requires simulation
More informationPerceptual Effects in Real-time Tone Mapping
Perceptual Effects in Real-time Tone Mapping G. Krawczyk K. Myszkowski H.-P. Seidel Max-Planck-Institute für Informatik Saarbrücken, Germany SCCG 2005 High Dynamic Range (HDR) HDR Imaging Display of HDR
More informationOutline of Lecture. Real-Time High Quality Rendering. Geometry or Vertex Pipeline. Basic Hardware Pipeline. Pixel or Fragment Pipeline
Real-Time High Quality Rendering CSE 274 [Fall 2015], Lecture 2 Graphics Hardware Pipeline, Reflection and Rendering Equations, Taonomy of Methods http://www.cs.ucsd.edu/~ravir Outline of Lecture Taonomy
More informationA Frequency Analysis of Light Transport
A Frequency Analysis of Light Transport Frédo Durand MIT CSAIL With Nicolas Holzschuch, Cyril Soler, Eric Chan & Francois Sillion Artis Gravir/Imag-Inria & MIT CSAIL Our research 3D rendering Light transport
More informationPantaRay: Fast Ray-traced Occlusion Caching of Massive Scenes J. Pantaleoni, L. Fascione, M. Hill, T. Aila
PantaRay: Fast Ray-traced Occlusion Caching of Massive Scenes J. Pantaleoni, L. Fascione, M. Hill, T. Aila Agenda Introduction Motivation Basics PantaRay Accelerating structure generation Massively parallel
More informationTo Do. Real-Time High Quality Rendering. Motivation for Lecture. Monte Carlo Path Tracing. Monte Carlo Path Tracing. Monte Carlo Path Tracing
Real-Time High Quality Rendering CSE 274 [Fall 2015], Lecture 5 Tour of Modern Offline Rendering To Do Project milestone (1-2 pages), final project proposal Due on Oct 27 Please get in touch with me if
More informationframe buffer depth buffer stencil buffer
Final Project Proposals Programmable GPUS You should all have received an email with feedback Just about everyone was told: Test cases weren t detailed enough Project was possibly too big Motivation could
More informationFast HDR Image-Based Lighting Using Summed-Area Tables
Fast HDR Image-Based Lighting Using Summed-Area Tables Justin Hensley 1, Thorsten Scheuermann 2, Montek Singh 1 and Anselmo Lastra 1 1 University of North Carolina, Chapel Hill, NC, USA {hensley, montek,
More informationSimulating Spatially Varying Lighting on a Live Performance
Simulating Spatially Varying Lighting on a Live Performance Andrew Jones Andrew Gardner Mark Bolas Ian McDowall Paul Debevec USC Institute for Creative Technologies University of Southern California Fakespace
More informationMaking Pretty Pictures with D3D
Making Pretty Pictures with D3D Or A hand-wavey tour through some case studies of how to bring a graphics card to its knees in the persuit of greater beauty Alex Evans, Lionhead Studios And Relax Amid
More informationSkylight to enhance outdoor scenes Real-Time Graphics. The atmosphere. Rayleigh scattering. Jeppe Revall Frisvad.
Skylight to enhance outdoor scenes 02564 Real-Time Graphics Skylight and irradiance environment maps Jeppe Revall Frisvad March 2016 Esplanade, Saint Clair, Dunedin, New ealand: -45.9121, 170.4893 The
More informationCSE 167: Introduction to Computer Graphics Lecture #6: Colors. Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2013
CSE 167: Introduction to Computer Graphics Lecture #6: Colors Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2013 Announcements Homework project #3 due this Friday, October 18
More informationLecture 4: Reflection Models
Lecture 4: Reflection Models CS 660, Spring 009 Kavita Bala Computer Science Cornell University Outline Light sources Light source characteristics Types of sources Light reflection Physics-based models
More informationAll-Frequency Shadows Using Non-linear Wavelet Lighting Approximation
All-Frequency Shadows Using Non-linear Wavelet Lighting Approximation Ren Ng Stanford University Ravi Ramamoorthi Columbia University Pat Hanrahan Stanford University Abstract We present a method, based
More informationAdvanced Computer Graphics CS 563: Screen Space GI Techniques: Real Time
Advanced Computer Graphics CS 563: Screen Space GI Techniques: Real Time William DiSanto Computer Science Dept. Worcester Polytechnic Institute (WPI) Overview Deferred Shading Ambient Occlusion Screen
More informationRendering Light Reflection Models
Rendering Light Reflection Models Visual Imaging in the Electronic Age Donald P. Greenberg October 27, 2015 Lecture #18 Goal of Realistic Imaging The resulting images should be physically accurate and
More informationCENG 477 Introduction to Computer Graphics. Ray Tracing: Shading
CENG 477 Introduction to Computer Graphics Ray Tracing: Shading Last Week Until now we learned: How to create the primary rays from the given camera and image plane parameters How to intersect these rays
More informationComputer Graphics (CS 4731) Lecture 16: Lighting, Shading and Materials (Part 1)
Computer Graphics (CS 4731) Lecture 16: Lighting, Shading and Materials (Part 1) Prof Emmanuel Agu Computer Science Dept. Worcester Polytechnic Institute (WPI) Why do we need Lighting & shading? Sphere
More informationAll-Frequency Relighting of Non-Diffuse Objects using Separable BRDF Approximation
Eurographics Symposium on Rendering (2004) H. W. Jensen, A. Keller (Editors) All-Frequency Relighting of Non-Diffuse Objects using Separable BRDF Approximation Rui Wang, John Tran, and David Luebke Department
More informationMental Ray for BK5100
for BK5100 Practical guide: Global Illumination Interior and MIA Materials Tweety 1 Technisch Ontwerp en Informatica Lecture overview Final Gather Exterior Lighting and rendering an exterior scene using
More informationReal-Time High-Dynamic Range Texture Mapping
Real-Time High-Dynamic Range Texture Mapping Jonathan Cohen, Chris Tchou, Tim Hawkins, and Paul Debevec University of Southern California Institute for Creative Technologies 13274 Fiji Way, Marina del
More informationCapturing light. Source: A. Efros
Capturing light Source: A. Efros Review Pinhole projection models What are vanishing points and vanishing lines? What is orthographic projection? How can we approximate orthographic projection? Lenses
More informationjgt wrap 2011/11/30 10:04 page 1 #1
jgt wrap 2011/11/30 10:04 page 1 #1 Vol. [VOL], No. [ISS]: 1 8 Wrap Shading Peter-Pike Sloan Disney Interactive Studios Derek Nowrouzezahrai University of Toronto, Disney Research Zürich Hong Yuan UMass
More informationAdvanced Post Processing
Advanced Post Processing Agenda Efficient Use of Blur Horizon-Based Ambient Occlusion Efficient Use of Blur Many Forms of Blur Bloom Motion Blur And more Depth of Field God Rays Issues of Blur Effect Full-screen
More informationComputer Graphics (CS 543) Lecture 7b: Intro to lighting, Shading and Materials + Phong Lighting Model
Computer Graphics (CS 543) Lecture 7b: Intro to lighting, Shading and Materials + Phong Lighting Model Prof Emmanuel Agu Computer Science Dept. Worcester Polytechnic Institute (WPI) Why do we need Lighting
More informationPath Tracing part 2. Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017
Path Tracing part 2 Steve Rotenberg CSE168: Rendering Algorithms UCSD, Spring 2017 Monte Carlo Integration Monte Carlo Integration The rendering (& radiance) equation is an infinitely recursive integral
More informationLecture 7 - Path Tracing
INFOMAGR Advanced Graphics Jacco Bikker - November 2016 - February 2017 Lecture 7 - I x, x = g(x, x ) ε x, x + S ρ x, x, x I x, x dx Welcome! Today s Agenda: Introduction Advanced Graphics 3 Introduction
More informationGUERRILLA DEVELOP CONFERENCE JULY 07 BRIGHTON
Deferred Rendering in Killzone 2 Michal Valient Senior Programmer, Guerrilla Talk Outline Forward & Deferred Rendering Overview G-Buffer Layout Shader Creation Deferred Rendering in Detail Rendering Passes
More informationEfficient Rendering of Glossy Reflection Using Graphics Hardware
Efficient Rendering of Glossy Reflection Using Graphics Hardware Yoshinori Dobashi Yuki Yamada Tsuyoshi Yamamoto Hokkaido University Kita-ku Kita 14, Nishi 9, Sapporo 060-0814, Japan Phone: +81.11.706.6530,
More information