Light Field Spring

Size: px
Start display at page:

Download "Light Field Spring"

Transcription

1 Light Field 2015 Spring

2 Recall: Light is Electromagnetic radiation (EMR) moving along rays in space R(l) is EMR, measured in units of power (watts) l is wavelength Useful things: Light travels in straight lines In vacuum, radiance emitted = radiance arriving i.e. there is no transmission loss

3 Plenoptic Function The body of the air is full of an infinite number of radiant pyramids caused by the objects located in it Leonardo Da Vinci Pencil of rays: The set of light rays passing through any point in space Plenoptic function Plenus : complete or full Optic 3

4 The Plenoptic Function Figure by Leonard McMillan Q: What is the set of all things that we can ever see? A: The Plenoptic Function (Adelson & Bergen) Let s start with a stationary person and try to parameterize everything that he can see

5 Grayscale snapshot is intensity of light P(q,f) Seen from a single view point At a single time Averaged over the wavelengths of the visible spectrum (can also do P(x,y), but spherical coordinate are nicer)

6 Color snapshot is intensity of light Seen from a single view point At a single time As a function of wavelength P(q,f,l)

7 A movie is intensity of light Seen from a single view point Over time As a function of wavelength P(q,f,l,t)

8 Holographic movie is intensity of light Seen from ANY viewpoint Over time As a function of wavelength P(q,f,l,t,V X,V Y,V Z )

9 The Plenoptic Function P(q,f,l,t,V X,V Y,V Z ) Can reconstruct every possible view, at every moment, from every position, at every wavelength Contains every photograph, every movie, everything that anyone has ever seen.

10 Geometric Components of the pencil of ray lights ANGULAR COORDINATES I E = (Ex, Ey, Ez) Viewpoint V. ( v, v) P( v, v, Ex, Ey, Ez, t, l) Direction of the ray light passin trough the Viewpoint CARTESIAN COORDINATES I P( x, y, Ex, Ey, Ez, t, l) Comonly used in machine vision 10

11 Sampling Plenoptic Function (top view)

12 Ray Let s don t worry about time and color: P(q,f,V X,V Y,V Z ) 5D 3D position 2D direction Slide by Rick Szeliski and Michael Cohen

13 How can we use this? Lighting No Change in Radiance Surface Camera

14 Ray Reuse Infinite line Assume light is constant (vacuum) 4D 2D direction 2D position non-dispersive medium Slide by Rick Szeliski and Michael Cohen

15 Only need plenoptic surface

16 Synthesizing novel views Slide by Rick Szeliski and Michael Cohen

17 Lumigraph / Lightfield Outside convex space Empty Stuff 4D Slide by Rick Szeliski and Michael Cohen

18 Lumigraph - Organization 2D position 2D direction q s Slide by Rick Szeliski and Michael Cohen

19 Lumigraph - Organization 2D position 2D position s u 2 plane parameterization Slide by Rick Szeliski and Michael Cohen

20 Lumigraph - Organization 2D position 2D position t s,t s,t u,v v 2 plane parameterization u,v s u Slide by Rick Szeliski and Michael Cohen

21 Lumigraph - Organization Hold s,t constant Let u,v vary An image s,t u,v Slide by Rick Szeliski and Michael Cohen

22 Lumigraph / Lightfield

23 Lumigraph - Capture Idea 1 Move camera carefully over s,t plane Gantry see Lightfield paper s,t u,v Slide by Rick Szeliski and Michael Cohen

24 Lumigraph - Capture Idea 2 Move camera anywhere Rebinning see Lumigraph paper s,t u,v Slide by Rick Szeliski and Michael Cohen

25 Lumigraph - Rendering For each output pixel determine s,t,u,v either use closest discrete RGB interpolate near values s u Slide by Rick Szeliski and Michael Cohen

26 Lumigraph - Rendering Nearest closest s closest u draw it Blend 16 nearest quadrilinear interpolation s u Slide by Rick Szeliski and Michael Cohen

27 Stanford multi-camera array pixels 30 fps 128 cameras synchronized timing continuous streaming flexible arrangement

28 2D: Image What is an image? All rays through a point Panorama? Slide by Rick Szeliski and Michael Cohen

29 Image Image plane 2D position

30 Spherical Panorama See also: 2003 New Years Eve All light rays through a point form a ponorama Totally captured in a 2D array -- P(q,f) Where is the geometry???

31 Other ways to sample Plenoptic Function Moving in time: Spatio-temporal volume: P(q,f,t) Useful to study temporal changes Long an interest of artists: Claude Monet, Haystacks studies

32 Space-time images Other ways to slice the plenoptic function t y x

33 What is a BRDF? Must know something about light and how it interacts with matter When light interacts with matter: Complicated light-matter dynamic occurs Dependent on characteristics of both the light and the matter Example, sandpaper vs. a mirror

34 What is a BRDF? Typical light-matter interaction scenario: Reflected Light Incoming Light Internal Reflection Transmitted Light Absorption Scattering and Emission 3 types of interaction: transmission, reflection, and absorbtion Light incident at surface = reflected + absorbed + transmitted BRDF describes how much light is reflected

35 What is a BRDF? BRDF is a function of incoming light direction and outgoing view direction light L θ L N θ V V observer surface In 3D, a direction D can be represented in spherical coordinates (q D, f D ) A BRDF is a 4D function: BRDF( q L, f L, q V, f V )

36 Background Bidirectional Reflectance Distribution Function

37 BRDF Bidirectional Reflectance Distribution Function ρ(θ i,f i ; θ o, f o )

38 BRDF Bidirectional Reflectance Distribution Function ρ(θ i,f i ; θ o, f o ) Isotropic material Invariant when material is rotated BRDF is 3D

39 BRDF Models Phenomenological Phong [75] Blinn-Phong [77] Ward [92] Lafortune et al. [97] Ashikhmin et al. [00] Physical Cook-Torrance [81] He et al. [91] Lafortune [97] Cook-Torrance [81]

Modeling Light. Michal Havlik

Modeling Light. Michal Havlik Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Spring 2010 What is light? Electromagnetic radiation (EMR) moving along rays in space R( ) is EMR, measured in units of

More information

Modeling Light. Slides from Alexei A. Efros and others

Modeling Light. Slides from Alexei A. Efros and others Project 3 Results http://www.cs.brown.edu/courses/cs129/results/proj3/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj3/damoreno/ http://www.cs.brown.edu/courses/cs129/results/proj3/taox/ Stereo

More information

Modeling Light. Michal Havlik : Computational Photography Alexei Efros, CMU, Fall 2011

Modeling Light. Michal Havlik : Computational Photography Alexei Efros, CMU, Fall 2011 Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Fall 2011 What is light? Electromagnetic radiation (EMR) moving along rays in space R(λ) is EMR, measured in units of power

More information

Modeling Light. Michal Havlik

Modeling Light. Michal Havlik Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 What is light? Electromagnetic radiation (EMR) moving along rays in space R(λ) is EMR, measured in units of power

More information

Modeling Light. Michal Havlik : Computational Photography Alexei Efros, CMU, Fall 2007

Modeling Light. Michal Havlik : Computational Photography Alexei Efros, CMU, Fall 2007 Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 The Plenoptic Function Figure by Leonard McMillan Q: What is the set of all things that we can ever see? A: The

More information

CSCI 1290: Comp Photo

CSCI 1290: Comp Photo CSCI 1290: Comp Photo Fall 2018 @ Brown University James Tompkin Many slides thanks to James Hays old CS 129 course, along with all of its acknowledgements. What do we see? 3D world 2D image Point of observation

More information

Modeling Light. On Simulating the Visual Experience

Modeling Light. On Simulating the Visual Experience Modeling Light 15-463: Rendering and Image Processing Alexei Efros On Simulating the Visual Experience Just feed the eyes the right data No one will know the difference! Philosophy: Ancient question: Does

More information

Announcements. Light. Properties of light. Light. Project status reports on Wednesday. Readings. Today. Readings Szeliski, 2.2, 2.3.

Announcements. Light. Properties of light. Light. Project status reports on Wednesday. Readings. Today. Readings Szeliski, 2.2, 2.3. Announcements Project status reports on Wednesday prepare 5 minute ppt presentation should contain: problem statement (1 slide) description of approach (1 slide) some images (1 slide) current status +

More information

Image or Object? Is this real?

Image or Object? Is this real? Image or Object? Michael F. Cohen Microsoft Is this real? Photo by Patrick Jennings (patrick@synaptic.bc.ca), Copyright 1995, 96, 97 Whistler B. C. Canada Modeling, Rendering, and Lighting 1 A mental model?

More information

But, vision technology falls short. and so does graphics. Image Based Rendering. Ray. Constant radiance. time is fixed. 3D position 2D direction

But, vision technology falls short. and so does graphics. Image Based Rendering. Ray. Constant radiance. time is fixed. 3D position 2D direction Computer Graphics -based rendering Output Michael F. Cohen Microsoft Research Synthetic Camera Model Computer Vision Combined Output Output Model Real Scene Synthetic Camera Model Real Cameras Real Scene

More information

CS6670: Computer Vision

CS6670: Computer Vision CS6670: Computer Vision Noah Snavely Lecture 20: Light, reflectance and photometric stereo Light by Ted Adelson Readings Szeliski, 2.2, 2.3.2 Light by Ted Adelson Readings Szeliski, 2.2, 2.3.2 Properties

More information

Ligh%ng and Reflectance

Ligh%ng and Reflectance Ligh%ng and Reflectance 2 3 4 Ligh%ng Ligh%ng can have a big effect on how an object looks. Modeling the effect of ligh%ng can be used for: Recogni%on par%cularly face recogni%on Shape reconstruc%on Mo%on

More information

Light. Properties of light. What is light? Today What is light? How do we measure it? How does light propagate? How does light interact with matter?

Light. Properties of light. What is light? Today What is light? How do we measure it? How does light propagate? How does light interact with matter? Light Properties of light Today What is light? How do we measure it? How does light propagate? How does light interact with matter? by Ted Adelson Readings Andrew Glassner, Principles of Digital Image

More information

CS6670: Computer Vision

CS6670: Computer Vision CS6670: Computer Vision Noah Snavely Lecture 21: Light, reflectance and photometric stereo Announcements Final projects Midterm reports due November 24 (next Tuesday) by 11:59pm (upload to CMS) State the

More information

Image-Based Rendering

Image-Based Rendering Image-Based Rendering COS 526, Fall 2016 Thomas Funkhouser Acknowledgments: Dan Aliaga, Marc Levoy, Szymon Rusinkiewicz What is Image-Based Rendering? Definition 1: the use of photographic imagery to overcome

More information

Computational Photography

Computational Photography Computational Photography Matthias Zwicker University of Bern Fall 2010 Today Light fields Introduction Light fields Signal processing analysis Light field cameras Application Introduction Pinhole camera

More information

rendering equation computer graphics rendering equation 2009 fabio pellacini 1

rendering equation computer graphics rendering equation 2009 fabio pellacini 1 rendering equation computer graphics rendering equation 2009 fabio pellacini 1 physically-based rendering synthesis algorithms that compute images by simulation the physical behavior of light computer

More information

Image-Based Modeling and Rendering

Image-Based Modeling and Rendering Image-Based Modeling and Rendering Richard Szeliski Microsoft Research IPAM Graduate Summer School: Computer Vision July 26, 2013 How far have we come? Light Fields / Lumigraph - 1996 Richard Szeliski

More information

Image-Based Modeling and Rendering

Image-Based Modeling and Rendering Traditional Computer Graphics Image-Based Modeling and Rendering Thomas Funkhouser Princeton University COS 426 Guest Lecture Spring 2003 How would you model and render this scene? (Jensen) How about this

More information

Photometric Stereo.

Photometric Stereo. Photometric Stereo Photometric Stereo v.s.. Structure from Shading [1] Photometric stereo is a technique in computer vision for estimating the surface normals of objects by observing that object under

More information

INFOGR Computer Graphics. J. Bikker - April-July Lecture 10: Shading Models. Welcome!

INFOGR Computer Graphics. J. Bikker - April-July Lecture 10: Shading Models. Welcome! INFOGR Computer Graphics J. Bikker - April-July 2016 - Lecture 10: Shading Models Welcome! Today s Agenda: Introduction Light Transport Materials Sensors Shading INFOGR Lecture 10 Shading Models 3 Introduction

More information

A Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India

A Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India A Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India Keshav Mahavidyalaya, University of Delhi, Delhi, India Abstract

More information

Global Illumination. CMPT 361 Introduction to Computer Graphics Torsten Möller. Machiraju/Zhang/Möller

Global Illumination. CMPT 361 Introduction to Computer Graphics Torsten Möller. Machiraju/Zhang/Möller Global Illumination CMPT 361 Introduction to Computer Graphics Torsten Möller Reading Foley, van Dam (better): Chapter 16.7-13 Angel: Chapter 5.11, 11.1-11.5 2 Limitation of local illumination A concrete

More information

Image Formation: Light and Shading. Introduction to Computer Vision CSE 152 Lecture 3

Image Formation: Light and Shading. Introduction to Computer Vision CSE 152 Lecture 3 Image Formation: Light and Shading CSE 152 Lecture 3 Announcements Homework 1 is due Apr 11, 11:59 PM Homework 2 will be assigned on Apr 11 Reading: Chapter 2: Light and Shading Geometric image formation

More information

The Rendering Equation. Computer Graphics CMU /15-662

The Rendering Equation. Computer Graphics CMU /15-662 The Rendering Equation Computer Graphics CMU 15-462/15-662 Review: What is radiance? Radiance at point p in direction N is radiant energy ( #hits ) per unit time, per solid angle, per unit area perpendicular

More information

Experimental Validation of Analytical BRDF Models

Experimental Validation of Analytical BRDF Models Experimental Validation of Analytical BRDF Models Addy Ngan, Frédo Durand, Wojciech Matusik Massachusetts Institute of Technology Goal Evaluate and analyze the performance of analytical reflectance models

More information

Radiometry. Reflectance & Lighting. Solid Angle. Radiance. Radiance Power is energy per unit time

Radiometry. Reflectance & Lighting. Solid Angle. Radiance. Radiance Power is energy per unit time Radiometry Reflectance & Lighting Computer Vision I CSE5A Lecture 6 Read Chapter 4 of Ponce & Forsyth Homework 1 Assigned Outline Solid Angle Irradiance Radiance BRDF Lambertian/Phong BRDF By analogy with

More information

Reflection models and radiometry Advanced Graphics

Reflection models and radiometry Advanced Graphics Reflection models and radiometry Advanced Graphics Rafał Mantiuk Computer Laboratory, University of Cambridge Applications To render realistic looking materials Applications also in computer vision, optical

More information

Announcements. Image Formation: Light and Shading. Photometric image formation. Geometric image formation

Announcements. Image Formation: Light and Shading. Photometric image formation. Geometric image formation Announcements Image Formation: Light and Shading Homework 0 is due Oct 5, 11:59 PM Homework 1 will be assigned on Oct 5 Reading: Chapters 2: Light and Shading CSE 252A Lecture 3 Geometric image formation

More information

Radiometry Measuring Light

Radiometry Measuring Light 1 Radiometry Measuring Light CS 554 Computer Vision Pinar Duygulu Bilkent University 2 How do we see? [Plato] from our eyes flows a light similar to the light of the sun [Chalcidius, middle ages] Therefore,

More information

Mosaics, Plenoptic Function, and Light Field Rendering. Last Lecture

Mosaics, Plenoptic Function, and Light Field Rendering. Last Lecture Mosaics, Plenoptic Function, and Light Field Rendering Topics in Image-ased Modeling and Rendering CSE291 J00 Lecture 3 Last Lecture Camera Models Pinhole perspective Affine/Orthographic models Homogeneous

More information

Lighting and Reflectance COS 426

Lighting and Reflectance COS 426 ighting and Reflectance COS 426 Ray Casting R2mage *RayCast(R3Scene *scene, int width, int height) { R2mage *image = new R2mage(width, height); for (int i = 0; i < width; i++) { for (int j = 0; j < height;

More information

CS 5625 Lec 2: Shading Models

CS 5625 Lec 2: Shading Models CS 5625 Lec 2: Shading Models Kavita Bala Spring 2013 Shading Models Chapter 7 Next few weeks Textures Graphics Pipeline Light Emission To compute images What are the light sources? Light Propagation Fog/Clear?

More information

More and More on Light Fields. Last Lecture

More and More on Light Fields. Last Lecture More and More on Light Fields Topics in Image-Based Modeling and Rendering CSE291 J00 Lecture 4 Last Lecture Re-review with emphasis on radiometry Mosaics & Quicktime VR The Plenoptic function The main

More information

Radiometry & BRDFs CS295, Spring 2017 Shuang Zhao

Radiometry & BRDFs CS295, Spring 2017 Shuang Zhao Radiometry & BRDFs CS295, Spring 2017 Shuang Zhao Computer Science Department University of California, Irvine CS295, Spring 2017 Shuang Zhao 1 Today s Lecture Radiometry Physics of light BRDFs How materials

More information

Introduction to Computer Vision. Introduction CMPSCI 591A/691A CMPSCI 570/670. Image Formation

Introduction to Computer Vision. Introduction CMPSCI 591A/691A CMPSCI 570/670. Image Formation Introduction CMPSCI 591A/691A CMPSCI 570/670 Image Formation Lecture Outline Light and Optics Pinhole camera model Perspective projection Thin lens model Fundamental equation Distortion: spherical & chromatic

More information

The Rendering Equation. Computer Graphics CMU /15-662, Fall 2016

The Rendering Equation. Computer Graphics CMU /15-662, Fall 2016 The Rendering Equation Computer Graphics CMU 15-462/15-662, Fall 2016 Review: What is radiance? Radiance at point p in direction N is radiant energy ( #hits ) per unit time, per solid angle, per unit area

More information

CS4670: Computer Vision

CS4670: Computer Vision CS4670: Computer Vision Noah Snavely Lecture 30: Light, color, and reflectance Light by Ted Adelson Readings Szeliski, 2.2, 2.3.2 Light by Ted Adelson Readings Szeliski, 2.2, 2.3.2 Properties of light

More information

Shading. Brian Curless CSE 557 Autumn 2017

Shading. Brian Curless CSE 557 Autumn 2017 Shading Brian Curless CSE 557 Autumn 2017 1 Reading Optional: Angel and Shreiner: chapter 5. Marschner and Shirley: chapter 10, chapter 17. Further reading: OpenGL red book, chapter 5. 2 Basic 3D graphics

More information

Shading & Material Appearance

Shading & Material Appearance Shading & Material Appearance ACM. All rights reserved. This content is excluded from our Creative Commons license. For more information, see http://ocw.mit.edu/help/faq-fair-use/. MIT EECS 6.837 Matusik

More information

Overview. Radiometry and Photometry. Foundations of Computer Graphics (Spring 2012)

Overview. Radiometry and Photometry. Foundations of Computer Graphics (Spring 2012) Foundations of Computer Graphics (Spring 2012) CS 184, Lecture 21: Radiometry http://inst.eecs.berkeley.edu/~cs184 Overview Lighting and shading key in computer graphics HW 2 etc. ad-hoc shading models,

More information

Illumination and Shading - II

Illumination and Shading - II Illumination and Shading - II Computer Graphics COMP 770 (236) Spring 2007 Instructor: Brandon Lloyd 2/19/07 1 From last time Light Sources Empirical Illumination Shading Local vs Global Illumination 2/19/07

More information

Announcements. Radiometry and Sources, Shadows, and Shading

Announcements. Radiometry and Sources, Shadows, and Shading Announcements Radiometry and Sources, Shadows, and Shading CSE 252A Lecture 6 Instructor office hours This week only: Thursday, 3:45 PM-4:45 PM Tuesdays 6:30 PM-7:30 PM Library (for now) Homework 1 is

More information

Local Illumination. CMPT 361 Introduction to Computer Graphics Torsten Möller. Machiraju/Zhang/Möller

Local Illumination. CMPT 361 Introduction to Computer Graphics Torsten Möller. Machiraju/Zhang/Möller Local Illumination CMPT 361 Introduction to Computer Graphics Torsten Möller Graphics Pipeline Hardware Modelling Transform Visibility Illumination + Shading Perception, Interaction Color Texture/ Realism

More information

Topic 9: Lighting & Reflection models 9/10/2016. Spot the differences. Terminology. Two Components of Illumination. Ambient Light Source

Topic 9: Lighting & Reflection models 9/10/2016. Spot the differences. Terminology. Two Components of Illumination. Ambient Light Source Topic 9: Lighting & Reflection models Lighting & reflection The Phong reflection model diffuse component ambient component specular component Spot the differences Terminology Illumination The transport

More information

Topic 9: Lighting & Reflection models. Lighting & reflection The Phong reflection model diffuse component ambient component specular component

Topic 9: Lighting & Reflection models. Lighting & reflection The Phong reflection model diffuse component ambient component specular component Topic 9: Lighting & Reflection models Lighting & reflection The Phong reflection model diffuse component ambient component specular component Spot the differences Terminology Illumination The transport

More information

Announcements. Rotation. Camera Calibration

Announcements. Rotation. Camera Calibration Announcements HW1 has been posted See links on web page for reading Introduction to Computer Vision CSE 152 Lecture 5 Coordinate Changes: Rigid Transformations both translation and rotatoin Rotation About

More information

Lighting and Materials

Lighting and Materials http://graphics.ucsd.edu/~henrik/images/global.html Lighting and Materials Introduction The goal of any graphics rendering app is to simulate light Trying to convince the viewer they are seeing the real

More information

CMSC427 Shading Intro. Credit: slides from Dr. Zwicker

CMSC427 Shading Intro. Credit: slides from Dr. Zwicker CMSC427 Shading Intro Credit: slides from Dr. Zwicker 2 Today Shading Introduction Radiometry & BRDFs Local shading models Light sources Shading strategies Shading Compute interaction of light with surfaces

More information

Image-based modeling (IBM) and image-based rendering (IBR)

Image-based modeling (IBM) and image-based rendering (IBR) Image-based modeling (IBM) and image-based rendering (IBR) CS 248 - Introduction to Computer Graphics Autumn quarter, 2005 Slides for December 8 lecture The graphics pipeline modeling animation rendering

More information

And if that 120MP Camera was cool

And if that 120MP Camera was cool Reflectance, Lights and on to photometric stereo CSE 252A Lecture 7 And if that 120MP Camera was cool Large Synoptic Survey Telescope 3.2Gigapixel camera 189 CCD s, each with 16 megapixels Pixels are 10µm

More information

Chapter 32 Light: Reflection and Refraction. Copyright 2009 Pearson Education, Inc.

Chapter 32 Light: Reflection and Refraction. Copyright 2009 Pearson Education, Inc. Chapter 32 Light: Reflection and Refraction Units of Chapter 32 The Ray Model of Light Reflection; Image Formation by a Plane Mirror Formation of Images by Spherical Mirrors Index of Refraction Refraction:

More information

CS5670: Computer Vision

CS5670: Computer Vision CS5670: Computer Vision Noah Snavely Light & Perception Announcements Quiz on Tuesday Project 3 code due Monday, April 17, by 11:59pm artifact due Wednesday, April 19, by 11:59pm Can we determine shape

More information

CS201 Computer Vision Lect 4 - Image Formation

CS201 Computer Vision Lect 4 - Image Formation CS201 Computer Vision Lect 4 - Image Formation John Magee 9 September, 2014 Slides courtesy of Diane H. Theriault Question of the Day: Why is Computer Vision hard? Something to think about from our view

More information

Visual Appearance and Color. Gianpaolo Palma

Visual Appearance and Color. Gianpaolo Palma Visual Appearance and Color Gianpaolo Palma LIGHT MATERIAL Visual Appearance Color due to the interaction between the lighting environment (intensity, position, ) and the properties of the object surface

More information

Light. Electromagnetic wave with wave-like nature Refraction Interference Diffraction

Light. Electromagnetic wave with wave-like nature Refraction Interference Diffraction Light Electromagnetic wave with wave-like nature Refraction Interference Diffraction Light Electromagnetic wave with wave-like nature Refraction Interference Diffraction Photons with particle-like nature

More information

Understanding Variability

Understanding Variability Understanding Variability Why so different? Light and Optics Pinhole camera model Perspective projection Thin lens model Fundamental equation Distortion: spherical & chromatic aberration, radial distortion

More information

Radiometry and reflectance

Radiometry and reflectance Radiometry and reflectance http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 16 Course announcements Homework 4 is still ongoing - Any questions?

More information

Re-live the Movie Matrix : From Harry Nyquist to Image-Based Rendering. Tsuhan Chen Carnegie Mellon University Pittsburgh, USA

Re-live the Movie Matrix : From Harry Nyquist to Image-Based Rendering. Tsuhan Chen Carnegie Mellon University Pittsburgh, USA Re-live the Movie Matrix : From Harry Nyquist to Image-Based Rendering Tsuhan Chen tsuhan@cmu.edu Carnegie Mellon University Pittsburgh, USA Some History IEEE Multimedia Signal Processing (MMSP) Technical

More information

Computer Vision. The image formation process

Computer Vision. The image formation process Computer Vision The image formation process Filippo Bergamasco (filippo.bergamasco@unive.it) http://www.dais.unive.it/~bergamasco DAIS, Ca Foscari University of Venice Academic year 2016/2017 The image

More information

Radiometry. Radiometry. Measuring Angle. Solid Angle. Radiance

Radiometry. Radiometry. Measuring Angle. Solid Angle. Radiance Radiometry Radiometry Computer Vision I CSE5A ecture 5-Part II Read Chapter 4 of Ponce & Forsyth Solid Angle Irradiance Radiance BRDF ambertian/phong BRDF Measuring Angle Solid Angle By analogy with angle

More information

THE goal of rendering algorithms is to synthesize images of virtual scenes. Global illumination

THE goal of rendering algorithms is to synthesize images of virtual scenes. Global illumination 2 Fundamentals of Light Transport He who loves practice without theory is like the sailor who boards ship without a rudder and compass and never knows where he may cast. Leonardo Da Vinci, 1452 1519 THE

More information

Lecture 4: Reflection Models

Lecture 4: Reflection Models Lecture 4: Reflection Models CS 660, Spring 009 Kavita Bala Computer Science Cornell University Outline Light sources Light source characteristics Types of sources Light reflection Physics-based models

More information

Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images

Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images Abstract This paper presents a new method to generate and present arbitrarily

More information

Unit 3: Optics Chapter 4

Unit 3: Optics Chapter 4 Unit 3: Optics Chapter 4 History of Light https://www.youtube.com/watch?v=j1yiapztlos History of Light Early philosophers (Pythagoras) believed light was made up of tiny particles Later scientist found

More information

Illumination & Shading: Part 1

Illumination & Shading: Part 1 Illumination & Shading: Part 1 Light Sources Empirical Illumination Shading Local vs Global Illumination Lecture 10 Comp 236 Spring 2005 Computer Graphics Jargon: Illumination Models Illumination - the

More information

Phys102 Lecture 21/22 Light: Reflection and Refraction

Phys102 Lecture 21/22 Light: Reflection and Refraction Phys102 Lecture 21/22 Light: Reflection and Refraction Key Points The Ray Model of Light Reflection and Mirrors Refraction, Snell s Law Total internal Reflection References 23-1,2,3,4,5,6. The Ray Model

More information

Reflection and Refraction of Light

Reflection and Refraction of Light PC1222 Fundamentals of Physics II Reflection and Refraction of Light 1 Objectives Investigate for reflection of rays from a plane surface, the dependence of the angle of reflection on the angle of incidence.

More information

Today. Global illumination. Shading. Interactive applications. Rendering pipeline. Computergrafik. Shading Introduction Local shading models

Today. Global illumination. Shading. Interactive applications. Rendering pipeline. Computergrafik. Shading Introduction Local shading models Computergrafik Matthias Zwicker Universität Bern Herbst 2009 Today Introduction Local shading models Light sources strategies Compute interaction of light with surfaces Requires simulation of physics Global

More information

At the interface between two materials, where light can be reflected or refracted. Within a material, where the light can be scattered or absorbed.

At the interface between two materials, where light can be reflected or refracted. Within a material, where the light can be scattered or absorbed. At the interface between two materials, where light can be reflected or refracted. Within a material, where the light can be scattered or absorbed. The eye sees by focusing a diverging bundle of rays from

More information

Measuring Light: Radiometry and Cameras

Measuring Light: Radiometry and Cameras Lecture 11: Measuring Light: Radiometry and Cameras Computer Graphics CMU 15-462/15-662, Fall 2015 Slides credit: a majority of these slides were created by Matt Pharr and Pat Hanrahan Simulating a pinhole

More information

Lights, Surfaces, and Cameras. Light sources emit photons Surfaces reflect & absorb photons Cameras measure photons

Lights, Surfaces, and Cameras. Light sources emit photons Surfaces reflect & absorb photons Cameras measure photons Reflectance 1 Lights, Surfaces, and Cameras Light sources emit photons Surfaces reflect & absorb photons Cameras measure photons 2 Light at Surfaces Many effects when light strikes a surface -- could be:

More information

Sung-Eui Yoon ( 윤성의 )

Sung-Eui Yoon ( 윤성의 ) CS380: Computer Graphics Illumination and Shading Sung-Eui Yoon ( 윤성의 ) Course URL: http://sglab.kaist.ac.kr/~sungeui/cg/ Course Objectives (Ch. 10) Know how to consider lights during rendering models

More information

CENG 477 Introduction to Computer Graphics. Ray Tracing: Shading

CENG 477 Introduction to Computer Graphics. Ray Tracing: Shading CENG 477 Introduction to Computer Graphics Ray Tracing: Shading Last Week Until now we learned: How to create the primary rays from the given camera and image plane parameters How to intersect these rays

More information

Visualisatie BMT. Rendering. Arjan Kok

Visualisatie BMT. Rendering. Arjan Kok Visualisatie BMT Rendering Arjan Kok a.j.f.kok@tue.nl 1 Lecture overview Color Rendering Illumination 2 Visualization pipeline Raw Data Data Enrichment/Enhancement Derived Data Visualization Mapping Abstract

More information

Lecture 7 Notes: 07 / 11. Reflection and refraction

Lecture 7 Notes: 07 / 11. Reflection and refraction Lecture 7 Notes: 07 / 11 Reflection and refraction When an electromagnetic wave, such as light, encounters the surface of a medium, some of it is reflected off the surface, while some crosses the boundary

More information

Announcement. Lighting and Photometric Stereo. Computer Vision I. Surface Reflectance Models. Lambertian (Diffuse) Surface.

Announcement. Lighting and Photometric Stereo. Computer Vision I. Surface Reflectance Models. Lambertian (Diffuse) Surface. Lighting and Photometric Stereo CSE252A Lecture 7 Announcement Read Chapter 2 of Forsyth & Ponce Might find section 12.1.3 of Forsyth & Ponce useful. HW Problem Emitted radiance in direction f r for incident

More information

BRDF Computer Graphics (Spring 2008)

BRDF Computer Graphics (Spring 2008) BRDF Computer Graphics (Spring 2008) COMS 4160, Lecture 20: Illumination and Shading 2 http://www.cs.columbia.edu/~cs4160 Reflected Radiance proportional to Irradiance Constant proportionality: BRDF [CW

More information

PHYS 219 General Physics: Electricity, Light and Modern Physics

PHYS 219 General Physics: Electricity, Light and Modern Physics PHYS 219 General Physics: Electricity, Light and Modern Physics Exam 2 is scheduled on Tuesday, March 26 @ 8 10 PM In Physics 114 It will cover four Chapters 21, 22, 23, and 24. Start reviewing lecture

More information

Measuring Light: Radiometry and Photometry

Measuring Light: Radiometry and Photometry Lecture 10: Measuring Light: Radiometry and Photometry Computer Graphics and Imaging UC Berkeley CS184/284A, Spring 2016 Radiometry Measurement system and units for illumination Measure the spatial properties

More information

Hot Sync. Materials Needed Today

Hot Sync. Materials Needed Today Chapter 11 Lesson 2 Materials Needed Today Please take these materials out of your backpack. Pencil Blank sheet of paper for a lab! Hot Sync Thursday 3/27/14 After learning how light acts. Write a new

More information

Shading. Reading. Pinhole camera. Basic 3D graphics. Brian Curless CSE 557 Fall Required: Shirley, Chapter 10

Shading. Reading. Pinhole camera. Basic 3D graphics. Brian Curless CSE 557 Fall Required: Shirley, Chapter 10 Reading Required: Shirley, Chapter 10 Shading Brian Curless CSE 557 Fall 2014 1 2 Basic 3D graphics With affine matrices, we can now transform virtual 3D objects in their local coordinate systems into

More information

Shading. Brian Curless CSE 457 Spring 2017

Shading. Brian Curless CSE 457 Spring 2017 Shading Brian Curless CSE 457 Spring 2017 1 Reading Optional: Angel and Shreiner: chapter 5. Marschner and Shirley: chapter 10, chapter 17. Further reading: OpenGL red book, chapter 5. 2 Basic 3D graphics

More information

rendering equation computer graphics rendering equation 2009 fabio pellacini 1

rendering equation computer graphics rendering equation 2009 fabio pellacini 1 rendering equation computer graphics rendering equation 2009 fabio pellacini 1 phsicall-based rendering snthesis algorithms that compute images b simulation the phsical behavior of light computer graphics

More information

Jingyi Yu CISC 849. Department of Computer and Information Science

Jingyi Yu CISC 849. Department of Computer and Information Science Digital Photography and Videos Jingyi Yu CISC 849 Light Fields, Lumigraph, and Image-based Rendering Pinhole Camera A camera captures a set of rays A pinhole camera captures a set of rays passing through

More information

Supplement to Lecture 16

Supplement to Lecture 16 Supplement to Lecture 16 Global Illumination: View Dependent CS 354 Computer Graphics http://www.cs.utexas.edu/~bajaj/ Notes and figures from Ed Angel: Interactive Computer Graphics, 6 th Ed., 2012 Addison

More information

Computer Graphics (CS 543) Lecture 7b: Intro to lighting, Shading and Materials + Phong Lighting Model

Computer Graphics (CS 543) Lecture 7b: Intro to lighting, Shading and Materials + Phong Lighting Model Computer Graphics (CS 543) Lecture 7b: Intro to lighting, Shading and Materials + Phong Lighting Model Prof Emmanuel Agu Computer Science Dept. Worcester Polytechnic Institute (WPI) Why do we need Lighting

More information

Lecture 24 EM waves Geometrical optics

Lecture 24 EM waves Geometrical optics Physics 2102 Jonathan Dowling Lecture 24 EM waves Geometrical optics EM spherical waves The intensity of a wave is power per unit area. If one has a source that emits isotropically (equally in all directions)

More information

(0, 1, 1) (0, 1, 1) (0, 1, 0) What is light? What is color? Terminology

(0, 1, 1) (0, 1, 1) (0, 1, 0) What is light? What is color? Terminology lecture 23 (0, 1, 1) (0, 0, 0) (0, 0, 1) (0, 1, 1) (1, 1, 1) (1, 1, 0) (0, 1, 0) hue - which ''? saturation - how pure? luminance (value) - intensity What is light? What is? Light consists of electromagnetic

More information

Announcements. Image Formation: Outline. Homogenous coordinates. Image Formation and Cameras (cont.)

Announcements. Image Formation: Outline. Homogenous coordinates. Image Formation and Cameras (cont.) Announcements Image Formation and Cameras (cont.) HW1 due, InitialProject topics due today CSE 190 Lecture 6 Image Formation: Outline Factors in producing images Projection Perspective Vanishing points

More information

Timothy Walsh. Reflection Models

Timothy Walsh. Reflection Models Timothy Walsh Reflection Models Outline Reflection Models Geometric Setting Fresnel Reflectance Specular Refletance & Transmission Microfacet Models Lafortune Model Fresnel Incidence Effects Diffuse Scatter

More information

Geometrical Optics INTRODUCTION. Wave Fronts and Rays

Geometrical Optics INTRODUCTION. Wave Fronts and Rays Geometrical Optics INTRODUCTION In this experiment, the optical characteristics of mirrors, lenses, and prisms will be studied based on using the following physics definitions and relationships plus simple

More information

Ray Tracing: Special Topics CSCI 4239/5239 Advanced Computer Graphics Spring 2018

Ray Tracing: Special Topics CSCI 4239/5239 Advanced Computer Graphics Spring 2018 Ray Tracing: Special Topics CSCI 4239/5239 Advanced Computer Graphics Spring 2018 Theoretical foundations Ray Tracing from the Ground Up Chapters 13-15 Bidirectional Reflectance Distribution Function BRDF

More information

Light. Form of Electromagnetic Energy Only part of Electromagnetic Spectrum that we can really see

Light. Form of Electromagnetic Energy Only part of Electromagnetic Spectrum that we can really see Light Form of Electromagnetic Energy Only part of Electromagnetic Spectrum that we can really see Facts About Light The speed of light, c, is constant in a vacuum. Light can be: REFLECTED ABSORBED REFRACTED

More information

Image-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about

Image-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about Image-Based Modeling and Rendering Image-Based Modeling and Rendering MIT EECS 6.837 Frédo Durand and Seth Teller 1 Some slides courtesy of Leonard McMillan, Wojciech Matusik, Byong Mok Oh, Max Chen 2

More information

Unit 3: Optics Chapter 4

Unit 3: Optics Chapter 4 Unit 3: Optics Chapter 4 History of Light https://www.youtube.com/watch?v=j1yiapztlos History of Light Early philosophers (Pythagoras) believed light was made up of tiny particles Later scientist found

More information

Assignment #2. (Due date: 11/6/2012)

Assignment #2. (Due date: 11/6/2012) Computer Vision I CSE 252a, Fall 2012 David Kriegman Assignment #2 (Due date: 11/6/2012) Name: Student ID: Email: Problem 1 [1 pts] Calculate the number of steradians contained in a spherical wedge with

More information

Introduction to Computer Vision. Week 8, Fall 2010 Instructor: Prof. Ko Nishino

Introduction to Computer Vision. Week 8, Fall 2010 Instructor: Prof. Ko Nishino Introduction to Computer Vision Week 8, Fall 2010 Instructor: Prof. Ko Nishino Midterm Project 2 without radial distortion correction with radial distortion correction Light Light Light! How do you recover

More information

Radiance. Radiance properties. Radiance properties. Computer Graphics (Fall 2008)

Radiance. Radiance properties. Radiance properties. Computer Graphics (Fall 2008) Computer Graphics (Fall 2008) COMS 4160, Lecture 19: Illumination and Shading 2 http://www.cs.columbia.edu/~cs4160 Radiance Power per unit projected area perpendicular to the ray per unit solid angle in

More information

Let s review the four equations we now call Maxwell s equations. (Gauss s law for magnetism) (Faraday s law)

Let s review the four equations we now call Maxwell s equations. (Gauss s law for magnetism) (Faraday s law) Electromagnetic Waves Let s review the four equations we now call Maxwell s equations. E da= B d A= Q encl ε E B d l = ( ic + ε ) encl (Gauss s law) (Gauss s law for magnetism) dφ µ (Ampere s law) dt dφ

More information