CS 684 Fall 2005 Image-based Modeling and Rendering. Ruigang Yang

Size: px
Start display at page:

Download "CS 684 Fall 2005 Image-based Modeling and Rendering. Ruigang Yang"

Transcription

1 CS 684 Fall 2005 Image-based Modeling and Rendering Ruigang Yang

2 Administrivia Classes: Monday and Wednesday, 4:00-5:15 PM Instructor: Ruigang Yang Office Hour: Robotics 514D, MW Prerequisite: Graduate standing, CS 635 (or equivalent) Recommended Reference Book: Computer Vision: a modern approach by Forsyth & Ponce OpenGL Programming Guide the red book Webpage: (slides and more) Fall 2005 CS684-IBMR 2

3 Goals and Objectives To introduce a new interdisciplinary research topic that is both technically challenging and empirically important. To introduce the fundamental problems and main concepts and techniques to solve those. To enable participants to implement solutions for reasonably complex problems To enable participants to do research in IBMR Fall 2005 CS684-IBMR 3

4 Some Results from Last Year David Guinnip and Shuhua Lai (SIGGRAPH 2004 Poster, Pacific Graphics 2005) Shunnan Chen, Jesus Caban, Xinyu Huang, George V. Landon (Virtual Reality 2005, SIGGRAPH 2005 Poster) Mingxuan Sun et al. (ICCV 2005) Fall 2005 CS684-IBMR 4

5 Course Organization Lectures (~1.5 months) Research Reading and Presentation Research Investigation Fall 2005 CS684-IBMR 5

6 Grading Class participation 15% Presentation 25% Project Proposal 10% Final Project 50% No final exam Fall 2005 CS684-IBMR 6

7 The Evolution of Computer Graphics Sketchpad, 1963 Ivan Sutherland Fall 2005 CS684-IBMR 7

8 The Evolution of Computer Graphics Fall 2005 CS684-IBMR 8

9 Traditional Rendering 3D model Rendering New New image New image 2D image image Real-time Rendering on GeForce FX, NVIDIA 2003 Photo Realism Fall 2005 CS684-IBMR 9

10 Image-Based Modeling and Rendering 3D model Rendering New New image New image 2D image image Image Image Image Image Image Fall 2005 CS684-IBMR 10

11 Computer Vision A discipline related to Artificial Intelligence Let computer see Obtaining 3D models A Branch of CV that focuses on reconstruction of 3D model from 2D images Fall 2005 CS684-IBMR 11

12 Computer Graphics What is the goal of computer graphics again Given a 3D model, we ll make a 2D image Fall 2005 CS684-IBMR 12

13 Bridge the Gap between Computer Graphics & Computer Vision Fall 2005 CS684-IBMR 13

14 Image-Based Modeling and Rendering (IBMR): Advantages Photographs are easy to obtain Photographs are already photo-realistic Allow cheating to circumvent the need for a 3D model, which is hard to obtain. More predictable performance Fall 2005 CS684-IBMR 14

15 IBMR: A Historical Perspective Theoretical Foundations Jim Kajiya (Caltech) The Rendering Equation 1986 Edward Adelson, James Bergen The Plenoptic Function and the Elements of Early Vision, 1991 Fall 2005 CS684-IBMR 15

16 IBMR: A Historical Perspective Texture- and Environment Mapping (Blinn 78) With and without texture-mapping Environment Mapping Fall 2005 CS684-IBMR 16

17 IBMR: A Historical Perspective Image Warping and Morphing (Wolberg 90) Fall 2005 CS684-IBMR 17

18 IBMR: A Historical Perspective Image Mosaics (Chen 95) combination Higher resolution or lager image Fall 2005 CS684-IBMR 18

19 Fall 2005 CS684-IBMR 19 IBMR: A Historical Perspective Formalization by McMillan and Bishop (1995) ),,,, ( z y x V V V P p φ θ = ),,,, ( z y x V V V P p φ θ = Viewer s position Rotation and elevation of light ray

20 Image Mosaics Different Images combination Higher resolution or lager image Fall 2005 CS684-IBMR 20

21 Mosaic Image Representation Planar Image Cube Cylinder Sphere Fall 2005 CS684-IBMR 21

22 Quick-time VR approach Uses a cylinder mapping of the mosaic Virtual camera is at a fixed center-of-projection You can move around the mosaic by rotation and tilting up/down the virtual camera Fall 2005 CS684-IBMR 22

23 Image-Based Modeling Rendering Mosaics are large images with a single center of projection How about imagery from arbitrary views? Solution One: Create a 3D model! 3D model Rendering New New image New image 2D image image Image Image Image Image Image Fall 2005 CS684-IBMR 23

24 3D Shape Recovery Stereo Depth Map Correlation profile u 1 u 1 Left Camera Right Camera Pioneered by Marr and Poggio, 1976 Fall 2005 CS684-IBMR 24

25 Advantages of Stereo Well-studied, many algorithms Passive, requiring only two images Can be done in real-time Depth Map Yang & Pollefeys CVPR 2003 Fall 2005 CS684-IBMR 25

26 State of the art Show video (from Marc Pollefeys, 2000) Fall 2005 CS684-IBMR 26

27 Image-Based Modeling Rendering Stereo is not robust Any alternative for imagery from arbitrary views? Solution Two: Pre-record them all 3D model Rendering New New image New image 2D image image Image Image Image Image Image Fall 2005 CS684-IBMR 27

28 Image-based Modeling and Rendering (IBMR) McMillan & Bishop 1995 New Viewpoint Fall 2005 CS684-IBMR 28

29 Light Field Rendering Any surface, any scene Photo realism Hundreds or thousands of images Levoy & Hanrahan 1996 Fall 2005 CS684-IBMR 29

30 A Continuum of IBMR methods Geometry-based Image-based Image Image Image Image Image Shape Recovery 3D model Computer Graphics New 2D image New 2D image New 2D image Image Image Image Image Image Additional constraints New 2D image New 2D image New 2D image Stereo Space Carving Façade Lumigraph Light Field More geometric primitives More image samples Fall 2005 CS684-IBMR 30

31 FAÇADE: Fall 2005 CS684-IBMR 31

32 FAÇADE: Video Fall 2005 CS684-IBMR 32

33 View Morphing Mona Lisa Stereo Pair (cross your eyes and fuse them!) Steve Seitz, Chuck Dyer 1996 Show Video Fall 2005 CS684-IBMR 33

34 Other Issues in IBMR: Lighting Ravi Ramamoorthi, 2002 Yizhou Yu, 1998 Fall 2005 CS684-IBMR 34

35 Other Issues in IBMR : Properties of Surfaces ω i ωr i Diffuse Reflection ω Mirror Reflection ωr ω i i Specular Reflection D. McAllister, 2003 ωr ω ωr Retroreflection Fall 2005 CS684-IBMR 35

36 Other Issues in IBMR : Properties of Surfaces Measurement Fall 2005 CS684-IBMR 36

37 Course Lecture Outline Introduction to 3D Reconstruction Camera basics Passive algorithms Stereo, Space Carving, Shape from X Active techniques Image-based Rendering Image Warping Plenoptic function Lighting Surface Reflectance Properties Capturing and Synthesizing Reality (smoke, water,etc) Fall 2005 CS684-IBMR 37

Real Time Rendering. CS 563 Advanced Topics in Computer Graphics. Songxiang Gu Jan, 31, 2005

Real Time Rendering. CS 563 Advanced Topics in Computer Graphics. Songxiang Gu Jan, 31, 2005 Real Time Rendering CS 563 Advanced Topics in Computer Graphics Songxiang Gu Jan, 31, 2005 Introduction Polygon based rendering Phong modeling Texture mapping Opengl, Directx Point based rendering VTK

More information

Image-Based Rendering and Light Fields

Image-Based Rendering and Light Fields CS194-13: Advanced Computer Graphics Lecture #9 Image-Based Rendering University of California Berkeley Image-Based Rendering and Light Fields Lecture #9: Wednesday, September 30th 2009 Lecturer: Ravi

More information

Stereo pairs from linear morphing

Stereo pairs from linear morphing Proc. of SPIE Vol. 3295, Stereoscopic Displays and Virtual Reality Systems V, ed. M T Bolas, S S Fisher, J O Merritt (Apr 1998) Copyright SPIE Stereo pairs from linear morphing David F. McAllister Multimedia

More information

A Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India

A Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India A Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India Keshav Mahavidyalaya, University of Delhi, Delhi, India Abstract

More information

Computer Vision. I-Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University

Computer Vision. I-Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University Computer Vision I-Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung University About the course Course title: Computer Vision Lectures: EC016, 10:10~12:00(Tues.); 15:30~16:20(Thurs.) Pre-requisites:

More information

Computer Vision Lecture 17

Computer Vision Lecture 17 Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics 13.01.2015 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar in the summer semester

More information

Computer Vision Lecture 17

Computer Vision Lecture 17 Announcements Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics Seminar in the summer semester Current Topics in Computer Vision and Machine Learning Block seminar, presentations in 1 st week

More information

Overview. Computer Graphics CSE 167

Overview. Computer Graphics CSE 167 Overview Computer Graphics CSE 167 CSE 167: Computer Graphics Today Course overview Logistics CSE 167, Winter 2018 2 What is computer graphics? Everything visual on computers The representation and manipulation

More information

Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images

Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images Abstract This paper presents a new method to generate and present arbitrarily

More information

Image-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about

Image-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about Image-Based Modeling and Rendering Image-Based Modeling and Rendering MIT EECS 6.837 Frédo Durand and Seth Teller 1 Some slides courtesy of Leonard McMillan, Wojciech Matusik, Byong Mok Oh, Max Chen 2

More information

History of computer graphics

History of computer graphics Ivan Sutherland (1963) - SKETCHPAD History of computer graphics CS 248 - Introduction to Computer Graphics Autumn quarter, 2006 Slides for September 26 lecture pop-up menus constraint-based drawing hierarchical

More information

Multiple View Geometry

Multiple View Geometry Multiple View Geometry Martin Quinn with a lot of slides stolen from Steve Seitz and Jianbo Shi 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 Our Goal The Plenoptic Function P(θ,φ,λ,t,V

More information

CSc Topics in Computer Graphics 3D Photography

CSc Topics in Computer Graphics 3D Photography CSc 83010 Topics in Computer Graphics 3D Photography Tuesdays 11:45-1:45 1:45 Room 3305 Ioannis Stamos istamos@hunter.cuny.edu Office: 1090F, Hunter North (Entrance at 69 th bw/ / Park and Lexington Avenues)

More information

Goals. Computer Graphics (Fall 2008) Course Outline. Course Outline. Course Outline. Demo: Surreal and Crazy World (HW 3)

Goals. Computer Graphics (Fall 2008) Course Outline. Course Outline. Course Outline. Demo: Surreal and Crazy World (HW 3) Computer Graphics (Fall 2008) COMS 4160, Lecture 1: Overview and History Ravi Ramamoorthi http://www.cs.columbia.edu/~cs4160 Goals Systems: Be able to write complex 3D graphics programs (real-time in OpenGL,

More information

Volumetric Scene Reconstruction from Multiple Views

Volumetric Scene Reconstruction from Multiple Views Volumetric Scene Reconstruction from Multiple Views Chuck Dyer University of Wisconsin dyer@cs cs.wisc.edu www.cs cs.wisc.edu/~dyer Image-Based Scene Reconstruction Goal Automatic construction of photo-realistic

More information

Morphable 3D-Mosaics: a Hybrid Framework for Photorealistic Walkthroughs of Large Natural Environments

Morphable 3D-Mosaics: a Hybrid Framework for Photorealistic Walkthroughs of Large Natural Environments Morphable 3D-Mosaics: a Hybrid Framework for Photorealistic Walkthroughs of Large Natural Environments Nikos Komodakis and Georgios Tziritas Computer Science Department, University of Crete E-mails: {komod,

More information

Image-Based Rendering. Johns Hopkins Department of Computer Science Course : Rendering Techniques, Professor: Jonathan Cohen

Image-Based Rendering. Johns Hopkins Department of Computer Science Course : Rendering Techniques, Professor: Jonathan Cohen Image-Based Rendering Image-Based Rendering What is it? Still a difficult question to answer Uses images (photometric( info) as key component of model representation What s Good about IBR Model acquisition

More information

Image Base Rendering: An Introduction

Image Base Rendering: An Introduction Image Base Rendering: An Introduction Cliff Lindsay CS563 Spring 03, WPI 1. Introduction Up to this point, we have focused on showing 3D objects in the form of polygons. This is not the only approach to

More information

Hybrid Rendering for Collaborative, Immersive Virtual Environments

Hybrid Rendering for Collaborative, Immersive Virtual Environments Hybrid Rendering for Collaborative, Immersive Virtual Environments Stephan Würmlin wuermlin@inf.ethz.ch Outline! Rendering techniques GBR, IBR and HR! From images to models! Novel view generation! Putting

More information

More and More on Light Fields. Last Lecture

More and More on Light Fields. Last Lecture More and More on Light Fields Topics in Image-Based Modeling and Rendering CSE291 J00 Lecture 4 Last Lecture Re-review with emphasis on radiometry Mosaics & Quicktime VR The Plenoptic function The main

More information

Choosing the right course

Choosing the right course Choosing the right course CS 148 Winter, Hanrahan, not SCPD undergraduates only requires 107 terminal course broad and conceptual CS 248 lite + 2D image processing media technologies video technologies

More information

Image-based rendering using plane-sweeping modelisation

Image-based rendering using plane-sweeping modelisation Author manuscript, published in "IAPR Machine Vision and Applications MVA2005, Japan (2005)" Image-based rendering using plane-sweeping modelisation Vincent Nozick, Sylvain Michelin and Didier Arquès Marne

More information

Modeling Light. On Simulating the Visual Experience

Modeling Light. On Simulating the Visual Experience Modeling Light 15-463: Rendering and Image Processing Alexei Efros On Simulating the Visual Experience Just feed the eyes the right data No one will know the difference! Philosophy: Ancient question: Does

More information

Mosaics, Plenoptic Function, and Light Field Rendering. Last Lecture

Mosaics, Plenoptic Function, and Light Field Rendering. Last Lecture Mosaics, Plenoptic Function, and Light Field Rendering Topics in Image-ased Modeling and Rendering CSE291 J00 Lecture 3 Last Lecture Camera Models Pinhole perspective Affine/Orthographic models Homogeneous

More information

Goals. Advanced Computer Graphics. Course Outline. Course Outline. Course Outline. Course Outline

Goals. Advanced Computer Graphics. Course Outline. Course Outline. Course Outline. Course Outline Advanced Computer Graphics CSE 163 [Spring 2017], Lecture 1 Ravi Ramamoorthi http://www.cs.ucsd.edu/~ravir Goals Systems: Write fairly complex programs for image processing, mesh algorithms, image synthesis

More information

Image-Based Rendering

Image-Based Rendering Image-Based Rendering COS 526, Fall 2016 Thomas Funkhouser Acknowledgments: Dan Aliaga, Marc Levoy, Szymon Rusinkiewicz What is Image-Based Rendering? Definition 1: the use of photographic imagery to overcome

More information

Goals. Course Staff. Demo: Surreal (HW 3) Entertainment. Foundations of Computer Graphics (Spring 2012) Why Study 3D Computer Graphics?

Goals. Course Staff. Demo: Surreal (HW 3) Entertainment. Foundations of Computer Graphics (Spring 2012) Why Study 3D Computer Graphics? Foundations of Computer Graphics (Spring 2012) CS 184, Lecture 1: Overview and History Ravi Ramamoorthi http://inst.eecs.berkeley.edu/~cs184 Goals Systems: Write complex 3D graphics programs (real-time

More information

Image-based modeling (IBM) and image-based rendering (IBR)

Image-based modeling (IBM) and image-based rendering (IBR) Image-based modeling (IBM) and image-based rendering (IBR) CS 248 - Introduction to Computer Graphics Autumn quarter, 2005 Slides for December 8 lecture The graphics pipeline modeling animation rendering

More information

Recap from Previous Lecture

Recap from Previous Lecture Recap from Previous Lecture Tone Mapping Preserve local contrast or detail at the expense of large scale contrast. Changing the brightness within objects or surfaces unequally leads to halos. We are now

More information

Image Based Rendering

Image Based Rendering Image Based Rendering an overview Photographs We have tools that acquire and tools that display photographs at a convincing quality level 2 1 3 4 2 5 6 3 7 8 4 9 10 5 Photographs We have tools that acquire

More information

Multi-view stereo. Many slides adapted from S. Seitz

Multi-view stereo. Many slides adapted from S. Seitz Multi-view stereo Many slides adapted from S. Seitz Beyond two-view stereo The third eye can be used for verification Multiple-baseline stereo Pick a reference image, and slide the corresponding window

More information

Overview. Computer Graphics CS324. OpenGL. Books. Learning Resources. CS131 Notes. 30 Lectures 3hr Exam

Overview. Computer Graphics CS324. OpenGL. Books. Learning Resources. CS131 Notes. 30 Lectures 3hr Exam Computer Graphics CS324 Dr Abhir Bhalerao Department of Computer Science University of Warwick Coventry CV4 7AL TJA 1999-2003, AHB 2004+ 30 Lectures 3hr Exam Overview Recommended books: Hearn and Baker,

More information

Image-Based Modeling and Rendering

Image-Based Modeling and Rendering Image-Based Modeling and Rendering Richard Szeliski Microsoft Research IPAM Graduate Summer School: Computer Vision July 26, 2013 How far have we come? Light Fields / Lumigraph - 1996 Richard Szeliski

More information

CS559: Computer Graphics. Lecture 1 Introduction Li Zhang University of Wisconsin, Madison

CS559: Computer Graphics. Lecture 1 Introduction Li Zhang University of Wisconsin, Madison CS559: Computer Graphics Lecture 1 Introduction Li Zhang University of Wisconsin, Madison Today Introduction to Computer Graphics Course Overview What is Computer Graphics Using computers to generate and

More information

But, vision technology falls short. and so does graphics. Image Based Rendering. Ray. Constant radiance. time is fixed. 3D position 2D direction

But, vision technology falls short. and so does graphics. Image Based Rendering. Ray. Constant radiance. time is fixed. 3D position 2D direction Computer Graphics -based rendering Output Michael F. Cohen Microsoft Research Synthetic Camera Model Computer Vision Combined Output Output Model Real Scene Synthetic Camera Model Real Cameras Real Scene

More information

Computational Photography

Computational Photography End of Semester is the last lecture of new material Quiz on Friday 4/30 Sample problems are posted on website Computational Photography Final Project Presentations Wednesday May 12 1-5pm, CII 4040 Attendance

More information

Image-Based Rendering using Image-Warping Motivation and Background

Image-Based Rendering using Image-Warping Motivation and Background Image-Based Rendering using Image-Warping Motivation and Background Leonard McMillan LCS Computer Graphics Group MIT The field of three-dimensional computer graphics has long focused on the problem of

More information

CS535: Interactive Computer Graphics

CS535: Interactive Computer Graphics CS535: Interactive Computer Graphics Instructor: Daniel G. Aliaga (aliaga@cs.purdue.edu, www.cs.purdue.edu/homes/aliaga) Classroom: LWSN B134 Time: MWF @ 1:30-2:20pm Office hours: by appointment (LWSN

More information

EE795: Computer Vision and Intelligent Systems

EE795: Computer Vision and Intelligent Systems EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 12 130228 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Panoramas, Mosaics, Stitching Two View Geometry

More information

Multi-View Geometry (Ch7 New book. Ch 10/11 old book)

Multi-View Geometry (Ch7 New book. Ch 10/11 old book) Multi-View Geometry (Ch7 New book. Ch 10/11 old book) Guido Gerig CS-GY 6643, Spring 2016 gerig@nyu.edu Credits: M. Shah, UCF CAP5415, lecture 23 http://www.cs.ucf.edu/courses/cap6411/cap5415/, Trevor

More information

Image-Based Rendering. Image-Based Rendering

Image-Based Rendering. Image-Based Rendering Image-Based Rendering Image-Based Rendering What is it? Still a difficult question to answer Uses images (photometric info) as key component of model representation 1 What s Good about IBR Model acquisition

More information

Plenoptic Image Editing

Plenoptic Image Editing Plenoptic Image Editing Steven M. Seitz Computer Sciences Department University of Wisconsin Madison Madison, WI53706 seitz@cs.wisc.edu Kiriakos N. Kutulakos Department of Computer Science University of

More information

Image-Based Modeling and Rendering

Image-Based Modeling and Rendering Traditional Computer Graphics Image-Based Modeling and Rendering Thomas Funkhouser Princeton University COS 426 Guest Lecture Spring 2003 How would you model and render this scene? (Jensen) How about this

More information

Topics and things to know about them:

Topics and things to know about them: Practice Final CMSC 427 Distributed Tuesday, December 11, 2007 Review Session, Monday, December 17, 5:00pm, 4424 AV Williams Final: 10:30 AM Wednesday, December 19, 2007 General Guidelines: The final will

More information

Instructor. Goals. Image Synthesis Examples. Applications. Foundations of Computer Graphics. Why Study 3D Computer Graphics?

Instructor. Goals. Image Synthesis Examples. Applications. Foundations of Computer Graphics. Why Study 3D Computer Graphics? Foundations of Computer Graphics Motivation: Why do we study 3D Graphics? http://www.cs.berkeley.edu/~ravir Instructor http://www.cs.berkeley.edu/~ravir PhD Stanford, 2002. PhD thesis developed Spherical

More information

Assignment #2. (Due date: 11/6/2012)

Assignment #2. (Due date: 11/6/2012) Computer Vision I CSE 252a, Fall 2012 David Kriegman Assignment #2 (Due date: 11/6/2012) Name: Student ID: Email: Problem 1 [1 pts] Calculate the number of steradians contained in a spherical wedge with

More information

Projective Texture Mapping with Full Panorama

Projective Texture Mapping with Full Panorama EUROGRAPHICS 2002 / G. Drettakis and H.-P. Seidel Volume 21 (2002), Number 3 (Guest Editors) Projective Texture Mapping with Full Panorama Dongho Kim and James K. Hahn Department of Computer Science, The

More information

Announcement. Lighting and Photometric Stereo. Computer Vision I. Surface Reflectance Models. Lambertian (Diffuse) Surface.

Announcement. Lighting and Photometric Stereo. Computer Vision I. Surface Reflectance Models. Lambertian (Diffuse) Surface. Lighting and Photometric Stereo CSE252A Lecture 7 Announcement Read Chapter 2 of Forsyth & Ponce Might find section 12.1.3 of Forsyth & Ponce useful. HW Problem Emitted radiance in direction f r for incident

More information

Image-Based Rendering. Johns Hopkins Department of Computer Science Course : Rendering Techniques, Professor: Jonathan Cohen

Image-Based Rendering. Johns Hopkins Department of Computer Science Course : Rendering Techniques, Professor: Jonathan Cohen Image-Based Rendering Image-Based Rendering What is it? Still a difficult question to answer Uses images (photometric( info) as key component of model representation What s Good about IBR Model acquisition

More information

Lecturer Athanasios Nikolaidis

Lecturer Athanasios Nikolaidis Lecturer Athanasios Nikolaidis Computer Graphics: Graphics primitives 2D viewing and clipping 2D and 3D transformations Curves and surfaces Rendering and ray tracing Illumination models Shading models

More information

Designing a Self-Calibrating Pipeline for Projection Mapping Application. Kevin Wright Kevin Moule

Designing a Self-Calibrating Pipeline for Projection Mapping Application. Kevin Wright Kevin Moule Designing a Self-Calibrating Pipeline for Projection Mapping Application Kevin Wright Kevin Moule 2 Who we are Kevin Wright Director of the Application Software group at Christie responsible for developing

More information

PAPER Three-Dimensional Scene Walkthrough System Using Multiple Acentric Panorama View (APV) Technique

PAPER Three-Dimensional Scene Walkthrough System Using Multiple Acentric Panorama View (APV) Technique IEICE TRANS. INF. & SYST., VOL.E86 D, NO.1 JANUARY 2003 117 PAPER Three-Dimensional Scene Walkthrough System Using Multiple Acentric Panorama View (APV) Technique Ping-Hsien LIN and Tong-Yee LEE, Nonmembers

More information

Image Transfer Methods. Satya Prakash Mallick Jan 28 th, 2003

Image Transfer Methods. Satya Prakash Mallick Jan 28 th, 2003 Image Transfer Methods Satya Prakash Mallick Jan 28 th, 2003 Objective Given two or more images of the same scene, the objective is to synthesize a novel view of the scene from a view point where there

More information

CS 431/636 Advanced Rendering Techniques

CS 431/636 Advanced Rendering Techniques CS 431/636 Advanced Rendering Techniques Dr. David Breen Matheson 308 Thursday 6PM 8:50PM Presentation 7 5/23/06 Questions from Last Time? Hall Shading Model Shadows Reflections Refractions Slide Credits

More information

Scene Modeling for a Single View

Scene Modeling for a Single View Scene Modeling for a Single View René MAGRITTE Portrait d'edward James with a lot of slides stolen from Steve Seitz and David Brogan, 15-463: Computational Photography Alexei Efros, CMU, Fall 2005 Classes

More information

VIDEO FOR VIRTUAL REALITY LIGHT FIELD BASICS JAMES TOMPKIN

VIDEO FOR VIRTUAL REALITY LIGHT FIELD BASICS JAMES TOMPKIN VIDEO FOR VIRTUAL REALITY LIGHT FIELD BASICS JAMES TOMPKIN WHAT IS A LIGHT FIELD? Light field seems to have turned into a catch-all term for many advanced camera/display technologies. WHAT IS A LIGHT FIELD?

More information

Shadow and Environment Maps

Shadow and Environment Maps CS294-13: Special Topics Lecture #8 Advanced Computer Graphics University of California, Berkeley Monday, 28 September 2009 Shadow and Environment Maps Lecture #8: Monday, 28 September 2009 Lecturer: Ravi

More information

3-D Shape Reconstruction from Light Fields Using Voxel Back-Projection

3-D Shape Reconstruction from Light Fields Using Voxel Back-Projection 3-D Shape Reconstruction from Light Fields Using Voxel Back-Projection Peter Eisert, Eckehard Steinbach, and Bernd Girod Telecommunications Laboratory, University of Erlangen-Nuremberg Cauerstrasse 7,

More information

Computer Graphics Disciplines. Grading. Textbooks. Course Overview. Assignment Policies. Computer Graphics Goals I

Computer Graphics Disciplines. Grading. Textbooks. Course Overview. Assignment Policies. Computer Graphics Goals I CSCI 480 Computer Graphics Lecture 1 Course Overview January 10, 2011 Jernej Barbic University of Southern California Administrative Issues Modeling Animation Rendering OpenGL Programming Course Information

More information

The 7d plenoptic function, indexing all light.

The 7d plenoptic function, indexing all light. Previous Lecture The 7d plenoptic function, indexing all light. Lightfields: a 4d (not 5d!) data structure which captures all outgoing light from a region and permits reconstruction of arbitrary synthetic

More information

Modeling Light. Michal Havlik

Modeling Light. Michal Havlik Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 What is light? Electromagnetic radiation (EMR) moving along rays in space R(λ) is EMR, measured in units of power

More information

Hardware-Assisted Relief Texture Mapping

Hardware-Assisted Relief Texture Mapping EUROGRAPHICS 0x / N.N. and N.N. Short Presentations Hardware-Assisted Relief Texture Mapping Masahiro Fujita and Takashi Kanai Keio University Shonan-Fujisawa Campus, Fujisawa, Kanagawa, Japan Abstract

More information

Modeling Light. Slides from Alexei A. Efros and others

Modeling Light. Slides from Alexei A. Efros and others Project 3 Results http://www.cs.brown.edu/courses/cs129/results/proj3/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj3/damoreno/ http://www.cs.brown.edu/courses/cs129/results/proj3/taox/ Stereo

More information

3D Computer Vision Introduction. Guido Gerig CS 6320, Spring 2012

3D Computer Vision Introduction. Guido Gerig CS 6320, Spring 2012 3D Computer Vision Introduction Guido Gerig CS 6320, Spring 2012 gerig@sci.utah.edu Administrivia Classes: M & W, 1.25-2:45 Room WEB L126 Instructor: Guido Gerig gerig@sci.utah.edu (801) 585 0327 Prerequisites:

More information

Evolution of Imaging Technology in Computer Graphics. Related Areas

Evolution of Imaging Technology in Computer Graphics. Related Areas Evolution of Imaging Technology in Computer Graphics Jonas Gomes Rio de Janeiro http://www.visgraf.impa.br Image computation Related Areas 1 Related Areas An integrated view Problems on the frontiers Graphical

More information

Volumetric Warping for Voxel Coloring on an Infinite Domain Gregory G. Slabaugh Λ Thomas Malzbender, W. Bruce Culbertson y School of Electrical and Co

Volumetric Warping for Voxel Coloring on an Infinite Domain Gregory G. Slabaugh Λ Thomas Malzbender, W. Bruce Culbertson y School of Electrical and Co Volumetric Warping for Voxel Coloring on an Infinite Domain Gregory G. Slabaugh Λ Thomas Malzbender, W. Bruce Culbertson y School of Electrical and Comp. Engineering Client and Media Systems Lab Georgia

More information

Image-Based Rendering and Modeling. IBR Approaches for View Synthesis

Image-Based Rendering and Modeling. IBR Approaches for View Synthesis Image-Based Rendering and Modeling l Image-based rendering (IBR): A scene is represented as a collection of images l 3D model-based rendering (MBR): A scene is represented by a 3D model plus texture maps

More information

Outline of Lecture. Real-Time High Quality Rendering. Geometry or Vertex Pipeline. Basic Hardware Pipeline. Pixel or Fragment Pipeline

Outline of Lecture. Real-Time High Quality Rendering. Geometry or Vertex Pipeline. Basic Hardware Pipeline. Pixel or Fragment Pipeline Real-Time High Quality Rendering CSE 274 [Fall 2015], Lecture 2 Graphics Hardware Pipeline, Reflection and Rendering Equations, Taonomy of Methods http://www.cs.ucsd.edu/~ravir Outline of Lecture Taonomy

More information

CS354 Computer Graphics Introduction. Qixing Huang Januray 17 8h 2017

CS354 Computer Graphics Introduction. Qixing Huang Januray 17 8h 2017 CS354 Computer Graphics Introduction Qixing Huang Januray 17 8h 2017 CS 354 Computer Graphics Instructor: Qixing Huang huangqx@cs.utexas.edu Office: GDC 5.422 Office hours: Friday 3:00 pm 5:00 pm Teaching

More information

Motivation. Sampling and Reconstruction of Visual Appearance. Effects needed for Realism. Ray Tracing. Outline

Motivation. Sampling and Reconstruction of Visual Appearance. Effects needed for Realism. Ray Tracing. Outline Sampling and Reconstruction of Visual Appearance CSE 274 [Fall 2018], Special Lecture Ray Tracing Ravi Ramamoorthi http://www.cs.ucsd.edu/~ravir Motivation Ray Tracing is a core aspect of both offline

More information

Scene Modeling for a Single View

Scene Modeling for a Single View Scene Modeling for a Single View René MAGRITTE Portrait d'edward James CS194: Image Manipulation & Computational Photography with a lot of slides stolen from Alexei Efros, UC Berkeley, Fall 2014 Steve

More information

Department of Computer Engineering, Middle East Technical University, Ankara, Turkey, TR-06531

Department of Computer Engineering, Middle East Technical University, Ankara, Turkey, TR-06531 INEXPENSIVE AND ROBUST 3D MODEL ACQUISITION SYSTEM FOR THREE-DIMENSIONAL MODELING OF SMALL ARTIFACTS Ulaş Yılmaz, Oğuz Özün, Burçak Otlu, Adem Mulayim, Volkan Atalay {ulas, oguz, burcak, adem, volkan}@ceng.metu.edu.tr

More information

COMPUTER GRAPHICS CS

COMPUTER GRAPHICS CS COMPUTER GRAPHICS CS-234325 http://webcourse.cs.technion.ac.il/234325/ Lecture Syllabus Introduction (1 week) Transformations (2 weeks) Line Drawing (1 weeks) Polygon Fill (1 week) Hidden Surface Removal

More information

CIS 581 Interactive Computer Graphics

CIS 581 Interactive Computer Graphics CIS 581 Interactive Computer Graphics Instructor: Han-Wei Shen (hwshen@cse.ohio-state.edu) Credit: 4 Class: MWF 2:30 pm 3:18 pm DL 264 Office hours: TuTr 11 am - 12pm DL 789 Web: http://www.cse.ohio-state.edu/~hwshen/581

More information

Structure from Motion and Multi- view Geometry. Last lecture

Structure from Motion and Multi- view Geometry. Last lecture Structure from Motion and Multi- view Geometry Topics in Image-Based Modeling and Rendering CSE291 J00 Lecture 5 Last lecture S. J. Gortler, R. Grzeszczuk, R. Szeliski,M. F. Cohen The Lumigraph, SIGGRAPH,

More information

Assignment 2: Stereo and 3D Reconstruction from Disparity

Assignment 2: Stereo and 3D Reconstruction from Disparity CS 6320, 3D Computer Vision Spring 2013, Prof. Guido Gerig Assignment 2: Stereo and 3D Reconstruction from Disparity Out: Mon Feb-11-2013 Due: Mon Feb-25-2013, midnight (theoretical and practical parts,

More information

A million pixels, a million polygons. Which is heavier? François X. Sillion. imagis* Grenoble, France

A million pixels, a million polygons. Which is heavier? François X. Sillion. imagis* Grenoble, France A million pixels, a million polygons. Which is heavier? François X. Sillion imagis* Grenoble, France *A joint research project of CNRS, INRIA, INPG and UJF MAGIS Why this question? Evolution of processing

More information

Applications of Image-Based Modeling and Rendering in Art and Cinema

Applications of Image-Based Modeling and Rendering in Art and Cinema Applications of Image-Based Modeling and Rendering in Art and Cinema Paul Debevec Overview Image-based techniques are used in many ways; for each we can ask: What is the model? How are images used? What

More information

And if that 120MP Camera was cool

And if that 120MP Camera was cool Reflectance, Lights and on to photometric stereo CSE 252A Lecture 7 And if that 120MP Camera was cool Large Synoptic Survey Telescope 3.2Gigapixel camera 189 CCD s, each with 16 megapixels Pixels are 10µm

More information

Image stitching. Digital Visual Effects Yung-Yu Chuang. with slides by Richard Szeliski, Steve Seitz, Matthew Brown and Vaclav Hlavac

Image stitching. Digital Visual Effects Yung-Yu Chuang. with slides by Richard Szeliski, Steve Seitz, Matthew Brown and Vaclav Hlavac Image stitching Digital Visual Effects Yung-Yu Chuang with slides by Richard Szeliski, Steve Seitz, Matthew Brown and Vaclav Hlavac Image stitching Stitching = alignment + blending geometrical registration

More information

Modeling Light. Michal Havlik : Computational Photography Alexei Efros, CMU, Fall 2007

Modeling Light. Michal Havlik : Computational Photography Alexei Efros, CMU, Fall 2007 Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 The Plenoptic Function Figure by Leonard McMillan Q: What is the set of all things that we can ever see? A: The

More information

CIS 581 Interactive Computer Graphics (slides based on Dr. Han-Wei Shen s slides) Requirements. Reference Books. Textbook

CIS 581 Interactive Computer Graphics (slides based on Dr. Han-Wei Shen s slides) Requirements. Reference Books. Textbook CIS 581 Interactive Computer Graphics (slides based on Dr. Han-Wei Shen s slides) Instructor: Rick Parent (parent@cse.osu.edu) Credit: 4 Class: MWF 10:30 11:18 pm DL357 Office hours: MW 11:30 12:18 DL

More information

Chapter 7. Conclusions and Future Work

Chapter 7. Conclusions and Future Work Chapter 7 Conclusions and Future Work In this dissertation, we have presented a new way of analyzing a basic building block in computer graphics rendering algorithms the computational interaction between

More information

IMAGE-BASED RENDERING TECHNIQUES FOR APPLICATION IN VIRTUAL ENVIRONMENTS

IMAGE-BASED RENDERING TECHNIQUES FOR APPLICATION IN VIRTUAL ENVIRONMENTS IMAGE-BASED RENDERING TECHNIQUES FOR APPLICATION IN VIRTUAL ENVIRONMENTS Xiaoyong Sun A Thesis submitted to the Faculty of Graduate and Postdoctoral Studies in partial fulfillment of the requirements for

More information

Computer Science 175. Introduction to Computer Graphics lib175 time: m/w 2:30-4:00 pm place:md g125 section times: tba

Computer Science 175. Introduction to Computer Graphics  lib175 time: m/w 2:30-4:00 pm place:md g125 section times: tba Computer Science 175 Introduction to Computer Graphics www.fas.harvard.edu/ lib175 time: m/w 2:30-4:00 pm place:md g125 section times: tba Instructor: Steven shlomo Gortler www.cs.harvard.edu/ sjg sjg@cs.harvard.edu

More information

Capturing and View-Dependent Rendering of Billboard Models

Capturing and View-Dependent Rendering of Billboard Models Capturing and View-Dependent Rendering of Billboard Models Oliver Le, Anusheel Bhushan, Pablo Diaz-Gutierrez and M. Gopi Computer Graphics Lab University of California, Irvine Abstract. In this paper,

More information

0. Introduction: What is Computer Graphics? 1. Basics of scan conversion (line drawing) 2. Representing 2D curves

0. Introduction: What is Computer Graphics? 1. Basics of scan conversion (line drawing) 2. Representing 2D curves CSC 418/2504: Computer Graphics Course web site (includes course information sheet): http://www.dgp.toronto.edu/~elf Instructor: Eugene Fiume Office: BA 5266 Phone: 416 978 5472 (not a reliable way) Email:

More information

o Basic signal processing o Filtering, resampling, warping,... Rendering o Polygon rendering pipeline o Ray tracing Modeling

o Basic signal processing o Filtering, resampling, warping,... Rendering o Polygon rendering pipeline o Ray tracing Modeling Background COS526: Advanced Computer Graphics Tom Funkhouser Fall 2010 Image Processing o Basic signal processing o Filtering, resampling, warping,... Rendering o Polygon rendering pipeline o Ray tracing

More information

Image Based Rendering. D.A. Forsyth, with slides from John Hart

Image Based Rendering. D.A. Forsyth, with slides from John Hart Image Based Rendering D.A. Forsyth, with slides from John Hart Topics Mosaics translating cameras reveal extra information, break occlusion Optical flow for very small movements of the camera Explicit

More information

Radiance. Radiance properties. Radiance properties. Computer Graphics (Fall 2008)

Radiance. Radiance properties. Radiance properties. Computer Graphics (Fall 2008) Computer Graphics (Fall 2008) COMS 4160, Lecture 19: Illumination and Shading 2 http://www.cs.columbia.edu/~cs4160 Radiance Power per unit projected area perpendicular to the ray per unit solid angle in

More information

Announcements. Light. Properties of light. Light. Project status reports on Wednesday. Readings. Today. Readings Szeliski, 2.2, 2.3.

Announcements. Light. Properties of light. Light. Project status reports on Wednesday. Readings. Today. Readings Szeliski, 2.2, 2.3. Announcements Project status reports on Wednesday prepare 5 minute ppt presentation should contain: problem statement (1 slide) description of approach (1 slide) some images (1 slide) current status +

More information

Computer Graphics Lecture 11

Computer Graphics Lecture 11 1 / 14 Computer Graphics Lecture 11 Dr. Marc Eduard Frîncu West University of Timisoara May 15th 2012 2 / 14 Outline 1 Introduction 2 Transparency 3 Reflection 4 Recap 3 / 14 Introduction light = local

More information

Lecture 15: Image-Based Rendering and the Light Field. Kayvon Fatahalian CMU : Graphics and Imaging Architectures (Fall 2011)

Lecture 15: Image-Based Rendering and the Light Field. Kayvon Fatahalian CMU : Graphics and Imaging Architectures (Fall 2011) Lecture 15: Image-Based Rendering and the Light Field Kayvon Fatahalian CMU 15-869: Graphics and Imaging Architectures (Fall 2011) Demo (movie) Royal Palace: Madrid, Spain Image-based rendering (IBR) So

More information

I expect to interact in class with the students, so I expect students to be engaged. (no laptops, smartphones,...) (fig)

I expect to interact in class with the students, so I expect students to be engaged. (no laptops, smartphones,...) (fig) Computer Science 175 Introduction to Computer Graphics www.fas.harvard.edu/ lib175 time: m/w 2:30-4:00 pm place:md g125 section times: tba Instructor: Steven shlomo Gortler www.cs.harvard.edu/ sjg sjg@cs.harvard.edu

More information

Foundations of 3D Graphics Programming

Foundations of 3D Graphics Programming Foundations of 3D Graphics Programming Jim X. Chen Edward J. Wegman Foundations of 3D Graphics Programming Using JOGL and Java3D With 139 Figures Jim X. Chen, PhD Computer Science Department George Mason

More information

Image or Object? Is this real?

Image or Object? Is this real? Image or Object? Michael F. Cohen Microsoft Is this real? Photo by Patrick Jennings (patrick@synaptic.bc.ca), Copyright 1995, 96, 97 Whistler B. C. Canada Modeling, Rendering, and Lighting 1 A mental model?

More information

CSE4030 Introduction to Computer Graphics

CSE4030 Introduction to Computer Graphics CSE4030 Introduction to Computer Graphics Dongguk University Jeong-Mo Hong Timetable 00:00~00:10 Introduction (English) 00:10~00:50 Topic 1 (English) 00:50~00:60 Q&A (English, Korean) 01:00~01:40 Topic

More information

3D Photography: Active Ranging, Structured Light, ICP

3D Photography: Active Ranging, Structured Light, ICP 3D Photography: Active Ranging, Structured Light, ICP Kalin Kolev, Marc Pollefeys Spring 2013 http://cvg.ethz.ch/teaching/2013spring/3dphoto/ Schedule (tentative) Feb 18 Feb 25 Mar 4 Mar 11 Mar 18 Mar

More information

A Warping-based Refinement of Lumigraphs

A Warping-based Refinement of Lumigraphs A Warping-based Refinement of Lumigraphs Wolfgang Heidrich, Hartmut Schirmacher, Hendrik Kück, Hans-Peter Seidel Computer Graphics Group University of Erlangen heidrich,schirmacher,hkkueck,seidel@immd9.informatik.uni-erlangen.de

More information

On the Use of Ray-tracing for Viewpoint Interpolation in Panoramic Imagery

On the Use of Ray-tracing for Viewpoint Interpolation in Panoramic Imagery On the Use of Ray-tracing for Viewpoint Interpolation in Panoramic Imagery Feng Shi, Robert Laganière, Eric Dubois VIVA research lab SITE, University of Ottawa Ottawa, ON, Canada, K1N 6N5 {fshi098,laganier,edubois}@site.uottawa.ca

More information