Illumination Decomposition for Material Editing with Consistent Interreflections
|
|
|
- Arleen Garrett
- 5 years ago
- Views:
Transcription
1 Illumination Decomposition for Material Editing with Consistent Interreflections Robert Carroll Maneesh Agrawala Ravi Ramamoorthi University of California, Berkeley Presented by Wesley Willett Computational Photography & Image Manipulation (UCB CS294-69) 16 Nov 2011
2
3
4
5
6
7
8
9 Editing Material Colors Today
10
11 Intrinsic Images Observed Image Illumination Reflectance [Barrow78, Horn86, Tappen05, Shen08, Weiss01,
12 Intrinsic Images Observed Image Illumination Reflectance [Barrow78, Horn86, Tappen05, Shen08, Weiss01,
13 Intrinsic Images Observed Image Illumination Modified Reflectance
14 Intrinsic Images Observed Image Illumination Modified Reflectance
15 Intrinsic Images Composite Illumination Modified Reflectance
16 Illumination Decomposition Input Illumination Reflectance Input Illumination Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
17 Illumination Decomposition Input Illumination Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
18 Illumination Decomposition Input Illumination Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
19 Illumination Decomposition Input Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
20 Illumination Decomposition Input Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
21 Illumination Decomposition Input Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
22 Illumination Decomposition Input Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
23 Illumination Decomposition Input Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
24 Illumination Decomposition Input Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
25 Illumination Decomposition Composite Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
26 Illumination Decomposition Composite Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
27 Illumination Decomposition Composite Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
28 Illumination Decomposition Composite Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
29 Illumination Decomposition Composite Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
30 Illumination Decomposition Composite Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
31 Illumination Decomposition Composite Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
32 Illumination Decomposition Composite Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
33 Illumination Decomposition Composite Modified Illumination Modified Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
34 Many possible decompositions Plausible Illumination User Guidance
35 Assumptions Illumination colors are locally independent Single bounce of indirect illumination Lambertian reflectance
36 Workflow Stage 1: Setup Stage 2: Illumination Decomposition Stage 3: Compositing
37 Workflow Stage 1: Setup
38 Image Formation Model Input Illumination Reflectance
39 Image Formation Model
40 Image Formation Model Input Illumination Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
41 Image Formation Model Input Illumination Reflectance Direct White Walls Left Wall Right Wall Short Box Tall Box
42 Illumination Model
43 Inverting the Illumination Model Known Unknown Known Underdetermined system 3 equations and n unknowns per pixel
44 Energy Minimization Data Fidelity: Non-Negativity: Smoothness : Sparsity :
45 User Interaction Strokes constrain contribution to zero Set very large in
46 Optimization least-squares one-sided penalty least-absolute-value - Optimize with IRLS (Iteratively Reweighted Least Squares) - Matlab implementation: 3 min for 250x250 image with 6 components
47 Ground Truth Comparison Ground Truth Components Our Decomposition (before user guidance)
48 Ground Truth Comparison Ground Truth Components Our Decomposition after 7 strokes
49 Ground Truth Comparison Ground Truth Components Our Decomposition after 12 strokes
50 Input
51 Input Illumination Reflectance Direct Shirt Skin Strap User-stroke Illumination Components
52 Our Result
53 Input Modified Reflectance Only Our Result
54 Input Modified Reflectance Only Our Result
55 Input Modified Reflectance Only Our Result
56 Limitations and Future Work Intrinsic Image Quality More flexible user interaction Reliance on dissimilar colors Illumination Intrinsic Image Our Result
57 Real world applications? Discussion
CS635 Spring Department of Computer Science Purdue University
Inverse Light Transport CS635 Spring 200 Daniel G Aliaga Daniel G. Aliaga Department of Computer Science Purdue University Inverse Light Transport Light Transport Model transfer of light from source (e.g.,
DECOMPOSING and editing the illumination of a photograph
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017 1 Illumination Decomposition for Photograph with Multiple Light Sources Ling Zhang, Qingan Yan, Zheng Liu, Hua Zou, and Chunxia Xiao, Member, IEEE Abstract Illumination
Lecture 24: More on Reflectance CAP 5415
Lecture 24: More on Reflectance CAP 5415 Recovering Shape We ve talked about photometric stereo, where we assumed that a surface was diffuse Could calculate surface normals and albedo What if the surface
Inverse Light Transport (and next Separation of Global and Direct Illumination)
Inverse ight Transport (and next Separation of Global and Direct Illumination) CS434 Daniel G. Aliaga Department of Computer Science Purdue University Inverse ight Transport ight Transport Model transfer
CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein. Lecture 23: Photometric Stereo
CS4670/5760: Computer Vision Kavita Bala Scott Wehrwein Lecture 23: Photometric Stereo Announcements PA3 Artifact due tonight PA3 Demos Thursday Signups close at 4:30 today No lecture on Friday Last Time:
Computational Photography and Video: Intrinsic Images. Prof. Marc Pollefeys Dr. Gabriel Brostow
Computational Photography and Video: Intrinsic Images Prof. Marc Pollefeys Dr. Gabriel Brostow Last Week Schedule Computational Photography and Video Exercises 18 Feb Introduction to Computational Photography
Segmentation Based Stereo. Michael Bleyer LVA Stereo Vision
Segmentation Based Stereo Michael Bleyer LVA Stereo Vision What happened last time? Once again, we have looked at our energy function: E ( D) = m( p, dp) + p I < p, q > We have investigated the matching
Radiance. Pixels measure radiance. This pixel Measures radiance along this ray
Photometric stereo Radiance Pixels measure radiance This pixel Measures radiance along this ray Where do the rays come from? Rays from the light source reflect off a surface and reach camera Reflection:
Extracting Smooth and Transparent Layers from a Single Image
Extracting Smooth and Transparent Layers from a Single Image Sai-Kit Yeung Tai-Pang Wu Chi-Keung Tang saikit@ust.hk pang@ust.hk cktang@cse.ust.hk Vision and Graphics Group The Hong Kong University of Science
Shadow and Environment Maps
CS294-13: Special Topics Lecture #8 Advanced Computer Graphics University of California, Berkeley Monday, 28 September 2009 Shadow and Environment Maps Lecture #8: Monday, 28 September 2009 Lecturer: Ravi
Measurement-based Editing of Diffuse Albedo with Consistent Interreflections
Measurement-based Editing of Diffuse Albedo with Consistent Interreflections Bo Dong 1 Yue Dong 2 Xin Tong 2 Pieter Peers 1 1 College of William & Mary 2 Microsoft Research Figure 1: Changing the diffuse
CS6670: Computer Vision
CS6670: Computer Vision Noah Snavely Lecture 19: Optical flow http://en.wikipedia.org/wiki/barberpole_illusion Readings Szeliski, Chapter 8.4-8.5 Announcements Project 2b due Tuesday, Nov 2 Please sign
Introduction. Lighting model Light reflection model Local illumination model Reflectance model BRDF
Shading Introduction Affine transformations help us to place objects into a scene. Before creating images of these objects, we ll look at models for how light interacts with their surfaces. Such a model
INTRINSIC IMAGE EVALUATION ON SYNTHETIC COMPLEX SCENES
INTRINSIC IMAGE EVALUATION ON SYNTHETIC COMPLEX SCENES S. Beigpour, M. Serra, J. van de Weijer, R. Benavente, M. Vanrell, O. Penacchio, D. Samaras Computer Vision Center, Universitat Auto noma de Barcelona,
Irradiance Gradients. Media & Occlusions
Irradiance Gradients in the Presence of Media & Occlusions Wojciech Jarosz in collaboration with Matthias Zwicker and Henrik Wann Jensen University of California, San Diego June 23, 2008 Wojciech Jarosz
Mesh-Based Inverse Kinematics
CS468, Wed Nov 9 th 2005 Mesh-Based Inverse Kinematics R. W. Sumner, M. Zwicker, C. Gotsman, J. Popović SIGGRAPH 2005 The problem 1 General approach Learn from experience... 2 As-rigid-as-possible shape
Advanced phase retrieval: maximum likelihood technique with sparse regularization of phase and amplitude
Advanced phase retrieval: maximum likelihood technique with sparse regularization of phase and amplitude A. Migukin *, V. atkovnik and J. Astola Department of Signal Processing, Tampere University of Technology,
Optic Flow and Basics Towards Horn-Schunck 1
Optic Flow and Basics Towards Horn-Schunck 1 Lecture 7 See Section 4.1 and Beginning of 4.2 in Reinhard Klette: Concise Computer Vision Springer-Verlag, London, 2014 1 See last slide for copyright information.
Mysteries of Parameterizing Camera Motion - Part 1
Mysteries of Parameterizing Camera Motion - Part 1 Instructor - Simon Lucey 16-623 - Advanced Computer Vision Apps Today Motivation SO(3) Convex? Exponential Maps SL(3) Group. Adapted from: Computer vision:
Live Intrinsic Video. 1 Introduction. Abstract. Abhimitra Meka 1 Michael Zollhöfer 1 Christian Richardt 1, 2 Christian Theobalt 1
Live Intrinsic Video Abhimitra Meka 1 Michael Zollhöfer 1 Christian Richardt 1, 2 Christian Theobalt 1 1 Max Planck Institute for Informatics 2 Intel Visual Computing Institute Figure 1: We present the
EE613 Machine Learning for Engineers LINEAR REGRESSION. Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov.
EE613 Machine Learning for Engineers LINEAR REGRESSION Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov. 9, 2017 1 Outline Multivariate ordinary least squares Matlab code:
Pin Hole Cameras & Warp Functions
Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Motivation Taken from: http://img.gawkerassets.com/img/18w7i1umpzoa9jpg/original.jpg
Ground truth dataset and baseline evaluations for intrinsic image algorithms
Ground truth dataset and baseline evaluations for intrinsic image algorithms Roger Grosse Micah K. Johnson Edward H. Adelson William T. Freeman Massachusetts Institute of Technology Cambridge, MA 02139
Interreflection Removal for Photometric Stereo by Using Spectrum-dependent Albedo
Interreflection Removal for Photometric Stereo by Using Spectrum-dependent Albedo Miao Liao 1, Xinyu Huang, and Ruigang Yang 1 1 Department of Computer Science, University of Kentucky Department of Mathematics
Shape, Albedo, and Illumination from a Single Image of an Unknown Object Supplementary Material
Shape, Albedo, and from a Single Image of an Unknown Object Supplementary Material Jonathan T. Barron and Jitendra Malik UC Berkeley {barron, malik}@eecs.berkeley.edu 1. Gradient Norm We will detail how
Other approaches to obtaining 3D structure
Other approaches to obtaining 3D structure Active stereo with structured light Project structured light patterns onto the object simplifies the correspondence problem Allows us to use only one camera camera
A Framework for Content-Adaptive Photo Manipulation Macros: Application to Face, Landscape, and Global Manipulations. Supplemental Materials
A Framework for Content-Adaptive Photo Manipulation Macros: Application to Face, Landscape, and Global Manipulations Supplemental Materials page 2-3 page 4-5 page 6 page 7-1 page 11 page 12 page 13 Tilt
COMP 558 lecture 19 Nov. 17, 2010
COMP 558 lecture 9 Nov. 7, 2 Camera calibration To estimate the geometry of 3D scenes, it helps to know the camera parameters, both external and internal. The problem of finding all these parameters is
Recent Advances in Monte Carlo Offline Rendering
CS294-13: Special Topics Lecture #6 Advanced Computer Graphics University of California, Berkeley Monday, 21 September 2009 Recent Advances in Monte Carlo Offline Rendering Lecture #6: Monday, 21 September
Simultaneous Foreground, Background, and Alpha Estimation for Image Matting
Brigham Young University BYU ScholarsArchive All Faculty Publications 2010-06-01 Simultaneous Foreground, Background, and Alpha Estimation for Image Matting Bryan S. Morse morse@byu.edu Brian L. Price
Image Blending and Compositing NASA
Image Blending and Compositing NASA CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2016 Image Compositing Compositing Procedure 1. Extract Sprites (e.g using Intelligent
w Foley, Section16.1 Reading
Shading w Foley, Section16.1 Reading Introduction So far, we ve talked exclusively about geometry. w What is the shape of an object? w How do I place it in a virtual 3D space? w How do I know which pixels
CSE 167: Introduction to Computer Graphics Lecture #6: Lights. Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2016
CSE 167: Introduction to Computer Graphics Lecture #6: Lights Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2016 Announcements Thursday in class: midterm #1 Closed book Material
Lecture on Modeling Tools for Clustering & Regression
Lecture on Modeling Tools for Clustering & Regression CS 590.21 Analysis and Modeling of Brain Networks Department of Computer Science University of Crete Data Clustering Overview Organizing data into
Data Term. Michael Bleyer LVA Stereo Vision
Data Term Michael Bleyer LVA Stereo Vision What happened last time? We have looked at our energy function: E ( D) = m( p, dp) + p I < p, q > N s( p, q) We have learned about an optimization algorithm that
Siggraph Course 2017 Path Tracing in Production Part 1 Manuka: Weta Digital's Spectral Renderer
Siggraph Course 2017 Path Tracing in Production Part 1 Manuka: Weta Digital's Spectral Renderer Johannes Hanika, Weta Digital 1 Motivation Weta Digital is a VFX house we care about matching plate a lot
Practical Least-Squares for Computer Graphics
Outline Least Squares with Generalized Errors Robust Least Squares Constrained Least Squares Practical Least-Squares for Computer Graphics Outline Least Squares with Generalized Errors Robust Least Squares
A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction
A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction Jaemin Lee and Ergun Akleman Visualization Sciences Program Texas A&M University Abstract In this paper we present a practical
Assignment 4: Seamless Editing
Assignment 4: Seamless Editing - EE Affiliate I. INTRODUCTION This assignment discusses and eventually implements the techniques of seamless cloning as detailed in the research paper [1]. First, a summary
Pin Hole Cameras & Warp Functions
Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Example of SLAM for AR Taken from:
Image Processing Techniques and Smart Image Manipulation : Texture Synthesis
CS294-13: Special Topics Lecture #15 Advanced Computer Graphics University of California, Berkeley Monday, 26 October 2009 Image Processing Techniques and Smart Image Manipulation : Texture Synthesis Lecture
Color Me Right Seamless Image Compositing
Color Me Right Seamless Image Compositing Dong Guo and Terence Sim School of Computing National University of Singapore Singapore, 117417 Abstract. This paper introduces an approach of creating an image
EE613 Machine Learning for Engineers LINEAR REGRESSION. Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov.
EE613 Machine Learning for Engineers LINEAR REGRESSION Sylvain Calinon Robot Learning & Interaction Group Idiap Research Institute Nov. 4, 2015 1 Outline Multivariate ordinary least squares Singular value
Computational Photography and Capture: (Re)Coloring. Gabriel Brostow & Tim Weyrich TA: Frederic Besse
Computational Photography and Capture: (Re)Coloring Gabriel Brostow & Tim Weyrich TA: Frederic Besse Week Date Topic Hours 1 12-Jan Introduction to Computational Photography and Capture 1 1 14-Jan Intro
INTRINSIC image decomposition addresses the problem
JOURNAL OF L A T E X CLASS FILES, VOL. 6, NO. 1, JANUARY 2007 1 Intrinsic Image Decomposition Using a Sparse Representation of Reflectance Li Shen, Member, IEEE, Chuohao Yeo, Member, IEEE, and Binh-Son
CS-184: Computer Graphics. Today. Lecture 22: Radiometry! James O Brien University of California, Berkeley! V2014-S
CS-184: Computer Graphics Lecture 22: Radiometry James O Brien University of California, Berkeley V2014-S-15-1.0 Today Radiometry: measuring light Local Illumination and Raytracing were discussed in an
Stereo Matching.
Stereo Matching Stereo Vision [1] Reduction of Searching by Epipolar Constraint [1] Photometric Constraint [1] Same world point has same intensity in both images. True for Lambertian surfaces A Lambertian
Compact and Low Cost System for the Measurement of Accurate 3D Shape and Normal
Compact and Low Cost System for the Measurement of Accurate 3D Shape and Normal Ryusuke Homma, Takao Makino, Koichi Takase, Norimichi Tsumura, Toshiya Nakaguchi and Yoichi Miyake Chiba University, Japan
Prof. Feng Liu. Spring /17/2017. With slides by F. Durand, Y.Y. Chuang, R. Raskar, and C.
Prof. Feng Liu Spring 2017 http://www.cs.pdx.edu/~fliu/courses/cs510/ 05/17/2017 With slides by F. Durand, Y.Y. Chuang, R. Raskar, and C. Rother Last Time Image segmentation Normalized cut and segmentation
Time-to-Contact from Image Intensity
Time-to-Contact from Image Intensity Yukitoshi Watanabe Fumihiko Sakaue Jun Sato Nagoya Institute of Technology Gokiso, Showa, Nagoya, 466-8555, Japan {yukitoshi@cv.,sakaue@,junsato@}nitech.ac.jp Abstract
Motivation: Monte Carlo Path Tracing. Sampling and Reconstruction of Visual Appearance. Monte Carlo Path Tracing. Monte Carlo Path Tracing
Sampling and Reconstruction of Visual Appearance CSE 274 [Winter 2018], Lecture 4 Ravi Ramamoorthi http://www.cs.ucsd.edu/~ravir Motivation: Key application area for sampling/reconstruction Core method
Particle Tracking. For Bulk Material Handling Systems Using DEM Models. By: Jordan Pease
Particle Tracking For Bulk Material Handling Systems Using DEM Models By: Jordan Pease Introduction Motivation for project Particle Tracking Application to DEM models Experimental Results Future Work References
Public Library, Stereoscopic Looking Room, Chicago, by Phillips, 1923
Public Library, Stereoscopic Looking Room, Chicago, by Phillips, 1923 Teesta suspension bridge-darjeeling, India Mark Twain at Pool Table", no date, UCR Museum of Photography Woman getting eye exam during
Total Variation Denoising with Overlapping Group Sparsity
1 Total Variation Denoising with Overlapping Group Sparsity Ivan W. Selesnick and Po-Yu Chen Polytechnic Institute of New York University Brooklyn, New York selesi@poly.edu 2 Abstract This paper describes
Multiple View Geometry
Multiple View Geometry CS 6320, Spring 2013 Guest Lecture Marcel Prastawa adapted from Pollefeys, Shah, and Zisserman Single view computer vision Projective actions of cameras Camera callibration Photometric
MATLAB Based Optimization Techniques and Parallel Computing
MATLAB Based Optimization Techniques and Parallel Computing Bratislava June 4, 2009 2009 The MathWorks, Inc. Jörg-M. Sautter Application Engineer The MathWorks Agenda Introduction Local and Smooth Optimization
Shading. Brian Curless CSE 557 Autumn 2017
Shading Brian Curless CSE 557 Autumn 2017 1 Reading Optional: Angel and Shreiner: chapter 5. Marschner and Shirley: chapter 10, chapter 17. Further reading: OpenGL red book, chapter 5. 2 Basic 3D graphics
Lambertian model of reflectance I: shape from shading and photometric stereo. Ronen Basri Weizmann Institute of Science
Lambertian model of reflectance I: shape from shading and photometric stereo Ronen Basri Weizmann Institute of Science Variations due to lighting (and pose) Relief Dumitru Verdianu Flying Pregnant Woman
Single image based illumination estimation for lighting virtual object in real scene
2011 12th International Conference on Computer-Aided Design and Computer Graphics Single image based illumination estimation for lighting virtual object in real scene Xiaowu Chen, Ke Wang and Xin Jin State
Neural Face Editing with Intrinsic Image Disentangling SUPPLEMENTARY MATERIAL
Neural Face Editing with Intrinsic Image Disentangling SUPPLEMENTARY MATERIAL Zhixin Shu 1 Ersin Yumer 2 Sunil Hadap 2 Kalyan Sunkavalli 2 Eli Shechtman 2 Dimitris Samaras 1,3 1 Stony Brook University
Locally Weighted Least Squares Regression for Image Denoising, Reconstruction and Up-sampling
Locally Weighted Least Squares Regression for Image Denoising, Reconstruction and Up-sampling Moritz Baecher May 15, 29 1 Introduction Edge-preserving smoothing and super-resolution are classic and important
COMP 558 lecture 16 Nov. 8, 2010
Shading The term shading typically refers to variations in irradiance along a smooth Lambertian surface. Recall that if a surface point is illuminated by parallel light source from direction l, then the
Direct Matrix Factorization and Alignment Refinement: Application to Defect Detection
Direct Matrix Factorization and Alignment Refinement: Application to Defect Detection Zhen Qin (University of California, Riverside) Peter van Beek & Xu Chen (SHARP Labs of America, Camas, WA) 2015/8/30
Horn-Schunck and Lucas Kanade 1
Horn-Schunck and Lucas Kanade 1 Lecture 8 See Sections 4.2 and 4.3 in Reinhard Klette: Concise Computer Vision Springer-Verlag, London, 2014 1 See last slide for copyright information. 1 / 40 Where We
Ninio, J. and Stevens, K. A. (2000) Variations on the Hermann grid: an extinction illusion. Perception, 29,
Ninio, J. and Stevens, K. A. (2000) Variations on the Hermann grid: an extinction illusion. Perception, 29, 1209-1217. CS 4495 Computer Vision A. Bobick Sparse to Dense Correspodence Building Rome in
Matching. Compare region of image to region of image. Today, simplest kind of matching. Intensities similar.
Matching Compare region of image to region of image. We talked about this for stereo. Important for motion. Epipolar constraint unknown. But motion small. Recognition Find object in image. Recognize object.
Camera Calibration. Schedule. Jesus J Caban. Note: You have until next Monday to let me know. ! Today:! Camera calibration
Camera Calibration Jesus J Caban Schedule! Today:! Camera calibration! Wednesday:! Lecture: Motion & Optical Flow! Monday:! Lecture: Medical Imaging! Final presentations:! Nov 29 th : W. Griffin! Dec 1
Beyond Mere Pixels: How Can Computers Interpret and Compare Digital Images? Nicholas R. Howe Cornell University
Beyond Mere Pixels: How Can Computers Interpret and Compare Digital Images? Nicholas R. Howe Cornell University Why Image Retrieval? World Wide Web: Millions of hosts Billions of images Growth of video
(Sparse) Linear Solvers
(Sparse) Linear Solvers Ax = B Why? Many geometry processing applications boil down to: solve one or more linear systems Parameterization Editing Reconstruction Fairing Morphing 2 Don t you just invert
Image-Based Rendering and Light Fields
CS194-13: Advanced Computer Graphics Lecture #9 Image-Based Rendering University of California Berkeley Image-Based Rendering and Light Fields Lecture #9: Wednesday, September 30th 2009 Lecturer: Ravi
Relighting for an Arbitrary Shape Object Under Unknown Illumination Environment
Relighting for an Arbitrary Shape Object Under Unknown Illumination Environment Yohei Ogura (B) and Hideo Saito Keio University, 3-14-1 Hiyoshi, Kohoku, Yokohama, Kanagawa 223-8522, Japan {y.ogura,saito}@hvrl.ics.keio.ac.jp
AN ANALYSIS OF ITERATIVE ALGORITHMS FOR IMAGE RECONSTRUCTION FROM SATELLITE EARTH REMOTE SENSING DATA Matthew H Willis Brigham Young University, MERS Laboratory 459 CB, Provo, UT 8462 8-378-4884, FAX:
Gene Clustering & Classification
BINF, Introduction to Computational Biology Gene Clustering & Classification Young-Rae Cho Associate Professor Department of Computer Science Baylor University Overview Introduction to Gene Clustering
Finally: Motion and tracking. Motion 4/20/2011. CS 376 Lecture 24 Motion 1. Video. Uses of motion. Motion parallax. Motion field
Finally: Motion and tracking Tracking objects, video analysis, low level motion Motion Wed, April 20 Kristen Grauman UT-Austin Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys, and S. Lazebnik
Light Reflection Models
Light Reflection Models Visual Imaging in the Electronic Age Donald P. Greenberg October 21, 2014 Lecture #15 Goal of Realistic Imaging From Strobel, Photographic Materials and Processes Focal Press, 186.
This course covers a group of global illumination algorithms known as many light methods, or VPL rendering methods. (VPL = virtual point light)
This course covers a group of global illumination algorithms known as many light methods, or VPL rendering methods. (VPL = virtual point light) 1 Our goal is to render realistic images and one of the
Real-Time Ambient Occlusion for Dynamic Character Skins
Real-Time Ambient Occlusion for Dynamic Character Skins Adam G. Kirk UC-Berkeley Okan Arikan UT-Austin Figure 1: Time-lapse screen capture showing ambient occlusion values calculated in real-time. Abstract
To Do. Real-Time High Quality Rendering. Motivation for Lecture. Monte Carlo Path Tracing. Monte Carlo Path Tracing. Monte Carlo Path Tracing
Real-Time High Quality Rendering CSE 274 [Fall 2015], Lecture 5 Tour of Modern Offline Rendering To Do Project milestone (1-2 pages), final project proposal Due on Oct 27 Please get in touch with me if
Estimating Intrinsic Component Images using Non-Linear Regression
Estimating Intrinsic Component Images using Non-Linear Regression Marshall F. Tappen Edward H. Adelson William T. Freeman MIT Computer Science and Artificial Intelligence Laboratory Cambridge, MA 02139
Physics-based Vision: an Introduction
Physics-based Vision: an Introduction Robby Tan ANU/NICTA (Vision Science, Technology and Applications) PhD from The University of Tokyo, 2004 1 What is Physics-based? An approach that is principally concerned
Photoshop Quickselect & Interactive Digital Photomontage
Photoshop Quickselect & Interactive Digital Photomontage By Joseph Tighe 1 Photoshop Quickselect Based on the graph cut technology discussed Boykov-Kolmogorov What might happen when we use a color model?
Metric Structure from Motion
CS443 Final Project Metric Structure from Motion Peng Cheng 1 Objective of the Project Given: 1. A static object with n feature points and unknown shape. 2. A camera with unknown intrinsic parameters takes
Matting, Transparency, and Illumination. Slides from Alexei Efros
New course focus Done with texture, patches, and shuffling image content. Focus on light, specifically light models derived from multiple photos of the same scene. Matting, Transparency, and Illumination
Motivation. My General Philosophy. Assumptions. Advanced Computer Graphics (Spring 2013) Precomputation-Based Relighting
Advanced Computer Graphics (Spring 2013) CS 283, Lecture 17: Precomputation-Based Real-Time Rendering Ravi Ramamoorthi http://inst.eecs.berkeley.edu/~cs283/sp13 Motivation Previously: seen IBR. Use measured
EE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 11 140311 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Motion Analysis Motivation Differential Motion Optical
Image Warping. Image Manipula-on and Computa-onal Photography CS Fall 2011 Robert Carroll.
Image Warping http://www.jeffrey-martin.com Image Manipula-on and Computa-onal Photography CS294-69 Fall 2011 Robert Carroll [Some slides from K. Padalkar, S. Avidan, A. Shamir, A. Efros, S. Seitz, and
Global Illumination CS334. Daniel G. Aliaga Department of Computer Science Purdue University
Global Illumination CS334 Daniel G. Aliaga Department of Computer Science Purdue University Recall: Lighting and Shading Light sources Point light Models an omnidirectional light source (e.g., a bulb)
User assisted separation of reflections from a single image using a sparsity prior
User assisted separation of reflections from a single image using a sparsity prior Anat Levin and Yair Weiss School of Computer Science and Engineering The Hebrew University of Jerusalem 994 Jerusalem,
Robust l p -norm Singular Value Decomposition
Robust l p -norm Singular Value Decomposition Kha Gia Quach 1, Khoa Luu 2, Chi Nhan Duong 1, Tien D. Bui 1 1 Concordia University, Computer Science and Software Engineering, Montréal, Québec, Canada 2
Rendering Light Reflection Models
Rendering Light Reflection Models Visual Imaging in the Electronic Age Donald P. Greenberg October 27, 2015 Lecture #18 Goal of Realistic Imaging The resulting images should be physically accurate and
Shading. Reading. Pinhole camera. Basic 3D graphics. Brian Curless CSE 557 Fall Required: Shirley, Chapter 10
Reading Required: Shirley, Chapter 10 Shading Brian Curless CSE 557 Fall 2014 1 2 Basic 3D graphics With affine matrices, we can now transform virtual 3D objects in their local coordinate systems into
Photometric Stereo. Lighting and Photometric Stereo. Computer Vision I. Last lecture in a nutshell BRDF. CSE252A Lecture 7
Lighting and Photometric Stereo Photometric Stereo HW will be on web later today CSE5A Lecture 7 Radiometry of thin lenses δa Last lecture in a nutshell δa δa'cosα δacos β δω = = ( z' / cosα ) ( z / cosα
EECS 4330/7330 Introduction to Mechatronics and Robotic Vision, Fall Lab 1. Camera Calibration
1 Lab 1 Camera Calibration Objective In this experiment, students will use stereo cameras, an image acquisition program and camera calibration algorithms to achieve the following goals: 1. Develop a procedure
Visual Tracking (1) Pixel-intensity-based methods
Intelligent Control Systems Visual Tracking (1) Pixel-intensity-based methods Shingo Kagami Graduate School of Information Sciences, Tohoku University swk(at)ic.is.tohoku.ac.jp http://www.ic.is.tohoku.ac.jp/ja/swk/
High Dynamic Range Images
High Dynamic Range Images Alyosha Efros CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2018 with a lot of slides stolen from Paul Debevec Why HDR? Problem: Dynamic
RASTERIZING POLYGONS IN IMAGE SPACE
On-Line Computer Graphics Notes RASTERIZING POLYGONS IN IMAGE SPACE Kenneth I. Joy Visualization and Graphics Research Group Department of Computer Science University of California, Davis A fundamental
Homework 3 Solutions
CS3510 Design & Analysis of Algorithms Section A Homework 3 Solutions Released: 7pm, Wednesday Nov 8, 2017 This homework has a total of 4 problems on 4 pages. Solutions should be submitted to GradeScope
Global Illumination and the Rendering Equation
CS294-13: Special Topics Lecture #3 Advanced Computer Graphics University of California, Berkeley Handout Date??? Global Illumination and the Rendering Equation Lecture #3: Wednesday, 9 September 2009
Today. Anti-aliasing Surface Parametrization Soft Shadows Global Illumination. Exercise 2. Path Tracing Radiosity
Today Anti-aliasing Surface Parametrization Soft Shadows Global Illumination Path Tracing Radiosity Exercise 2 Sampling Ray Casting is a form of discrete sampling. Rendered Image: Sampling of the ground
IMAGE DE-NOISING IN WAVELET DOMAIN
IMAGE DE-NOISING IN WAVELET DOMAIN Aaditya Verma a, Shrey Agarwal a a Department of Civil Engineering, Indian Institute of Technology, Kanpur, India - (aaditya, ashrey)@iitk.ac.in KEY WORDS: Wavelets,