Integrated High-Quality Acquisition of Geometry and Appearance for Cultural Heritage

Size: px
Start display at page:

Download "Integrated High-Quality Acquisition of Geometry and Appearance for Cultural Heritage"

Transcription

1 Integrated High-Quality Acquisition of Geometry and Appearance for Cultural Heritage Christopher Schwartz, Michael Weinmann, Roland Ruiters, Reinhard Klein Institute of Computer Science II Computer Graphics 1 26/10/2011

2 Outline Motivation Previous Work Overview Acquisition Postprocessing Results Conclusion 2 26/10/2011

3 MOTIVATION 3 26/10/2011

4 Motivation Digitization of CH artefacts Public dissemination (see my talk tomorrow) Exchange between experts and institutions Novel tools for research 4 26/10/2011

5 Motivation The shapes of objects are scanned in HQ but what about appearance? Geometry only With texture Correct appearance 5 26/10/2011

6 Object Appearance Impression of reflection of incident light Influenced by features on different scales Macroscopic Mesoscopic Microscopic Viewpoint and Illumination dependent 6 26/10/2011

7 Form of Representation Macroscopic scale 3D shape Explicit representation (e.g. polygon mesh) Mesoscopic scale Individually resolved by human perception Statistical representation not accurate Explicit representation too costly Microscopic scale Alignment of microscopic structures Statistical representation (e.g. BRDF) Image based! 7 26/10/2011

8 Form of Representation Macroscopic scale 3D shape Explicit representation (e.g. polygon mesh) Mesoscopic scale Individually resolved by human perception Statistical representation not accurate Explicit representation too costly Microscopic scale Alignment of microscopic structures Statistical representation (e.g. BRDF) Image based! 8 26/10/2011

9 Form of Representation Macroscopic scale 3D shape Explicit representation (e.g. polygon mesh) Mesoscopic scale Individually resolved by human perception Statistical representation not accurate Explicit representation too costly Microscopic scale Alignment of microscopic structures Statistical representation (e.g. BRDF) Bidirectional Texture Function 9 26/10/2011

10 Why BTF? Data-driven No model assumption No statistical approximation High compression ratios Good rendering properties Full light transport simulation Realtime Streamable over the Internet see my talk tomorrow 10 26/10/2011

11 PREVIOUS WORK 11 26/10/2011

12 reference rendering reference rendering Previous Work Lensch et al. 2003: SVBRDF + external geometry + Good geometry - Analytical BRDF model assumption - Mesoscale only indicated with normal-mapping - Separate acquisition registration problem Müller et al. 2005: BTF + shape from silhouette + Meso- and Microscale effects captured with BTF + Integrated acquisition - Poor geometry Holroyd et al. 2010: SVBRDF + structured light + High-quality geometry + Integrated acquisition - Analytical BRDF model assumptions - Mesoscale only indicated with normal-mapping - Very sparse reflectance sampling 12 26/10/2011

13 OVERVIEW 13 26/10/2011

14 Goal: Digital Replica Digital Replica Arbitrary viewpoint Arbitrary illumination Arbitrary arrangement (virtual scene) High-quality geometry High-quality appearance (BTF) Acquisition integrated in one setup No error-prone registration No movement during acquisition Suitable for non-rigid objects Automatable 14 26/10/2011

15 The proposed pipeline Structured Light HDR Images Geometry Reconstruction Real Object Image Acquisition View/Light Dependent HDR Images Weinmann et al. 2011, 3DIMPVT Digitized Object BTF Resampling & Hole Filling Camera Calibration 3D Mesh 15 26/10/2011

16 ACQUISITION 16 26/10/2011

17 The Capture Setup Multi-Camera Dome 151 cameras: Canon PowerShot G9 12 Megapixels Integrated flash Rapid acquisition 8 projectors: Acer C20 Pico At different positions Completely computer controlled 17 26/10/2011

18 Appearance Measurement Acquire light/view combinations: 151 flashes 151 cams HDR: 3 exposures 68,403 images 2.5 hours 453 flash discharges a few seconds under 100W tungsten lamp 18 26/10/2011

19 Geometry Measurement Acquire structured light sequences: 8 projectors 38 patterns 151 cams HDR: 3 exposures 137,712 images 1.2 hours 19 26/10/2011

20 Calibration Geometric From structured light: Weinmann et al Radiometric Cameras: Known response curves Flashes: Capture reflectance standards for every discharge 20 26/10/2011

21 POSTPROCESSING 21 26/10/2011

22 Geometry Reconstruction Weinmann et al. 2011: HQ triangle meshes ABF++: Parameterization V U 22 26/10/2011

23 Appearance Reconstruction For every point: 23 26/10/2011

24 Appearance Reconstruction For every point: Measurement BTF Tabulated ( ) Camera hemispheres Tabulated ( ) In local orientation Local hemispheres 24 26/10/2011

25 Appearance Reconstruction Gather samples Not measured Irregular Occlusion 25 26/10/2011

26 Resampling & Hole Filling Representative points (random sampling) Irregular samples & confidence Interpolate both Radial Basis Functions 26 26/10/2011

27 Resampling & Hole Filling Perform clustering Build low-rank basis per cluster Non-negative Matrix Factorization 27 26/10/2011

28 Resampling & Hole Filling All points RBF interpolation Project into bases Data-driven regularization cluster-center Choose representation with minimum error Blend with interpolation w.r.t. confidence 28 26/10/2011

29 RESULTS 29 26/10/2011

30 Datasets Geometry: 250k 560k vertices (500k 1M Δ) Edge length 317 µm Appearance: BTF Spatial resolution (4.2 Megapixel) Texel 117 µm surface resolution Angular resolution Uncompressed: GB Compressed: 1.59 GB (780 MB,125MB) Resampling: 25 hours Compression: 8 hours 30 26/10/2011

31 Quality 31 26/10/2011

32 Faithfulness Photographic picture Our Result (tonemapped HDR) Polynomial Texture Map Malzbender et al (Single view and LDR!) 32 26/10/2011

33 Photorealistic Rendering 33 26/10/2011

34 Photorealistic Rendering 34 26/10/2011

35 Interactive Inspection 35 26/10/2011

36 CONCLUSION 36 26/10/2011

37 Conclusion High-quality Digital Replicas Free viewpoint Arbitrary illumination Photorealistic Realtime Integrated acquisition setup Geometry + appearance Rapid automated acquisition Processing pipeline Triangle Mesh + BTF Technical Contribution 37 26/10/2011

38 Questions Thank you for your attention! Datasets are available for download at ftp://btf.cs.uni-bonn.de Acknowledgement: The research leading to these results was partially funded by the European Community s Seventh Framework Programme (FP7/ ) under grant agreement n ; and by the German Science Foundation (DFG) under research grant KL 1142/ /10/2011

Capturing Shape and Reflectance of Food

Capturing Shape and Reflectance of Food Capturing Shape and Reflectance of Food C. Schwartz*, M. Weinmann*, R. Ruiters*, A. Zinke, R. Sarlette*, R. Klein* *University of Bonn / GfAR mbh Goal Photorealistic 3D content Usable in arbitrary synthetic

More information

Chapter 7. Conclusions and Future Work

Chapter 7. Conclusions and Future Work Chapter 7 Conclusions and Future Work In this dissertation, we have presented a new way of analyzing a basic building block in computer graphics rendering algorithms the computational interaction between

More information

Il colore: acquisizione e visualizzazione. Lezione 17: 11 Maggio 2012

Il colore: acquisizione e visualizzazione. Lezione 17: 11 Maggio 2012 Il colore: acquisizione e visualizzazione Lezione 17: 11 Maggio 2012 The importance of color information Precision vs. Perception 3D scanned geometry Photo Color and appearance Pure geometry Pure color

More information

Il colore: acquisizione e visualizzazione. Lezione 20: 11 Maggio 2011

Il colore: acquisizione e visualizzazione. Lezione 20: 11 Maggio 2011 Il colore: acquisizione e visualizzazione Lezione 20: 11 Maggio 2011 Outline The importance of color What is color? Material properties vs. unshaded color Texture building from photos Image registration

More information

Tutorial Notes for the DAGM 2001 A Framework for the Acquisition, Processing and Interactive Display of High Quality 3D Models

Tutorial Notes for the DAGM 2001 A Framework for the Acquisition, Processing and Interactive Display of High Quality 3D Models χfiχfi k INFORMATIK Tutorial Notes for the DAGM 2001 A Framework for the Acquisition, Processing and Interactive Display of High Quality 3D Models Research Report MPI-I-2001-4-005 September 2001 Hendrik

More information

Image-Based Modeling and Rendering

Image-Based Modeling and Rendering Traditional Computer Graphics Image-Based Modeling and Rendering Thomas Funkhouser Princeton University COS 426 Guest Lecture Spring 2003 How would you model and render this scene? (Jensen) How about this

More information

Visual Appearance and Color. Gianpaolo Palma

Visual Appearance and Color. Gianpaolo Palma Visual Appearance and Color Gianpaolo Palma LIGHT MATERIAL Visual Appearance Color due to the interaction between the lighting environment (intensity, position, ) and the properties of the object surface

More information

Synthesis of Textures with Intricate Geometries using BTF and Large Number of Textured Micropolygons. Abstract. 2. Related studies. 1.

Synthesis of Textures with Intricate Geometries using BTF and Large Number of Textured Micropolygons. Abstract. 2. Related studies. 1. Synthesis of Textures with Intricate Geometries using BTF and Large Number of Textured Micropolygons sub047 Abstract BTF has been studied extensively and much progress has been done for measurements, compression

More information

Hybrid Textons: Modeling Surfaces with Reflectance and Geometry

Hybrid Textons: Modeling Surfaces with Reflectance and Geometry Hybrid Textons: Modeling Surfaces with Reflectance and Geometry Jing Wang and Kristin J. Dana Electrical and Computer Engineering Department Rutgers University Piscataway, NJ, USA {jingwang,kdana}@caip.rutgers.edu

More information

Light-Dependent Texture Mapping

Light-Dependent Texture Mapping Light-Dependent Texture Mapping Dan Gelb, Tom Malzbender, Kevin Wu Client and Media Systems Laboratory HP Laboratories Palo Alto HPL-98-131 (R.1) April 26 th, 2001* E-mail: malzbend@hpl.hp.com texture

More information

Multiplexed Acquisition of Bidirectional Texture Functions for Materials

Multiplexed Acquisition of Bidirectional Texture Functions for Materials Best Student Paper Award Multiplexed Acquisition of Bidirectional Texture Functions for Materials Dennis den Brok, Heinz C. Steinhausen, Matthias B. Hullin and Reinhard Klein Institut für Informatik II,

More information

Image-Based Rendering

Image-Based Rendering Image-Based Rendering COS 526, Fall 2016 Thomas Funkhouser Acknowledgments: Dan Aliaga, Marc Levoy, Szymon Rusinkiewicz What is Image-Based Rendering? Definition 1: the use of photographic imagery to overcome

More information

Project Periodic Report Summary

Project Periodic Report Summary Project Periodic Report Summary Month 12 Date: 24.7.2014 Grant Agreement number: EU 323567 Project acronym: HARVEST4D Project title: Harvesting Dynamic 3D Worlds from Commodity Sensor Clouds TABLE OF CONTENTS

More information

Dynamic Geometry Processing

Dynamic Geometry Processing Dynamic Geometry Processing EG 2012 Tutorial Will Chang, Hao Li, Niloy Mitra, Mark Pauly, Michael Wand Tutorial: Dynamic Geometry Processing 1 Articulated Global Registration Introduction and Overview

More information

Interactive Vizualisation of Complex Real-World Light Sources

Interactive Vizualisation of Complex Real-World Light Sources Interactive Vizualisation of Complex Real-World Light Sources Xavier Granier(1-2) Michael Goesele(3) (2) (3) Wolgang Heidrich Hans-Peter Seidel (1) (2) (3) IPARLA/INRIA LaBRI (Bordeaux) University of British

More information

ENGN D Photography / Spring 2018 / SYLLABUS

ENGN D Photography / Spring 2018 / SYLLABUS ENGN 2502 3D Photography / Spring 2018 / SYLLABUS Description of the proposed course Over the last decade digital photography has entered the mainstream with inexpensive, miniaturized cameras routinely

More information

Jingyi Yu CISC 849. Department of Computer and Information Science

Jingyi Yu CISC 849. Department of Computer and Information Science Digital Photography and Videos Jingyi Yu CISC 849 Light Fields, Lumigraph, and Image-based Rendering Pinhole Camera A camera captures a set of rays A pinhole camera captures a set of rays passing through

More information

Traditional Image Generation. Reflectance Fields. The Light Field. The Light Field. The Light Field. The Light Field

Traditional Image Generation. Reflectance Fields. The Light Field. The Light Field. The Light Field. The Light Field Traditional Image Generation Course 10 Realistic Materials in Computer Graphics Surfaces + BRDFs Reflectance Fields USC Institute for Creative Technologies Volumetric scattering, density fields, phase

More information

Online Interactive 4D Character Animation

Online Interactive 4D Character Animation Online Interactive 4D Character Animation Marco Volino, Peng Huang and Adrian Hilton Web3D 2015 Outline 4D Performance Capture - 3D Reconstruction, Alignment, Texture Maps Animation - Parametric Motion

More information

Image-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about

Image-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about Image-Based Modeling and Rendering Image-Based Modeling and Rendering MIT EECS 6.837 Frédo Durand and Seth Teller 1 Some slides courtesy of Leonard McMillan, Wojciech Matusik, Byong Mok Oh, Max Chen 2

More information

Structured light 3D reconstruction

Structured light 3D reconstruction Structured light 3D reconstruction Reconstruction pipeline and industrial applications rodola@dsi.unive.it 11/05/2010 3D Reconstruction 3D reconstruction is the process of capturing the shape and appearance

More information

Modeling the Virtual World

Modeling the Virtual World Modeling the Virtual World Joaquim Madeira November, 2013 RVA - 2013/2014 1 A VR system architecture Modeling the Virtual World Geometry Physics Haptics VR Toolkits RVA - 2013/2014 2 VR object modeling

More information

Chapter 1 Introduction

Chapter 1 Introduction Chapter 1 Introduction The central problem in computer graphics is creating, or rendering, realistic computergenerated images that are indistinguishable from real photographs, a goal referred to as photorealism.

More information

Acquisition and Visualization of Colored 3D Objects

Acquisition and Visualization of Colored 3D Objects Acquisition and Visualization of Colored 3D Objects Kari Pulli Stanford University Stanford, CA, U.S.A kapu@cs.stanford.edu Habib Abi-Rached, Tom Duchamp, Linda G. Shapiro and Werner Stuetzle University

More information

BTF Compression via Sparse Tensor Decomposition

BTF Compression via Sparse Tensor Decomposition Eurographics Symposium on Rendering 2009 Hendrik P. A. Lensch and Peter-Pike Sloan (Guest Editors) Volume 28 (2009), Number 4 BTF Compression via Sparse Tensor Decomposition Roland Ruiters and Reinhard

More information

Synthesizing Realistic Facial Expressions from Photographs

Synthesizing Realistic Facial Expressions from Photographs Synthesizing Realistic Facial Expressions from Photographs 1998 F. Pighin, J Hecker, D. Lischinskiy, R. Szeliskiz and D. H. Salesin University of Washington, The Hebrew University Microsoft Research 1

More information

Research White Paper WHP 143. Multi-camera radiometric surface modelling for image-based re-lighting BRITISH BROADCASTING CORPORATION.

Research White Paper WHP 143. Multi-camera radiometric surface modelling for image-based re-lighting BRITISH BROADCASTING CORPORATION. Research White Paper WHP 143 11 January 2007 Multi-camera radiometric surface modelling for image-based re-lighting Oliver Grau BRITISH BROADCASTING CORPORATION Multi-camera radiometric surface modelling

More information

A Variational Study on BRDF Reconstruction in a Structured Light Scanner

A Variational Study on BRDF Reconstruction in a Structured Light Scanner A Variational Study on BRDF Reconstruction in a Structured Light Scanner Jannik Boll Nielsen, Jonathan Dyssel Stets, Rasmus Ahrenkiel Lyngby, Henrik Aanæs, Anders Bjorholm Dahl, Jeppe Revall Frisvad Technical

More information

Topic 12: Texture Mapping. Motivation Sources of texture Texture coordinates Bump mapping, mip-mapping & env mapping

Topic 12: Texture Mapping. Motivation Sources of texture Texture coordinates Bump mapping, mip-mapping & env mapping Topic 12: Texture Mapping Motivation Sources of texture Texture coordinates Bump mapping, mip-mapping & env mapping Texture sources: Photographs Texture sources: Procedural Texture sources: Solid textures

More information

Real-Time Non- Photorealistic Rendering

Real-Time Non- Photorealistic Rendering Real-Time Non- Photorealistic Rendering Presented by: Qing Hu LIAO SOCS, McGill Feb 1, 2005 Index Introduction Motivation Appel s Algorithm Improving Schema Rendering Result Economy of line A great deal

More information

Multi-View 3D-Reconstruction

Multi-View 3D-Reconstruction Multi-View 3D-Reconstruction Cedric Cagniart Computer Aided Medical Procedures (CAMP) Technische Universität München, Germany 1 Problem Statement Given several calibrated views of an object... can we automatically

More information

THE FUTURE OF MATERIAL COMMUNICATION VIA THE APPEARANCE EXCHANGE FORMAT AXF

THE FUTURE OF MATERIAL COMMUNICATION VIA THE APPEARANCE EXCHANGE FORMAT AXF THE FUTURE OF MATERIAL COMMUNICATION VIA THE APPEARANCE EXCHANGE FORMAT AXF Dr. Marc Ellens EI 2017: MATERIAL APPEARANCE APPEARANCE DISCUSSION ACQUISITION DEVICE AXF FORMAT ROADMAP VISION WHAT IS THIS

More information

Finding Structure in Large Collections of 3D Models

Finding Structure in Large Collections of 3D Models Finding Structure in Large Collections of 3D Models Vladimir Kim Adobe Research Motivation Explore, Analyze, and Create Geometric Data Real Virtual Motivation Explore, Analyze, and Create Geometric Data

More information

Data Representation in Visualisation

Data Representation in Visualisation Data Representation in Visualisation Visualisation Lecture 4 Taku Komura Institute for Perception, Action & Behaviour School of Informatics Taku Komura Data Representation 1 Data Representation We have

More information

Topic 11: Texture Mapping 11/13/2017. Texture sources: Solid textures. Texture sources: Synthesized

Topic 11: Texture Mapping 11/13/2017. Texture sources: Solid textures. Texture sources: Synthesized Topic 11: Texture Mapping Motivation Sources of texture Texture coordinates Bump mapping, mip mapping & env mapping Texture sources: Photographs Texture sources: Procedural Texture sources: Solid textures

More information

The 7d plenoptic function, indexing all light.

The 7d plenoptic function, indexing all light. Previous Lecture The 7d plenoptic function, indexing all light. Lightfields: a 4d (not 5d!) data structure which captures all outgoing light from a region and permits reconstruction of arbitrary synthetic

More information

03 - Reconstruction. Acknowledgements: Olga Sorkine-Hornung. CSCI-GA Geometric Modeling - Spring 17 - Daniele Panozzo

03 - Reconstruction. Acknowledgements: Olga Sorkine-Hornung. CSCI-GA Geometric Modeling - Spring 17 - Daniele Panozzo 3 - Reconstruction Acknowledgements: Olga Sorkine-Hornung Geometry Acquisition Pipeline Scanning: results in range images Registration: bring all range images to one coordinate system Stitching/ reconstruction:

More information

Multi-View Stereo for Static and Dynamic Scenes

Multi-View Stereo for Static and Dynamic Scenes Multi-View Stereo for Static and Dynamic Scenes Wolfgang Burgard Jan 6, 2010 Main references Yasutaka Furukawa and Jean Ponce, Accurate, Dense and Robust Multi-View Stereopsis, 2007 C.L. Zitnick, S.B.

More information

Estimation of Surface Spectral Reflectance on 3D. Painted Objects Using a Gonio-Spectral Imaging System

Estimation of Surface Spectral Reflectance on 3D. Painted Objects Using a Gonio-Spectral Imaging System Estimation of Surface Spectral Reflectance on 3D Painted Objects Using a Gonio-Spectral Imaging System Akira Kimachi, Shogo Nishi and Shoji Tominaga Osaka Electro-Communication University, Chiba University

More information

Animation of 3D surfaces

Animation of 3D surfaces Animation of 3D surfaces 2013-14 Motivations When character animation is controlled by skeleton set of hierarchical joints joints oriented by rotations the character shape still needs to be visible: visible

More information

Topic 11: Texture Mapping 10/21/2015. Photographs. Solid textures. Procedural

Topic 11: Texture Mapping 10/21/2015. Photographs. Solid textures. Procedural Topic 11: Texture Mapping Motivation Sources of texture Texture coordinates Bump mapping, mip mapping & env mapping Topic 11: Photographs Texture Mapping Motivation Sources of texture Texture coordinates

More information

Department of Computer Engineering, Middle East Technical University, Ankara, Turkey, TR-06531

Department of Computer Engineering, Middle East Technical University, Ankara, Turkey, TR-06531 INEXPENSIVE AND ROBUST 3D MODEL ACQUISITION SYSTEM FOR THREE-DIMENSIONAL MODELING OF SMALL ARTIFACTS Ulaş Yılmaz, Oğuz Özün, Burçak Otlu, Adem Mulayim, Volkan Atalay {ulas, oguz, burcak, adem, volkan}@ceng.metu.edu.tr

More information

Volumetric Scene Reconstruction from Multiple Views

Volumetric Scene Reconstruction from Multiple Views Volumetric Scene Reconstruction from Multiple Views Chuck Dyer University of Wisconsin dyer@cs cs.wisc.edu www.cs cs.wisc.edu/~dyer Image-Based Scene Reconstruction Goal Automatic construction of photo-realistic

More information

3D Polygon Rendering. Many applications use rendering of 3D polygons with direct illumination

3D Polygon Rendering. Many applications use rendering of 3D polygons with direct illumination Rendering Pipeline 3D Polygon Rendering Many applications use rendering of 3D polygons with direct illumination 3D Polygon Rendering What steps are necessary to utilize spatial coherence while drawing

More information

Render all data necessary into textures Process textures to calculate final image

Render all data necessary into textures Process textures to calculate final image Screenspace Effects Introduction General idea: Render all data necessary into textures Process textures to calculate final image Achievable Effects: Glow/Bloom Depth of field Distortions High dynamic range

More information

Integrating the Generations, FIG Working Week 2008,Stockholm, Sweden June 2008

Integrating the Generations, FIG Working Week 2008,Stockholm, Sweden June 2008 H. Murat Yilmaz, Aksaray University,Turkey Omer Mutluoglu, Selçuk University, Turkey Murat Yakar, Selçuk University,Turkey Cutting and filling volume calculation are important issues in many engineering

More information

Topic 9: Lighting & Reflection models 9/10/2016. Spot the differences. Terminology. Two Components of Illumination. Ambient Light Source

Topic 9: Lighting & Reflection models 9/10/2016. Spot the differences. Terminology. Two Components of Illumination. Ambient Light Source Topic 9: Lighting & Reflection models Lighting & reflection The Phong reflection model diffuse component ambient component specular component Spot the differences Terminology Illumination The transport

More information

Image-based modeling (IBM) and image-based rendering (IBR)

Image-based modeling (IBM) and image-based rendering (IBR) Image-based modeling (IBM) and image-based rendering (IBR) CS 248 - Introduction to Computer Graphics Autumn quarter, 2005 Slides for December 8 lecture The graphics pipeline modeling animation rendering

More information

GRAPHICS TOOLS FOR THE GENERATION OF LARGE SCALE URBAN SCENES

GRAPHICS TOOLS FOR THE GENERATION OF LARGE SCALE URBAN SCENES GRAPHICS TOOLS FOR THE GENERATION OF LARGE SCALE URBAN SCENES Norbert Haala, Martin Kada, Susanne Becker, Jan Böhm, Yahya Alshawabkeh University of Stuttgart, Institute for Photogrammetry, Germany Forename.Lastname@ifp.uni-stuttgart.de

More information

What s new in Solutionix s scanners?

What s new in Solutionix s scanners? SOLUTIONIX 1 What s new in Solutionix s scanners? Solutionix provides fully automated 3D scanning solutions for both small and medium sized objects. With a powerful scan engine and affordable pricing,

More information

Topic 9: Lighting & Reflection models. Lighting & reflection The Phong reflection model diffuse component ambient component specular component

Topic 9: Lighting & Reflection models. Lighting & reflection The Phong reflection model diffuse component ambient component specular component Topic 9: Lighting & Reflection models Lighting & reflection The Phong reflection model diffuse component ambient component specular component Spot the differences Terminology Illumination The transport

More information

Estimating the surface normal of artwork using a DLP projector

Estimating the surface normal of artwork using a DLP projector Estimating the surface normal of artwork using a DLP projector KOICHI TAKASE 1 AND ROY S. BERNS 2 1 TOPPAN Printing co., ltd. 2 Munsell Color Science Laboratory, Rochester Institute of Technology Summary:

More information

Motivation. My General Philosophy. Assumptions. Advanced Computer Graphics (Spring 2013) Precomputation-Based Relighting

Motivation. My General Philosophy. Assumptions. Advanced Computer Graphics (Spring 2013) Precomputation-Based Relighting Advanced Computer Graphics (Spring 2013) CS 283, Lecture 17: Precomputation-Based Real-Time Rendering Ravi Ramamoorthi http://inst.eecs.berkeley.edu/~cs283/sp13 Motivation Previously: seen IBR. Use measured

More information

AUTOMATED 3D MODELING OF URBAN ENVIRONMENTS

AUTOMATED 3D MODELING OF URBAN ENVIRONMENTS AUTOMATED 3D MODELING OF URBAN ENVIRONMENTS Ioannis Stamos Department of Computer Science Hunter College, City University of New York 695 Park Avenue, New York NY 10065 istamos@hunter.cuny.edu http://www.cs.hunter.cuny.edu/

More information

3D Rasterization II COS 426

3D Rasterization II COS 426 3D Rasterization II COS 426 3D Rendering Pipeline (for direct illumination) 3D Primitives Modeling Transformation Lighting Viewing Transformation Projection Transformation Clipping Viewport Transformation

More information

CSE528 Computer Graphics: Theory, Algorithms, and Applications

CSE528 Computer Graphics: Theory, Algorithms, and Applications CSE528 Computer Graphics: Theory, Algorithms, and Applications Hong Qin State University of New York at Stony Brook (Stony Brook University) Stony Brook, New York 11794--4400 Tel: (631)632-8450; Fax: (631)632-8334

More information

3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation.

3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation. 3D Sensing 3D Shape from X Perspective Geometry Camera Model Camera Calibration General Stereo Triangulation 3D Reconstruction 3D Shape from X shading silhouette texture stereo light striping motion mainly

More information

Image Base Rendering: An Introduction

Image Base Rendering: An Introduction Image Base Rendering: An Introduction Cliff Lindsay CS563 Spring 03, WPI 1. Introduction Up to this point, we have focused on showing 3D objects in the form of polygons. This is not the only approach to

More information

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier Computer Vision 2 SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung Computer Vision 2 Dr. Benjamin Guthier 3. HIGH DYNAMIC RANGE Computer Vision 2 Dr. Benjamin Guthier Pixel Value Content of this

More information

Color Alignment in Texture Mapping of Images under Point Light Source and General Lighting Condition

Color Alignment in Texture Mapping of Images under Point Light Source and General Lighting Condition Color Alignment in Texture Mapping of Images under Point Light Source and General Lighting Condition Hiroki Unten Graduate School of Information Science and Technology The University of Tokyo unten@cvliisu-tokyoacjp

More information

View-Dependent Texture Mapping

View-Dependent Texture Mapping 81 Chapter 6 View-Dependent Texture Mapping 6.1 Motivation Once a model of an architectural scene is recovered, the goal is to produce photorealistic renderings. A traditional approach that is consistent

More information

LASER ECHO INTENSITY BASED TEXTURE MAPPING OF 3D SCAN MESH

LASER ECHO INTENSITY BASED TEXTURE MAPPING OF 3D SCAN MESH 22nd CIPA Symposium, October 11-15, 2009, Kyoto, Japan LASER ECHO INTENSITY BASED TEXTURE MAPPING OF 3D SCAN MESH Zhichao ZHANG, Fan ZHANG, Xianfeng HUANG, Deren LI *, Yixuan ZHU, Pingxiang LI State Key

More information

Image Based Rendering

Image Based Rendering Image Based Rendering an overview Photographs We have tools that acquire and tools that display photographs at a convincing quality level 2 1 3 4 2 5 6 3 7 8 4 9 10 5 Photographs We have tools that acquire

More information

Fast and robust techniques for 3D/2D registration and photo blending on massive point clouds

Fast and robust techniques for 3D/2D registration and photo blending on massive point clouds www.crs4.it/vic/ vcg.isti.cnr.it/ Fast and robust techniques for 3D/2D registration and photo blending on massive point clouds R. Pintus, E. Gobbetti, M.Agus, R. Combet CRS4 Visual Computing M. Callieri

More information

Bi-Scale Radiance Transfer

Bi-Scale Radiance Transfer Siggraph 2003 paper: papers_0260, page 1 of 6 Bi-Scale Radiance Transfer Peter-Pike Sloan Xinguo Liu Heung-Yeung Shum John Snyder Microsoft Corporation Microsoft Research Asia Microsoft Research Asia Microsoft

More information

BioTechnology. An Indian Journal FULL PAPER. Trade Science Inc. A wavelet based real-time rendering technology for indoor mixed reality ABSTRACT

BioTechnology. An Indian Journal FULL PAPER. Trade Science Inc. A wavelet based real-time rendering technology for indoor mixed reality ABSTRACT [Type text] [Type text] [Type text] ISSN : 0974-7435 Volume 10 Issue 24 2014 BioTechnology An Indian Journal FULL PAPER BTAIJ, 10(24), 2014 [15095-15100] A wavelet based real-time rendering technology

More information

PHOG:Photometric and geometric functions for textured shape retrieval. Presentation by Eivind Kvissel

PHOG:Photometric and geometric functions for textured shape retrieval. Presentation by Eivind Kvissel PHOG:Photometric and geometric functions for textured shape retrieval Presentation by Eivind Kvissel Introduction This paper is about tackling the issue of textured 3D object retrieval. Thanks to advances

More information

Multi-View 3D-Reconstruction

Multi-View 3D-Reconstruction Multi-View 3D-Reconstruction Slobodan Ilic Computer Aided Medical Procedures (CAMP) Technische Universität München, Germany 1 3D Models Digital copy of real object Allows us to - Inspect details of object

More information

Image Based Lighting with Near Light Sources

Image Based Lighting with Near Light Sources Image Based Lighting with Near Light Sources Shiho Furuya, Takayuki Itoh Graduate School of Humanitics and Sciences, Ochanomizu University E-mail: {shiho, itot}@itolab.is.ocha.ac.jp Abstract Recent some

More information

Image Based Lighting with Near Light Sources

Image Based Lighting with Near Light Sources Image Based Lighting with Near Light Sources Shiho Furuya, Takayuki Itoh Graduate School of Humanitics and Sciences, Ochanomizu University E-mail: {shiho, itot}@itolab.is.ocha.ac.jp Abstract Recent some

More information

AIT Inline Computational Imaging: Geometric calibration and image rectification

AIT Inline Computational Imaging: Geometric calibration and image rectification AIT Inline Computational Imaging: Geometric calibration and image rectification B. Blaschitz, S. Štolc and S. Breuss AIT Austrian Institute of Technology GmbH Center for Vision, Automation & Control Vienna,

More information

Metadata Requirements for Digital Museum Environments

Metadata Requirements for Digital Museum Environments Metadata Requirements for Digital Museum Environments Manjula Patel UKOLN, University of Bath m.patel@ukoln.ac.uk Unless otherwise stated this work is licensed under a Creative Commons Attribution-ShareAlike

More information

Digitizing the Parthenon: Estimating Surface Reflectance under Measured Natural Illumination

Digitizing the Parthenon: Estimating Surface Reflectance under Measured Natural Illumination 6 Digitizing the Parthenon: Estimating Surface Reflectance under Measured Natural Illumination Paul Debevec, Chris Tchou, Andrew Gardner, Tim Hawkins, Charis Poullis, Jessi Stumpfel, Andrew Jones, Nathaniel

More information

5 member consortium o University of Strathclyde o Wideblue o National Nuclear Laboratory o Sellafield Ltd o Inspectahire

5 member consortium o University of Strathclyde o Wideblue o National Nuclear Laboratory o Sellafield Ltd o Inspectahire 3 year, 1.24M Innovate UK funded Collaborative Research and Development Project (Nuclear Call) o Commenced April 2015 o Follows on from a successful 6 month Innovate UK funded feasibility study 2013-2014

More information

An Automatic Hole Filling Method of Point Cloud for 3D Scanning

An Automatic Hole Filling Method of Point Cloud for 3D Scanning An Automatic Hole Filling Method of Point Cloud for 3D Scanning Yuta MURAKI Osaka Institute of Technology Osaka, Japan yuta.muraki@oit.ac.jp Koji NISHIO Osaka Institute of Technology Osaka, Japan koji.a.nishio@oit.ac.jp

More information

Image-Based Reconstruction of Spatial Appearance and Geometric Detail

Image-Based Reconstruction of Spatial Appearance and Geometric Detail Image-Based Reconstruction of Spatial Appearance and Geometric Detail HENDRIK P. A. LENSCH, JAN KAUTZ and MICHAEL GOESELE Max-Planck-Institut für Informatik and WOLFGANG HEIDRICH The University of British

More information

Chapter IV Fragment Processing and Output Merging. 3D Graphics for Game Programming

Chapter IV Fragment Processing and Output Merging. 3D Graphics for Game Programming Chapter IV Fragment Processing and Output Merging Fragment Processing The per-fragment attributes may include a normal vector, a set of texture coordinates, a set of color values, a depth, etc. Using these

More information

2D rendering takes a photo of the 2D scene with a virtual camera that selects an axis aligned rectangle from the scene. The photograph is placed into

2D rendering takes a photo of the 2D scene with a virtual camera that selects an axis aligned rectangle from the scene. The photograph is placed into 2D rendering takes a photo of the 2D scene with a virtual camera that selects an axis aligned rectangle from the scene. The photograph is placed into the viewport of the current application window. A pixel

More information

What is visualization? Why is it important?

What is visualization? Why is it important? What is visualization? Why is it important? What does visualization do? What is the difference between scientific data and information data Cycle of Visualization Storage De noising/filtering Down sampling

More information

Computer Graphics. Lecture 8 Antialiasing, Texture Mapping

Computer Graphics. Lecture 8 Antialiasing, Texture Mapping Computer Graphics Lecture 8 Antialiasing, Texture Mapping Today Texture mapping Antialiasing Antialiasing-textures Texture Mapping : Why needed? Adding details using high resolution polygon meshes is costly

More information

What is visualization? Why is it important?

What is visualization? Why is it important? What is visualization? Why is it important? What does visualization do? What is the difference between scientific data and information data Visualization Pipeline Visualization Pipeline Overview Data acquisition

More information

Automatic 3-D 3 D Model Acquisition from Range Images. Michael K. Reed and Peter K. Allen Computer Science Department Columbia University

Automatic 3-D 3 D Model Acquisition from Range Images. Michael K. Reed and Peter K. Allen Computer Science Department Columbia University Automatic 3-D 3 D Model Acquisition from Range Images Michael K. Reed and Peter K. Allen Computer Science Department Columbia University Introduction Objective: given an arbitrary object or scene, construct

More information

IMAGE-BASED RENDERING AND ANIMATION

IMAGE-BASED RENDERING AND ANIMATION DH2323 DGI17 INTRODUCTION TO COMPUTER GRAPHICS AND INTERACTION IMAGE-BASED RENDERING AND ANIMATION Christopher Peters CST, KTH Royal Institute of Technology, Sweden chpeters@kth.se http://kth.academia.edu/christopheredwardpeters

More information

6.837 Introduction to Computer Graphics Quiz 2 Thursday November 20, :40-4pm One hand-written sheet of notes allowed

6.837 Introduction to Computer Graphics Quiz 2 Thursday November 20, :40-4pm One hand-written sheet of notes allowed 6.837 Introduction to Computer Graphics Quiz 2 Thursday November 20, 2003 2:40-4pm One hand-written sheet of notes allowed Name: 1 2 3 4 5 6 7 / 4 / 15 / 5 / 5 / 12 / 2 / 7 Total / 50 1 Animation [ /4]

More information

Mach band effect. The Mach band effect increases the visual unpleasant representation of curved surface using flat shading.

Mach band effect. The Mach band effect increases the visual unpleasant representation of curved surface using flat shading. Mach band effect The Mach band effect increases the visual unpleasant representation of curved surface using flat shading. A B 320322: Graphics and Visualization 456 Mach band effect The Mach band effect

More information

Rendering Synthetic Objects into Real Scenes. based on [Debevec98]

Rendering Synthetic Objects into Real Scenes. based on [Debevec98] Rendering Synthetic Objects into Real Scenes based on [Debevec98] Compositing of synthetic objects Geometry consistency needed: geometric model of synthetic objects needed: (coarse) geometric model of

More information

Multiple View Geometry

Multiple View Geometry Multiple View Geometry CS 6320, Spring 2013 Guest Lecture Marcel Prastawa adapted from Pollefeys, Shah, and Zisserman Single view computer vision Projective actions of cameras Camera callibration Photometric

More information

Processing 3D Surface Data

Processing 3D Surface Data Processing 3D Surface Data Computer Animation and Visualisation Lecture 15 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing

More information

COMET 5 3D DIGITIZING

COMET 5 3D DIGITIZING COMET 5 3D DIGITIZING 2 COMET 5: THE 3D SENSOR REFERENCE 3D digitizing in revolutionary shape: With the COMET5 sensor, Steinbichler Optotechnik is presenting a system perfectly fitting the steadily growing

More information

Realistic Human Head Modeling with Multi-view Hairstyle Reconstruction

Realistic Human Head Modeling with Multi-view Hairstyle Reconstruction Realistic Human Head Modeling with Multi-view Hairstyle Reconstruction Xiaolan Li and Hongbin Zha ational Laboratory on Machine Perception, Peing University 100871, Beiing, P.R.China Email: {lixlan,zha}@cis.pu.edu.cn

More information

Rasterization Overview

Rasterization Overview Rendering Overview The process of generating an image given a virtual camera objects light sources Various techniques rasterization (topic of this course) raytracing (topic of the course Advanced Computer

More information

3D Reconstruction from Scene Knowledge

3D Reconstruction from Scene Knowledge Multiple-View Reconstruction from Scene Knowledge 3D Reconstruction from Scene Knowledge SYMMETRY & MULTIPLE-VIEW GEOMETRY Fundamental types of symmetry Equivalent views Symmetry based reconstruction MUTIPLE-VIEW

More information

Presented at the FIG Congress 2018, May 6-11, 2018 in Istanbul, Turkey

Presented at the FIG Congress 2018, May 6-11, 2018 in Istanbul, Turkey Presented at the FIG Congress 2018, May 6-11, 2018 in Istanbul, Turkey Evangelos MALTEZOS, Charalabos IOANNIDIS, Anastasios DOULAMIS and Nikolaos DOULAMIS Laboratory of Photogrammetry, School of Rural

More information

Making Machines See. Roberto Cipolla Department of Engineering. Research team

Making Machines See. Roberto Cipolla Department of Engineering. Research team Making Machines See Roberto Cipolla Department of Engineering Research team http://www.eng.cam.ac.uk/~cipolla/people.html Cognitive Systems Engineering Cognitive Systems Engineering Introduction Making

More information

Image-Based Modeling and Rendering

Image-Based Modeling and Rendering Image-Based Modeling and Rendering Richard Szeliski Microsoft Research IPAM Graduate Summer School: Computer Vision July 26, 2013 How far have we come? Light Fields / Lumigraph - 1996 Richard Szeliski

More information

Radiosity. Johns Hopkins Department of Computer Science Course : Rendering Techniques, Professor: Jonathan Cohen

Radiosity. Johns Hopkins Department of Computer Science Course : Rendering Techniques, Professor: Jonathan Cohen Radiosity Radiosity Concept Global computation of diffuse interreflections among scene objects Diffuse lighting changes fairly slowly across a surface Break surfaces up into some number of patches Assume

More information

Overview. Radiometry and Photometry. Foundations of Computer Graphics (Spring 2012)

Overview. Radiometry and Photometry. Foundations of Computer Graphics (Spring 2012) Foundations of Computer Graphics (Spring 2012) CS 184, Lecture 21: Radiometry http://inst.eecs.berkeley.edu/~cs184 Overview Lighting and shading key in computer graphics HW 2 etc. ad-hoc shading models,

More information

Virtual Reality Model of Koumokuten Generated from Measurement

Virtual Reality Model of Koumokuten Generated from Measurement Virtual Reality Model of Koumokuten Generated from Measurement Hiroki UNTEN Graduate School of Information Science and Technology The University of Tokyo unten@cvl.iis.u-tokyo.ac.jp Katsushi IKEUCHI Graduate

More information

Polyhedral Visual Hulls for Real-Time Rendering

Polyhedral Visual Hulls for Real-Time Rendering Polyhedral Visual Hulls for Real-Time Rendering Wojciech Matusik Chris Buehler Leonard McMillan MIT Laboratory for Computer Science Abstract. We present new algorithms for creating and rendering visual

More information

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter

More information