Large Scale and In Situ Visualization
|
|
|
- Sharleen Elliott
- 5 years ago
- Views:
Transcription
1 Large Scale and In Situ Visualization Today s Class Definition of In Situ (for Computer Science) SpatioTemporal Definition & Examples Random Graphics Topic: Light Field Rendering Readings for Today An Image-based Approach to Extreme Scale In Situ Visualization and Analysis Globe Browsing: Contextualized Spatio-Temporal Planetary Surface Visualization Readings for Tuesday Leftover from last time...
2 in situ definition: in its original place, on site, in position, locally, in place In computer science: An in situ operation is one that occurs without interrupting the normal state of a system Without taking the system down, while still running, without rebooting In place algorithm (no extra memory) UI: without going to another window For Big Data: Doing computation where the data is located [ From ] Semotus Visum: A Flexible Remote Visualization Framework, Luke & Hansen, IEEE Visualization 2002 A Review of Image-based Rendering Techniques Shum & Kang, Visual Communication & Image Processing
3 Today s Class Definition of In Situ (for Computer Science) SpatioTemporal Definition & Examples Random Graphics Topic: Light Field Rendering Readings for Today An Image-based Approach to Extreme Scale In Situ Visualization and Analysis Globe Browsing: Contextualized Spatio-Temporal Planetary Surface Visualization Readings for Tuesday Leftover from last time... Spatiotemporal (Databases) both space and time information. Examples: Tracking of moving objects, which typically can occupy only a single position at a given time A database of wireless communication networks, which may exist only for a short timespan within a geographic region An index of species in a given geographic region, where over time additional species may be introduced or existing species migrate or die out Historical tracking of plate tectonic activity Not just an extension of spatial data. Specifically includes geometry changing over time and/or location of objects moving over invariant geometry (known variously as moving objects databases or real-time locating systems) From:
4 Architectural Daylighting Design: The use of windows and reflective surfaces to allow natural light from the sun and sky to provide effective and interesting internal illumination. Residential design proposal by Mark Cabrinha Daylighting Challenges Daily & Seasonal variations Discomfort/Disability Glare: too much contrast reduces visibility
5 Measuring the Dynamics of Contrast & Daylight Variability in Architecture: A Proof of Concept Methodology Rockcastle & Andersen Graphical Representation of Climate-Based Daylight Performance to Support Architectural Design Kleindienst, Bodart, & Andersen Motivation Detect direct illumination on sensitive objects (artwork, chalkboard, tv, etc.) Detect under-illumination (artificial light needed) What is correct sampling frequency? 56 moments 8 days of the year 7 times of the day Visualization Requirements: Show min & max & average lighting in each day/timespan (~45 days & ~ 2 hours) How? Animation: full year, or range of hours for usage, multiple windows for day, animation of a day, play it on a loop, bin into common image features, sliders for 3 axes (day/time/weather)
6 Today s Class Definition of In Situ (for Computer Science) SpatioTemporal Definition & Examples Random Graphics Topic: Light Field Rendering Readings for Today An Image-based Approach to Extreme Scale In Situ Visualization and Analysis Globe Browsing: Contextualized Spatio-Temporal Planetary Surface Visualization Readings for Tuesday Leftover from last time... Layered Depth Images, Shade, Gortler, Hey, & Szeliski, SIGGRAPH 1998 Place resulting sprites at different depths. Move the camera, appears 3D!
7 Light Fields Plenoptic Modeling: An ImageBased Rendering System, McMillan & Bishop, SIGGRAPH 1995 Dynamically reparameterized light fields, Isaksen, McMillan, & Gortler, SIGGRAPH 2000 Unstructured Lumigraph Rendering Buehler et al. SIGGRAPH 2001 Light Field Rendering, Levoy & Hanrahan, SIGGRAPH 1996
8 Unstructured Lumigraph Rendering Buehler et al. SIGGRAPH 2001 Video at: Light Field Camera After taking the photograph, we can: Adjust focus Change viewpoint Change illumination & more? Light Field Photography with a Hand-Held Plenoptic Camera, Ng, Levoy, Bredif, Duval, Horowitz, & Hanrahan, Stanford Tech Report, 2005
9 Today s Class Definition of In Situ (for Computer Science) SpatioTemporal Definition & Examples Random Graphics Topic: Light Field Rendering Readings for Today An Image-based Approach to Extreme Scale In Situ Visualization and Analysis Globe Browsing: Contextualized Spatio-Temporal Planetary Surface Visualization Readings for Tuesday Leftover from last time... Readings for Today "An Image-based Approach to Extreme Scale In Situ Visualization and Analysis, Ahrens, Patchett, Jourdain, Rogers, O'Leary, & Petersen, Supercomputing 2014
10 Motivation: power & I/O constraints Without in situ: write huge files to disk (size:?), then later input those files for interactive exploratory visualization & analysis However, storage bandwidth is significantly falling behind processing power & data generation Instead: compute & save many images to disk (size: 1 image 106, set of images 24 TB=1013), then later explore & analyze by viewing those images interactively Preserve important elements from simulations Significantly reduce data needed Be flexible for post-processing interactive exploration Perform predefined (by expert scientist) set of analyses & predefined data bounds of interest (Rarely) make automated decisions about what visualization & analyses to perform Requirements/Features Animation & Selection of objects Control over Camera & Time Temporal exploration encouraged Responsive, Interactive System (constant time retrieval & assembly/compositing of images) Computationally intensive analyses (precomputed) encouraged Enables Metadata Searching Image-based visual queries prioritize exploration of matching results Provides interface for scientists to make decisions for the production of this in situ visualization
11 When designing in situ visualization (preprocess) use Paraview provides cost estimate (# of images, total size of image dataset, time to produce) No penalty/disincentive/bias against exploring expensive visualizations, because they have already been computed and saved as images Query image database for all images that match XXX, then sort by YYY Where is the largest visible mass of low salinity in the northern hemisphere? What is the best view? Compositing allows user to reason about simulation results from visualization space, not just image space rendering & sampling Interactive tool for displaying & compositing items from the image database with interface very similar to Paraview simulates experience of exploring simulation data Interactive, at least 12 fps (surprisingly slow? What s the bottleneck? Could some quality be sacrificed for speed?) Data saved per image for compositing (2X normal image) color (rgb) + depth (z-buffer) sprite layers For opaque layers: save simulation data (geometry?) which allows recoloring/relighting Image provenance (how image was created, parameters, etc.) Images can be compressed into video format
12 Well-written, good illustrations Good motivation & good explanation of features but lacked detail on how things worked Impressive use of real-world datasets Niche but critical audience for this tool How powerful are their camera settings? Can you rotate about an arbitrary point or limited to the initially chosen rotation center? What hardware is needed to run the simulation? A supercomputer. What hardware is needed to analyze/visualize the resulting data? A fancy desktop or a supercomputer What hardware is needed to display/composite the pre-generated visualization images? A fancy desktop Image based (feature based) search of simulation results is inspiring for my final project MPAS: Model for Predication Across Scales 24 TB, 215 is reasonable. Impressive. Ridiculous. Each image 1 MB. Will increasing the image size help scientists better explore the data? Or is this the limit of the simulation resolution? Today s Class Definition of In Situ (for Computer Science) SpatioTemporal Definition & Examples Random Graphics Topic: Light Field Rendering Readings for Today An Image-based Approach to Extreme Scale In Situ Visualization and Analysis Globe Browsing: Contextualized Spatio-Temporal Planetary Surface Visualization Readings for Tuesday Leftover from last time...
13 Reading for Friday (pick one) Globe Browsing: Contextualized Spatio-Temporal Planetary Surface Visualization, Bladin, Axelsson, Broberg, Emmart, Ljung, Bock, & Ynnerman, IEEE SciVis 2017 Challenges in astrovisualization: extreme distances Sensing/Imaging from orbiting or non-orbiting spacecraft Planetary atmosphere Resolution: Earth&Mars: 240 m/pixel, Pluto 161km/pixel->1km/pixel->50m/pixel all data must be images, convert meters into degrees LOD: Level of detail
14 Today s Class Definition of In Situ (for Computer Science) SpatioTemporal Definition & Examples Random Graphics Topic: Light Field Rendering Readings for Today An Image-based Approach to Extreme Scale In Situ Visualization and Analysis Globe Browsing: Contextualized Spatio-Temporal Planetary Surface Visualization Readings for Tuesday Leftover from last time... Reading for Tuesday (pick one) DimpVis: Exploring Time-varying Information Visualizations by Direct Manipulation, Kondo and Collins, IEEE Visualization 2014
15 Reading for Tuesday (pick one) Visualization, Selection, and Analysis of Traffic Flows, Scheepens, Hurter, van de Wetering, van Wijk, IEEE InfoVis 2015 Today s Class Definition of In Situ (for Computer Science) SpatioTemporal Definition & Examples Random Graphics Topic: Light Field Rendering Readings for Today An Image-based Approach to Extreme Scale In Situ Visualization and Analysis Globe Browsing: Contextualized Spatio-Temporal Planetary Surface Visualization Readings for Tuesday Leftover from last time...
16 Jones, B., Sodhi, R., Murdock, M., Mehra, R., Benko, H., Wilson, A. D., Ofek, E., MacIntyre, B., Shapira, L. RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera Units. ACM UIST, Interaction Technology Applications? Implementation Challenges? Well controlled environment? Non white colored walls/furniture/clothes? Works best in big empty white walled rooms. Disorienting? Danger of looking into projector? Less nauseating than VR (for people who can t handle VR)? VR -> AR -> spatially-augmented reality (SAR) Low maintenance cave What is the perspective view? For just one person, or ok for many people? Low resolution? Hot & noisy projectors
17 Interaction Technology Applications? Implementation Challenges? Color compensation? Non white surfaces? Can t move furniture after calibration Windows & different lighting? How accurate is the touch? How adaptable to odd shaped rooms, partial rooms? Audio is surround sound necessary, will it add something, make more immersive, what if target audience member is moving, multiple people Seems expensive, power, not home use, but permanent installation charge admission Interactive puzzle experience, group, solve riddles (escape the room), adding augmented reality would be interesting How does perspective work for multiple viewers for synthetic 3d objects? Dynamic Projection Surfaces for Immersive Visualization Theodore C. Yapo, Yu Sheng, Joshua Nasman, Andrew Dolce, Eric Li, and Barbara Cutler PROCAMS 2010 IEEE International Workshop on Projector-Camera Systems, June 2010
18 Our System Goals/Requirements Large, human-scale projection environment People move freely within the space Projection surfaces can be moved interactively Varying illumination conditions Robust & real-time tracking and display Architectural Daylighting Design Windows, wall colors, & time of day controlled through itouch interface
19 Volumetric Visualization Cross sections of a 3D medical dataset virtually placed within the projection volume General User Interface Elements Projection surfaces as input devices No instruction necessary to play the game!
20 Panorama from Gehua Yang, DualAlign
Computational Photography
End of Semester is the last lecture of new material Quiz on Friday 4/30 Sample problems are posted on website Computational Photography Final Project Presentations Wednesday May 12 1-5pm, CII 4040 Attendance
But, vision technology falls short. and so does graphics. Image Based Rendering. Ray. Constant radiance. time is fixed. 3D position 2D direction
Computer Graphics -based rendering Output Michael F. Cohen Microsoft Research Synthetic Camera Model Computer Vision Combined Output Output Model Real Scene Synthetic Camera Model Real Cameras Real Scene
Modeling Light. Michal Havlik : Computational Photography Alexei Efros, CMU, Fall 2007
Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 The Plenoptic Function Figure by Leonard McMillan Q: What is the set of all things that we can ever see? A: The
Morphable 3D-Mosaics: a Hybrid Framework for Photorealistic Walkthroughs of Large Natural Environments
Morphable 3D-Mosaics: a Hybrid Framework for Photorealistic Walkthroughs of Large Natural Environments Nikos Komodakis and Georgios Tziritas Computer Science Department, University of Crete E-mails: {komod,
Today s Class. Interac.on & Picking. Simplicity. Real 3D Coordinates 9/15/10
9/15/10 Interac.on & Picking Mary DeVarney Real 3D Coordinates Simplicity William Fergus Chris Stuetzle Andrew Dolce Evan Sullivan Density of Informa.on? Importance of Labels? Tricks to Visualizing Mul.ple
Real Time Rendering. CS 563 Advanced Topics in Computer Graphics. Songxiang Gu Jan, 31, 2005
Real Time Rendering CS 563 Advanced Topics in Computer Graphics Songxiang Gu Jan, 31, 2005 Introduction Polygon based rendering Phong modeling Texture mapping Opengl, Directx Point based rendering VTK
VIDEO FOR VIRTUAL REALITY LIGHT FIELD BASICS JAMES TOMPKIN
VIDEO FOR VIRTUAL REALITY LIGHT FIELD BASICS JAMES TOMPKIN WHAT IS A LIGHT FIELD? Light field seems to have turned into a catch-all term for many advanced camera/display technologies. WHAT IS A LIGHT FIELD?
Image-based modeling (IBM) and image-based rendering (IBR)
Image-based modeling (IBM) and image-based rendering (IBR) CS 248 - Introduction to Computer Graphics Autumn quarter, 2005 Slides for December 8 lecture The graphics pipeline modeling animation rendering
Modeling Light. Michal Havlik
Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Spring 2010 What is light? Electromagnetic radiation (EMR) moving along rays in space R( ) is EMR, measured in units of
Modeling Light. Slides from Alexei A. Efros and others
Project 3 Results http://www.cs.brown.edu/courses/cs129/results/proj3/jcmace/ http://www.cs.brown.edu/courses/cs129/results/proj3/damoreno/ http://www.cs.brown.edu/courses/cs129/results/proj3/taox/ Stereo
CSc Topics in Computer Graphics 3D Photography
CSc 83010 Topics in Computer Graphics 3D Photography Tuesdays 11:45-1:45 1:45 Room 3305 Ioannis Stamos istamos@hunter.cuny.edu Office: 1090F, Hunter North (Entrance at 69 th bw/ / Park and Lexington Avenues)
Modeling Light. Michal Havlik : Computational Photography Alexei Efros, CMU, Fall 2011
Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Fall 2011 What is light? Electromagnetic radiation (EMR) moving along rays in space R(λ) is EMR, measured in units of power
Image Base Rendering: An Introduction
Image Base Rendering: An Introduction Cliff Lindsay CS563 Spring 03, WPI 1. Introduction Up to this point, we have focused on showing 3D objects in the form of polygons. This is not the only approach to
More and More on Light Fields. Last Lecture
More and More on Light Fields Topics in Image-Based Modeling and Rendering CSE291 J00 Lecture 4 Last Lecture Re-review with emphasis on radiometry Mosaics & Quicktime VR The Plenoptic function The main
A million pixels, a million polygons. Which is heavier? François X. Sillion. imagis* Grenoble, France
A million pixels, a million polygons. Which is heavier? François X. Sillion imagis* Grenoble, France *A joint research project of CNRS, INRIA, INPG and UJF MAGIS Why this question? Evolution of processing
Image-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about
Image-Based Modeling and Rendering Image-Based Modeling and Rendering MIT EECS 6.837 Frédo Durand and Seth Teller 1 Some slides courtesy of Leonard McMillan, Wojciech Matusik, Byong Mok Oh, Max Chen 2
Modeling Light. Michal Havlik
Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 What is light? Electromagnetic radiation (EMR) moving along rays in space R(λ) is EMR, measured in units of power
Plenoptic camera and its Applications
Aum Sri Sairam Plenoptic camera and its Applications Agenda: 1. Introduction 2. Single lens stereo design 3. Plenoptic camera design 4. Depth estimation 5. Synthetic refocusing 6. Fourier slicing 7. References
A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction
A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction Jaemin Lee and Ergun Akleman Visualization Sciences Program Texas A&M University Abstract In this paper we present a practical
CS 684 Fall 2005 Image-based Modeling and Rendering. Ruigang Yang
CS 684 Fall 2005 Image-based Modeling and Rendering Ruigang Yang Administrivia Classes: Monday and Wednesday, 4:00-5:15 PM Instructor: Ruigang Yang ryang@cs.uky.edu Office Hour: Robotics 514D, MW 1500-1600
Image-Based Rendering. Johns Hopkins Department of Computer Science Course : Rendering Techniques, Professor: Jonathan Cohen
Image-Based Rendering Image-Based Rendering What is it? Still a difficult question to answer Uses images (photometric( info) as key component of model representation What s Good about IBR Model acquisition
Jingyi Yu CISC 849. Department of Computer and Information Science
Digital Photography and Videos Jingyi Yu CISC 849 Light Fields, Lumigraph, and Image-based Rendering Pinhole Camera A camera captures a set of rays A pinhole camera captures a set of rays passing through
Viscous Fingers: A topological Visual Analytic Approach
Viscous Fingers: A topological Visual Analytic Approach Jonas Lukasczyk University of Kaiserslautern Germany Bernd Hamann University of California Davis, U.S.A. Garrett Aldrich Univeristy of California
Capturing and View-Dependent Rendering of Billboard Models
Capturing and View-Dependent Rendering of Billboard Models Oliver Le, Anusheel Bhushan, Pablo Diaz-Gutierrez and M. Gopi Computer Graphics Lab University of California, Irvine Abstract. In this paper,
Georgios Tziritas Computer Science Department
New Video Coding standards MPEG-4, HEVC Georgios Tziritas Computer Science Department http://www.csd.uoc.gr/~tziritas 1 MPEG-4 : introduction Motion Picture Expert Group Publication 1998 (Intern. Standardization
Image-Based Deformation of Objects in Real Scenes
Image-Based Deformation of Objects in Real Scenes Han-Vit Chung and In-Kwon Lee Dept. of Computer Science, Yonsei University sharpguy@cs.yonsei.ac.kr, iklee@yonsei.ac.kr Abstract. We present a new method
View Synthesis for Multiview Video Compression
View Synthesis for Multiview Video Compression Emin Martinian, Alexander Behrens, Jun Xin, and Anthony Vetro email:{martinian,jxin,avetro}@merl.com, behrens@tnt.uni-hannover.de Mitsubishi Electric Research
Light Fields. Johns Hopkins Department of Computer Science Course : Rendering Techniques, Professor: Jonathan Cohen
Light Fields Light Fields By Levoy and Hanrahan, SIGGRAPH 96 Representation for sampled plenoptic function stores data about visible light at various positions and directions Created from set of images
Hybrid Rendering for Collaborative, Immersive Virtual Environments
Hybrid Rendering for Collaborative, Immersive Virtual Environments Stephan Würmlin wuermlin@inf.ethz.ch Outline! Rendering techniques GBR, IBR and HR! From images to models! Novel view generation! Putting
Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images
Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images Abstract This paper presents a new method to generate and present arbitrarily
Image-Based Rendering
Image-Based Rendering COS 526, Fall 2016 Thomas Funkhouser Acknowledgments: Dan Aliaga, Marc Levoy, Szymon Rusinkiewicz What is Image-Based Rendering? Definition 1: the use of photographic imagery to overcome
Image-Based Modeling and Rendering
Traditional Computer Graphics Image-Based Modeling and Rendering Thomas Funkhouser Princeton University COS 426 Guest Lecture Spring 2003 How would you model and render this scene? (Jensen) How about this
ICS RESEARCH TECHNICAL TALK DRAKE TETREAULT, ICS H197 FALL 2013
ICS RESEARCH TECHNICAL TALK DRAKE TETREAULT, ICS H197 FALL 2013 TOPIC: RESEARCH PAPER Title: Data Management for SSDs for Large-Scale Interactive Graphics Applications Authors: M. Gopi, Behzad Sajadi,
Image-based rendering using plane-sweeping modelisation
Author manuscript, published in "IAPR Machine Vision and Applications MVA2005, Japan (2005)" Image-based rendering using plane-sweeping modelisation Vincent Nozick, Sylvain Michelin and Didier Arquès Marne
3-D Shape Reconstruction from Light Fields Using Voxel Back-Projection
3-D Shape Reconstruction from Light Fields Using Voxel Back-Projection Peter Eisert, Eckehard Steinbach, and Bernd Girod Telecommunications Laboratory, University of Erlangen-Nuremberg Cauerstrasse 7,
Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping
Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping Paul Debevec, Yizhou Yu, and George Borshukov Univeristy of California at Berkeley debevec@cs.berkeley.edu Abstract. This
Traditional Image Generation. Reflectance Fields. The Light Field. The Light Field. The Light Field. The Light Field
Traditional Image Generation Course 10 Realistic Materials in Computer Graphics Surfaces + BRDFs Reflectance Fields USC Institute for Creative Technologies Volumetric scattering, density fields, phase
A million pixels, a million polygons: which is heavier?
A million pixels, a million polygons: which is heavier? François X. Sillion To cite this version: François X. Sillion. A million pixels, a million polygons: which is heavier?. Eurographics 97, Sep 1997,
The Light Field and Image-Based Rendering
Lecture 11: The Light Field and Image-Based Rendering Visual Computing Systems Demo (movie) Royal Palace: Madrid, Spain Image-based rendering (IBR) So far in course: rendering = synthesizing an image from
Multimedia Technology CHAPTER 4. Video and Animation
CHAPTER 4 Video and Animation - Both video and animation give us a sense of motion. They exploit some properties of human eye s ability of viewing pictures. - Motion video is the element of multimedia
3D Photography: Active Ranging, Structured Light, ICP
3D Photography: Active Ranging, Structured Light, ICP Kalin Kolev, Marc Pollefeys Spring 2013 http://cvg.ethz.ch/teaching/2013spring/3dphoto/ Schedule (tentative) Feb 18 Feb 25 Mar 4 Mar 11 Mar 18 Mar
V-RAY 3.6 FOR RHINO KEY FEATURES. January 2018
V-RAY 3.6 FOR RHINO KEY FEATURES January 2018 NEW FEATURES MORE POWERFUL GPU RENDERING Faster, more powerful GPU rendering adds support for on-demand mip-mapping, aerial perspective, displacement, subsurface
Image-Based Rendering. Johns Hopkins Department of Computer Science Course : Rendering Techniques, Professor: Jonathan Cohen
Image-Based Rendering Image-Based Rendering What is it? Still a difficult question to answer Uses images (photometric( info) as key component of model representation What s Good about IBR Model acquisition
Real-Time Video-Based Rendering from Multiple Cameras
Real-Time Video-Based Rendering from Multiple Cameras Vincent Nozick Hideo Saito Graduate School of Science and Technology, Keio University, Japan E-mail: {nozick,saito}@ozawa.ics.keio.ac.jp Abstract In
Course Recap + 3D Graphics on Mobile GPUs
Lecture 18: Course Recap + 3D Graphics on Mobile GPUs Interactive Computer Graphics Q. What is a big concern in mobile computing? A. Power Two reasons to save power Run at higher performance for a fixed
Optimizing and Profiling Unity Games for Mobile Platforms. Angelo Theodorou Senior Software Engineer, MPG Gamelab 2014, 25 th -27 th June
Optimizing and Profiling Unity Games for Mobile Platforms Angelo Theodorou Senior Software Engineer, MPG Gamelab 2014, 25 th -27 th June 1 Agenda Introduction ARM and the presenter Preliminary knowledge
Designing a Self-Calibrating Pipeline for Projection Mapping Application. Kevin Wright Kevin Moule
Designing a Self-Calibrating Pipeline for Projection Mapping Application Kevin Wright Kevin Moule 2 Who we are Kevin Wright Director of the Application Software group at Christie responsible for developing
Volumetric Scene Reconstruction from Multiple Views
Volumetric Scene Reconstruction from Multiple Views Chuck Dyer University of Wisconsin dyer@cs cs.wisc.edu www.cs cs.wisc.edu/~dyer Image-Based Scene Reconstruction Goal Automatic construction of photo-realistic
Rate-distortion Optimized Streaming of Compressed Light Fields with Multiple Representations
Rate-distortion Optimized Streaming of Compressed Light Fields with Multiple Representations Prashant Ramanathan and Bernd Girod Department of Electrical Engineering Stanford University Stanford CA 945
Image-Based Rendering and Light Fields
CS194-13: Advanced Computer Graphics Lecture #9 Image-Based Rendering University of California Berkeley Image-Based Rendering and Light Fields Lecture #9: Wednesday, September 30th 2009 Lecturer: Ravi
Image Based Lighting with Near Light Sources
Image Based Lighting with Near Light Sources Shiho Furuya, Takayuki Itoh Graduate School of Humanitics and Sciences, Ochanomizu University E-mail: {shiho, itot}@itolab.is.ocha.ac.jp Abstract Recent some
Image Based Lighting with Near Light Sources
Image Based Lighting with Near Light Sources Shiho Furuya, Takayuki Itoh Graduate School of Humanitics and Sciences, Ochanomizu University E-mail: {shiho, itot}@itolab.is.ocha.ac.jp Abstract Recent some
Image-Based Modeling and Rendering
Image-Based Modeling and Rendering Richard Szeliski Microsoft Research IPAM Graduate Summer School: Computer Vision July 26, 2013 How far have we come? Light Fields / Lumigraph - 1996 Richard Szeliski
ImageVis3D User's Manual
ImageVis3D User's Manual 1 1. The current state of ImageVis3D Remember : 1. If ImageVis3D causes any kind of trouble, please report this to us! 2. We are still in the process of adding features to the
Lecture 19: Depth Cameras. Visual Computing Systems CMU , Fall 2013
Lecture 19: Depth Cameras Visual Computing Systems Continuing theme: computational photography Cameras capture light, then extensive processing produces the desired image Today: - Capturing scene depth
Lead Discovery 5.2. User Guide. Powered by TIBCO Spotfire
User Guide Powered by TIBCO Spotfire Last Modified: July 26, 2013 Table of Contents 1. Introduction... 5 2. Loading Data... 6 2.1. Opening an SDFile... 6 2.2. Importing a ChemDraw for Excel File... 6 2.3.
View Synthesis for Multiview Video Compression
MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com View Synthesis for Multiview Video Compression Emin Martinian, Alexander Behrens, Jun Xin, and Anthony Vetro TR2006-035 April 2006 Abstract
WATERMARKING FOR LIGHT FIELD RENDERING 1
ATERMARKING FOR LIGHT FIELD RENDERING 1 Alper Koz, Cevahir Çığla and A. Aydın Alatan Department of Electrical and Electronics Engineering, METU Balgat, 06531, Ankara, TURKEY. e-mail: koz@metu.edu.tr, cevahir@eee.metu.edu.tr,
CSCI 1290: Comp Photo
CSCI 1290: Comp Photo Fall 2018 @ Brown University James Tompkin Many slides thanks to James Hays old CS 129 course, along with all of its acknowledgements. What do we see? 3D world 2D image Point of observation
What have we leaned so far?
What have we leaned so far? Camera structure Eye structure Project 1: High Dynamic Range Imaging What have we learned so far? Image Filtering Image Warping Camera Projection Model Project 2: Panoramic
MPEG 기반 AR 표준화현황. 건국대학교컴퓨터공학부윤경로 (yoonk_at_konkuk.ac.kr)
MPEG 기반 AR 표준화현황 건국대학교컴퓨터공학부윤경로 (yoonk_at_konkuk.ac.kr) CONTENTS Background of MPEG Status of MPEG-AR activities AR from MPEG s view AR Application Format (23000-13) AR Reference Model (23000-14) Use Cases
3D Photography: Stereo
3D Photography: Stereo Marc Pollefeys, Torsten Sattler Spring 2016 http://www.cvg.ethz.ch/teaching/3dvision/ 3D Modeling with Depth Sensors Today s class Obtaining depth maps / range images unstructured
A Thin-Client Approach for Porting OpenGL Applications to Pocket PC s
A Thin-Client Approach for Porting OpenGL Applications to Pocket PC s Zhe-Yu Lin Shyh-Haur Ger Yung-Feng Chiu Chun-Fa Chang Department of Computer Science National Tsing Hua University Abstract The display
Efficient Rendering of Glossy Reflection Using Graphics Hardware
Efficient Rendering of Glossy Reflection Using Graphics Hardware Yoshinori Dobashi Yuki Yamada Tsuyoshi Yamamoto Hokkaido University Kita-ku Kita 14, Nishi 9, Sapporo 060-0814, Japan Phone: +81.11.706.6530,
Algorithms for Image-Based Rendering with an Application to Driving Simulation
Algorithms for Image-Based Rendering with an Application to Driving Simulation George Drettakis GRAPHDECO/Inria Sophia Antipolis, Université Côte d Azur http://team.inria.fr/graphdeco Graphics for Driving
An Efficient Visual Hull Computation Algorithm
An Efficient Visual Hull Computation Algorithm Wojciech Matusik Chris Buehler Leonard McMillan Laboratory for Computer Science Massachusetts institute of Technology (wojciech, cbuehler, mcmillan)@graphics.lcs.mit.edu
Many rendering scenarios, such as battle scenes or urban environments, require rendering of large numbers of autonomous characters.
1 2 Many rendering scenarios, such as battle scenes or urban environments, require rendering of large numbers of autonomous characters. Crowd rendering in large environments presents a number of challenges,
CS231N Section. Video Understanding 6/1/2018
CS231N Section Video Understanding 6/1/2018 Outline Background / Motivation / History Video Datasets Models Pre-deep learning CNN + RNN 3D convolution Two-stream What we ve seen in class so far... Image
Rate-distortion Optimized Streaming of Compressed Light Fields with Multiple Representations
Rate-distortion Optimized Streaming of Compressed Light Fields with Multiple Representations Prashant Ramanathan and Bernd Girod Department of Electrical Engineering Stanford University Stanford CA 945
The Plenoptic videos: Capturing, Rendering and Compression. Chan, SC; Ng, KT; Gan, ZF; Chan, KL; Shum, HY.
Title The Plenoptic videos: Capturing, Rendering and Compression Author(s) Chan, SC; Ng, KT; Gan, ZF; Chan, KL; Shum, HY Citation IEEE International Symposium on Circuits and Systems Proceedings, Vancouver,
Multi-view stereo. Many slides adapted from S. Seitz
Multi-view stereo Many slides adapted from S. Seitz Beyond two-view stereo The third eye can be used for verification Multiple-baseline stereo Pick a reference image, and slide the corresponding window
Globally Consistent Depth Labeling of 4D Light Fields
Globally Consistent Depth Labeling of 4D Light Fields Sven Wanner and Bastian Goldluecke Heidelberg Collaboratory for Image Processing Abstract We present a novel paradigm to deal with depth reconstruction
A Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India
A Review of Image- based Rendering Techniques Nisha 1, Vijaya Goel 2 1 Department of computer science, University of Delhi, Delhi, India Keshav Mahavidyalaya, University of Delhi, Delhi, India Abstract
Acquisition and Visualization of Colored 3D Objects
Acquisition and Visualization of Colored 3D Objects Kari Pulli Stanford University Stanford, CA, U.S.A kapu@cs.stanford.edu Habib Abi-Rached, Tom Duchamp, Linda G. Shapiro and Werner Stuetzle University
Scalable and Distributed Visualization using ParaView
Scalable and Distributed Visualization using ParaView Eric A. Wernert, Ph.D. Senior Manager & Scientist, Advanced Visualization Lab Pervasive Technology Institute, Indiana University Big Data for Science
Introduction. Chapter Computer Graphics
Chapter 1 Introduction 1.1. Computer Graphics Computer graphics has grown at an astounding rate over the last three decades. In the 1970s, frame-buffers capable of displaying digital images were rare and
Lecture 15: Image-Based Rendering and the Light Field. Kayvon Fatahalian CMU : Graphics and Imaging Architectures (Fall 2011)
Lecture 15: Image-Based Rendering and the Light Field Kayvon Fatahalian CMU 15-869: Graphics and Imaging Architectures (Fall 2011) Demo (movie) Royal Palace: Madrid, Spain Image-based rendering (IBR) So
Augmenting Reality with Projected Interactive Displays
Augmenting Reality with Projected Interactive Displays Claudio Pinhanez IBM T.J. Watson Research Center, P.O. Box 218 Yorktown Heights, N.Y. 10598, USA Abstract. This paper examines a steerable projection
Face Cyclographs for Recognition
Face Cyclographs for Recognition Guodong Guo Department of Computer Science North Carolina Central University E-mail: gdguo@nccu.edu Charles R. Dyer Computer Sciences Department University of Wisconsin-Madison
Multidimensional image retargeting
Multidimensional image retargeting 9:00: Introduction 9:10: Dynamic range retargeting Tone mapping Apparent contrast and brightness enhancement 10:45: Break 11:00: Color retargeting 11:30: LDR to HDR 12:20:
Color and Shading. Color. Shapiro and Stockman, Chapter 6. Color and Machine Vision. Color and Perception
Color and Shading Color Shapiro and Stockman, Chapter 6 Color is an important factor for for human perception for object and material identification, even time of day. Color perception depends upon both
CS : Assignment 2 Real-Time / Image-Based Rendering
CS 294-13: Assignment 2 Real-Time / Image-Based Rendering Ravi Ramamoorthi 1 Introduction In this assignment, you will implement some of the modern techniques for real-time and/or image-based rendering.
Computational Photography
Computational Photography Matthias Zwicker University of Bern Fall 2010 Today Light fields Introduction Light fields Signal processing analysis Light field cameras Application Introduction Pinhole camera
Modeling, Combining, and Rendering Dynamic Real-World Events From Image Sequences
Modeling, Combining, and Rendering Dynamic Real-World Events From Image s Sundar Vedula, Peter Rander, Hideo Saito, and Takeo Kanade The Robotics Institute Carnegie Mellon University Abstract Virtualized
Projective Texture Mapping with Full Panorama
EUROGRAPHICS 2002 / G. Drettakis and H.-P. Seidel Volume 21 (2002), Number 3 (Guest Editors) Projective Texture Mapping with Full Panorama Dongho Kim and James K. Hahn Department of Computer Science, The
ArcGIS Runtime: Building 3D Apps. Rex Hansen Adrien Meriaux
ArcGIS Runtime: Building 3D Apps Rex Hansen Adrien Meriaux Agenda 3D across the ArcGIS Platform 3D in ArcGIS Runtime Road ahead ArcGIS 3D helps customers Create and Manage Design and Simulate Visualize
Visualization for Debugging
Visualization for Debugging Homework for Thursday April 5th: grade/feedback available on Submitty Progress Post #1: Depends on project... probably data collection Homework for Thursday April 12th: another
Perceptual Effects in Real-time Tone Mapping
Perceptual Effects in Real-time Tone Mapping G. Krawczyk K. Myszkowski H.-P. Seidel Max-Planck-Institute für Informatik Saarbrücken, Germany SCCG 2005 High Dynamic Range (HDR) HDR Imaging Display of HDR
Light Field Spring
Light Field 2015 Spring Recall: Light is Electromagnetic radiation (EMR) moving along rays in space R(l) is EMR, measured in units of power (watts) l is wavelength Useful things: Light travels in straight
Image-Based Rendering. Image-Based Rendering
Image-Based Rendering Image-Based Rendering What is it? Still a difficult question to answer Uses images (photometric info) as key component of model representation 1 What s Good about IBR Model acquisition
Multiple View Geometry
Multiple View Geometry Martin Quinn with a lot of slides stolen from Steve Seitz and Jianbo Shi 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 Our Goal The Plenoptic Function P(θ,φ,λ,t,V
V-RAY 3.6 FOR SKETCHUP KEY FEATURES
V-RAY 3.6 FOR SKETCHUP KEY FEATURES November 2017 NEW FEATURES VIEWPORT RENDERING POWERFUL GPU RENDERING With new Viewport rendering, you can easily select and render multiple regions at once, and quickly
Local Illumination. CMPT 361 Introduction to Computer Graphics Torsten Möller. Machiraju/Zhang/Möller
Local Illumination CMPT 361 Introduction to Computer Graphics Torsten Möller Graphics Pipeline Hardware Modelling Transform Visibility Illumination + Shading Perception, Interaction Color Texture/ Realism
Computational Cameras: Exploiting Spatial- Angular Temporal Tradeoffs in Photography
Mitsubishi Electric Research Labs (MERL) Computational Cameras Computational Cameras: Exploiting Spatial- Angular Temporal Tradeoffs in Photography Amit Agrawal Mitsubishi Electric Research Labs (MERL)
Low Latency Rendering and Positioning for Mobile Augmented Reality
Low Latency Rendering and Positioning for Mobile Augmented Reality W. Pasman, A. van der Schaaf, R.L. Lagendijk, F.W. Jansen Ubicom-project, Faculty of Information Technology and Systems Delft University
Photo Tourism: Exploring Photo Collections in 3D
Click! Click! Oooo!! Click! Zoom click! Click! Some other camera noise!! Photo Tourism: Exploring Photo Collections in 3D Click! Click! Ahhh! Click! Click! Overview of Research at Microsoft, 2007 Jeremy
The 7d plenoptic function, indexing all light.
Previous Lecture The 7d plenoptic function, indexing all light. Lightfields: a 4d (not 5d!) data structure which captures all outgoing light from a region and permits reconstruction of arbitrary synthetic
Assembly and Cutaway Illustration & Interaction
Assembly and Cutaway Illustration & Interaction Erik Johansson, Cut & Fold http://erikjohanssonphoto.com/work/cut-fold/ http://gfycat.com/scrawnythoughtfulfairyfly http://i.imgur.com/szqz7r7.gif http://entertainment.howstuffworks.com/muppet4.htm
Real-Time Video- Based Modeling and Rendering of 3D Scenes
Image-Based Modeling, Rendering, and Lighting Real-Time Video- Based Modeling and Rendering of 3D Scenes Takeshi Naemura Stanford University Junji Tago and Hiroshi Harashima University of Tokyo In research
IMAGE BASED RENDERING: Using High Dynamic Range Photographs to Light Architectural Scenes
IMAGE BASED RENDERING 1 IMAGE BASED RENDERING: Using High Dynamic Range Photographs to Light Architectural Scenes KATHLEEN CHENEY MEHLIKA INANICI University of Washington Abstract Image Based Rendering