INTRODUCTION TO 360 VIDEO. Oliver Wang Adobe Research
|
|
- Henry Cook
- 5 years ago
- Views:
Transcription
1 INTRODUCTION TO 360 VIDEO Oliver Wang Adobe Research
2 OUTLINE What is 360 video?
3 OUTLINE What is 360 video? How do we represent it? Formats
4 OUTLINE What is 360 video? How do we represent it? How do we create it? Stitching
5 OUTLINE What is 360 How do we How do we What can we video? represent it? create it? do with it? Stabilization
6 OUTLINE What can t What is 360 How do we How do we What can we we do with video? represent it? create it? do with it? it?? Future Areas
7 OUTLINE What can t What is 360 How do we How do we What can we we do with video? represent it? create it? do with it? it?
8 360 VIDEO VS FULL VR VIDEO 3DoF 6DoF Mozilla Developer Network - WebVR Concepts
9 ONE OF THE MOST POPULAR FORMS OF VR
10 360 VIDEO VS FULL Display Capture VS
11 OUTLINE What can t What is 360 How do we How do we What can we we do with video? represent it? create it? do with it? it?
12 360 VIDEO FORMATS
13 360 VIDEO FORMATS
14 360 VIDEO FORMATS
15 EQUIRECTANGULAR
16 EQUIRECTANGULAR Positive Negative Visually interpretable Distortion on poles Easy to process Low pixel density on horizon
17 CUBEMAPS
18 CUBEMAPS Graphics pipeline friendly Hard to interpret/process Low distortion (25% storage reduction)
19 EQUIANGULAR CUBEMAPS
20 EQUIANGULAR CUBEMAPS Equirectangular Projection Cubemap Equiangular Cubemap
21 EQUIANGULAR CUBEMAPS
22 PYRAMIDS
23 PYRAMIDS
24 360 VIDEO CONTENT CREATION What can t What is 360 How do we How do we What can we we do with video? represent it? create it? do with it? it?
25 MULTI-LENS CAMERAS
26 STITCHING Image Alignment and Stitching [Szeliski, Richard 2005]
27 PARALLAX ARTIFACTS different projection centers Slides courtesy of Jungjin Lee, KAIST
28 PARALLAX COMPENSATION Optical Flow Mesh Warping [Jiang and Gu 2015]
29 HIGH-LEVEL PIPELINE - INPUT Panoramic Video from Unstructured Camera Arrays [Perazzi et al. Eurographics 2015]
30 REFERENCE PROJECTION Slides courtesy of Federico Perazzi, Disney Research
31 PARALLAX COMPENSATION Slides courtesy of Federico Perazzi, Disney Research
32 PARALLAX COMPENSATION Slides courtesy of Federico Perazzi, Disney Research
33 BLENDING Slides courtesy of Federico Perazzi, Disney Research
34 BLENDING A Multiresolution Spline With Application to Image Mosaics [Burt and Adelson 1983] Slides courtesy of Federico Perazzi, Disney Research
35 Slides courtesy of Federico Perazzi, Disney Research
36 Slides courtesy of Federico Perazzi, Disney Research
37 ANOTHER WAY TO THINK ABOUT IT Rich360: Optimized Spherical Representation from Structured Panoramic Camera Arrays [Lee et al. SIGGRAPH 2016] Slides courtesy of Jungjin Lee, KAIST
38 MESH DEFORMATION Deformation of the projection sphere Slides courtesy of Jungjin Lee, KAIST
39 DEFORMABLE SPHERICAL PROJECTION SURFACE Recovered 3D point Slides courtesy of Jungjin Lee, KAIST
40 DEFORMABLE SPHERICAL PROJECTION SURFACE Recovered 3D point Slides courtesy of Jungjin Lee, KAIST
41 DEFORMABLE SPHERICAL PROJECTION SURFACE Slides courtesy of Jungjin Lee, KAIST
42 Comparisons with two state-of-the-art stitching methods GCW: per pixel warping using optical flow [Perazzi et al. 2015] STCPW: mesh-based warping using sparse feature points [Jiang and Gu 2015] Slides courtesy of Jungjin Lee, KAIST
43 NON-UNIFORM RAY SAMPLING Slides courtesy of Jungjin Lee, KAIST
44 NON-UNIFORM RAY SAMPLING Slides courtesy of Jungjin Lee, KAIST
45 Slides courtesy of Jungjin Lee, KAIST
46 Comparisons with the equirectangular projection Rendering resolution: 2K Resolution of the viewing screen: full HD Slides courtesy of Jungjin Lee, KAIST
47 360 Video Processing What can t What is 360 How do we How do we What can we we do with video? represent it? create it? do with it? it? 360 VIDEO STABILIZATION [Johannes Kopf, SIGGRAPH Asia 2016]
48 Slides courtesy of Johannes Kopf, Facebook
49 Slides courtesy of Johannes Kopf, Facebook
50 TRACK FIT MOTION MODEL + SMOOTHING WARP Narrow FOV 2D or 3D Cropped Slides courtesy of Johannes Kopf, Facebook
51 TRACK FIT MOTION MODEL + SMOOTHING WARP Full 360 Hybrid 3D-2D Not Cropped Slides courtesy of Johannes Kopf, Facebook
52 Input video Pure-rotation stabilization Slides courtesy of Johannes Kopf, Facebook
53 Translation effects Rolling shutter/lens deformation
54 Pure-rotation Deformed-rotation Slides courtesy of Johannes Kopf, Facebook
55 CREATING NARROW FOV VIDEOS FROM 360 VIDEO Pano2Vid: Automatic Cinematography for Watching 360 Video [Su et al. ACCV 2016]
56 PANO2VID Input: 360 Video Output: normal-field-of-view (NFOV) Video Slides courtesy of Yu-Chuan Su, UT Austin
57 PANO2VID z C3D [Tran 2015] Train Ω x y ST-glimpses Slides courtesy of Yu-Chuan Su, UT Austin
58 PANO2VID z C3D [Tran 2015] Train Ω x y ST-glimpses Test Evaluate capture-worthiness Construct trajectory Slides courtesy of Yu-Chuan Su, UT Austin
59 HUMAN VALIDATION Slides courtesy of Yu-Chuan Su, UT Austin
60 HUMAN VALIDATION # videos Total length 360 videos hours HumanCam 9, hours AutoCam performs the best Justified by multiple metrics Slides courtesy of Yu-Chuan Su, UT Austin
61 Making 360 Video Watchable in 2D: Learning Videography for Click Free Viewing [Su and Grauman CVPR 2017]
62 FUTURE PROBLEMS What can t What is 360 How do we How do we What can we we do with video? represent it? create it? do with it? it?
63 PERCEPTION Gaze Visualization for Immersive Video Thomas Löwe, Michael Stengel, Emmy-Charlotte Förster, Steve Grogorick, Marcus Magnor Eye Tracking and Visualization (Springer), 2017 Saliency in VR: How do people explore virtual environments? Vincent Sitzmann, Ana Serrano, Amy Pavel, Maneesh Agrawala, Diego Gutierrez, Gordon Wetzstein. Arxiv 2016
64 CINEMATOGRAPHY RULES Constraint on camera motion Zooms Cuts (coming up) Lighting
65 SPATIAL AUDIO Core Sound TetraMic
66 360 VIDEO Oliver Wang Adobe Research
Announcements. Mosaics. Image Mosaics. How to do it? Basic Procedure Take a sequence of images from the same position =
Announcements Project 2 out today panorama signup help session at end of class Today mosaic recap blending Mosaics Full screen panoramas (cubic): http://www.panoramas.dk/ Mars: http://www.panoramas.dk/fullscreen3/f2_mars97.html
More informationRecap. DoF Constraint Solver. translation. affine. homography. 3D rotation
Image Blending Recap DoF Constraint Solver translation affine homography 3D rotation Recap DoF Constraint Solver translation 2 affine homography 3D rotation Recap DoF Constraint Solver translation 2 affine
More informationMosaics. Today s Readings
Mosaics VR Seattle: http://www.vrseattle.com/ Full screen panoramas (cubic): http://www.panoramas.dk/ Mars: http://www.panoramas.dk/fullscreen3/f2_mars97.html Today s Readings Szeliski and Shum paper (sections
More informationAnnouncements. Mosaics. How to do it? Image Mosaics
Announcements Mosaics Project artifact voting Project 2 out today (help session at end of class) http://www.destination36.com/start.htm http://www.vrseattle.com/html/vrview.php?cat_id=&vrs_id=vrs38 Today
More informationCS 498 VR. Lecture 20-4/11/18. go.illinois.edu/vrlect20
CS 498 VR Lecture 20-4/11/18 go.illinois.edu/vrlect20 Review from last lecture Texture, Normal mapping Three types of optical distortion? How does texture mipmapping work? Improving Latency and Frame Rates
More informationToday s lecture. Image Alignment and Stitching. Readings. Motion models
Today s lecture Image Alignment and Stitching Computer Vision CSE576, Spring 2005 Richard Szeliski Image alignment and stitching motion models cylindrical and spherical warping point-based alignment global
More informationImage Stitching. Slides from Rick Szeliski, Steve Seitz, Derek Hoiem, Ira Kemelmacher, Ali Farhadi
Image Stitching Slides from Rick Szeliski, Steve Seitz, Derek Hoiem, Ira Kemelmacher, Ali Farhadi Combine two or more overlapping images to make one larger image Add example Slide credit: Vaibhav Vaish
More informationImage stitching. Announcements. Outline. Image stitching
Announcements Image stitching Project #1 was due yesterday. Project #2 handout will be available on the web later tomorrow. I will set up a webpage for artifact voting soon. Digital Visual Effects, Spring
More information360 video stabilization
360 video stabilization PÉTER BODNÁR DEPARTMENT OF IMAGE PROCESSING AND COMPUTER GRAPHICS UNIVERSITY OF SZEGED, HUNGARY Outline About 360 video technology Stabilization: motivation and overview The video
More informationImage stitching. Digital Visual Effects Yung-Yu Chuang. with slides by Richard Szeliski, Steve Seitz, Matthew Brown and Vaclav Hlavac
Image stitching Digital Visual Effects Yung-Yu Chuang with slides by Richard Szeliski, Steve Seitz, Matthew Brown and Vaclav Hlavac Image stitching Stitching = alignment + blending geometrical registration
More informationPing Tan. Simon Fraser University
Ping Tan Simon Fraser University Photos vs. Videos (live photos) A good photo tells a story Stories are better told in videos Videos in the Mobile Era (mobile & share) More videos are captured by mobile
More informationCS6670: Computer Vision
CS6670: Computer Vision Noah Snavely Lecture 7: Image Alignment and Panoramas What s inside your fridge? http://www.cs.washington.edu/education/courses/cse590ss/01wi/ Projection matrix intrinsics projection
More informationImage stitching. Digital Visual Effects Yung-Yu Chuang. with slides by Richard Szeliski, Steve Seitz, Matthew Brown and Vaclav Hlavac
Image stitching Digital Visual Effects Yung-Yu Chuang with slides by Richard Szeliski, Steve Seitz, Matthew Brown and Vaclav Hlavac Image stitching Stitching = alignment + blending geometrical registration
More informationNonlinear Multiresolution Image Blending
Nonlinear Multiresolution Image Blending Mark Grundland, Rahul Vohra, Gareth P. Williams and Neil A. Dodgson Computer Laboratory, University of Cambridge, United Kingdom October, 26 Abstract. We study
More informationImage-Based Modeling and Rendering
Image-Based Modeling and Rendering Richard Szeliski Microsoft Research IPAM Graduate Summer School: Computer Vision July 26, 2013 How far have we come? Light Fields / Lumigraph - 1996 Richard Szeliski
More informationCSE 527: Introduction to Computer Vision
CSE 527: Introduction to Computer Vision Week 5 - Class 1: Matching, Stitching, Registration September 26th, 2017 ??? Recap Today Feature Matching Image Alignment Panoramas HW2! Feature Matches Feature
More informationNinio, J. and Stevens, K. A. (2000) Variations on the Hermann grid: an extinction illusion. Perception, 29,
Ninio, J. and Stevens, K. A. (2000) Variations on the Hermann grid: an extinction illusion. Perception, 29, 1209-1217. CS 4495 Computer Vision A. Bobick Sparse to Dense Correspodence Building Rome in
More informationDesigning objective quality metrics for panoramic videos based on human perception
Designing objective quality metrics for panoramic videos based on human perception Sandra Nabil, Raffaella Balzarini, Frédéric Devernay, James Crowley To cite this version: Sandra Nabil, Raffaella Balzarini,
More informationFinally: Motion and tracking. Motion 4/20/2011. CS 376 Lecture 24 Motion 1. Video. Uses of motion. Motion parallax. Motion field
Finally: Motion and tracking Tracking objects, video analysis, low level motion Motion Wed, April 20 Kristen Grauman UT-Austin Many slides adapted from S. Seitz, R. Szeliski, M. Pollefeys, and S. Lazebnik
More informationReal-Time Stereo Mosaicing using Feature Tracking
2011 IEEE International Symposium on Multimedia Real- Stereo Mosaicing using Feature Tracking Marc Vivet Computer Science Department Universitat Autònoma de Barcelona Barcelona, Spain Shmuel Peleg School
More informationParallax-tolerant Image Stitching
Parallax-tolerant Image Stitching Fan Zhang and Feng Liu Department of Computer Science Portland State University {zhangfan,fliu}@cs.pdx.edu Abstract Parallax handling is a challenging task for image stitching.
More informationPanoramic Video Texture
Aseem Agarwala, Colin Zheng, Chris Pal, Maneesh Agrawala, Michael Cohen, Brian Curless, David Salesin, Richard Szeliski A paper accepted for SIGGRAPH 05 presented by 1 Outline Introduction & Motivation
More informationComputational Cameras: Exploiting Spatial- Angular Temporal Tradeoffs in Photography
Mitsubishi Electric Research Labs (MERL) Computational Cameras Computational Cameras: Exploiting Spatial- Angular Temporal Tradeoffs in Photography Amit Agrawal Mitsubishi Electric Research Labs (MERL)
More informationRectangling Panoramic Images via Warping
Rectangling Panoramic Images via Warping Kaiming He Microsoft Research Asia Huiwen Chang Tsinghua University Jian Sun Microsoft Research Asia Introduction Panoramas are irregular Introduction Panoramas
More information6.098 Digital and Computational Photography Advanced Computational Photography. Panoramas. Bill Freeman Frédo Durand MIT - EECS
6.098 Digital and Computational Photography 6.882 Advanced Computational Photography Panoramas Bill Freeman Frédo Durand MIT - EECS Lots of slides stolen from Alyosha Efros, who stole them from Steve Seitz
More informationPanoramas. Why Mosaic? Why Mosaic? Mosaics: stitching images together. Why Mosaic? Olivier Gondry. Bill Freeman Frédo Durand MIT - EECS
Olivier Gondry 6.098 Digital and Computational Photography 6.882 Advanced Computational Photography Panoramas Director of music video and commercial Special effect specialist (Morphing, rotoscoping) Today
More informationPeripheral drift illusion
Peripheral drift illusion Does it work on other animals? Computer Vision Motion and Optical Flow Many slides adapted from J. Hays, S. Seitz, R. Szeliski, M. Pollefeys, K. Grauman and others Video A video
More informationMorphable 3D-Mosaics: a Hybrid Framework for Photorealistic Walkthroughs of Large Natural Environments
Morphable 3D-Mosaics: a Hybrid Framework for Photorealistic Walkthroughs of Large Natural Environments Nikos Komodakis and Georgios Tziritas Computer Science Department, University of Crete E-mails: {komod,
More informationTargil 10 : Why Mosaic? Why is this a challenge? Exposure differences Scene illumination Miss-registration Moving objects
Why Mosaic? Are you getting the whole picture? Compact Camera FOV = 5 x 35 Targil : Panoramas - Stitching and Blending Some slides from Alexei Efros 2 Slide from Brown & Lowe Why Mosaic? Are you getting
More informationMore Mosaic Madness. CS194: Image Manipulation & Computational Photography. Steve Seitz and Rick Szeliski. Jeffrey Martin (jeffrey-martin.
More Mosaic Madness Jeffrey Martin (jeffrey-martin.com) CS194: Image Manipulation & Computational Photography with a lot of slides stolen from Alexei Efros, UC Berkeley, Fall 2018 Steve Seitz and Rick
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 12 130228 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Panoramas, Mosaics, Stitching Two View Geometry
More information360 Video Technology Exploration
360 Video Technology Exploration Roger Zimmermann FXPAL & Media Management Research Lab NUS School of Computing 11/15/2017 FXPAL, 16 December 2016 1 Outline 2 360 Video Hardware Layout Projection Optimizing
More informationImage Warping and Mosacing
Image Warping and Mosacing 15-463: Rendering and Image Processing Alexei Efros with a lot of slides stolen from Steve Seitz and Rick Szeliski Today Mosacs Image Warping Homographies Programming Assignment
More informationA Framework to Evaluate Omnidirectional Video Coding Schemes
2015 IEEE International Symposium on Mixed and Augmented Reality A Framework to Evaluate Omnidirectional Video Coding Schemes Matt Yu Haricharan Lakshman Department of Electrical Engineering Stanford University
More informationFeature Matching and RANSAC
Feature Matching and RANSAC Recognising Panoramas. [M. Brown and D. Lowe,ICCV 2003] [Brown, Szeliski, Winder, CVPR 2005] with a lot of slides stolen from Steve Seitz, Rick Szeliski, A. Efros Introduction
More informationEXAMPLE-BASED MOTION MANIPULATION
EXAMPLE-BASED MOTION MANIPULATION Pin-Ching Su, Hwann-Tzong Chen Chia-Ming Cheng National Tsing Hua University MediaTek ABSTRACT This paper introduces an idea of imitating camera movements and shooting
More informationImage-Based Rendering
Image-Based Rendering COS 526, Fall 2016 Thomas Funkhouser Acknowledgments: Dan Aliaga, Marc Levoy, Szymon Rusinkiewicz What is Image-Based Rendering? Definition 1: the use of photographic imagery to overcome
More informationReal-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images
Real-time Generation and Presentation of View-dependent Binocular Stereo Images Using a Sequence of Omnidirectional Images Abstract This paper presents a new method to generate and present arbitrarily
More informationCamera Calibration for a Robust Omni-directional Photogrammetry System
Camera Calibration for a Robust Omni-directional Photogrammetry System Fuad Khan 1, Michael Chapman 2, Jonathan Li 3 1 Immersive Media Corporation Calgary, Alberta, Canada 2 Ryerson University Toronto,
More informationarxiv: v2 [cs.cv] 24 May 2017
Making 3 Video Watchable in 2D: Learning Videography for Click Free Viewing Yu-Chuan Su Kristen Grauman The University of Texas at Austin arxiv:173.495v2 [cs.cv] 24 May 217 Abstract 3 video requires human
More informationTo Do. Advanced Computer Graphics. The Story So Far. Course Outline. Rendering (Creating, shading images from geometry, lighting, materials)
Advanced Computer Graphics CSE 190 [Spring 2015], Lecture 16 Ravi Ramamoorthi http://www.cs.ucsd.edu/~ravir To Do Assignment 3 milestone due May 29 Should already be well on way Contact us for difficulties
More informationComputed Photography - Final Project Endoscope Exploration on Knee Surface
15-862 Computed Photography - Final Project Endoscope Exploration on Knee Surface Chenyu Wu Robotics Institute, Nov. 2005 Abstract Endoscope is widely used in the minimally invasive surgery. However the
More informationCourse Outline. Advanced Computer Graphics. Animation. The Story So Far. Animation. To Do
Advanced Computer Graphics CSE 163 [Spring 2017], Lecture 18 Ravi Ramamoorthi http://www.cs.ucsd.edu/~ravir 3D Graphics Pipeline Modeling (Creating 3D Geometry) Course Outline Rendering (Creating, shading
More informationIl colore: acquisizione e visualizzazione. Lezione 20: 11 Maggio 2011
Il colore: acquisizione e visualizzazione Lezione 20: 11 Maggio 2011 Outline The importance of color What is color? Material properties vs. unshaded color Texture building from photos Image registration
More informationIl colore: acquisizione e visualizzazione. Lezione 17: 11 Maggio 2012
Il colore: acquisizione e visualizzazione Lezione 17: 11 Maggio 2012 The importance of color information Precision vs. Perception 3D scanned geometry Photo Color and appearance Pure geometry Pure color
More informationScalable Motion-Aware Panoramic Videos
Scalable Motion-Aware Panoramic Videos Leonardo Sacht Luiz Velho Diego Nehab Marcelo Cicconet IMPA, Rio de Janeiro, Brazil September 16, 2011 Abstract The work presents a method for obtaining perceptually
More informationAlignment and Mosaicing of Non-Overlapping Images
Alignment and Mosaicing of Non-Overlapping Images Yair Poleg Shmuel Peleg School of Computer Science and Engineering The Hebrew University of Jerusalem Jerusalem, Israel Abstract Image alignment and mosaicing
More informationSnap Angle Prediction for 360 Panoramas
In Proceedings of the European Conference on Computer Vision (ECCV), 2018 Snap Angle Prediction for 360 Panoramas Bo Xiong 1 and Kristen Grauman 2 1 University of Texas at Austin 2 Facebook AI Research
More informationMosaics, Plenoptic Function, and Light Field Rendering. Last Lecture
Mosaics, Plenoptic Function, and Light Field Rendering Topics in Image-ased Modeling and Rendering CSE291 J00 Lecture 3 Last Lecture Camera Models Pinhole perspective Affine/Orthographic models Homogeneous
More informationFast Image Stitching and Editing for Panorama Painting on Mobile Phones
Fast Image Stitching and Editing for Panorama Painting on Mobile Phones Yingen Xiong and Kari Pulli Nokia Research Center 955 Page Mill Road, Palo Alto, CA 94304, USA {yingen.xiong, kari.pulli}@nokia.com
More informationVideo Mosaics for Virtual Environments, R. Szeliski. Review by: Christopher Rasmussen
Video Mosaics for Virtual Environments, R. Szeliski Review by: Christopher Rasmussen September 19, 2002 Announcements Homework due by midnight Next homework will be assigned Tuesday, due following Tuesday.
More informationIntroduction to Computer Vision. Week 3, Fall 2010 Instructor: Prof. Ko Nishino
Introduction to Computer Vision Week 3, Fall 2010 Instructor: Prof. Ko Nishino Last Week! Image Sensing " Our eyes: rods and cones " CCD, CMOS, Rolling Shutter " Sensing brightness and sensing color! Projective
More informationHow to create video effects
Adobe After Affects CC Guide How to create video effects After Effects includes many innovative and expressive video effects, which you apply to layers to add or modify characteristics of still images
More informationStereoStitch Tutorial (mono)
StereoStitch Tutorial (mono) This tutorial will teach you how to use StereoStitch. You can download a Source Sample (1.5GB) (by courtesy of Stijn Van Velthoven, www.thehomepilot.com) and the stitched video
More information3D Cinematography Principles and Their Applications to
3D Cinematography Principles and Their Applications to Stereoscopic Media Processing Chun-Wei Liu, Tz-Huan Huang, Ming-Hsu Chang, Ken-Yi Lee, Chia-Kai Liang, and Yung-Yu Chuang National Taiwan University
More informationAnimations. Hakan Bilen University of Edinburgh. Computer Graphics Fall Some slides are courtesy of Steve Marschner and Kavita Bala
Animations Hakan Bilen University of Edinburgh Computer Graphics Fall 2017 Some slides are courtesy of Steve Marschner and Kavita Bala Animation Artistic process What are animators trying to do? What tools
More informationFast Image Stitching and Editing for Panorama Painting on Mobile Phones
in IEEE Workshop on Mobile Vision, in Conjunction with CVPR 2010 (IWMV2010), San Francisco, 2010, IEEE Computer Society Fast Image Stitching and Editing for Panorama Painting on Mobile Phones Yingen Xiong
More informationImage Warping. Image Manipula-on and Computa-onal Photography CS Fall 2011 Robert Carroll.
Image Warping http://www.jeffrey-martin.com Image Manipula-on and Computa-onal Photography CS294-69 Fall 2011 Robert Carroll [Some slides from K. Padalkar, S. Avidan, A. Shamir, A. Efros, S. Seitz, and
More informationImage-based Modeling and Rendering: 8. Image Transformation and Panorama
Image-based Modeling and Rendering: 8. Image Transformation and Panorama I-Chen Lin, Assistant Professor Dept. of CS, National Chiao Tung Univ, Taiwan Outline Image transformation How to represent the
More informationA New Data Format for Multiview Video
A New Data Format for Multiview Video MEHRDAD PANAHPOUR TEHRANI 1 AKIO ISHIKAWA 1 MASASHIRO KAWAKITA 1 NAOMI INOUE 1 TOSHIAKI FUJII 2 This paper proposes a new data forma that can be used for multiview
More informationPhotographic stitching with optimized object and color matching based on image derivatives
Photographic stitching with optimized object and color matching based on image derivatives Simon T.Y. Suen, Edmund Y. Lam, and Kenneth K.Y. Wong Department of Electrical and Electronic Engineering, The
More informationIntroduction to 3D Concepts
PART I Introduction to 3D Concepts Chapter 1 Scene... 3 Chapter 2 Rendering: OpenGL (OGL) and Adobe Ray Tracer (ART)...19 1 CHAPTER 1 Scene s0010 1.1. The 3D Scene p0010 A typical 3D scene has several
More informationImage Compositing and Blending
Computational Photography and Capture: Image Compositing and Blending Gabriel Brostow & Tim Weyrich TA: Frederic Besse Vignetting 3 Figure from http://www.vanwalree.com/optics/vignetting.html Radial Distortion
More informationCompositing a bird's eye view mosaic
Compositing a bird's eye view mosaic Robert Laganiere School of Information Technology and Engineering University of Ottawa Ottawa, Ont KN 6N Abstract This paper describes a method that allows the composition
More informationSynthesizing Realistic Facial Expressions from Photographs
Synthesizing Realistic Facial Expressions from Photographs 1998 F. Pighin, J Hecker, D. Lischinskiy, R. Szeliskiz and D. H. Salesin University of Washington, The Hebrew University Microsoft Research 1
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 14 130307 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Stereo Dense Motion Estimation Translational
More informationSingle-view 3D Reconstruction
Single-view 3D Reconstruction 10/12/17 Computational Photography Derek Hoiem, University of Illinois Some slides from Alyosha Efros, Steve Seitz Notes about Project 4 (Image-based Lighting) You can work
More informationLucas-Kanade Without Iterative Warping
3 LucasKanade Without Iterative Warping Alex RavAcha School of Computer Science and Engineering The Hebrew University of Jerusalem 91904 Jerusalem, Israel EMail: alexis@cs.huji.ac.il Abstract A significant
More informationOptical flow and tracking
EECS 442 Computer vision Optical flow and tracking Intro Optical flow and feature tracking Lucas-Kanade algorithm Motion segmentation Segments of this lectures are courtesy of Profs S. Lazebnik S. Seitz,
More informationStabilizing First Person 360 Degree Videos
Stabilizing First Person 6 Degree Videos Chetan Arora IIIT Delhi Vivek Kwatra Google Research Abstract The use of 6 degree cameras, enabling one to record and share full-spherical 6 8 view without any
More informationImage-Based Lighting. Inserting Synthetic Objects
Image-Based Lighting 15-463: Rendering and Image Processing Alexei Efros with a lot of slides donated by Paul Debevec Inserting Synthetic Objects Why does this look so bad? Wrong camera orientation Wrong
More informationImage-based modeling (IBM) and image-based rendering (IBR)
Image-based modeling (IBM) and image-based rendering (IBR) CS 248 - Introduction to Computer Graphics Autumn quarter, 2005 Slides for December 8 lecture The graphics pipeline modeling animation rendering
More informationObject Recognition with Invariant Features
Object Recognition with Invariant Features Definition: Identify objects or scenes and determine their pose and model parameters Applications Industrial automation and inspection Mobile robots, toys, user
More informationComputer Graphics for Large- Scale Immersive Theaters
Computer Graphics for Large- Scale Immersive Theaters Immersive Rendering Basics Brad Thompson Lead Animator Spitz, Inc. bthompson@spitzinc.com Aesthetic Considerations: Understanding the space Completely
More informationImage warping and stitching
Image warping and stitching Thurs Oct 15 Last time Feature-based alignment 2D transformations Affine fit RANSAC 1 Robust feature-based alignment Extract features Compute putative matches Loop: Hypothesize
More informationProjection simulator to support design development of spherical immersive display
Projection simulator to support design development of spherical immersive display Wataru Hashimoto, Yasuharu Mizutani, and Satoshi Nishiguchi Faculty of Information Sciences and Technology, Osaka Institute
More informationSeamless creativity.
Seamless creativity. 2 The 360 4K 3D camera to record, edit and stream complete VR video and audio, anywhere, anytime. 360 degrees is only the beginning. The Samsung 360 Round is a commercial-quality camera
More informationProjective Geometry and Camera Models
/2/ Projective Geometry and Camera Models Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem Note about HW Out before next Tues Prob: covered today, Tues Prob2: covered next Thurs Prob3:
More informationImage warping and stitching
Image warping and stitching May 4 th, 2017 Yong Jae Lee UC Davis Last time Interactive segmentation Feature-based alignment 2D transformations Affine fit RANSAC 2 Alignment problem In alignment, we will
More informationGradient Domain Image Blending and Implementation on Mobile Devices
in MobiCase 09: Proceedings of The First Annual International Conference on Mobile Computing, Applications, and Services. 2009, Springer Berlin / Heidelberg. Gradient Domain Image Blending and Implementation
More informationWhat have we leaned so far?
What have we leaned so far? Camera structure Eye structure Project 1: High Dynamic Range Imaging What have we learned so far? Image Filtering Image Warping Camera Projection Model Project 2: Panoramic
More informationMobile Panoramic Imaging System
Mobile Panoramic Imaging System Kari Pulli, Marius Tico, Yingen Xiong Nokia Research Center 955 Page Mill Road, Palo Alto, CA, USA firstname.lastname@nokia.com Abstract We introduce a mobile system for
More informationLASER ECHO INTENSITY BASED TEXTURE MAPPING OF 3D SCAN MESH
22nd CIPA Symposium, October 11-15, 2009, Kyoto, Japan LASER ECHO INTENSITY BASED TEXTURE MAPPING OF 3D SCAN MESH Zhichao ZHANG, Fan ZHANG, Xianfeng HUANG, Deren LI *, Yixuan ZHU, Pingxiang LI State Key
More informationOptical Flow CS 637. Fuxin Li. With materials from Kristen Grauman, Richard Szeliski, S. Narasimhan, Deqing Sun
Optical Flow CS 637 Fuxin Li With materials from Kristen Grauman, Richard Szeliski, S. Narasimhan, Deqing Sun Motion and perceptual organization Sometimes, motion is the only cue Motion and perceptual
More informationOptical image stabilization (IS)
Optical image stabilization (IS) CS 178, Spring 2014 Begun 4/29/14, finished 5/1. Marc Levoy Computer Science Department Stanford University Outline what are the causes of camera shake? how can you avoid
More informationCS 2770: Intro to Computer Vision. Multiple Views. Prof. Adriana Kovashka University of Pittsburgh March 14, 2017
CS 277: Intro to Computer Vision Multiple Views Prof. Adriana Kovashka Universit of Pittsburgh March 4, 27 Plan for toda Affine and projective image transformations Homographies and image mosaics Stereo
More informationCapturing and View-Dependent Rendering of Billboard Models
Capturing and View-Dependent Rendering of Billboard Models Oliver Le, Anusheel Bhushan, Pablo Diaz-Gutierrez and M. Gopi Computer Graphics Lab University of California, Irvine Abstract. In this paper,
More informationWHILE the use of egocentric cameras is on the rise,
1 EgoSampling: Wide View Hyperlapse from Single and Multiple Egocentric Videos Tavi Halperin Yair Poleg Chetan Arora Shmuel Peleg arxiv:1604.07741v1 [cs.cv] 26 Apr 2016 Abstract The possibility of sharing
More informationRemote Reality Demonstration
Remote Reality Demonstration Terrance E. Boult EECS Dept., 19 Memorial Drive West Lehigh Univ., Bethlehem, PA 18015 tboult@eecs.lehigh.edu Fax: 610 758 6279 Contact Author: T.Boult Submission category:
More informationImage warping and stitching
Image warping and stitching May 5 th, 2015 Yong Jae Lee UC Davis PS2 due next Friday Announcements 2 Last time Interactive segmentation Feature-based alignment 2D transformations Affine fit RANSAC 3 Alignment
More informationModeling Light. Michal Havlik : Computational Photography Alexei Efros, CMU, Fall 2007
Modeling Light Michal Havlik 15-463: Computational Photography Alexei Efros, CMU, Fall 2007 The Plenoptic Function Figure by Leonard McMillan Q: What is the set of all things that we can ever see? A: The
More informationarxiv: v1 [cs.cv] 7 Dec 2016
Pano2Vid: Automatic Cinematography for Watching 360 Videos Yu-Chuan Su, Dinesh Jayaraman, and Kristen Grauman The University of Texas at Austin arxiv:1612.02335v1 [cs.cv] 7 Dec 2016 Abstract. We introduce
More informationFeature Tracking and Optical Flow
Feature Tracking and Optical Flow Prof. D. Stricker Doz. G. Bleser Many slides adapted from James Hays, Derek Hoeim, Lana Lazebnik, Silvio Saverse, who in turn adapted slides from Steve Seitz, Rick Szeliski,
More information12/07/17. Video Magnification. Magritte, The Listening Room. Computational Photography Derek Hoiem, University of Illinois
Video Magnification 12/07/17 Magritte, The Listening Room Computational Photography Derek Hoiem, University of Illinois Today 1. Video Magnification Lagrangian (point tracking) approach Eulerian (signal
More informationarxiv: v1 [cs.cv] 20 Nov 2018
SpherePHD: Applying CNNs on a Spherical PolyHeDron Representation of 360 Images arxiv:1811.08196v1 [cs.cv] 20 Nov 2018 Yeon Kun Lee Jaeseok Jeong Jong Seob Yun Won June Cho Kuk-Jin Yoon {dldusrjs, jason.jeong,
More informationCamera Calibration. COS 429 Princeton University
Camera Calibration COS 429 Princeton University Point Correspondences What can you figure out from point correspondences? Noah Snavely Point Correspondences X 1 X 4 X 3 X 2 X 5 X 6 X 7 p 1,1 p 1,2 p 1,3
More informationKandao Live. User Guide
Kandao Live User Guide Contents 1. Product Introduction 1.1 Function 2. Hardware Requirement 3. Directions 3.1 Connect 3.1.1 Connecting via Router 3.1.2 Connecting via DHCP 3.2 Live Streaming Setting 3.2.1
More informationIEEE Consumer Electronics Society Calibrating a VR Camera. Adam Rowell CTO, Lucid VR
IEEE Consumer Electronics Society Calibrating a VR Camera Adam Rowell CTO, Lucid VR adam@lucidcam.com Virtual Reality Cameras Lucid VR Camera How Does it Work? Lucid Software Technology Recording: Synchronization
More informationVIDEO FOR VIRTUAL REALITY LIGHT FIELD BASICS JAMES TOMPKIN
VIDEO FOR VIRTUAL REALITY LIGHT FIELD BASICS JAMES TOMPKIN WHAT IS A LIGHT FIELD? Light field seems to have turned into a catch-all term for many advanced camera/display technologies. WHAT IS A LIGHT FIELD?
More informationColor Correction for Image Stitching by Monotone Cubic Spline Interpolation
Color Correction for Image Stitching by Monotone Cubic Spline Interpolation Fabio Bellavia (B) and Carlo Colombo Computational Vision Group, University of Florence, Firenze, Italy {fabio.bellavia,carlo.colombo}@unifi.it
More information