Fast and robust techniques for 3D/2D registration and photo blending on massive point clouds
|
|
- Tracy Adams
- 6 years ago
- Views:
Transcription
1 vcg.isti.cnr.it/ Fast and robust techniques for 3D/2D registration and photo blending on massive point clouds R. Pintus, E. Gobbetti, M.Agus, R. Combet CRS4 Visual Computing M. Callieri Visual Computing Group ISTI-CNR
2 Goal Fast and robust techniques for creating accurate colored models Acquisition 3D laser scanners Color digital cameras Point-based rendering pipeline Mapping photo-to-geometry Fast and Robust Semi-Automatic Registration of Photographs to 3D Geometry Photo blending A Streaming Framework for Seamless Detailed Photo Blending on Massive Point Clouds
3 vcg.isti.cnr.it/ Point-based Rendering Ruggero Pintus, Enrico Gobbetti, and Marco Agus. Real-time Rendering of Massive Unstructured Raw Point Clouds using Screen-space Operators. In The 12th International Symposium on Virtual Reality, Archaeology and Cultural Heritage, October 2011.
4 Problem Statement R. Pintus CRS4/ViC, LC3D, March 2012 NORMALS RADII
5 Problem Statement R. Pintus CRS4/ViC, LC3D, March 2012 NORMALS RADII
6 Related work Point based rendering (PBR) techniques Continuous surface, solving visibility Object space vs Screen space Point attributes (normals and radii) needed Require only radii [Grottel et al. 2010] No attributes [Wimmer et al. 2006] Visibility not solved Direct visibility algorithms [Katz et al. 2007] and [Mehra et al. 2010] Compute point set convex hull not feasible for a real-time application
7 Our method Point based rendering pipeline Unstructured raw point clouds (no attributes) Screen-space operators Direct visibility, Anisotropic filling, Shading Real-time with massive models Multi-resolution out-of-core structure Minimizing pre-computation Suitable for quick on-site visualizations
8 Pipeline - Overview Unstructured Raw Point Cloud Point projection Visibility Filling Shape depiction Final rendering
9 Input data Unstructured Raw Point Cloud Point projection Visibility Filling Shape depiction Final rendering Unstructured raw point cloud Position (Color?) No normals No influence radii Multi-resolution out-ofcore structure Fast pre-processing
10 Point projection R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud Point projection Near Plane Visibility Filling Shape depiction Final rendering Far Plane
11 Point projection R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud Point projection Visibility Filling Shape depiction Final rendering
12 Visibility Unstructured Raw Point Cloud Point projection Near Plane Visibility Filling Shape depiction Final rendering Far Plane
13 Visibility Unstructured Raw Point Cloud Point projection Near Plane Visibility Filling Shape depiction Final rendering Far Plane
14 Visibility Unstructured Raw Point Cloud Point projection Near Plane Visibility Filling Shape depiction Final rendering Far Plane
15 Visibility Unstructured Raw Point Cloud Point projection Near Plane Visibility Filling Shape depiction Final rendering Far Plane
16 Visibility Unstructured Raw Point Cloud Point projection Near Plane Visibility Filling Shape depiction Final rendering Far Plane
17 Visibility Unstructured Raw Point Cloud Point projection Near Plane Visibility Filling Shape depiction Final rendering Far Plane
18 Visibility Unstructured Raw Point Cloud Point projection Screen-space implementation Visibility Filling Shape depiction Final rendering
19 Visibility Unstructured Raw Point Cloud Point projection Visibility Filling Shape depiction Final rendering
20 Anisotropic filling R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud Point projection 3D surface reconstruction 2D infilling Multi-pass GPU shader Visibility Filling Shape depiction Neighbor distance from Kernel center (pixel) w i 1 r i 2 1 min 1, Depth value of neighbor i z i z 0 Depth filter dimension Depth value of current pixel Final rendering
21 Anisotropic filling R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud Point projection Visibility Filling Shape depiction Final rendering
22 Shape depiction R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud Point projection Visibility Deferred shading Multi-level shading term Similar to [Rusinkiewicz et al. 2006] We start from (3x3 kernel) d i 0 min D Filling d i 0 max 0 0 Shape depiction Final rendering i 0 clamp d i 0 d max 0 i d d i 0 i 0 min min
23 Shape depiction R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud Point projection Visibility Filling Shape depiction Final rendering
24 Shape depiction R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud For a level D k d i k 1 k d 2 i k min Point projection Visibility Filling Shape depiction Final rendering
25 Shape depiction R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud For a level D k d i k 1 k d 2 i k min Point projection Visibility Filling Shape depiction k 0 Final rendering
26 Shape depiction R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud For a level D k d i k 1 k d 2 i k min Point projection Visibility Filling Shape depiction k 10 Final rendering
27 Shape depiction R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud For a level D k d i k 1 k d 2 i k min Point projection Visibility Filling Shape depiction k 20 Final rendering
28 Shape depiction R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud For a level D k d i k 1 k d 2 i k min Point projection Visibility Filling Shape depiction k 30 Final rendering
29 Shape depiction R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud Merging levels i K k 1 k i 0 k 1 Point projection Visibility Filling 3 2 Shape depiction Final rendering
30 Final rendering R. Pintus CRS4/ViC, LC3D, March 2012 Unstructured Raw Point Cloud Point projection Visibility Filling Shape depiction Final rendering
31 Results Massive unstructured raw point clouds Integrated in a pipeline for real-time out-ofcore rendering Datasets Sirmione 100Mpts Toronto 260Mpts Loggia (Brescia) 110Mpts
32 Results Video R. Pintus CRS4/ViC, LC3D, March 2012
33 Sirmione 100Mpts Point projection
34 Sirmione 100Mpts Pull-push method
35 Sirmione 100Mpts Our method
36 Sirmione 100Mpts Pull-push method
37 Sirmione 100Mpts Our method
38 Sirmione 100Mpts Our method with shape depiction
39 Toronto 260Mpts Point Splat Noisy dataset
40 Toronto 260Mpts Our Rendering Noisy dataset
41 Loggia (Brescia) 110Mpts Point Splat Noisy dataset
42 Loggia (Brescia) 110Mpts Our Rendering Noisy dataset
43 Conclusion PBR pipeline comparable to state-of-the-art techniques Unstructured raw point clouds Screen-space operators Real-time with massive models Multi-resolution out-of-core structure Minimizing pre-computation Robust to noise Suitable for quick on-site visualizations
44 vcg.isti.cnr.it/ Photo Mapping Ruggero Pintus, Enrico Gobbetti, and Roberto Combet. Fast and Robust Semi-Automatic Registration of Photographs to 3D Geometry. In The 12th International Symposium on Virtual Reality, Archaeology and Cultural Heritage, October 2011.
45 Problem Statement R. Pintus CRS4/ViC, LC3D, March D Geometry Unordered Set Of n Uncalibrated Photos n Camera Poses (2D/3D Registration)
46 Related work Manual selection of 2D-3D matches Massive user intervention Tiring and time-consuming Automatic feature matching Not robust enough for a generic dataset Semi-automatic statistical correlation Point cloud attributes not always provided Geometric multi-view reconstruction 2D-3D problem 3D-3D registration task dense and ordered frame sequence Our contribution Minimize user intervention / Large datasets / Semiautomatic / Multi-view based approach / No Attributes
47 Input Data User Dense 3D n Photos SfM Reconstruction Coarse Registration Refinement Output Data Dense Geometry Point cloud, triangle mesh, etc. No attributes No particular features n photos Naïve constraints: Blur, Noise, Under- or over-exposured Sufficient overlap
48 Multi-view User Dense 3D n Photos SfM Reconstruction Coarse Registration Refinement Bundler [Snavely et al. 2006] SfM system for unordered image collections n.edu/bundler/ Output A sparse point cloud n camera poses SIFT keypoints (projections of sparse 3D points) Output Data
49 Coarse registration User Dense 3D n Photos SfM Reconstruction Coarse Registration Refinement Output Data Register two point clouds with different: scales reference frames resolutions Automatic methods are not robust and efficient enough User aligns few images (one or more) to the dense geometry Affine transformation is applied to all cameras and sparse points
50 Refinement User Dense 3D n Photos P j C 1 Q C, 2 p j s 1, j SfM Reconstruction p j s 2, j NN F p j Coarse Registration Refinement Q C, 2 NN F p j C 2 Output Data E C, P N N P C j 1 i 1 v ij Q C i, NN F p j s i, j 2
51 Refinement User Dense 3D n Photos SfM Reconstruction Coarse Registration Refinement Sparse Bundle Adjustment (SBA) Constants SIFT keypoints, dense 3D points Variables Camera poses, sparse 3D points SBA A Generic SBA C/C++ Package Based on the Levenberg- Marquardt Algorithm kis/sba/ Output Data
52 Output data User Dense 3D n Photos n camera poses SfM Reconstruction Coarse Registration Refinement Input of photo blending n photos n camera poses Dense 3D geometry Output Data
53 Results Photo mapping R. Pintus CRS4/ViC, LC3D, March 2012
54 vcg.isti.cnr.it/ Photo Blending Ruggero Pintus, Enrico Gobbetti, and Marco Callieri. A Streaming Framework for Seamless Detailed Photo Blending on Massive Point Clouds. In Proc. Eurographics Area Papers. Pages 25-32, 2011.
55 Problem Statement R. Pintus CRS4/ViC, LC3D, March 2012 Point Cloud Calibrated Photos
56 Problem Statement R. Pintus CRS4/ViC, LC3D, March 2012 Point Cloud P Calibrated Photos
57 Problem Statement R. Pintus CRS4/ViC, LC3D, March 2012 Point Cloud P Calibrated Photos Colored Point Cloud
58 Problem Statement R. Pintus CRS4/ViC, LC3D, March 2012 Point Cloud P Calibrated Photos Colored Point Cloud Problem Unlimited size of 3D model (Gpoints) and unlimited number of images
59 Related work State-of-the-art techniques Image quality estimation Stitching or blending Data representation Triangle meshes exploit connectivity Meshless approaches Both triangle meshes and point clouds Memory settings All in-core no massive geometry/images 3D in-core and images out-of-core no massive geometry All out-of-core Low performances Our contribution Blending function / Streaming framework / Massive point cloud / Adaptive geometry refinement
60 Pipeline Photo Stencil Per-pixel Weight Masked Per-pixel Weight
61 Simple blending R. Pintus CRS4/ViC, LC3D, March 2012
62 Edge extraction and Distance Transform
63 Smooth weight R. Pintus CRS4/ViC, LC3D, March 2012
64 Smooth weight R. Pintus CRS4/ViC, LC3D, March 2012
65 Single band blending R. Pintus CRS4/ViC, LC3D, March 2012
66 Multi band blending R. Pintus CRS4/ViC, LC3D, March 2012
67 Adaptive point refinement R. Pintus CRS4/ViC, LC3D, March 2012
68 Adaptive point refinement R. Pintus CRS4/ViC, LC3D, March 2012
69 Adaptive point refinement R. Pintus CRS4/ViC, LC3D, March 2012
70 Adaptive point refinement R. Pintus CRS4/ViC, LC3D, March 2012
71 Results David 470Mpoints Callieri et. al 2008 David 28M Disk space occupancy 6.2GB Computation time 15.5 hours
72 Results Church s Apse 14 Mpoint Geometry 40 photos
73 Results Church s Apse R. Pintus CRS4/ViC, LC3D, March 2012
74 Results Grave 8 Mpoint Geometry 21 photos
75 Results Grave R. Pintus CRS4/ViC, LC3D, March 2012
76 Results Church s detail Outliers
77 Results Church s detail R. Pintus CRS4/ViC, LC3D, March 2012
78 Results R. Pintus CRS4/ViC, LC3D, March 2012
79 Results R. Pintus CRS4/ViC, LC3D, March 2012
80 Results David 470Mpoints Image size 19456x Gpixel
81 Results R. Pintus CRS4/ViC, LC3D, March 2012
82 Conclusion Point-based rendering pipeline Image-to-geometry registration approach Minimum user intervention No constraints on geometry, attributes and features Specific robust cost function and SBA Out-of-core photo blending approach (Point clouds of unlimited size) Incremental color accumulation (Unlimited number of images) Smooth weight function (Seamless color blending) Streaming framework (Performance improvement) Adaptive point refinement Future work Automatic sparse-to-dense geometry registration Interactive blending - adding and removing images in an interactive tool Fast visual check of previous alignment step
83 Conclusion Low cost Personal computer Digital camera Decreased manual intervention Open Source / Free Software Bundler SfM reconstruction Sparse Bundle Adjustment SBA Minimization Opengl / GLSL shaders Rendering Qt Interface Opencv Manual registration Spaceland Library Geometric computation IIPImage Web-based Viewer
84 Questions & Contacts CRS4 VIC Ruggero Pintus
Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov
Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter
More informationCamera Drones Lecture 3 3D data generation
Camera Drones Lecture 3 3D data generation Ass.Prof. Friedrich Fraundorfer WS 2017 Outline SfM introduction SfM concept Feature matching Camera pose estimation Bundle adjustment Dense matching Data products
More information3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.
3D Computer Vision Structured Light II Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de 1 Introduction
More information3D Editing System for Captured Real Scenes
3D Editing System for Captured Real Scenes Inwoo Ha, Yong Beom Lee and James D.K. Kim Samsung Advanced Institute of Technology, Youngin, South Korea E-mail: {iw.ha, leey, jamesdk.kim}@samsung.com Tel:
More informationLecture 8.2 Structure from Motion. Thomas Opsahl
Lecture 8.2 Structure from Motion Thomas Opsahl More-than-two-view geometry Correspondences (matching) More views enables us to reveal and remove more mismatches than we can do in the two-view case More
More informationDense 3D Reconstruction. Christiano Gava
Dense 3D Reconstruction Christiano Gava christiano.gava@dfki.de Outline Previous lecture: structure and motion II Structure and motion loop Triangulation Today: dense 3D reconstruction The matching problem
More information3DNSITE: A networked interactive 3D visualization system to simplify location awareness in crisis management
www.crs4.it/vic/ 3DNSITE: A networked interactive 3D visualization system to simplify location awareness in crisis management Giovanni Pintore 1, Enrico Gobbetti 1, Fabio Ganovelli 2 and Paolo Brivio 2
More informationA Systems View of Large- Scale 3D Reconstruction
Lecture 23: A Systems View of Large- Scale 3D Reconstruction Visual Computing Systems Goals and motivation Construct a detailed 3D model of the world from unstructured photographs (e.g., Flickr, Facebook)
More informationIl colore: acquisizione e visualizzazione. Lezione 17: 11 Maggio 2012
Il colore: acquisizione e visualizzazione Lezione 17: 11 Maggio 2012 The importance of color information Precision vs. Perception 3D scanned geometry Photo Color and appearance Pure geometry Pure color
More informationAPPLICATIONS OF OPEN AND FREE SOFTWARE: FROM UNDERWATER TO THE SKY
APPLICATIONS OF OPEN AND FREE SOFTWARE: FROM UNDERWATER TO THE SKY ISPRS Working Group V/2 Conference, Cultural heritage data acquisition and processing 17th 19th August 2011 - University of York, UK Why
More informationImproving Initial Estimations for Structure from Motion Methods
Improving Initial Estimations for Structure from Motion Methods University of Bonn Outline Motivation Computer-Vision Basics Stereo Vision Bundle Adjustment Feature Matching Global Initial Estimation Component
More informationLarge Scale 3D Reconstruction by Structure from Motion
Large Scale 3D Reconstruction by Structure from Motion Devin Guillory Ziang Xie CS 331B 7 October 2013 Overview Rome wasn t built in a day Overview of SfM Building Rome in a Day Building Rome on a Cloudless
More informationAccurate 3D Face and Body Modeling from a Single Fixed Kinect
Accurate 3D Face and Body Modeling from a Single Fixed Kinect Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this
More informationCOMPARISON OF LASER SCANNING, PHOTOGRAMMETRY AND SfM-MVS PIPELINE APPLIED IN STRUCTURES AND ARTIFICIAL SURFACES
COMPARISON OF LASER SCANNING, PHOTOGRAMMETRY AND SfM-MVS PIPELINE APPLIED IN STRUCTURES AND ARTIFICIAL SURFACES 2012 ISPRS Melbourne, Com III/4, S.Kiparissi Cyprus University of Technology 1 / 28 Structure
More informationIl colore: acquisizione e visualizzazione. Lezione 20: 11 Maggio 2011
Il colore: acquisizione e visualizzazione Lezione 20: 11 Maggio 2011 Outline The importance of color What is color? Material properties vs. unshaded color Texture building from photos Image registration
More informationDense 3D Reconstruction. Christiano Gava
Dense 3D Reconstruction Christiano Gava christiano.gava@dfki.de Outline Previous lecture: structure and motion II Structure and motion loop Triangulation Wide baseline matching (SIFT) Today: dense 3D reconstruction
More informationAugmenting Reality, Naturally:
Augmenting Reality, Naturally: Scene Modelling, Recognition and Tracking with Invariant Image Features by Iryna Gordon in collaboration with David G. Lowe Laboratory for Computational Intelligence Department
More informationHigh-Quality Surface Splatting on Today s GPUs
High-Quality Surface Splatting on Today s GPUs M. Botsch, A. Hornung, M. Zwicker, L. Kobbelt Presented by Julian Yu-Chung Chen CS594 GPU Programming 2006-03-30 Outline Point Based Rendering Surface splatting
More informationHigh Quality Adaptive Soft Shadow Mapping
High Quality Adaptive Soft Shadow Mapping A paper by Gaël Guennebaud, Loïc Barthe and Mathias Paulin Roy Triesscheijn Overview - Algorithms from 2 papers, initial 2006 version and improved version from
More information3D Models from Range Sensors. Gianpaolo Palma
3D Models from Range Sensors Gianpaolo Palma Who Gianpaolo Palma Researcher at Visual Computing Laboratory (ISTI-CNR) Expertise: 3D scanning, Mesh Processing, Computer Graphics E-mail: gianpaolo.palma@isti.cnr.it
More informationPanoramic Image Stitching
Mcgill University Panoramic Image Stitching by Kai Wang Pengbo Li A report submitted in fulfillment for the COMP 558 Final project in the Faculty of Computer Science April 2013 Mcgill University Abstract
More informationPoint-Based Rendering
Point-Based Rendering Kobbelt & Botsch, Computers & Graphics 2004 Surface Splatting (EWA: Elliptic Weighted Averaging) Main Idea Signal Processing Basics Resampling Gaussian Filters Reconstruction Kernels
More informationImage-Based Modeling and Rendering. Image-Based Modeling and Rendering. Final projects IBMR. What we have learnt so far. What IBMR is about
Image-Based Modeling and Rendering Image-Based Modeling and Rendering MIT EECS 6.837 Frédo Durand and Seth Teller 1 Some slides courtesy of Leonard McMillan, Wojciech Matusik, Byong Mok Oh, Max Chen 2
More informationStructure from Motion. Introduction to Computer Vision CSE 152 Lecture 10
Structure from Motion CSE 152 Lecture 10 Announcements Homework 3 is due May 9, 11:59 PM Reading: Chapter 8: Structure from Motion Optional: Multiple View Geometry in Computer Vision, 2nd edition, Hartley
More informationADVANCING REALITY MODELING WITH CONTEXTCAPTURE
ADVANCING REALITY MODELING WITH CONTEXTCAPTURE Knowing the existing conditions of a project is a key asset in any decision process. Governments need to better know their territories, through mapping operations,
More informationMulti-View Stereo for Static and Dynamic Scenes
Multi-View Stereo for Static and Dynamic Scenes Wolfgang Burgard Jan 6, 2010 Main references Yasutaka Furukawa and Jean Ponce, Accurate, Dense and Robust Multi-View Stereopsis, 2007 C.L. Zitnick, S.B.
More informationStructured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov
Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter
More information3D Scanning. Lecture courtesy of Szymon Rusinkiewicz Princeton University
3D Scanning Lecture courtesy of Szymon Rusinkiewicz Princeton University Computer Graphics Pipeline 3D Scanning Shape Motion Rendering Lighting and Reflectance Human time = expensive Sensors = cheap Computer
More informationImage Based Reconstruction II
Image Based Reconstruction II Qixing Huang Feb. 2 th 2017 Slide Credit: Yasutaka Furukawa Image-Based Geometry Reconstruction Pipeline Last Lecture: Multi-View SFM Multi-View SFM This Lecture: Multi-View
More informationGeometry for Computer Vision
Geometry for Computer Vision Lecture 5b Calibrated Multi View Geometry Per-Erik Forssén 1 Overview The 5-point Algorithm Structure from Motion Bundle Adjustment 2 Planar degeneracy In the uncalibrated
More informationMixed-Reality for Intuitive Photo-Realistic 3D-Model Generation
Mixed-Reality for Intuitive Photo-Realistic 3D-Model Generation Wolfgang Sepp, Tim Bodenmueller, Michael Suppa, and Gerd Hirzinger DLR, Institut für Robotik und Mechatronik @ GI-Workshop VR/AR 2009 Folie
More informationCS GPU and GPGPU Programming Lecture 2: Introduction; GPU Architecture 1. Markus Hadwiger, KAUST
CS 380 - GPU and GPGPU Programming Lecture 2: Introduction; GPU Architecture 1 Markus Hadwiger, KAUST Reading Assignment #2 (until Feb. 17) Read (required): GLSL book, chapter 4 (The OpenGL Programmable
More information28 out of 28 images calibrated (100%), all images enabled. 0.02% relative difference between initial and optimized internal camera parameters
Dronedata Render Server Generated Quality Report Phase 1 Time 00h:01m:56s Phase 2 Time 00h:04m:35s Phase 3 Time 00h:13m:45s Total Time All Phases 00h:20m:16s Generated with Pix4Dmapper Pro - TRIAL version
More informationREFINEMENT OF COLORED MOBILE MAPPING DATA USING INTENSITY IMAGES
REFINEMENT OF COLORED MOBILE MAPPING DATA USING INTENSITY IMAGES T. Yamakawa a, K. Fukano a,r. Onodera a, H. Masuda a, * a Dept. of Mechanical Engineering and Intelligent Systems, The University of Electro-Communications,
More informationStructure from motion
Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t R 2 3,t 3 Camera 1 Camera
More informationSeamless Texturing of Archaeological Data
Seamless Texturing of Archaeological Data Michael Birsak Przemyslaw Musialski Murat Arikan Michael Wimmer Institute of Computer Graphics and Algorithms Vienna University of Technology, Vienna, Austria
More informationScreen-Space Triangulation for Interactive Point Rendering
Screen-Space Triangulation for Interactive Point Rendering Reinhold Preiner Institute of Computer Graphics and Algorithms Vienna University of Technology Motivation High-quality point rendering mostly
More informationObject Recognition with Invariant Features
Object Recognition with Invariant Features Definition: Identify objects or scenes and determine their pose and model parameters Applications Industrial automation and inspection Mobile robots, toys, user
More informationGRAPHICS TOOLS FOR THE GENERATION OF LARGE SCALE URBAN SCENES
GRAPHICS TOOLS FOR THE GENERATION OF LARGE SCALE URBAN SCENES Norbert Haala, Martin Kada, Susanne Becker, Jan Böhm, Yahya Alshawabkeh University of Stuttgart, Institute for Photogrammetry, Germany Forename.Lastname@ifp.uni-stuttgart.de
More informationDirect Methods in Visual Odometry
Direct Methods in Visual Odometry July 24, 2017 Direct Methods in Visual Odometry July 24, 2017 1 / 47 Motivation for using Visual Odometry Wheel odometry is affected by wheel slip More accurate compared
More informationStructured light 3D reconstruction
Structured light 3D reconstruction Reconstruction pipeline and industrial applications rodola@dsi.unive.it 11/05/2010 3D Reconstruction 3D reconstruction is the process of capturing the shape and appearance
More informationStep-by-Step Model Buidling
Step-by-Step Model Buidling Review Feature selection Feature selection Feature correspondence Camera Calibration Euclidean Reconstruction Landing Augmented Reality Vision Based Control Sparse Structure
More informationPipeline Operations. CS 4620 Lecture Steve Marschner. Cornell CS4620 Spring 2018 Lecture 11
Pipeline Operations CS 4620 Lecture 11 1 Pipeline you are here APPLICATION COMMAND STREAM 3D transformations; shading VERTEX PROCESSING TRANSFORMED GEOMETRY conversion of primitives to pixels RASTERIZATION
More informationarxiv: v1 [cs.cv] 28 Sep 2018
Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,
More informationPhoto Tourism: Exploring Photo Collections in 3D
Click! Click! Oooo!! Click! Zoom click! Click! Some other camera noise!! Photo Tourism: Exploring Photo Collections in 3D Click! Click! Ahhh! Click! Click! Overview of Research at Microsoft, 2007 Jeremy
More informationVision 3D articielle Multiple view geometry
Vision 3D articielle Multiple view geometry Pascal Monasse monasse@imagine.enpc.fr IMAGINE, École des Ponts ParisTech Contents Multi-view constraints Multi-view calibration Incremental calibration Global
More informationTSBK03 Screen-Space Ambient Occlusion
TSBK03 Screen-Space Ambient Occlusion Joakim Gebart, Jimmy Liikala December 15, 2013 Contents 1 Abstract 1 2 History 2 2.1 Crysis method..................................... 2 3 Chosen method 2 3.1 Algorithm
More informationL2 Data Acquisition. Mechanical measurement (CMM) Structured light Range images Shape from shading Other methods
L2 Data Acquisition Mechanical measurement (CMM) Structured light Range images Shape from shading Other methods 1 Coordinate Measurement Machine Touch based Slow Sparse Data Complex planning Accurate 2
More informationParis-Le Bourget Airport. 557 out of 557 images calibrated (100%), all images enabled
DroneData Render Server Generated Quality Report Phase 1 Time 00h:27m:34s Phase 2 Time 01h:40m:23s Phase 3 Time 01h:41m:18s Total Time All Phases 03h:48m:59s Generated with Pix4Dmapper Pro - TRIAL version
More informationSMOOTH VISUALIZATION OF LARGE POINT CLOUDS
Vol. 11, No. 2, pp. 146-158 ISSN: 1646-3692 SMOOTH VISUALIZATION OF LARGE POINT CLOUDS Jörg Futterlieb, Christian Teutsch and Dirk Berndt. Fraunhofer Institute for Factory Operation and Automation IFF,
More information3D Reconstruction from Multi-View Stereo: Implementation Verification via Oculus Virtual Reality
3D Reconstruction from Multi-View Stereo: Implementation Verification via Oculus Virtual Reality Andrew Moran MIT, Class of 2014 andrewmo@mit.edu Ben Eysenbach MIT, Class of 2017 bce@mit.edu Abstract We
More informationAccurate and Dense Wide-Baseline Stereo Matching Using SW-POC
Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC Shuji Sakai, Koichi Ito, Takafumi Aoki Graduate School of Information Sciences, Tohoku University, Sendai, 980 8579, Japan Email: sakai@aoki.ecei.tohoku.ac.jp
More informationPipeline Operations. CS 4620 Lecture 14
Pipeline Operations CS 4620 Lecture 14 2014 Steve Marschner 1 Pipeline you are here APPLICATION COMMAND STREAM 3D transformations; shading VERTEX PROCESSING TRANSFORMED GEOMETRY conversion of primitives
More information3D Object Representations. COS 526, Fall 2016 Princeton University
3D Object Representations COS 526, Fall 2016 Princeton University 3D Object Representations How do we... Represent 3D objects in a computer? Acquire computer representations of 3D objects? Manipulate computer
More informationRobust extraction of image correspondences exploiting the image scene geometry and approximate camera orientation
Robust extraction of image correspondences exploiting the image scene geometry and approximate camera orientation Bashar Alsadik a,c, Fabio Remondino b, Fabio Menna b, Markus Gerke a, George Vosselman
More informationInstance-level recognition
Instance-level recognition 1) Local invariant features 2) Matching and recognition with local features 3) Efficient visual search 4) Very large scale indexing Matching of descriptors Matching and 3D reconstruction
More informationInstance-level recognition
Instance-level recognition 1) Local invariant features 2) Matching and recognition with local features 3) Efficient visual search 4) Very large scale indexing Matching of descriptors Matching and 3D reconstruction
More informationCS 4758: Automated Semantic Mapping of Environment
CS 4758: Automated Semantic Mapping of Environment Dongsu Lee, ECE, M.Eng., dl624@cornell.edu Aperahama Parangi, CS, 2013, alp75@cornell.edu Abstract The purpose of this project is to program an Erratic
More informationBIL Computer Vision Apr 16, 2014
BIL 719 - Computer Vision Apr 16, 2014 Binocular Stereo (cont d.), Structure from Motion Aykut Erdem Dept. of Computer Engineering Hacettepe University Slide credit: S. Lazebnik Basic stereo matching algorithm
More informationMultiview Stereo COSC450. Lecture 8
Multiview Stereo COSC450 Lecture 8 Stereo Vision So Far Stereo and epipolar geometry Fundamental matrix captures geometry 8-point algorithm Essential matrix with calibrated cameras 5-point algorithm Intersect
More informationGeometric and Semantic 3D Reconstruction: Part 4A: Volumetric Semantic 3D Reconstruction. CVPR 2017 Tutorial Christian Häne UC Berkeley
Geometric and Semantic 3D Reconstruction: Part 4A: Volumetric Semantic 3D Reconstruction CVPR 2017 Tutorial Christian Häne UC Berkeley Dense Multi-View Reconstruction Goal: 3D Model from Images (Depth
More informationLaptop Generated Quality Report Phase 1 Time 00h:26m:45s Phase 2 Time 02h:30m:06s Phase 3 Time 01h:20m:19s Total Time All phases 04h:17m:10s
Laptop Generated Quality Report Phase 1 Time 00h:26m:45s Phase 2 Time 02h:30m:06s Phase 3 Time 01h:20m:19s Total Time All phases 04h:17m:10s Generated with Pix4Dmapper Pro - TRIAL version 2.0.104 Important:
More informationCRF Based Point Cloud Segmentation Jonathan Nation
CRF Based Point Cloud Segmentation Jonathan Nation jsnation@stanford.edu 1. INTRODUCTION The goal of the project is to use the recently proposed fully connected conditional random field (CRF) model to
More informationReal-time Rendering of Massive Unstructured Raw Point Clouds using Screen-space Operators
The 12th International Symposium on Virtual Reality, Archaeology and Cultural Heritage VAST (2011) M. Dellepiane, F. Niccolucci, S. Pena Serna, H. Rushmeier, and L. Van Gool(Editors) Real-time Rendering
More informationLecture 10: Multi view geometry
Lecture 10: Multi view geometry Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Stereo vision Correspondence problem (Problem Set 2 (Q3)) Active stereo vision systems Structure from
More informationAutomatic image-based reconstruction of historical buildings from Ayutthaya
การประช มว ชาการว ศวกรรมโยธาแห งชาต คร งท 20 The 20 tth National Convention on Civil Engineering ว นท 8-10 กรกฎาคม 2558 จ. ชลบ ร 8-10 July 2015, Chonburi, THAILAND Automatic image-based reconstruction
More informationAugmented Reality, Advanced SLAM, Applications
Augmented Reality, Advanced SLAM, Applications Prof. Didier Stricker & Dr. Alain Pagani alain.pagani@dfki.de Lecture 3D Computer Vision AR, SLAM, Applications 1 Introduction Previous lectures: Basics (camera,
More informationMulti-view stereo. Many slides adapted from S. Seitz
Multi-view stereo Many slides adapted from S. Seitz Beyond two-view stereo The third eye can be used for verification Multiple-baseline stereo Pick a reference image, and slide the corresponding window
More informationSrikumar Ramalingam. Review. 3D Reconstruction. Pose Estimation Revisited. School of Computing University of Utah
School of Computing University of Utah Presentation Outline 1 2 3 Forward Projection (Reminder) u v 1 KR ( I t ) X m Y m Z m 1 Backward Projection (Reminder) Q K 1 q Presentation Outline 1 2 3 Sample Problem
More information3D from Images - Assisted Modeling, Photogrammetry. Marco Callieri ISTI-CNR, Pisa, Italy
3D from Images - Assisted Modeling, Photogrammetry Marco Callieri ISTI-CNR, Pisa, Italy 3D from Photos Our not-so-secret dream: obtain a reliable and precise 3D from simple photos Why? Easier, cheaper
More informationFusion of laser scanning and Photogrammetric data for the documentation and VR visualization of an archaeological tomb complex
Presented at the FIG Congress 2018, May 6-11, 2018 in Istanbul, Turkey Fusion of laser scanning and Photogrammetric data for the documentation and VR visualization of an archaeological tomb complex E.
More informationIntrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting
Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting R. Maier 1,2, K. Kim 1, D. Cremers 2, J. Kautz 1, M. Nießner 2,3 Fusion Ours 1
More informationNeue Verfahren der Bildverarbeitung auch zur Erfassung von Schäden in Abwasserkanälen?
Neue Verfahren der Bildverarbeitung auch zur Erfassung von Schäden in Abwasserkanälen? Fraunhofer HHI 13.07.2017 1 Fraunhofer-Gesellschaft Fraunhofer is Europe s largest organization for applied research.
More informationUsing digital 3D technology for documenting and studying the Griffin
Using digital 3D technology for documenting and studying the Griffin Marco Callieri, Roberto Scopigno, Matteo Dellepiane Visual Computing Lab, CNR-ISTI, Pisa, Italy marco.callieri@isti.cnr.it roberto.scopigno@isti.cnr.it
More information3D Colored Model Generation Based on Multiview Textures and Triangular Mesh
3D Colored Model Generation Based on Multiview Textures and Triangular Mesh Lingni Ma, Luat Do, Egor Bondarev and Peter H. N. de With Department of Electrical Engineering, Eindhoven University of Technology
More information3D object recognition used by team robotto
3D object recognition used by team robotto Workshop Juliane Hoebel February 1, 2016 Faculty of Computer Science, Otto-von-Guericke University Magdeburg Content 1. Introduction 2. Depth sensor 3. 3D object
More informationCluster-based 3D Reconstruction of Aerial Video
Cluster-based 3D Reconstruction of Aerial Video Scott Sawyer (scott.sawyer@ll.mit.edu) MIT Lincoln Laboratory HPEC 12 12 September 2012 This work is sponsored by the Assistant Secretary of Defense for
More informationENGN D Photography / Spring 2018 / SYLLABUS
ENGN 2502 3D Photography / Spring 2018 / SYLLABUS Description of the proposed course Over the last decade digital photography has entered the mainstream with inexpensive, miniaturized cameras routinely
More informationTecnologie per la ricostruzione di modelli 3D da immagini. Marco Callieri ISTI-CNR, Pisa, Italy
Tecnologie per la ricostruzione di modelli 3D da immagini Marco Callieri ISTI-CNR, Pisa, Italy 3D from Photos Our not-so-secret dream: obtain a reliable and precise 3D from simple photos Why? Easier, less
More informationHomographies and RANSAC
Homographies and RANSAC Computer vision 6.869 Bill Freeman and Antonio Torralba March 30, 2011 Homographies and RANSAC Homographies RANSAC Building panoramas Phototourism 2 Depth-based ambiguity of position
More informationScreen Space Ambient Occlusion TSBK03: Advanced Game Programming
Screen Space Ambient Occlusion TSBK03: Advanced Game Programming August Nam-Ki Ek, Oscar Johnson and Ramin Assadi March 5, 2015 This project report discusses our approach of implementing Screen Space Ambient
More informationMultiview Photogrammetry 3D Virtual Geology for everyone
Multiview Photogrammetry 3D Virtual Geology for everyone A short course Marko Vrabec University of Ljubljana, Department of Geology FIRST: some background info Precarious structural measurements of fractures
More informationTERRESTRIAL LASER SCANNER DATA PROCESSING
TERRESTRIAL LASER SCANNER DATA PROCESSING L. Bornaz (*), F. Rinaudo (*) (*) Politecnico di Torino - Dipartimento di Georisorse e Territorio C.so Duca degli Abruzzi, 24 10129 Torino Tel. +39.011.564.7687
More informationMulti-View 3D-Reconstruction
Multi-View 3D-Reconstruction Cedric Cagniart Computer Aided Medical Procedures (CAMP) Technische Universität München, Germany 1 Problem Statement Given several calibrated views of an object... can we automatically
More information03 - Reconstruction. Acknowledgements: Olga Sorkine-Hornung. CSCI-GA Geometric Modeling - Spring 17 - Daniele Panozzo
3 - Reconstruction Acknowledgements: Olga Sorkine-Hornung Geometry Acquisition Pipeline Scanning: results in range images Registration: bring all range images to one coordinate system Stitching/ reconstruction:
More informationTecnologie per la ricostruzione di modelli 3D da immagini. Marco Callieri ISTI-CNR, Pisa, Italy
Tecnologie per la ricostruzione di modelli 3D da immagini Marco Callieri ISTI-CNR, Pisa, Italy Who am I? Marco Callieri PhD in computer science Always had the like for 3D graphics... Researcher at the
More informationIndex. 3D reconstruction, point algorithm, point algorithm, point algorithm, point algorithm, 263
Index 3D reconstruction, 125 5+1-point algorithm, 284 5-point algorithm, 270 7-point algorithm, 265 8-point algorithm, 263 affine point, 45 affine transformation, 57 affine transformation group, 57 affine
More informationData Representation in Visualisation
Data Representation in Visualisation Visualisation Lecture 4 Taku Komura Institute for Perception, Action & Behaviour School of Informatics Taku Komura Data Representation 1 Data Representation We have
More informationEE795: Computer Vision and Intelligent Systems
EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 12 130228 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Panoramas, Mosaics, Stitching Two View Geometry
More informationMeshlab as a Complete Open Tool for the Integration of Photos and Colour with High- Resolution 3D Geometry Data
Meshlab as a Complete Open Tool for the Integration of Photos and Colour with High- Resolution 3D Geometry Data Marco Callieri, Guido Ranzuglia, Matteo Dellepiane, Paolo Cignoni and Roberto Scopigno Visual
More informationNear-Infrared Dataset. 101 out of 101 images calibrated (100%), all images enabled
Dronedata Back Office Server Generated Quality Report Phase 1 Time 01h:22m:16s Phase 2 Time 00h:11m:39s Phase 3 Time 00h:01m:40s Total Time All Phases 01:35m:35s Generated with Pix4Dmapper Pro - TRIAL
More informationComputer Graphics (CS 543) Lecture 10: Soft Shadows (Maps and Volumes), Normal and Bump Mapping
Computer Graphics (CS 543) Lecture 10: Soft Shadows (Maps and Volumes), Normal and Bump Mapping Prof Emmanuel Agu Computer Science Dept. Worcester Polytechnic Institute (WPI) Shadow Buffer Theory Observation:
More informationProject Updates Short lecture Volumetric Modeling +2 papers
Volumetric Modeling Schedule (tentative) Feb 20 Feb 27 Mar 5 Introduction Lecture: Geometry, Camera Model, Calibration Lecture: Features, Tracking/Matching Mar 12 Mar 19 Mar 26 Apr 2 Apr 9 Apr 16 Apr 23
More informationStructure from motion
Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t 2 R 3,t 3 Camera 1 Camera
More informationFan-Meshes: A Geometric Primitive for Point-based Description of 3D Models and Scenes
Fan-Meshes: A Geometric Primitive for Point-based Description of 3D Models and Scenes Xiaotian Yan, Fang Meng, Hongbin Zha National Laboratory on Machine Perception Peking University, Beijing, P. R. China
More informationProcessing 3D Surface Data
Processing 3D Surface Data Computer Animation and Visualisation Lecture 12 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing
More informationComputer Graphics (CS 563) Lecture 4: Advanced Computer Graphics Image Based Effects: Part 2. Prof Emmanuel Agu
Computer Graphics (CS 563) Lecture 4: Advanced Computer Graphics Image Based Effects: Part 2 Prof Emmanuel Agu Computer Science Dept. Worcester Polytechnic Institute (WPI) Image Processing Graphics concerned
More informationOnline Interactive 4D Character Animation
Online Interactive 4D Character Animation Marco Volino, Peng Huang and Adrian Hilton Web3D 2015 Outline 4D Performance Capture - 3D Reconstruction, Alignment, Texture Maps Animation - Parametric Motion
More informationREAL-TIME ADAPTIVE POINT SPLATTING FOR NOISY POINT CLOUDS
REAL-TIME ADAPTIVE POINT SPLATTING FOR NOISY POINT CLOUDS Rosen Diankov*, Ruzena Bajcsy + Dept. of Electrical Engineering and Computer Science University of California, Berkeley rdiankov@cmu.edu*, bajcsy@eecs.berkeley.edu
More informationMulti-view reconstruction for projector camera systems based on bundle adjustment
Multi-view reconstruction for projector camera systems based on bundle adjustment Ryo Furuakwa, Faculty of Information Sciences, Hiroshima City Univ., Japan, ryo-f@hiroshima-cu.ac.jp Kenji Inose, Hiroshi
More information