Matching and Recognition in 3D. Based on slides by Tom Funkhouser and Misha Kazhdan
|
|
- Ada Nelson
- 5 years ago
- Views:
Transcription
1 Matching and Recognition in 3D Based on slides by Tom Funkhouser and Misha Kazhdan
2 From 2D to 3D: Some Things Easier No occlusion (but sometimes missing data instead) Segmenting objects often simpler
3 From 2D to 3D: Many Things Harder Rigid transform has 6 degrees of freedom vs. 3 Brute-force algorithms much less practical Rotations do not commute Difficult to parameterize, search over No natural parameterization for surfaces in 3D Hard to do FFT, convolution, PCA Exception: range images
4 Shape Matching Challenge Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating 3D Query Shape Descriptor Best Matches 3D Database
5 Shape Matching Challenge Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating 3D Query Shape Descriptor Best Matches 3D Database
6 Shape Matching Challenge Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating 3D Query Shape Descriptor Best Matches 3D Database
7 Shape Matching Challenge Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating 3D Query Shape Descriptor Best Matches 3D Database
8 Shape Matching Challenge Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating 3D Query Shape Descriptor Best Matches 3D Database
9 Shape Matching Challenge Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating Invariant to transformations Invariant to deformations Insensitive to noise Insensitive to topology Robust to degeneracies Different Transformations (translation, scale, rotation, mirror)
10 Shape Matching Challenge Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating Invariant to transformations Invariant to deformations Insensitive to noise Insensitive to topology Robust to degeneracies Different Articulated Poses
11 Shape Matching Challenge Image courtesy of Ramamoorthi et al. Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating Invariant to transformations Invariant to deformations Insensitive to noise Insensitive to topology Robust to degeneracies Scanned Surface
12 Shape Matching Challenge Images courtesy of Viewpoint & Stanford Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating Invariant to transformations Invariant to deformations Insensitive to noise Insensitive to topology Robust to degeneracies Different Genus Different Tessellations
13 Shape Matching Challenge Images courtesy of Utah & De Espona Need shape descriptor & matching method that is: Concise to store Quick to compute Efficient to match Discriminating Invariant to transformations Invariant to deformations Insensitive to noise Insensitive to topology Robust to degeneracies No Bottom!
14 Taxonomy of 3D Matching Methods Images courtesy of Amenta & Osada Structural representations Skeletons Part-based methods Feature-based methods Statistical representations Attribute feature vectors Volumetric methods Surface-based methods View-based methods
15 Features on Surfaces Can construct edge and corner detectors Analogue of 1 st derivative: surface normal Analogue of 2 nd derivative: curvature Curvature at each point in each direction Minimum and maximum: principal curvatures Can threshold or do nonmaximum suppression
16 Taxonomy of 3D Matching Methods Image courtesy of Mao Chen Structural representations Skeletons Part-based methods Tables Feature-based methods Statistical representations Feature 1 Desks File cabinets Attribute feature vectors Volumetric methods Feature 2 Surface-based methods View-based methods
17 Example Shape distributions Shape representation: probability distributions Distance measure: difference between distributions Evaluation method: classification performance
18 Shape Distributions Key idea: map 3D surfaces to common parameterization by randomly sampling shape function 3D Models Randomly sample shape function Probability Probability Distance Distance D2 Shape Distributions Similarity Measure
19 Which Shape Function? Implementation: simple shape functions based on angles, distances, areas, and volumes θ θ A3 (angle) D1 (distance) D2 (distance) D3 (area) D4 (volume) [Ankerst 99]
20 D2 Shape Distribution Properties Concise to store? Quick to compute? Invariant to transforms? Efficient to match? Insensitive to noise? Insensitive to topology? Robust to degeneracies? Invariant to deformations? Discriminating?
21 D2 Shape Distribution Properties Concise to store? Quick to compute? Invariant to transforms? Efficient to match? Insensitive to noise? Insensitive to topology? Robust to degeneracies? Invariant to deformations? Discriminating? Probability Distance Skateboard 512 bytes (64 values) 0.5 seconds (10 6 samples)
22 D2 Shape Distribution Properties Concise to store Translation Quick to compute Rotation Invariant to transforms? { Mirror Efficient to match? Scale (w/ normalization) Insensitive to noise? Insensitive to topology? Robust to degeneracies? Invariant to deformations? Discriminating? Skateboard Normalized Means Porsche
23 D2 Shape Distribution Properties Concise to store Quick to compute Invariant to transforms Efficient to match? Insensitive to noise? Insensitive to topology? Robust to degeneracies? Invariant to deformations? Discriminating? Probability Porsche Distance Skateboard
24 D2 Shape Distribution Properties Concise to store Quick to compute Invariant to transforms Efficient to match Insensitive to noise? Insensitive to topology? Robust to degeneracies? Invariant to deformations? Discriminating? 1% Noise
25 D2 Shape Distribution Properties Concise to store Quick to compute Invariant to transforms Efficient to match Insensitive to noise Insensitive to topology Robust to degeneracies Invariant to deformations? Discriminating? Ellipsoids with Different Eccentricities
26 D2 Shape Distribution Properties Concise to store Quick to compute Invariant to transforms Efficient to match Insensitive to noise Insensitive to topology Robust to degeneracies Invariant to deformations Discriminating? Line Segment Cylinder Sphere Circle Cube Two Spheres
27 D2 Shape Distribution Results Question How discriminating are D2 shape distributions? Test database 133 polygonal models 25 classes 4 Mugs 6 Cars 3 Boats
28 D2 Shape Distribution Results D2 distributions are different across classes D2 shape distributions for 15 classes of objects
29 D2 Shape Distribution Results D2 distributions reveal gross shape of object Line Segment D2 shape distributions for 15 classes of objects
30 D2 Shape Distribution Results D2 distributions reveal gross shape of object Circle D2 shape distributions for 15 classes of objects
31 D2 Shape Distribution Results D2 distributions reveal gross shape of object Cylinder D2 shape distributions for 15 classes of objects
32 D2 Shape Distribution Results D2 distributions reveal gross shape of object Sphere D2 shape distributions for 15 classes of objects
33 D2 Shape Distribution Results D2 distributions reveal gross shape of object Two Spheres D2 shape distributions for 15 classes of objects
34 D2 Shape Distribution Results But are D2 distributions discriminating? D2 shape distributions for 15 classes of objects
35 D2 Shape Distribution Results Probability Distance D2 distributions for 5 tanks (gray) and 6 cars (black)
36 Evaluation Methods For each model (the query): Compute match score for all models Rank matches from best to worst Measure how often models in same class as query appear near top of ranked list Query Ranked Matches
37 Evaluation Methods Precision-recall curves Precision = retrieved_in_class / total_retrieved Recall = retrieved_in_class / total_in_class 100% 80% Precision 60% 40% 20% % 40% 60% 80% Recall 100%
38 Evaluation Methods Precision-recall curve example Precision = 0 / 0 Recall = 0 / Precision 100% 80% 60% 40% 20% Query Ranked Matches % 40% 60% 80% Recall 100%
39 Evaluation Methods Precision-recall curve example Precision = 1 / 1 Recall = 1 / Precision 100% 80% 60% 40% 20% Query Ranked Matches % 40% 60% 80% Recall 100%
40 Evaluation Methods Precision-recall curve example Precision = 2 / 3 Recall = 2 / Precision 100% 80% 60% 40% 20% Query Ranked Matches % 40% 60% 80% Recall 100%
41 Evaluation Methods Precision-recall curve example Precision = 3 / 5 Recall = 3 / Precision 100% 80% 60% 40% 20% Query Ranked Matches % 40% 60% 80% Recall 100%
42 Evaluation Methods Precision-recall curve example Precision = 4 / 7 Recall = 4 / Precision 100% 80% 60% 40% 20% Query Ranked Matches % 40% 60% 80% Recall 100%
43 Evaluation Methods Precision-recall curve example Precision = 5 / 9 Recall = 5 / Precision 100% 80% 60% 40% 20% Query Ranked Matches % 40% 60% 80% Recall 100%
44 Evaluation Methods 100% Precision 50% D2 Random 0% 0% 50% 100% Recall
45 Extended Gaussian Image [Horn, 1984] Represent a model by a spherical function by binning surface normals Model Angular Bins EGI
46 Extended Gaussian Image [Horn, 1984] Properties: Invertible for convex shapes Can be defined for most models 2D array of information Point Clouds Polygon Soups Closed Meshes Genus-0 Meshes Shape Spectrum
47 Extended Gaussian Image [Horn, 1984] Properties: Invertible for convex shapes Can be defined for most models 2D array of information Limitations: In general, shapes are not convex Normals are sensitive to noise 3D Model EGI
48 Extended Gaussian Image [Horn, 1984] Properties: Invertible for convex shapes Can be defined for most models 2D array of information Limitations: In general, shapes are not convex Normals are sensitive to noise Initial Model Noisy Model
49 Retrieval Results Princeton Shape Benchmark 51 potted plants 33 faces 15 desk chairs 22 dining chairs 100 humans 28 biplanes 14 flying birds 11 ships
50 Retrieval Results 100% Precision 50% Extended Gaussian Image D2 Random 0% 0% 50% 100% Recall
51 Shape Histograms [Ankerst et al., 1999] Shape descriptor stores a histogram of how much surface resides at different bins in space Model Shape Histogram (Sectors + Shells)
52 Boundary Voxel Representation Represent a model as the (anti-aliased) rasterization of its surface into a regular grid: A voxel has value 1 (or area of intersection) if it intersects the boundary A voxel has value 0 if it doesn t intersect Model Voxel Grid
53 Boundary Voxel Representation Properties: Can be defined for any model Invertible 3D array of information Point Clouds Polygon Soups Closed Meshes Genus-0 Meshes Shape Spectrum
54 Boundary Voxel Representation Properties: Can be defined for any model Invertible 3D array of information Limitations: Difficult to match If the resolution is too high: most voxels miss If the resolution is too low: representation is too coarse Intersection
55 Retrieval Results Precision 100% 50% Shape Histograms Extended Gaussian Image D2 Random 0% 0% 50% 100% Recall
56 Histogram Representations Challenge: If shape properties are mapped to nearby bins, they will not be compared Solutions: Match across adjacent bins: Earth Mover s Distance Low-pass filter: Convolution with a Gaussian
57 Earth Mover s distance [Rubner et al. 1998] Match by computing the minimal amount of work needed to transform one distribution into the other. Computing the distance: For 1D histograms can use the CDF to compare efficiently In general, need to solve the transportation problem which is inefficient for large numbers of bins
58 Convolving with a Gaussian The value at a point is obtained by summing Gaussians distributed over the surface of the model. Distributes the surface into adjacent bins Blurs the model, loses high frequency information Surface Gaussian Gaussian convolved surface
59 Gaussian EDT [Kazhdan et al., 2003] The value at a point is obtained by summing the Gaussian of the closest point on the model surface. Distributes the surface into adjacent bins Maintains high-frequency information max Surface Gaussian Gaussian EDT
60 Gaussian EDT Properties: Can be defined for any model Invertible 3D array of information Difference measures proximity between surfaces Point Clouds Polygon Soups Closed Meshes Genus-0 Meshes Shape Spectrum
61 Retrieval Results Precision 100% 50% Gaussian EDT Shape Histograms Extended Gaussian Image D2 Random 0% 0% 50% 100% Recall
62 Handling Transformations Key difficulty: locating objects under any rigid-body transformation Approaches: Exhaustive search: try all possibilities Invariance: use descriptors that do not change under transformations Normalization: align objects to canonical coordinate frame
63 Exhaustive Search Search for the best aligning transformation: Compare at all alignments Match at the alignment for which models are closest Exhaustive search for optimal rotation
64 Exhaustive Search Search for the best aligning transformation: Compare at all alignments Match at the alignment for which models are closest
65 Exhaustive Search Search for the best aligning transformation: Use signal processing for efficient correlation Represent model at many different transformations Search for the best aligning transformation: Gives the correct answer Is hard to do efficiently
66 Invariance Represent a model with information that is independent of the transformation Power spectrum representation Fourier Transform for translation and 2D rotations Spherical Harmonic Transform for 3D rotations Frequency Circular Power Spectrum Frequency Spherical Power Spectrum
67 Circular Power Spectrum Circular Function
68 Circular Power Spectrum + = Circular Function Cosine/Sine Decomposition
69 Circular Power Spectrum + = Circular Function = Constant Frequency Decomposition
70 Circular Power Spectrum Circular Function + = = + Constant 1 st Order Frequency Decomposition
71 Circular Power Spectrum Circular Function + = = + + Constant 1 st Order 2 nd Order Frequency Decomposition
72 Circular Power Spectrum Circular Function + = = Constant 1 st Order 2 nd Order 3 rd Order Frequency Decomposition
73 Circular Power Spectrum Circular Function = Amplitudes invariant to rotation = Constant 1 st Order 2 nd Order 3 rd Order Frequency Decomposition
74 Spherical Power Spectrum Represent each spherical function as a sum of harmonic frequencies (orders) = Harmonic Decomposition
75 Spherical Power Spectrum Represent each spherical function as a sum of harmonic frequencies (orders) = Constant 1 st Order 2 nd Order 3 rd Order + + +
76 Spherical Power Spectrum Store how much (L 2 -norm) of the shape resides in each frequency to get a rotation invariant representation Constant 1 st Order 2 nd Order 3 rd Order = + + +
77 Invariant to transforms? Frequency subspaces are fixed by rotations:
78 Invariant to transforms? Frequency subspaces are fixed by rotations:
79 Invariant to transforms? Frequency subspaces are fixed by rotations:
80 Invariant to transforms? Frequency subspaces are fixed by rotations:
81 Power Spectrum Translation-invariance: Represent the model in a Cartesian coordinate system Compute the 3D Fourier transform Store the amplitudes of the frequency components f ( x, Cartesian Coordinates y, z) = l, m, n f l e, m, n i( lx+ my+ zn) y x z { f } l, m, n l, m, n Translation Invariant Representation
82 Power Spectrum Single axis rotation-invariance: Represent the model in a cylindrical coordinate system Compute the Fourier transform in the angular direction Store the amplitudes of the frequency components η r h f Cylindrical Coordinates ( r, h, θ ) = k f k { f } k ( r, h) k Rotation Invariant Representation ( r, h) e i( kθ )
83 Power Spectrum Full rotation-invariance: Represent the model in a spherical coordinate system Compute the spherical harmonic transform Store the amplitudes of the frequency components η ϖ Spherical Coordinates m f ( r, θ, φ) = f, ( r) Y ( θ, φ) l m l l m l r m l m f l r ( ) 2 Rotation Invariant Representation l
84 Power Spectrum Power spectrum representations Are invariant to transformations Give a lower bound for the best match Tend to discard too much information Translation invariant: n 3 data -> n 3 /2 data Single-axis rotation invariant: n 3 data -> n 3 /2 data Full rotation invariant: n 3 data -> n 2 data
85 Normalization Place a model into a canonical coordinate frame by normalizing for: translation scale rotation Translation Rotation Scale
86 Alignment of Point Sets [Horn et al., 1988] Given two point sets P={p 1,,p n } and Q={q 1,,q n }, what is the transformation T minimizing the sum of squared distances: d( P, Q) = n i= 1 p T ( q ) i i 2 p i q n q1 q i q2 p n p 1 p 2 Point set P Point set Q
87 Alignment of Point Sets [Horn et al., 1988] Translation Align the models so that their center of mass is at the origin. n n i= 1 p i = 0 and q i= 1 i = 0 p i q i p 2 p n q n q 1 q 2 p 1 Translated point set P Translated point set Q
88 Alignment of Point Sets [Horn et al., 1988] Scale Align the models so that their mean variance is 1. n i= 1 2 p i = 1 and q n i= 1 i 2 = 1 p i q i p n p 1 p 2 q n q 1 q 2 Scaled point set P Scaled point set Q
89 Alignment of Point Sets [Horn et al., 1988] Rotation Factor the cross covariance matrix: ( p p ) ( q ) t M = n 1 q n p i q i p n p 1 p 2 q n q 1 q 2 Rotationally aligned point sets P and Q
90 Normalization Place a model into a canonical coordinate frame: Translation: center of mass i= 1 Can be done on a per-model basis Scale: mean variance n i= 1 n p i = 0 and q 2 i= 1 Can be done on a per-model basis Rotation: factoring cross covariance matrix Need to know the correspondences between models n p i = 1 and q n i= 1 ( p p ) ( q ) t M = n 1 q n i i = 2 0 = 1
91 Rotation Challenge: We want to normalize for rotation on a per-model basis Solution: Align the model so that the principal axes align with the coordinate axes PCA Alignment
92 Rotation Challenge: We want to normalize for rotation on a per-model basis Solution: Align the model so that the principal axes align with the coordinate axes PCA Alignment Directions of the axes are ambiguous
93 Normalization (PCA) PCA defines a coordinate frame up to reflection in the coordinate axes. y Make descriptor invariant to the eight reflections Reflections fix the cosine term Reflections multiply the sine term by -1 f ( θ ) = a cos( kθ ) + b sin( kθ ) k k k x z { } k k b k a, Translation Invariant Representation
94 Problem with PCA-Based Alignment If singular values are close, axes unstable
95 Retrieval Results (Rotation) 100% 50% Gaussian EDT Exhaustive Search PCA + Flip Invariance Cylindrical Power Spectrum Spherical Power Spectrum PCA Size: Method Floats Exhaustive Search 8192 PCA + Flip Invariance 8192 PCA 8192 Cylindrical PS 4352 Spherical PS 512 0% 0% 50% 100% Recall Time: Method Secs. Exhaustive Search PCA + Flip Invariance.67 PCA.67 Cylindrical PS.32 Spherical PS.03
FFTs in Graphics and Vision. Invariance of Shape Descriptors
FFTs in Graphics and Vision Invariance of Shape Descriptors 1 Outline Math Overview Translation and Rotation Invariance The 0 th Order Frequency Component Shape Descriptors Invariance 2 Translation Invariance
More informationShape Analysis. Introduction. Introduction. Motivation. Introduction. Introduction. Thomas Funkhouser Princeton University CS526, Fall 2006
Introduction Cyberware, ATI, & 3Dcafe Analysis Thomas Funkhouser Princeton University CS526, Fall 2006 Cyberware Cheap Scanners ATI Fast Graphics Cards 3D Cafe World Wide Web Someday 3D models will be
More informationShape Matching. Michael Kazhdan ( /657)
Shape Matching Michael Kazhdan (601.457/657) Overview Intro General Approach Minimum SSD Descriptor Goal Given a database of 3D models, and given a query shape, find the database models that are most similar
More informationShape Descriptors I. Thomas Funkhouser CS597D, Fall 2003 Princeton University. Editing
Shape Descriptors I Thomas Funkhouser CS597D, Fall 2003 Princeton University 3D Representations Property Editing Display Analysis Retrieval Intuitive specification Yes No No No Guaranteed continuity Yes
More informationLecture 8 Object Descriptors
Lecture 8 Object Descriptors Azadeh Fakhrzadeh Centre for Image Analysis Swedish University of Agricultural Sciences Uppsala University 2 Reading instructions Chapter 11.1 11.4 in G-W Azadeh Fakhrzadeh
More informationRotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors
Eurographics Symposium on Geometry Processing (2003) L. Kobbelt, P. Schröder, H. Hoppe (Editors) Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors Michael Kazhdan, Thomas Funkhouser,
More informationBoundary descriptors. Representation REPRESENTATION & DESCRIPTION. Descriptors. Moore boundary tracking
Representation REPRESENTATION & DESCRIPTION After image segmentation the resulting collection of regions is usually represented and described in a form suitable for higher level processing. Most important
More informationOverview of 3D Object Representations
Overview of 3D Object Representations Thomas Funkhouser Princeton University C0S 597D, Fall 2003 3D Object Representations What makes a good 3D object representation? Stanford and Hearn & Baker 1 3D Object
More informationA METHOD FOR CONTENT-BASED SEARCHING OF 3D MODEL DATABASES
A METHOD FOR CONTENT-BASED SEARCHING OF 3D MODEL DATABASES Jiale Wang *, Hongming Cai 2 and Yuanjun He * Department of Computer Science & Technology, Shanghai Jiaotong University, China Email: wjl8026@yahoo.com.cn
More informationFeature Detectors and Descriptors: Corners, Lines, etc.
Feature Detectors and Descriptors: Corners, Lines, etc. Edges vs. Corners Edges = maxima in intensity gradient Edges vs. Corners Corners = lots of variation in direction of gradient in a small neighborhood
More informationImage Processing. Image Features
Image Processing Image Features Preliminaries 2 What are Image Features? Anything. What they are used for? Some statements about image fragments (patches) recognition Search for similar patches matching
More informationDigital Image Processing
Digital Image Processing Part 9: Representation and Description AASS Learning Systems Lab, Dep. Teknik Room T1209 (Fr, 11-12 o'clock) achim.lilienthal@oru.se Course Book Chapter 11 2011-05-17 Contents
More informationComputer Vision for HCI. Topics of This Lecture
Computer Vision for HCI Interest Points Topics of This Lecture Local Invariant Features Motivation Requirements, Invariances Keypoint Localization Features from Accelerated Segment Test (FAST) Harris Shi-Tomasi
More information9 length of contour = no. of horizontal and vertical components + ( 2 no. of diagonal components) diameter of boundary B
8. Boundary Descriptor 8.. Some Simple Descriptors length of contour : simplest descriptor - chain-coded curve 9 length of contour no. of horiontal and vertical components ( no. of diagonal components
More information3D Models and Matching
3D Models and Matching representations for 3D object models particular matching techniques alignment-based systems appearance-based systems GC model of a screwdriver 1 3D Models Many different representations
More information4 Parametrization of closed curves and surfaces
4 Parametrization of closed curves and surfaces Parametrically deformable models give rise to the question of obtaining parametrical descriptions of given pixel or voxel based object contours or surfaces,
More informationIntroduction. Introduction. Related Research. SIFT method. SIFT method. Distinctive Image Features from Scale-Invariant. Scale.
Distinctive Image Features from Scale-Invariant Keypoints David G. Lowe presented by, Sudheendra Invariance Intensity Scale Rotation Affine View point Introduction Introduction SIFT (Scale Invariant Feature
More informationChapter 11 Representation & Description
Chapter 11 Representation & Description The results of segmentation is a set of regions. Regions have then to be represented and described. Two main ways of representing a region: - external characteristics
More information4.2 Description of surfaces by spherical harmonic functions
Chapter 4. Parametrization of closed curves and surfaces Im[z] Im[z] Translation Im[z] Im[z] Rotation Scale Starting point Re[z] Re[z] Re[z] Re[z] a b c d Figure 4.: Normalization steps of Fourier coefficients;
More informationEE 584 MACHINE VISION
EE 584 MACHINE VISION Binary Images Analysis Geometrical & Topological Properties Connectedness Binary Algorithms Morphology Binary Images Binary (two-valued; black/white) images gives better efficiency
More informationShape Distributions. Robert Osada, Thomas Funkhouser, Bernard Chazelle, and David Dobkin Princeton University, Princeton, NJ 08540, USA
Shape Distributions Robert Osada, Thomas Funkhouser, Bernard Chazelle, and David Dobkin Princeton University, Princeton, NJ 08540, USA February 12, 2002 Abstract Measuring the similarity between 3D shapes
More informationCoE4TN4 Image Processing
CoE4TN4 Image Processing Chapter 11 Image Representation & Description Image Representation & Description After an image is segmented into regions, the regions are represented and described in a form suitable
More informationImage Filtering, Warping and Sampling
Image Filtering, Warping and Sampling Connelly Barnes CS 4810 University of Virginia Acknowledgement: slides by Jason Lawrence, Misha Kazhdan, Allison Klein, Tom Funkhouser, Adam Finkelstein and David
More informationAlgorithms for Recognition of Low Quality Iris Images. Li Peng Xie University of Ottawa
Algorithms for Recognition of Low Quality Iris Images Li Peng Xie University of Ottawa Overview Iris Recognition Eyelash detection Accurate circular localization Covariance feature with LDA Fourier magnitude
More informationEECS150 - Digital Design Lecture 14 FIFO 2 and SIFT. Recap and Outline
EECS150 - Digital Design Lecture 14 FIFO 2 and SIFT Oct. 15, 2013 Prof. Ronald Fearing Electrical Engineering and Computer Sciences University of California, Berkeley (slides courtesy of Prof. John Wawrzynek)
More informationCorrespondence. CS 468 Geometry Processing Algorithms. Maks Ovsjanikov
Shape Matching & Correspondence CS 468 Geometry Processing Algorithms Maks Ovsjanikov Wednesday, October 27 th 2010 Overall Goal Given two shapes, find correspondences between them. Overall Goal Given
More informationMotion Estimation and Optical Flow Tracking
Image Matching Image Retrieval Object Recognition Motion Estimation and Optical Flow Tracking Example: Mosiacing (Panorama) M. Brown and D. G. Lowe. Recognising Panoramas. ICCV 2003 Example 3D Reconstruction
More informationFeatures Points. Andrea Torsello DAIS Università Ca Foscari via Torino 155, Mestre (VE)
Features Points Andrea Torsello DAIS Università Ca Foscari via Torino 155, 30172 Mestre (VE) Finding Corners Edge detectors perform poorly at corners. Corners provide repeatable points for matching, so
More informationSu et al. Shape Descriptors - III
Su et al. Shape Descriptors - III Siddhartha Chaudhuri http://www.cse.iitb.ac.in/~cs749 Funkhouser; Feng, Liu, Gong Recap Global A shape descriptor is a set of numbers that describes a shape in a way that
More information2: Image Display and Digital Images. EE547 Computer Vision: Lecture Slides. 2: Digital Images. 1. Introduction: EE547 Computer Vision
EE547 Computer Vision: Lecture Slides Anthony P. Reeves November 24, 1998 Lecture 2: Image Display and Digital Images 2: Image Display and Digital Images Image Display: - True Color, Grey, Pseudo Color,
More informationScale Invariant Feature Transform
Why do we care about matching features? Scale Invariant Feature Transform Camera calibration Stereo Tracking/SFM Image moiaicing Object/activity Recognition Objection representation and recognition Automatic
More informationThe SIFT (Scale Invariant Feature
The SIFT (Scale Invariant Feature Transform) Detector and Descriptor developed by David Lowe University of British Columbia Initial paper ICCV 1999 Newer journal paper IJCV 2004 Review: Matt Brown s Canonical
More informationLecture 10: Image Descriptors and Representation
I2200: Digital Image processing Lecture 10: Image Descriptors and Representation Prof. YingLi Tian Nov. 15, 2017 Department of Electrical Engineering The City College of New York The City University of
More informationSCALE INVARIANT FEATURE TRANSFORM (SIFT)
1 SCALE INVARIANT FEATURE TRANSFORM (SIFT) OUTLINE SIFT Background SIFT Extraction Application in Content Based Image Search Conclusion 2 SIFT BACKGROUND Scale-invariant feature transform SIFT: to detect
More informationLocal Features: Detection, Description & Matching
Local Features: Detection, Description & Matching Lecture 08 Computer Vision Material Citations Dr George Stockman Professor Emeritus, Michigan State University Dr David Lowe Professor, University of British
More informationCategory vs. instance recognition
Category vs. instance recognition Category: Find all the people Find all the buildings Often within a single image Often sliding window Instance: Is this face James? Find this specific famous building
More informationComputer vision: models, learning and inference. Chapter 13 Image preprocessing and feature extraction
Computer vision: models, learning and inference Chapter 13 Image preprocessing and feature extraction Preprocessing The goal of pre-processing is to try to reduce unwanted variation in image due to lighting,
More informationChapter 3 Image Registration. Chapter 3 Image Registration
Chapter 3 Image Registration Distributed Algorithms for Introduction (1) Definition: Image Registration Input: 2 images of the same scene but taken from different perspectives Goal: Identify transformation
More informationDigital Image Processing Chapter 11: Image Description and Representation
Digital Image Processing Chapter 11: Image Description and Representation Image Representation and Description? Objective: To represent and describe information embedded in an image in other forms that
More informationCITS 4402 Computer Vision
CITS 4402 Computer Vision Prof Ajmal Mian Lecture 12 3D Shape Analysis & Matching Overview of this lecture Revision of 3D shape acquisition techniques Representation of 3D data Applying 2D image techniques
More informationA Reflective Symmetry Descriptor
A Reflective Symmetry Descriptor Michael Kazhdan, Bernard Chazelle, David Dobkin, Adam Finkelstein, and Thomas Funkhouser Princeton University, Princeton NJ 08544, USA Abstract. Computing reflective symmetries
More informationMulti-view 3D retrieval using silhouette intersection and multi-scale contour representation
Multi-view 3D retrieval using silhouette intersection and multi-scale contour representation Thibault Napoléon Telecom Paris CNRS UMR 5141 75013 Paris, France napoleon@enst.fr Tomasz Adamek CDVP Dublin
More informationScale Invariant Feature Transform
Scale Invariant Feature Transform Why do we care about matching features? Camera calibration Stereo Tracking/SFM Image moiaicing Object/activity Recognition Objection representation and recognition Image
More informationDigital Image Processing Fundamentals
Ioannis Pitas Digital Image Processing Fundamentals Chapter 7 Shape Description Answers to the Chapter Questions Thessaloniki 1998 Chapter 7: Shape description 7.1 Introduction 1. Why is invariance to
More informationCGAL. Mesh Simplification. (Slides from Tom Funkhouser, Adam Finkelstein)
CGAL Mesh Simplification (Slides from Tom Funkhouser, Adam Finkelstein) Siddhartha Chaudhuri http://www.cse.iitb.ac.in/~cs749 In a nutshell Problem: Meshes have too many polygons for storage, rendering,
More informationMesh Simplification. Mesh Simplification. Mesh Simplification Goals. Mesh Simplification Motivation. Vertex Clustering. Mesh Simplification Overview
Mesh Simplification Mesh Simplification Adam Finkelstein Princeton University COS 56, Fall 008 Slides from: Funkhouser Division, Viewpoint, Cohen Mesh Simplification Motivation Interactive visualization
More informationLecture 6: Multimedia Information Retrieval Dr. Jian Zhang
Lecture 6: Multimedia Information Retrieval Dr. Jian Zhang NICTA & CSE UNSW COMP9314 Advanced Database S1 2007 jzhang@cse.unsw.edu.au Reference Papers and Resources Papers: Colour spaces-perceptual, historical
More informationCS 468 Data-driven Shape Analysis. Shape Descriptors
CS 468 Data-driven Shape Analysis Shape Descriptors April 1, 2014 What Is A Shape Descriptor? Shapes Shape Descriptor F1=[f1, f2,.., fn] F2=[f1, f2,.., fn] F3=[f1, f2,.., fn] What Is A Shape Descriptor?
More informationGeometric Modeling in Graphics
Geometric Modeling in Graphics Part 2: Meshes properties Martin Samuelčík www.sccg.sk/~samuelcik samuelcik@sccg.sk Meshes properties Working with DCEL representation One connected component with simple
More informationLocal features: detection and description May 12 th, 2015
Local features: detection and description May 12 th, 2015 Yong Jae Lee UC Davis Announcements PS1 grades up on SmartSite PS1 stats: Mean: 83.26 Standard Dev: 28.51 PS2 deadline extended to Saturday, 11:59
More informationINFO0948 Fitting and Shape Matching
INFO0948 Fitting and Shape Matching Renaud Detry University of Liège, Belgium Updated March 31, 2015 1 / 33 These slides are based on the following book: D. Forsyth and J. Ponce. Computer vision: a modern
More informationFace detection and recognition. Detection Recognition Sally
Face detection and recognition Detection Recognition Sally Face detection & recognition Viola & Jones detector Available in open CV Face recognition Eigenfaces for face recognition Metric learning identification
More informationLecture 14 Shape. ch. 9, sec. 1-8, of Machine Vision by Wesley E. Snyder & Hairong Qi. Spring (CMU RI) : BioE 2630 (Pitt)
Lecture 14 Shape ch. 9, sec. 1-8, 12-14 of Machine Vision by Wesley E. Snyder & Hairong Qi Spring 2018 16-725 (CMU RI) : BioE 2630 (Pitt) Dr. John Galeotti The content of these slides by John Galeotti,
More informationTA Section 7 Problem Set 3. SIFT (Lowe 2004) Shape Context (Belongie et al. 2002) Voxel Coloring (Seitz and Dyer 1999)
TA Section 7 Problem Set 3 SIFT (Lowe 2004) Shape Context (Belongie et al. 2002) Voxel Coloring (Seitz and Dyer 1999) Sam Corbett-Davies TA Section 7 02-13-2014 Distinctive Image Features from Scale-Invariant
More informationShape Context Matching For Efficient OCR
Matching For Efficient OCR May 14, 2012 Matching For Efficient OCR Table of contents 1 Motivation Background 2 What is a? Matching s Simliarity Measure 3 Matching s via Pyramid Matching Matching For Efficient
More informationLocal features: detection and description. Local invariant features
Local features: detection and description Local invariant features Detection of interest points Harris corner detection Scale invariant blob detection: LoG Description of local patches SIFT : Histograms
More informationKey properties of local features
Key properties of local features Locality, robust against occlusions Must be highly distinctive, a good feature should allow for correct object identification with low probability of mismatch Easy to etract
More informationCollision Detection. Jane Li Assistant Professor Mechanical Engineering & Robotics Engineering
RBE 550 MOTION PLANNING BASED ON DR. DMITRY BERENSON S RBE 550 Collision Detection Jane Li Assistant Professor Mechanical Engineering & Robotics Engineering http://users.wpi.edu/~zli11 Euler Angle RBE
More information3D Modeling Parametric Curves & Surfaces
3D Modeling Parametric Curves & Surfaces Shandong University Spring 2012 3D Object Representations Raw data Point cloud Range image Polygon soup Solids Voxels BSP tree CSG Sweep Surfaces Mesh Subdivision
More informationLearning 3D Part Detection from Sparsely Labeled Data: Supplemental Material
Learning 3D Part Detection from Sparsely Labeled Data: Supplemental Material Ameesh Makadia Google New York, NY 10011 makadia@google.com Mehmet Ersin Yumer Carnegie Mellon University Pittsburgh, PA 15213
More informationFourier Transform and Texture Filtering
Fourier Transform and Texture Filtering Lucas J. van Vliet www.ph.tn.tudelft.nl/~lucas Image Analysis Paradigm scene Image formation sensor pre-processing Image enhancement Image restoration Texture filtering
More informationFeature Extraction and Image Processing, 2 nd Edition. Contents. Preface
, 2 nd Edition Preface ix 1 Introduction 1 1.1 Overview 1 1.2 Human and Computer Vision 1 1.3 The Human Vision System 3 1.3.1 The Eye 4 1.3.2 The Neural System 7 1.3.3 Processing 7 1.4 Computer Vision
More informationScanning Real World Objects without Worries 3D Reconstruction
Scanning Real World Objects without Worries 3D Reconstruction 1. Overview Feng Li 308262 Kuan Tian 308263 This document is written for the 3D reconstruction part in the course Scanning real world objects
More informationAdvanced Video Content Analysis and Video Compression (5LSH0), Module 4
Advanced Video Content Analysis and Video Compression (5LSH0), Module 4 Visual feature extraction Part I: Color and texture analysis Sveta Zinger Video Coding and Architectures Research group, TU/e ( s.zinger@tue.nl
More informationGlobal Shape Matching
Global Shape Matching Section 3.2: Extrinsic Key Point Detection and Feature Descriptors 1 The story so far Problem statement Given pair of shapes/scans, find correspondences between the shapes Local shape
More informationSUMMARY: DISTINCTIVE IMAGE FEATURES FROM SCALE- INVARIANT KEYPOINTS
SUMMARY: DISTINCTIVE IMAGE FEATURES FROM SCALE- INVARIANT KEYPOINTS Cognitive Robotics Original: David G. Lowe, 004 Summary: Coen van Leeuwen, s1460919 Abstract: This article presents a method to extract
More informationEdge and local feature detection - 2. Importance of edge detection in computer vision
Edge and local feature detection Gradient based edge detection Edge detection by function fitting Second derivative edge detectors Edge linking and the construction of the chain graph Edge and local feature
More informationComputer Vision I. Announcements. Fourier Tansform. Efficient Implementation. Edge and Corner Detection. CSE252A Lecture 13.
Announcements Edge and Corner Detection HW3 assigned CSE252A Lecture 13 Efficient Implementation Both, the Box filter and the Gaussian filter are separable: First convolve each row of input image I with
More informationSIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014
SIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014 SIFT SIFT: Scale Invariant Feature Transform; transform image
More informationStatistical Shape Analysis of Anatomical Structures. Polina Golland
Statistical Shape Analysis of Anatomical Structures by Polina Golland B.A., Technion, Israel (1993) M.Sc., Technion, Israel (1995) Submitted to the Department of Electrical Engineering and Computer Science
More informationCRF Based Point Cloud Segmentation Jonathan Nation
CRF Based Point Cloud Segmentation Jonathan Nation jsnation@stanford.edu 1. INTRODUCTION The goal of the project is to use the recently proposed fully connected conditional random field (CRF) model to
More informationLecture 18 Representation and description I. 2. Boundary descriptors
Lecture 18 Representation and description I 1. Boundary representation 2. Boundary descriptors What is representation What is representation After segmentation, we obtain binary image with interested regions
More information3D Modeling Parametric Curves & Surfaces. Shandong University Spring 2013
3D Modeling Parametric Curves & Surfaces Shandong University Spring 2013 3D Object Representations Raw data Point cloud Range image Polygon soup Surfaces Mesh Subdivision Parametric Implicit Solids Voxels
More informationFACE RECOGNITION USING INDEPENDENT COMPONENT
Chapter 5 FACE RECOGNITION USING INDEPENDENT COMPONENT ANALYSIS OF GABORJET (GABORJET-ICA) 5.1 INTRODUCTION PCA is probably the most widely used subspace projection technique for face recognition. A major
More informationEdge detection. Convert a 2D image into a set of curves. Extracts salient features of the scene More compact than pixels
Edge Detection Edge detection Convert a 2D image into a set of curves Extracts salient features of the scene More compact than pixels Origin of Edges surface normal discontinuity depth discontinuity surface
More informationChapter 4. Clustering Core Atoms by Location
Chapter 4. Clustering Core Atoms by Location In this chapter, a process for sampling core atoms in space is developed, so that the analytic techniques in section 3C can be applied to local collections
More informationLocal Features Tutorial: Nov. 8, 04
Local Features Tutorial: Nov. 8, 04 Local Features Tutorial References: Matlab SIFT tutorial (from course webpage) Lowe, David G. Distinctive Image Features from Scale Invariant Features, International
More informationComputer Vision I - Appearance-based Matching and Projective Geometry
Computer Vision I - Appearance-based Matching and Projective Geometry Carsten Rother 01/11/2016 Computer Vision I: Image Formation Process Roadmap for next four lectures Computer Vision I: Image Formation
More informationSearching for the Shape
Searching for the Shape PURDUEURDUE U N I V E R S I T Y Yagna Kalyanaraman PRECISE, Purdue University The world we are in Designers spend 60% time searching for right info 75% of design activity is design
More informationComputer Vision I - Appearance-based Matching and Projective Geometry
Computer Vision I - Appearance-based Matching and Projective Geometry Carsten Rother 05/11/2015 Computer Vision I: Image Formation Process Roadmap for next four lectures Computer Vision I: Image Formation
More information3D Object Representation. Michael Kazhdan ( /657)
3D Object Representation Michael Kazhdan (601.457/657) 3D Objects How can this object be represented in a computer? 3D Objects This one? H&B Figure 10.46 3D Objects This one? H&B Figure 9.9 3D Objects
More informationBasic Algorithms for Digital Image Analysis: a course
Institute of Informatics Eötvös Loránd University Budapest, Hungary Basic Algorithms for Digital Image Analysis: a course Dmitrij Csetverikov with help of Attila Lerch, Judit Verestóy, Zoltán Megyesi,
More informationCS 532: 3D Computer Vision 13 th Set of Notes
1 CS 532: 3D Computer Vision 13 th Set of Notes Instructor: Philippos Mordohai Webpage: www.cs.stevens.edu/~mordohai E-mail: Philippos.Mordohai@stevens.edu Office: Lieb 215 Lecture Outline Unorganized
More informationOutline 7/2/201011/6/
Outline Pattern recognition in computer vision Background on the development of SIFT SIFT algorithm and some of its variations Computational considerations (SURF) Potential improvement Summary 01 2 Pattern
More informationAnno accademico 2006/2007. Davide Migliore
Robotica Anno accademico 6/7 Davide Migliore migliore@elet.polimi.it Today What is a feature? Some useful information The world of features: Detectors Edges detection Corners/Points detection Descriptors?!?!?
More informationA New MPEG-7 Standard: Perceptual 3-D Shape Descriptor
A New MPEG-7 Standard: Perceptual 3-D Shape Descriptor Duck Hoon Kim 1, In Kyu Park 2, Il Dong Yun 3, and Sang Uk Lee 1 1 School of Electrical Engineering and Computer Science, Seoul National University,
More informationCOSC160: Detection and Classification. Jeremy Bolton, PhD Assistant Teaching Professor
COSC160: Detection and Classification Jeremy Bolton, PhD Assistant Teaching Professor Outline I. Problem I. Strategies II. Features for training III. Using spatial information? IV. Reducing dimensionality
More informationCS 231A Computer Vision (Winter 2014) Problem Set 3
CS 231A Computer Vision (Winter 2014) Problem Set 3 Due: Feb. 18 th, 2015 (11:59pm) 1 Single Object Recognition Via SIFT (45 points) In his 2004 SIFT paper, David Lowe demonstrates impressive object recognition
More informationLocal Patch Descriptors
Local Patch Descriptors Slides courtesy of Steve Seitz and Larry Zitnick CSE 803 1 How do we describe an image patch? How do we describe an image patch? Patches with similar content should have similar
More informationTexture. Outline. Image representations: spatial and frequency Fourier transform Frequency filtering Oriented pyramids Texture representation
Texture Outline Image representations: spatial and frequency Fourier transform Frequency filtering Oriented pyramids Texture representation 1 Image Representation The standard basis for images is the set
More informationUlrik Söderström 21 Feb Representation and description
Ulrik Söderström ulrik.soderstrom@tfe.umu.se 2 Feb 207 Representation and description Representation and description Representation involves making object definitions more suitable for computer interpretations
More informationSIFT - scale-invariant feature transform Konrad Schindler
SIFT - scale-invariant feature transform Konrad Schindler Institute of Geodesy and Photogrammetry Invariant interest points Goal match points between images with very different scale, orientation, projective
More informationDistinctive Regions of 3D Surfaces
Distinctive Regions of 3D Surfaces PHILIP SHILANE and THOMAS FUNKHOUSER Princeton University Selecting the most important regions of a surface is useful for shape matching and a variety of applications
More informationOther Linear Filters CS 211A
Other Linear Filters CS 211A Slides from Cornelia Fermüller and Marc Pollefeys Edge detection Convert a 2D image into a set of curves Extracts salient features of the scene More compact than pixels Origin
More informationFeature descriptors. Alain Pagani Prof. Didier Stricker. Computer Vision: Object and People Tracking
Feature descriptors Alain Pagani Prof. Didier Stricker Computer Vision: Object and People Tracking 1 Overview Previous lectures: Feature extraction Today: Gradiant/edge Points (Kanade-Tomasi + Harris)
More informationform are graphed in Cartesian coordinates, and are graphed in Cartesian coordinates.
Plot 3D Introduction Plot 3D graphs objects in three dimensions. It has five basic modes: 1. Cartesian mode, where surfaces defined by equations of the form are graphed in Cartesian coordinates, 2. cylindrical
More information03 - Reconstruction. Acknowledgements: Olga Sorkine-Hornung. CSCI-GA Geometric Modeling - Spring 17 - Daniele Panozzo
3 - Reconstruction Acknowledgements: Olga Sorkine-Hornung Geometry Acquisition Pipeline Scanning: results in range images Registration: bring all range images to one coordinate system Stitching/ reconstruction:
More informationRequirements for region detection
Region detectors Requirements for region detection For region detection invariance transformations that should be considered are illumination changes, translation, rotation, scale and full affine transform
More informationCS 558: Computer Vision 4 th Set of Notes
1 CS 558: Computer Vision 4 th Set of Notes Instructor: Philippos Mordohai Webpage: www.cs.stevens.edu/~mordohai E-mail: Philippos.Mordohai@stevens.edu Office: Lieb 215 Overview Keypoint matching Hessian
More informationImage features. Image Features
Image features Image features, such as edges and interest points, provide rich information on the image content. They correspond to local regions in the image and are fundamental in many applications in
More information