Overview. Spectral Processing of Point- Sampled Geometry. Introduction. Introduction. Fourier Transform. Fourier Transform

Similar documents
Spectral Processing of Point-Sampled Geometry

Geometric Modeling. Mesh Decimation. Mesh Decimation. Applications. Copyright 2010 Gotsman, Pauly Page 1. Oversampled 3D scan data

Applications. Oversampled 3D scan data. ~150k triangles ~80k triangles

ANALYSIS OF GEOPHYSICAL POTENTIAL FIELDS A Digital Signal Processing Approach

Mesh Decimation. Mark Pauly

Digital Image Processing. Lecture 6

Fundamentals of Digital Image Processing

Overview. Efficient Simplification of Point-sampled Surfaces. Introduction. Introduction. Neighborhood. Local Surface Analysis

Image representation. 1. Introduction

DIGITAL TERRAIN MODELS

Digital Image Processing

Parameterization with Manifolds

Lecture 8 Object Descriptors

Parameterization of Meshes

Central Slice Theorem

Mesh Processing Pipeline

Lecture 18 Representation and description I. 2. Boundary descriptors

Computer Graphics. Texture Filtering & Sampling Theory. Hendrik Lensch. Computer Graphics WS07/08 Texturing

ELEC Dr Reji Mathew Electrical Engineering UNSW

Motivation. Freeform Shape Representations for Efficient Geometry Processing. Operations on Geometric Objects. Functional Representations

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier


Image Denoising Based on Hybrid Fourier and Neighborhood Wavelet Coefficients Jun Cheng, Songli Lei

Examination in Image Processing

Boundary descriptors. Representation REPRESENTATION & DESCRIPTION. Descriptors. Moore boundary tracking

Biomedical Image Analysis. Spatial Filtering

Image restoration. Lecture 14. Milan Gavrilovic Centre for Image Analysis Uppsala University

Mesh Repairing and Simplification. Gianpaolo Palma

Image Filtering, Warping and Sampling

Dissertação para obtenção do grau de Mestre em Matemática pelo INSTITUTO NACIONAL DE MATEMÁTICA PURA E APLICADA

Topic 6 Representation and Description

Computer Vision I. Announcements. Fourier Tansform. Efficient Implementation. Edge and Corner Detection. CSE252A Lecture 13.

Mesh Simplification. Mesh Simplification. Mesh Simplification Goals. Mesh Simplification Motivation. Vertex Clustering. Mesh Simplification Overview

Computer Graphics. Sampling Theory & Anti-Aliasing. Philipp Slusallek

Lecture 5: Frequency Domain Transformations

Contents. I The Basic Framework for Stationary Problems 1

A Developer s Survey of Polygonal Simplification algorithms. CS 563 Advanced Topics in Computer Graphics Fan Wu Mar. 31, 2005

Segmentation of point clouds

All MSEE students are required to take the following two core courses: Linear systems Probability and Random Processes

ELEC Dr Reji Mathew Electrical Engineering UNSW

Multiresolution Image Processing

Geometric Modeling and Processing

Shape Modeling and Geometry Processing

9 length of contour = no. of horizontal and vertical components + ( 2 no. of diagonal components) diameter of boundary B

Reading. 2. Fourier analysis and sampling theory. Required: Watt, Section 14.1 Recommended:

CPSC / Texture Mapping

Digital Geometry Processing Parameterization I

Chapter 11 Image Processing

Image Processing. Application area chosen because it has very good parallelism and interesting output.

Segmentation. (template) matching

Computer Vision. Fourier Transform. 20 January Copyright by NHL Hogeschool and Van de Loosdrecht Machine Vision BV All rights reserved

Ulrik Söderström 21 Feb Representation and description

05 - Surfaces. Acknowledgements: Olga Sorkine-Hornung. CSCI-GA Geometric Modeling - Daniele Panozzo

Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC

Image Processing. Filtering. Slide 1

The main goal of Computer Graphics is to generate 2D images 2D images are continuous 2D functions (or signals)

Digital Image Processing Fundamentals

Aliasing And Anti-Aliasing Sampling and Reconstruction

Data interpolation in pyramid domain

Hierarchical GEMINI - Hierarchical linear subspace indexing method

Computer Vision and Graphics (ee2031) Digital Image Processing I

Geometry Processing & Geometric Queries. Computer Graphics CMU /15-662

GEMINI GEneric Multimedia INdexIng

Segmentation and Grouping

Aliasing. Can t draw smooth lines on discrete raster device get staircased lines ( jaggies ):

Final Review. Image Processing CSE 166 Lecture 18

PATTERN CLASSIFICATION AND SCENE ANALYSIS

Digital Image Processing. Image Enhancement in the Frequency Domain

The Curse of Dimensionality. Panagiotis Parchas Advanced Data Management Spring 2012 CSE HKUST

Assignment 3: Edge Detection

Introduc1on to Computa1onal Manifolds and Applica1ons

Motivation. The main goal of Computer Graphics is to generate 2D images. 2D images are continuous 2D functions (or signals)

Shape-based Diffeomorphic Registration on Hippocampal Surfaces Using Beltrami Holomorphic Flow

Point Cloud Collision Detection

Laplacian Operator and Smoothing

Chapter 3: Intensity Transformations and Spatial Filtering

Image Transformation Techniques Dr. Rajeev Srivastava Dept. of Computer Engineering, ITBHU, Varanasi

Final Project, Digital Geometry Processing

Introduction to Computer Vision. Week 3, Fall 2010 Instructor: Prof. Ko Nishino

Multiscale 3-D texture segmentation: Isotropic Representations

Fourier Transform and Texture Filtering

Teichmüller Space and Fenchel-Nielsen Coordinates

Geometric structures on manifolds

Sampling, Aliasing, & Mipmaps

Index. aliasing artifacts and noise in CT images, 200 measurement of projection data, nondiffracting

CS 523: Computer Graphics, Spring Shape Modeling. Differential Geometry of Surfaces

Digital Image Processing COSC 6380/4393

How and what do we see? Segmentation and Grouping. Fundamental Problems. Polyhedral objects. Reducing the combinatorics of pose estimation

Geometry and Gravitation

Filtering, unwrapping, and geocoding R. Mellors

Point Lattices in Computer Graphics and Visualization how signal processing may help computer graphics

Advanced Computer Graphics. Aliasing. Matthias Teschner. Computer Science Department University of Freiburg

Lecture 4: Image Processing

Other Linear Filters CS 211A

EXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,

A Robust Spectral Approach for Blind Watermarking of Manifold Surfaces

Correspondence. CS 468 Geometry Processing Algorithms. Maks Ovsjanikov

Subpixel accurate refinement of disparity maps using stereo correspondences

CS 468 (Spring 2013) Discrete Differential Geometry

Computational QC Geometry: A tool for Medical Morphometry, Computer Graphics & Vision

Transcription:

Overview Spectral Processing of Point- Sampled Geometry Introduction Fourier transform Spectral processing pipeline Spectral filtering Adaptive subsampling Summary Point-Based Computer Graphics Markus Gross 1 Point-Based Computer Graphics Markus Gross 2 Introduction Idea: Extend the Fourier transform to manifold geometry Spectral representation of point-based objects Powerful methods for digital geometry processing Introduction : Spectral filtering: Noise removal Microstructure analysis Enhancement Adaptive resampling: Complexity reduction Continuous LOD Point-Based Computer Graphics Markus Gross 3 Point-Based Computer Graphics Markus Gross 4 Fourier Transform 1D example: N nk j 2π N X n = xke spectral basis function k = 1 output signal input signal Benefits: Sound concept of frequency Extensive theory Fast algorithms Fourier Transform Requirements: Fourier transform defined on Euclidean domain we need a global parameterization Basis functions are eigenfunctions of Laplacian operator requires regular sampling pattern so that basis functions can be expressed in analytical form (fast evaluation) Limitations: Basis functions are globally defined Lack of local control Point-Based Computer Graphics Markus Gross 5 Point-Based Computer Graphics Markus Gross 6 1

Approach Spectral Pipeline Split model into patches that: are parameterized over the unit-square mapping must be continuous and should minimize distortion are re-sampled onto a regular grid adjust sampling rate to minimize information loss provide sufficient granularity for intended application (local analysis) process each patch individually and blend processed patches Point-Based Computer Graphics Markus Gross 7 Point-Based Computer Graphics Markus Gross 8 Clustering Optimization Samples Clusters Patches Iterative, local optimization method Merge patches according to quality metric: Φ = Φ S NC Φ S patch Size Φ NC curvature B Reg Φ B patch boundary Φ Reg spring energy regularization Point-Based Computer Graphics Markus Gross 9 Point-Based Computer Graphics Markus Gross 10 Parameterize patches by orthogonal projection onto base plane Bound normal cone to control distortion of mapping using smallest enclosing sphere Patch Resampling Patches are irregularly sampled: Point-Based Computer Graphics Markus Gross 11 Point-Based Computer Graphics Markus Gross 12 2

Patch Resampling Resample patch onto regular grid using hierarchical push-pull filter (scattered data approximation) Spectral Analysis 2D discrete Fourier transform (DFT) Direct manipulation of spectral coefficients Filtering as convolution: F( x y) = F( x) F( y) Convolution: O(N 2 ) multiplication: O(N) Inverse Fourier transform Filtered patch surface Point-Based Computer Graphics Markus Gross 13 Point-Based Computer Graphics Markus Gross 14 Spectral Filters Spectral Filters Smoothing filters ideal low-pass Gaussian low-pass original Microstructure analysis and enhancement transfer function: spectral domain transfer function: spatial domain Point-Based Computer Graphics Markus Gross 15 Point-Based Computer Graphics Markus Gross 16 Spectral Resampling Low-pass filtering Band-limitation Regular Resampling Optimal sampling rate (sampling theorem) Filtering can lead to discontinuities at patch boundaries Create patch overlap, blend adjacent patches Sampling rates region of overlap Error control (Parseval s theorem) Power Spectrum Point positions Normals Point-Based Computer Graphics Markus Gross 17 Point-Based Computer Graphics Markus Gross 18 3

Timings Blending the sampling rate Time Clustering 9% Patch Merging 38% SDA 23% blended sampling rate in region of patch overlap discretized sampling rate on regular grid pre-computed sampling patterns Analysis 4% 26% Point-Based Computer Graphics Markus Gross 19 Point-Based Computer Graphics Markus Gross 20 Surface Restoration Interactive filtering Original Gaussian low-pass Wiener filter Patch layout Point-Based Computer Graphics Markus Gross 21 Point-Based Computer Graphics Markus Gross 22 Adaptive Subsampling Summary Versatile spectral decomposition of pointbased models Effective filtering Adaptive resampling Efficient processing of large point-sampled models 4,128,614 pts. = 100% 287,163 pts. = 6.9% Point-Based Computer Graphics Markus Gross 23 Point-Based Computer Graphics Markus Gross 24 4

Reference Pauly, Gross: Spectral Processing of Point-sampled Geometry, SIGGRAPH 2001 Point-Based Computer Graphics Markus Gross 25 5