Spectral Compression of Mesh Geometry

Similar documents
Spectral Coding of Three-Dimensional Mesh Geometry Information Using Dual Graph

Efficient Compression and Rendering of Multi-Resolution Meshes

Compression of Soft-Body Animation Sequences

Geometric Modeling and Processing

Partitioning and Partitioning Tools. Tim Barth NASA Ames Research Center Moffett Field, California USA

CS 140: Sparse Matrix-Vector Multiplication and Graph Partitioning

04 - Normal Estimation, Curves

CSEP 521 Applied Algorithms Spring Lossy Image Compression

Dimensionality Reduction of Laplacian Embedding for 3D Mesh Reconstruction

Dual Interpolants for Finite Element Methods

On Graph Partitioning, Spectral Analysis, and Digital Mesh Processing

Spectral Graph-Theoretic Approach to 3D Mesh Watermarking

Normal Mesh Compression

Wireless Communication

Mesh Compression. Triangle Meshes. Basic Definitions (II) Basic Definitions (I) Compression. History of Multimedia

Laplacian Meshes. COS 526 Fall 2016 Slides from Olga Sorkine and Yaron Lipman

Final Review. Image Processing CSE 166 Lecture 18

Segmentation and Grouping

A Course in Machine Learning

NOWADAYS, 3D models are used in a wider and wider

A Robust Spectral Approach for Blind Watermarking of Manifold Surfaces

OPTIMIZED MULTIPLE DESCRIPTION SCALAR QUANTIZATION BASED 3D MESH CODING

Features. Sequential encoding. Progressive encoding. Hierarchical encoding. Lossless encoding using a different strategy

Segmentation & Constraints

Improvements in Dynamic Partitioning. Aman Arora Snehal Chitnavis

JPEG: An Image Compression System. Nimrod Peleg update: Nov. 2003

Multimedia Communications. Transform Coding

Geometry Processing & Geometric Queries. Computer Graphics CMU /15-662

Geometry Compression of Normal Meshes Using Rate-Distortion Algorithms

Spectral Surface Reconstruction from Noisy Point Clouds

Tutorial on Image Compression

Geometric Modeling in Graphics

Sparse approximation of 3D shapes via spectral graph wavelets

Least-squares Meshes. Olga Sorkine Tel Aviv University Daniel Cohen-Or Tel Aviv University Abstract.

Assignment 4: Mesh Parametrization

Compression II: Images (JPEG)

Mesh Processing Pipeline

Biometrics Technology: Image Processing & Pattern Recognition (by Dr. Dickson Tong)

Subdivision Surfaces

Targil 12 : Image Segmentation. Image segmentation. Why do we need it? Image segmentation

How and what do we see? Segmentation and Grouping. Fundamental Problems. Polyhedral objects. Reducing the combinatorics of pose estimation

Topic 5 Image Compression

Compressing Texture Coordinates with Selective Linear Predictions

TELCOM2125: Network Science and Analysis

Lecture 8 JPEG Compression (Part 3)

Geometric Modeling Assignment 3: Discrete Differential Quantities

Mesh Decimation Using VTK

CS 664 Slides #11 Image Segmentation. Prof. Dan Huttenlocher Fall 2003

Surface Reconstruction. Gianpaolo Palma

Subdivision Curves and Surfaces

Improved Functional Mappings via Product Preservation

Introduction to Computer Graphics. Modeling (3) April 27, 2017 Kenshi Takayama

Digital Image Processing

Image compression. Stefano Ferrari. Università degli Studi di Milano Methods for Image Processing. academic year

Chapter 13. Boundary Value Problems for Partial Differential Equations* Linz 2002/ page

Visual Representations for Machine Learning

Scientific Computing: Interpolation

4.1 QUANTIZATION NOISE

Today. Motivation. Motivation. Image gradient. Image gradient. Computational Photography

Digital Image Representation Image Compression

Local patch blind spectral watermarking method for 3D graphics

Spectral Graph Sparsification: overview of theory and practical methods. Yiannis Koutis. University of Puerto Rico - Rio Piedras

Outline 7/2/201011/6/

Scott Smith Advanced Image Processing March 15, Speeded-Up Robust Features SURF

Review and Implementation of DWT based Scalable Video Coding with Scalable Motion Coding.

Graph drawing in spectral layout

Recent Advances in Compression of 3D Meshes

CSC 411: Lecture 14: Principal Components Analysis & Autoencoders

MULTIPLE-DESCRIPTION GEOMETRY COMPRESSION FOR NETWORKED INTERACTIVE 3D GRAPHICS

CSC 411: Lecture 14: Principal Components Analysis & Autoencoders

A Image Comparative Study using DCT, Fast Fourier, Wavelet Transforms and Huffman Algorithm

Image Coding and Data Compression

Big Data Analytics. Special Topics for Computer Science CSE CSE Feb 11

Image Compression Algorithm and JPEG Standard

EXAM SOLUTIONS. Image Processing and Computer Vision Course 2D1421 Monday, 13 th of March 2006,

Progressive Geometry Compression. Andrei Khodakovsky Peter Schröder Wim Sweldens

03 - Reconstruction. Acknowledgements: Olga Sorkine-Hornung. CSCI-GA Geometric Modeling - Spring 17 - Daniele Panozzo

A Primer on Laplacians. Max Wardetzky. Institute for Numerical and Applied Mathematics Georg-August Universität Göttingen, Germany

JPEG: An Image Compression System

Encoding Meshes in Differential Coordinates

SOLVING PARTIAL DIFFERENTIAL EQUATIONS ON POINT CLOUDS

Digital Geometry Processing Parameterization I

IMAGE COMPRESSION. October 7, ICSY Lab, University of Kaiserslautern, Germany

Outline. Visualization Discretization Sampling Quantization Representation Continuous Discrete. Noise

Partial Differential Equations

Spectral Watermarking for Parameterized Surfaces

A Parallel Reconfigurable Architecture for DCT of Lengths N=32/16/8

Geodesics in heat: A new approach to computing distance

Mining Social Network Graphs

CS 523: Computer Graphics, Spring Shape Modeling. Skeletal deformation. Andrew Nealen, Rutgers, /12/2011 1

CS242: Probabilistic Graphical Models Lecture 3: Factor Graphs & Variable Elimination

Lecture 5: Compression I. This Week s Schedule

UNIVERSITY OF CALGARY. Subdivision Surfaces. Advanced Geometric Modeling Faramarz Samavati

Computer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier

Lecture 7: Most Common Edge Detectors

JPEG 2000 Implementation Guide

Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting

Image Similarities for Learning Video Manifolds. Selen Atasoy MICCAI 2011 Tutorial

7.5 Dictionary-based Coding

2014 Summer School on MPEG/VCEG Video. Video Coding Concept

Transcription:

Spectral Compression of Mesh Geometry Zachi Karni, Craig Gotsman SIGGRAPH 2000 1

Introduction Thus far, topology coding drove geometry coding. Geometric data contains far more information (15 vs. 3 bits/vertex). Quantization methods are not suitable for lossy compression. non-graceful degradation. 2

Intuition 3

Laplace Operator The Laplace operator is a second order differential operator. f = f xx + f yy + f zz One-dimensional heat equation: u t = k u = ku xx 4

Discrete Laplace Operator Defined so that the Laplace operator has meaning on a graph or discrete grid (e.g. 3D mesh). Much discussion over correct weights most commonly: w ij = 1 i 5

Laplacian Smoothing 6

Laplacian Matrix We can express the discrete Laplacian operator in matrix-vector notation. x = Lx, L = I W Laplacian matrix in this paper: L ij = 1 i = j 1/d i i and j are neighbors 0 otherwise 7

Spectral Motivation Regular polygon of n vertices. n =5: x 1 x 2 x 3 x = x 1 x 2... x 5 x 4 x 5 Discrete Laplacian: 8

Spectral Motivation Discrete Laplacian written in matrix form: 9

Spectral Motivation n real eigenvalues of K in increasing order: The n real eigenvectors of K are of the following form: 10

Encoding Partition the mesh into submeshes. Compute the topological Laplacian matrix for each little submesh. Represent each submesh as a linear combination of orthogonal basis functions derived from the eigenvectors of the Laplacian. 11

Decoding Topology encoded/decoded by your method of choice. Geometric data sent as coefficient vectors. Mesh partitioned and eigenvectors computed based on topology, which are then used to decode the geometry. 12

Mesh Signal Processing Laplacian matrix: L ij = 1 i = j 1/d i i and j are neighbors 0 otherwise Eigenvectors form an orthogonal basis of. R n Associated eigenvalues are the squared frequencies. 13

Mesh Signal Processing Mesh Laplacian Eigen Matrix Eigenvalues 14

Geometry Vectors We are going to view the geometry as three n-dimensional column vectors (x, y, z), where n is the number of vertices. x = x 1 x 2... y = y 1 y 2... z = z 1 z 2... x n y n z n 15

Mesh Signal Processing Since form a basis of n- e 1,..., e n dimensional space, every n-dimensional vector can be written as a linear combination: x = x = n j=1 x 1 ˆx j e j = Eˆx, x 2.,E = x n e e 2... e n, ˆx = ˆx 1 ˆx 2. ˆx n 16

Mesh Signal Processing Original model containing 2,978 vertices. Reconstruction using 100 of the 2,978 basis functions. Reconstruction using 200 basis functions. 17

Mesh Signal Processing The grayscale intensity of a vertex is proportional to the scalar value of the basis function at that coordinate. Second basis function. Eigenvalue = 4.9x10^-4 Tenth basis function. Eigenvalue = 6.5x10^-2 Hundredth basis function. Eigenvalue = 1.2x10^-1 18

Spectral Coefficient Coding Uniformly quantize ˆx, ŷ, ẑ coefficient vectors to finite precision (10-16 bits). Truncate the coefficient vectors. Encode using Huffman or arithmetic coder. 19

Spectral Coefficient Coding Trade-off: Small number of high-precision coefficients Large number of low-precision coefficients Optimize based on visual metrics. Number of retained coefficients per coordinate per submesh chosen such that a visual quality is met. 20

A Visual Metric RMS geometric distance between corresponding vertices in both models does not capture properties like smoothness. 21

A Visual Metric Geometric Laplacian: GL(v i )=v i j n(i) l 1 ij v j j n(i) l 1 ij Average of the norm of the geometric distance and the norm of the Laplacian distance. M 1 M 2 = 1 2n ( v 1 v 2 + GL(v 1 ) GL(v 2 ) ) 22

Mesh Partitioning Eigenvectors can be calculated in O(n) time since Laplacian is sparse. (n is the number of vertices.) When n is large, eigenvalues become too close, leading to numerical instability. Necessary to partition mesh. 23

Mesh Partitioning Capture local properties better. Minimize Damage: roughly same number of vertices in each submesh. minimize number of edges straddling different submeshes (edge-cut). 24

Mesh Partitioning Optimal solution is NP-Complete. MeTIS Optimized linear-time implementation. Meshes of up to 100,000 vertices. preference to minimizing the edge-cut over balancing partition. 25

METIS 40 submeshes 70 submeshes 26

Results Comparison with Touma-Gotsman (TG) compression. 27

Results KG: 3.0 bits/vertex TG: 4.0 bits/vertex KG: 4.1 bits/vertex TG: 4.1 bits/vertex 28

Discussion Can t just throw out high frequency detail; it is not noise! Can t use the algorithm on very large meshes. MeTIS only accommodates meshes of up to 100,000 vertices. 29