3D Mesh Compression in Open3DGC. Khaled MAMMOU

Transcription

1 3D Mesh Compression in Open3DGC Khaled MAMMOU

2 OPPORTUNITIES FOR COMPRESSION Indexed Face Set Geometry: positions Connectivity: of triangles Requires 192 bits per vertex! Redundancy Indexes repeated multiple times No need to preserve triangles and vertices order No need for 32-bit precision for positions/attributes Neighbour vertices exhibit high geometry correlations Lossy geometry compression and lossless connectivity encoding reduce the stream size to bpv Geometry X1, Y1, Z1 X2, Y2, Z2 X3, Y3, Z3 X4, Y4, Z4 X5, Y5, Z5 X6, Y6, Z6 X7, Y7, Z7 Reordered geometry X3, Y3, Z3 X7, Y7, Z7 X6, Y6, Z6 X2, Y2, Z X4, Y4, Z4 X5, Y5, Z5 X1, Y1, Z1 Connectivity 1, 3, 7 1, 7, 6 1, 6, 2 1, 2, 4 1, 4, 5 Reordered Connectivity 7, 5, 6 7, 4, 5 7, 3, 4 7, 1, 2 7, 2, 3 V 5 V 3 V 4 V 1 V 7 V 2 V 6

3 ENCODER OVERVIEW Algorithm based on TFAN codec [Mammou 09] Triangular meshes with attributes Arbitrary topologies (e.g., manifold or not, open/closed, oriented or not, arbitrary genus, holes ) MPEG-SDMC (Scalable Complexity 3D Mesh Coding) published in 2010 Encoder Connectivity TFAN-based Connectivity Encoding Geometry Uniform Quantization Prediction Arithmetic or ASCII Encoding Compressed stream [Mammou 09] K. Mammou, T. Zaharia, F. Prêteux, TFAN: A low complexity 3D mesh compression algorithm Computer Animation and Virtual Worlds, Vol. 20(2-3), pp , 2009

4 ENCODER OVERVIEW Algorithm based on TFAN codec [Mammou 09] Triangular meshes with attributes Arbitrary topologies (e.g., manifold or not, open, closed, holes ) MPEG-SDMC (Scalable Complexity 3D Mesh Coding) published in 2010 Encoder Connectivity TFAN-based Connectivity Encoding Geometry Uniform Quantization Prediction Arithmetic or ASCII Encoding Compressed stream [Mammou 09] K. Mammou, T. Zaharia, F. Prêteux, TFAN: A low complexity 3D mesh compression algorithm Computer Animation and Virtual Worlds, Vol. 20(2-3), pp , 2009

5 ENCODER OVERVIEW Uniform quantization Map real numbers to integers Maximum quantization error Uniform quantization reduces the number of bits per vertex for positions from 96 bpv to 24 bpv q=4 q=6 q=8 q=10 Original

6 ENCODER OVERVIEW Algorithm based on TFAN codec [Mammou 09] Triangular meshes with attributes Arbitrary topologies (e.g., manifold or not, open, closed, holes ) MPEG-SDMC (Scalable Complexity 3D Mesh Coding) published in 2010 Encoder Connectivity TFAN-based Connectivity Encoding Geometry Uniform Quantization Prediction Arithmetic or ASCII Encoding Compressed stream [Mammou 09] K. Mammou, T. Zaharia, F. Prêteux, TFAN: A low complexity 3D mesh compression algorithm Computer Animation and Virtual Worlds, Vol. 20(2-3), pp , 2009

7 ENCODER OVERVIEW Geometry prediction Exploit connectivity information Differential and parallelogram prediction

8 ENCODER OVERVIEW Geometry prediction Exploit connectivity information Differential and parallelogram prediction Adaptively choose the best predictor Geometry prediction reduces the number of bits per vertex for positions from 24 bpv to 10.3 bpv

9 ENCODER OVERVIEW Algorithm based on TFAN codec [Mammou 09] Triangular meshes with attributes Arbitrary topologies (e.g., manifold or not, open, closed, holes ) MPEG-SDMC (Scalable Complexity 3D Mesh Coding) published in 2010 Encoder Connectivity TFAN-based Connectivity Encoding Geometry Uniform Quantization Prediction Arithmetic or ASCII Encoding Compressed stream [Mammou 09] K. Mammou, T. Zaharia, F. Prêteux, TFAN: A low complexity 3D mesh compression algorithm Computer Animation and Virtual Worlds, Vol. 20(2-3), pp , 2009

10 ENCODER OVERVIEW Triangle FAN Each two successive triangles share a common edge All triangles share a common vertex (i.e., center of the TFAN) All the triangles have the same orientation Described by enumerating the vertices in their traversal order Implicitly encodes adjacency information (1,3,7,6,2,4,5) 7 indices instead of 15 for IFS

11 ENCODER OVERVIEW TFAN-based connectivity compression Decompose the mesh into a set of TFANs Traverse the vertices from neighbour to neighbour Rename vertices according to the traversal order For each vertex, group its incident non-visited triangles into TFANs V 3 V 10 V 7 V 7 V 5 V 4 V 8 V 9 V 6 V 4 V 6 V 9 V 2 V 3 V 10 V 8 V 2 V 5 V 1 V 1

12 ENCODER OVERVIEW TFAN-based connectivity compression Decompose the mesh into a set of TFANs Traverse the vertices from neighbour to neighbour Rename vertices according to the traversal order For each vertex, group its incident non-visited triangles into TFANs Encode TFANs Distinguish 10 topological configurations Use local indices instead of absolute ones

13 Frequency ENCODER OVERVIEW TFAN-based connectivity compression Decompose the mesh into a set of TFANs Traverse the vertices from neighbour to neighbour Rename vertices according to the traversal order For each vertex, group its incident non-visited triangles into TFANs Encode TFANs Distinguish 10 topological configurations Use local indices instead of absolute ones Entropy encoding Exploit statistical redundancy 100% 80% TFAN-based connectivity compression reduces the number of bits per vertex for connectivity from 96 bpv to 3.1 bpv 60% 40% 20% 0% TFAN configurations

14 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering 10

15 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {} 10 1,(7,1)

16 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {V4} V6 V2 V4 V3 10 1,(7,1) 2,(4,1)

17 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {V4, V5} V6 V2 V4 V3 V5 V4 10 1,(7,1) 2,(4,1),(7,2)

18 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {V5, V2, V9, V7} V6 V2 V4 V3 V5 V4 V2 V5 V9 V6 V7 V7 10 1,(7,1) 2,(4,1),(7,2) 0

19 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {} V6 V2 V4 V3 V5 V4 V2 V5 V9 V6 V7 V7 10 1,(7,1) 2,(4,1),(7,2) 0 0

20 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {V9} V6 V2 V4 V3 V5 V4 V2 V5 V9 V6 V7 V7 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1)

21 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {V7,V10} V6 V2 V4 V3 V5 V4 V2 V5 V9 V6 V7 V7 V10 V8 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2)

22 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {V7,V10,V8} V6 V2 V4 V3 V5 V4 V2 V5 V9 V6 V7 V7 V10 V8 V8 V9 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

23 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {V3} V6 V2 V4 V3 V5 V4 V2 V5 V9 V6 V7 V7 V10 V8 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) V8 V9 V3 V10 2,(6,2),(4,1) 0

24 CONNECTIVITY ENCODING EXAMPLE Vertex re-ordering V1 V1 {V8} V6 V2 V4 V3 V5 V4 V2 V5 V9 V6 V7 V7 V10 V8 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) V8 V9 V3 V10 2,(6,2),(4,1) 0 0

25 CONNECTIVITY DECODING EXAMPLE {} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

26 CONNECTIVITY DECODING EXAMPLE {V3} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

27 CONNECTIVITY DECODING EXAMPLE {V3, V4} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

28 CONNECTIVITY DECODING EXAMPLE {V4} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

29 CONNECTIVITY DECODING EXAMPLE {} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

30 CONNECTIVITY DECODING EXAMPLE {V6} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

31 CONNECTIVITY DECODING EXAMPLE {V7, V8} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

32 CONNECTIVITY DECODING EXAMPLE {V7, V8, V9} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

33 CONNECTIVITY DECODING EXAMPLE {V9} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

34 CONNECTIVITY DECODING EXAMPLE {V10} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

35 CONNECTIVITY DECODING EXAMPLE {} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)

36 CONNECTIVITY DECODING EXAMPLE {} 10 1,(7,1) 2,(4,1),(7,2) 0 0 1,(4, 1) 2,(6,2),(4,1)