Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... ·...
Transcript of Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... ·...
![Page 1: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/1.jpg)
Symmetry in Shapes – Theory and Practice
Maks Ovsjanikov Ecole Polytechnique / LIX
Intrinsic Symmetry Detection
![Page 2: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/2.jpg)
Intrinsic Symmetries
![Page 3: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/3.jpg)
Intuition
What about us? I am symmetric. Image source: Bronstein et al.
![Page 4: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/4.jpg)
Problem Formulation
• Shape is symmetric, if there exists
a transformation f
such that .
What class of transformations is allowed?
• Extrinsic:
f is a combination of:
• Rotation,
• Translation,
• Reflection,
• (Scaling)
f
Bronstein et al.
![Page 5: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/5.jpg)
• Shape is symmetric, if there exists
a transformation f
such that .
What class of transformations is allowed?
• Extrinsic:
f is: rotation, translation, reflection
• Intrinsic?
Problem Formulation
Bronstein et al.
![Page 6: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/6.jpg)
Problem Formulation
f
Fundamental Theorem:
A map is a combination of translation, rotation, and reflection if and only if it preserves all Euclidean distances.
![Page 7: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/7.jpg)
Problem Formulation
Fundamental Theorem:
A map is a combination of translation, rotation, and reflection if and only if it preserves all Euclidean distances.
![Page 8: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/8.jpg)
Fundamental Theorem:
A map is a combination of translation, rotation, and reflection if and only if it preserves all Euclidean distances.
Problem Formulation
![Page 9: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/9.jpg)
Extrinsic Formulation
• Shape is extrinsically symmetric, if there exists
a rigid motion f,
such that .
Equivalently:
• Shape is extrinsically symmetric,
if there exists a map:
f
Bronstein et al.
![Page 10: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/10.jpg)
• Shape is extrinsically symmetric, if there exists
a rigid motion f,
such that .
Equivalently:
• Shape is extrinsically symmetric,
if there exists a map:
Bronstein et al.
Extrinsic Formulation
![Page 11: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/11.jpg)
• Shape is intrinsically symmetric,
if there exists a map:
Bronstein et al.
Intrinsic Formulation
![Page 12: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/12.jpg)
• Shape is intrinsically symmetric,
if there exists a map:
Bronstein et al.
Intrinsic Formulation
Source of difficulty: Instead of operating in the space of rigid motions, operate in the space of correspondences.
![Page 13: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/13.jpg)
• Intrinsic Isometries: Shape deformations that preserve intrinsic (geodesic) distances.
Intrinsic Formulation
Bronstein et al.
![Page 14: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/14.jpg)
• Intrinsic Symmetries: Self-maps that approximately preserve geodesic distances
Intrinsic Formulation
![Page 15: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/15.jpg)
Intrinsic Formulation
Mitra et al.
![Page 16: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/16.jpg)
1. Optimization-based approach: Raviv et al., Symmetries of Non-Rigid Shapes, NRTL 2007, IJCV 2009 2. Relation to extrinsic symmetries: Ovsjanikov et al., Global Intrinsic Symmetries of Shapes, SGP 2008 3. Relation to conformal maps: Kim et al., Mobius Transformations for Global Intrinsic Symmetry Analysis, SGP 2010 4. Detection of continuous symmetries: Ben-Chen et al., On Discrete Killing Vector Fields and Patterns on Surfaces, SGP 2010
Intrinsic Symmetry Detection
![Page 17: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/17.jpg)
Idea:
1. Solve the optimization problem directly:
Possible Approach:
GMDS: treat each point as a variable, solve using nonlinear optimization
(main difficulty: obtaining the gradient of the energy).
Raviv et al., Symmetries of Non-Rigid Shapes., NRTL 2007, IJCV 2009
Intrinsic Symmetry Detection
![Page 18: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/18.jpg)
Idea:
1. Solve the optimization problem directly:
Difficulties:
1. Energy is non-linear non-convex, need a good initial guess.
2. Optimization is expensive (compute over a small number of points).
3. Want to stay away from the trivial solution.
Raviv et al., Symmetries of Non-Rigid Shapes., NRTL 2007, IJCV 2009
Intrinsic Symmetry Detection
![Page 19: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/19.jpg)
Initial Guess:
1. Adapt the Global Rigid Matching idea to non-rigid setting:
1. For each point on the surface find a non-rigid descriptor.
2. Match points with similar descriptors.
3. Compute the distortion of the partial solution.
2. Branch and bound global optimum
1. Incrementally add points to get a partial solution.
2. If the distortion is greater than the known solution, disregard it.
3. Depends on the quality of the initial greedy guess.
Intrinsic Symmetry Detection
Raviv et al., Symmetries of Non-Rigid Shapes., NRTL 2007, IJCV 2009
![Page 20: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/20.jpg)
Non-rigid Descriptor:
1. At each point compute the histogram of geodesic distances.
Comparing Descriptors:
1. Non-trivial. Comparing is bad because of binning. Use instead:
where : distance between bins.
Geodesic level sets How many points within
each level set
Intrinsic Symmetry Detection
![Page 21: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/21.jpg)
Results:
Limitations:
1. Optimization is expensive.
2. Not easy to explore multiple symmetries.
3. Need better descriptor.
Intrinsic Symmetry Detection
![Page 22: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/22.jpg)
Intrinsic Symmetry Detection
Purely algebraic method for detecting intrinsic symmetries, and point-to-point correspondences.
Grouping symmetries into discrete classes.
Main Observation: In a certain space, intrinsic symmetries become extrinsic symmetries.
O., Sun, Guibas, Global Intrinsic Symmetries of Shapes, SGP 2008
![Page 23: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/23.jpg)
Where is the value of the eigenfunction of the Laplace-Beltrami operator at .
Global Point Signatures
Given a point on the surface, its GPS signature:
Rustamov, 2007
![Page 24: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/24.jpg)
Laplace-Beltrami Operator
Given a compact Riemannian manifold X without boundary, the Laplace-Beltrami operator:
![Page 25: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/25.jpg)
Laplace-Beltrami Operator
Given a compact Riemannian manifold X without boundary, the Laplace-Beltrami operator : 1. Is invariant under isometric deformations.
2. Characterizes the manifold completely.
3. Has a countable eigendecomposition:
that forms an orthonormal basis for L2(X) .
![Page 26: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/26.jpg)
Laplace-Beltrami Operator
The Laplace-Beltrami operator Has an eigendecomposition: that forms an orthonormal basis for L2(X) .
![Page 27: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/27.jpg)
Observations
If X has an intrinsic symmetry , then GPS(X ) has a Euclidean symmetry. I.e.:
Moreover, restriction to each distinct eigenvalue is symmetric.
Theorem:
GPS(X )
O., Sun, Guibas, Global Intrinsic Symmetries of Shapes, SGP 2008
![Page 28: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/28.jpg)
Restricted Signature Space
Only include non-repeating eigenvalues.
In the restricted space, intrinsic symmetries are reflective symmetries around principal axes:
![Page 29: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/29.jpg)
Results
Euclidean symmetries when present.
Two different symmetries for human shape.
![Page 30: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/30.jpg)
Topological Noise
Change in GPS after geodesic shortcuts:
Correspondences
![Page 31: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/31.jpg)
Limitations
Can only detect very global symmetries.
Cannot handle continuous symmetries.
In the discrete setting even non-repeating eigenfunctions can be unstable
O., Sun, Guibas, Global Intrinsic Symmetries of Shapes, SGP 2008
![Page 32: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/32.jpg)
Intrinsic Symmetry Detection
Möbius Voting:
Isometries are a subgroup of the group of conformal maps.
For genus zero surfaces: 3 correspondences constrain all degrees of freedom, and the optimal transformation has a closed form solution.
Volume preserving maps
Conformal maps
Isometries
Lipman and Funkhouser SIGGRAPH‘09
![Page 33: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/33.jpg)
Intrinsic Symmetry Detection
Möbius Voting for shape matching:
Isometries are a subgroup of the group of conformal maps.
For genus zero surfaces: 3 correspondences constrain all degrees of freedom, and the optimal transformation has a closed form solution.
![Page 34: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/34.jpg)
Intrinsic Symmetry Detection
Möbius Voting-based symmetry detection:
Kim, Lipman, Chen, and Funkhouser Mobius Transformations for Global Intrinsic Symmetry Analysis, SGP 2010
1) Map the mesh surface to the extended complex plane .
2) Generate a set of anti-Mobius transformations.
3) Measure alignment score
4) Return the best alignment
Iterate
![Page 35: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/35.jpg)
Intrinsic Symmetry Detection
Möbius Voting-based symmetry detection:
Kim, Lipman, Chen, and Funkhouser Mobius Transformations for Global Intrinsic Symmetry Analysis, SGP 2010
1) Map the mesh surface to the extended complex plane .
Mid-point uniformisation (Lipman et al. ‘09)
Conformal mapping onto the sphere by solving a sparse linear (Laplacian) system
![Page 36: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/36.jpg)
Möbius Voting-based symmetry detection:
Kim, Lipman, Chen, and Funkhouser Mobius Transformations for Global Intrinsic Symmetry Analysis, SGP 2010
1) Map the mesh surface to the extended complex plane .
2) Generate a set of anti-Mobius transformations.
Find likely triplets of correspondences
Intrinsic Symmetry Detection
Use intrinsic symmetry-invariant descriptors.
![Page 37: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/37.jpg)
Möbius Voting-based symmetry detection:
Kim, Lipman, Chen, and Funkhouser Mobius Transformations for Global Intrinsic Symmetry Analysis, SGP 2010
1) Map the mesh surface to the extended complex plane .
2) Generate a set of anti-Mobius transformations.
3) Measure alignment score.
Use the initial triplet to find correspondences between all other points.
Intrinsic Symmetry Detection
![Page 38: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/38.jpg)
Möbius Voting-based symmetry detection:
Kim, Lipman, Chen, and Funkhouser Mobius Transformations for Global Intrinsic Symmetry Analysis, SGP 2010
1) Map the mesh surface to the extended complex plane .
2) Generate a set of anti-Mobius transformations.
3) Measure alignment score.
Intrinsic Symmetry Detection
Use the initial triplet to find correspondences between all other points.
Closed form solution in the extended complex plane embedding.
![Page 39: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/39.jpg)
Intrinsic Symmetry Detection
Möbius Voting-based symmetry detection:
Kim, Lipman, Chen, and Funkhouser Mobius Transformations for Global Intrinsic Symmetry Analysis, SGP 2010
1) Map the mesh surface to the extended complex plane .
2) Generate a set of anti-Mobius transformations.
3) Measure alignment score
4) Return the best alignment
Iterate
![Page 40: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/40.jpg)
Results
Largest-scale evaluation of an intrinsic symmetry-detection method.
Benchmark for comparing other methods.
![Page 41: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/41.jpg)
Results
Largest-scale evaluation of an intrinsic symmetry-detection method.
Benchmark for comparing other methods.
ATTENTION: 1. More recent method based on Blended Intrinsic Maps
(SIGGRAPH ’11) available at:
http://www.cs.princeton.edu/~vk/projects/CorrsBlended/ 2. Benchmark has some inaccuracies (human labeled),
currently under review.
![Page 42: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/42.jpg)
Continuous Intrinsic Symmetries
Ben-Chen, Butscher, Solomon, Guibas On discrete killing vector fields and patterns on surfaces, SGP 2010
![Page 43: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/43.jpg)
Represent Transformations using Tangent Vector Fields
U(p)
ft1(p)
p
ft2(p)
ft (p) – One-parameter family of mappings generated by the tangent vector field U
Ben-Chen et al.
![Page 44: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/44.jpg)
Represent Transformations using Tangent Vector Fields
U(p)
ft1(p)
p
ft2(p)
![Page 45: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/45.jpg)
Represent Transformations using Tangent Vector Fields
U(p)
ft1(p)
p
ft2(p)
If ft (p) is an intrinsic isometry for every t then U is a Killing Vector Field (KVF).
![Page 46: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/46.jpg)
Killing Vector Fields (again) The Killing Equation
• U is a KVF only if:
Rn : U = Jacobian matrix Surface: U = covariant derivative tensor
![Page 47: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/47.jpg)
Killing Vector Fields A (very) simple example
U = (ux(x,y),uy(x,y)) = (-y,x)
![Page 48: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/48.jpg)
Computing AKVFs
Solve:
On a triangulated mesh.
Reformulate using (Discrete) Exterior Calculus. Leads to an eigendecomposition problem.
![Page 49: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/49.jpg)
AKVFs in the Wild
Ben-Chen, Butscher, Solomon, Guibas On discrete killing vector fields and patterns on surfaces, SGP 2010
![Page 50: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/50.jpg)
Approximate KVFs Noise
= 0.065
E = 0.29
= 0.087
E = 0.55
= 0.1145
E = 1.33
= 0.2
E = 6.7
Ben-Chen, Butscher, Solomon, Guibas On discrete killing vector fields and patterns on surfaces, SGP 2010
![Page 51: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/51.jpg)
Pattern Generation
![Page 52: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/52.jpg)
Multiple Continuous Symmetries
First Eigenvector
#2 #3 #4
![Page 53: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/53.jpg)
Pattern Generation
53
![Page 54: Symmetry in Shapes Theory and Practiceresources.mpi-inf.mpg.de/deformableShapeMatching/EG2013... · 2013-05-16 · Symmetry in Shapes – Theory and Practice Maks Ovsjanikov Ecole](https://reader034.fdocuments.us/reader034/viewer/2022042302/5ecd33e03ba3fa0b2c4f3ed4/html5/thumbnails/54.jpg)
Conclusions
Intrinsic Symmetry Detection:
• Formulated as finding intrinsic distance-preserving maps.
• Often solved using isometric matching techniques.
• Theoretically equivalent to extrinsic symmetry detection but in higher dimensional space.
• Continuous symmetries treated with differential methods.
Open problems:
• Good theory for the approximate setting.
• Practical automatic methods.
• Better understanding of the correct deformation space.