Decomposing 3D Shapes into Parts - Rutgers...

12
Decomposing 3D Shapes into Parts Christopher Tosh Perceptual Science and Technology Image Credit: Rong Liu

Transcript of Decomposing 3D Shapes into Parts - Rutgers...

Page 1: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

Decomposing 3D Shapes intoParts

Christopher ToshPerceptual Science and Technology

Image Credit: Rong Liu

Page 2: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

Motivation: Shape Analysis

• Applications in computergraphics, vision, andmany other fields needways of representingsurfaces in 3D.

Image credit: Attene et al.

Page 3: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

Motivation: Shape Analysis

• Objects can be analyzedbetter when broken intopieces

• Studies suggest that wesee objects in terms oftheir parts

Image credit: Attene et al.

Page 4: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

Starting Point: Segmentation• Segmentation is a partition of a surface.

• Ideally, those dividing lines are close to what humansnaturally perceive.

Image Credit: Attene et al.

Page 5: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

Previous Work

3D Segmentation:• Shalfman et al. (2002)• Clustering

• Golovinskiy andFunkhouser (2008)• Graph Cuts

Image Credit: Papers cited

Page 6: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

Segmentation Techniques• One approach is to map

surface points to some n-dimensional feature space.

• Then use a clustering algorithmto group the points. (k-means,mean shift, etc.)

• Problem: Hard to make bothfast and accurate.

Image Credit: Comaniciu and Meer TPAMI 2002

Page 7: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

Segmentation Techniques

• More common approach is tobuild a connected graph whosevertices are points on thesurface.

• Edge weights are carefullychosen.

• Graph is broken into connectedcomponents in an optimal way.

Source: http://www-sipl.technion.ac.il/Info/Teaching_Projects_Text-Synt_e.shtml

Page 8: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

From Segmentation to Parts

• Parts are the defining regions of a shape• Typically, elliptical• Held together by “glue”, which are the (usually)

hyperbolic connecting regions• Differ from segments in that not all of an object

must be considered to be in one part or another

Image Credit: Mi and DeCarlo ICCV 2007

Page 9: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

2D Case: Already done

Mi and DeCarlo (2007)

• Used symmetry to locatepotential parts

• Separated 2D object intonatural parts.

Images Credit: Siddiqi and Kimia 1995; Mi and DeCarlo ICCV 2007

Page 10: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

The Goal

• To design and implement aworkable algorithm that cansuccessfully decompose a3D object into parts

• To have those parts beapproximate to thoseperceived naturally byhumans

Page 11: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

The Plan

• Build on existing segmentation algorithms toapproximate locations of parts

• Identify hyperbolic regions between segments• Fill in holes left behind by removing parts

Page 12: Decomposing 3D Shapes into Parts - Rutgers Universityresearch.cs.rutgers.edu/~cjt118/Site/Presentations_files/REU_presentation1.pdfMotivation: Shape Analysis •Applications in computer

Special thanks to:

• Matthew Stone

• Doug DeCarlo

• Kevin Sanik