Automatic image-based 3D head modeling
description
Transcript of Automatic image-based 3D head modeling
![Page 1: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/1.jpg)
Supervisor: doc. RNDr. Andrej Ferko, PhD.
Peter Kán
Comenius University in BratislavaFaculty of Mathematics, Physics and Informatics
with a Parameterized Model Based on a Hierarchical Tree of Facial Features
![Page 2: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/2.jpg)
Introduction
Motivation
Solution• Program structure
• Parameterized model based on a hierarchical tree of facial features
• 3D head reconstruction
• Rendering
Conclusion
Automatic image-based 3D head modeling Peter Kán
![Page 3: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/3.jpg)
Design and implement an application for 3D head model reconstruction from input images
Real-time 3D head model rendering
Model Export
Automatic image-based 3D head modeling Peter Kán
![Page 4: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/4.jpg)
Problem definition
Human head modeling
Automatic image-based 3D head modeling Peter Kán
![Page 5: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/5.jpg)
Problem definition
Automatic image-based 3D head modeling Peter Kán
![Page 6: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/6.jpg)
Human head modeling algorithm
Automation
Automatic image-based 3D head modeling Peter Kán
![Page 7: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/7.jpg)
Automatic image-based 3D head modeling Peter Kán
![Page 8: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/8.jpg)
Automatic image-based 3D head modeling Peter Kán
Parameterized head model creation [Ahlberg 2001]
Parameters detection and parametrized model adjusting
[Mihálik, Kasár, 2007]
[In Kyu Park, Hui Zhang, Vladimir Vezhnevets, 2004]
Texture synthesis and mapping
![Page 9: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/9.jpg)
Automatic image-based 3D head modeling Peter Kán
Haar cascade classifiers with an Extended Set of Haar-like Features
[Paul Viola, Michael Jones]
[Rainer Lienhart,Jochen Maydt]
Skin tone based image segmentation [Prem Kuchi, Prasad Gabbur, P. Subbanna Bhat, Sumam David S.]
+ =
![Page 10: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/10.jpg)
Automatic image-based 3D head modeling Peter Kán
Front face detection
![Page 11: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/11.jpg)
Automatic image-based 3D head modeling Peter Kán
Profile face detection• Skin tone based image segmentation• Median filtration• Head center calculation by linear interpolation• Bounding box calculation• Face contour analysis
![Page 12: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/12.jpg)
Automatic image-based 3D head modeling Peter Kán
Predefined head model (32672 triangles)
Hierarchical structure of facial features
![Page 13: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/13.jpg)
Automatic image-based 3D head modeling Peter Kán
Model adjusting by hierarchical tree of facial features
3D head model reconstruction:
1. Global vertices transformation
2. Local vertices transformation
3. Textures creation
4. Textures mapping
![Page 14: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/14.jpg)
Automatic image-based 3D head modeling Peter Kán
Geometry transformation according to facial features positions detected from input images
Intensity of transformations is defined as vertex weights for each facial feature
Final vertex position calculation by linear interpolation
![Page 15: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/15.jpg)
Automatic image-based 3D head modeling Peter Kán
Real-time
OpengGL
Normal mapping, texture-space diffusion[S. Green, 2004] p
![Page 16: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/16.jpg)
Automatic image-based 3D head modeling Peter Kán
Model parts export:
• geometry, transformations
• efects
[Arnaud, Barnes, 2006]
Texture export
![Page 17: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/17.jpg)
Automatic image-based 3D head modeling Peter Kán
![Page 18: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/18.jpg)
Automatic image-based 3D head modeling Peter Kán
![Page 19: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/19.jpg)
Computer games
Films
Telecommunications
Medicine(Plastic surgery)
Security systems
...
Automatic image-based 3D head modeling Peter Kán
![Page 20: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/20.jpg)
The system for automatic image-based 3D head modeling from 2D images was designed and implemented
The novel technique for 3D head reconstruction with parameterized model based on hierarchical tree of facial features is proposed
New method for detecting head parameters from image with use Haar Cascade Classifiers and skin-tone based segmentation is presented
Collada Engine for rendering 3D models in real time was created
Automatic image-based 3D head modeling Peter Kán
![Page 21: Automatic image-based 3D head modeling](https://reader037.fdocuments.us/reader037/viewer/2022103006/5681420e550346895dae0d0a/html5/thumbnails/21.jpg)
Automatic image-based 3D head modeling Peter Kán
www.peterkan.com