Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models
description
Transcript of Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models
![Page 1: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/1.jpg)
Computer Science Honours Dissertation 499
Realism and Believabilityin MPEG-4 Facial Models
Bernhard TschirrenSchool of Computing
Curtin University of Technology
Project Supervisor: Andrew Marriott
![Page 2: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/2.jpg)
November 2000 Bernhard Tschirren 2
introduction
The FAQbot• Russel - Personality
• Quoc - Gesture Markup
• John - Speech
Realism
![Page 3: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/3.jpg)
November 2000 Bernhard Tschirren 3
introduction
![Page 4: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/4.jpg)
November 2000 Bernhard Tschirren 4
overview
Objectives
Background
Implementation
Results (Pretty Pictures)
Future Work
Conclusion
![Page 5: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/5.jpg)
November 2000 Bernhard Tschirren 5
objectives
Realism• Face, Hair, Eyes, Environment
Realtime - Believability• Consumer OpenGL Card
Complete System• Quick & Easy
Integrate with FAE
![Page 6: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/6.jpg)
November 2000 Bernhard Tschirren 6
background
The FAE• Univ. of Genoa, Italy
• Black-Box
MPEG-4• FDP - Facial Definition Parameters
• Number (major.minor)
• Location (x,y,z)
• Texture (u,v)
![Page 7: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/7.jpg)
November 2000 Bernhard Tschirren 7
background
![Page 8: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/8.jpg)
November 2000 Bernhard Tschirren 8
background
Model Calibration
![Page 9: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/9.jpg)
November 2000 Bernhard Tschirren 9
the face
Face Styler• Creates FDPs & Texture Map
• Requires Orthogonal Photographs
![Page 10: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/10.jpg)
November 2000 Bernhard Tschirren 10
the face
Place Feature Points• Interactive
• Adjust Images (Trans, Rot, Scale)
![Page 11: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/11.jpg)
November 2000 Bernhard Tschirren 11
the face
Texture Map• Cylindrical
• Generate from Input Images
• Positional Certainty
![Page 12: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/12.jpg)
November 2000 Bernhard Tschirren 12
the face
![Page 13: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/13.jpg)
November 2000 Bernhard Tschirren 13
the face
![Page 14: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/14.jpg)
November 2000 Bernhard Tschirren 14
the face
![Page 15: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/15.jpg)
November 2000 Bernhard Tschirren 15
the face
![Page 16: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/16.jpg)
November 2000 Bernhard Tschirren 16
the hair
MPEG-4 Defines 1 Hair FDP!
Added 101 New FDPs
![Page 17: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/17.jpg)
November 2000 Bernhard Tschirren 17
the hair
![Page 18: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/18.jpg)
November 2000 Bernhard Tschirren 18
the hair
![Page 19: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/19.jpg)
November 2000 Bernhard Tschirren 19
the eyes
FAE Supports Iris Texture
Extract Iris From Left Eye
![Page 20: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/20.jpg)
November 2000 Bernhard Tschirren 20
the eyes
![Page 21: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/21.jpg)
November 2000 Bernhard Tschirren 21
the environment
Set Background Image• Provides context (setting)
• Enhances Realism of Scene
![Page 22: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/22.jpg)
November 2000 Bernhard Tschirren 22
fae integration
FAE Integration Layer• Load & Display Hair
• Load & Display Environment
• Optimised Rendering Routines
Face Styler Engine
Face StylerApplication Hair, Environment
Face, EyesFAE
Face StylerFAE Integration
![Page 23: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/23.jpg)
November 2000 Bernhard Tschirren 23
performance
Tested on nVidia RIVA-TNTResolution Depth Refresh Textured Smooth
800×600 16 85 6 281024×768 16 85 6 28
1280×1024 16 60 6 28
Resolution Depth Refresh Textured Smooth800×600 16 85 28 281024×768 16 85 28 28
1280×1024 16 60 28 28
Resolution Depth Refresh Textured Smooth800×600 16 85 85 85
1024×768 16 85 85 851280×1024 16 60 28 57
![Page 24: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/24.jpg)
November 2000 Bernhard Tschirren 24
animation
![Page 25: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/25.jpg)
November 2000 Bernhard Tschirren 25
john stallo
![Page 26: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/26.jpg)
November 2000 Bernhard Tschirren 26
john stallo
![Page 27: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/27.jpg)
November 2000 Bernhard Tschirren 27
groucho marx
![Page 28: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/28.jpg)
November 2000 Bernhard Tschirren 28
female models
![Page 29: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/29.jpg)
November 2000 Bernhard Tschirren 29
lilly
![Page 30: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/30.jpg)
November 2000 Bernhard Tschirren 30
mug shots...
![Page 31: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/31.jpg)
November 2000 Bernhard Tschirren 31
future work
Arbitrary Camera Locations
Perspective Projection
Automatic Image Alignment
Improve Ears
![Page 32: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/32.jpg)
November 2000 Bernhard Tschirren 32
conclusion
Realtime - Believable
Complete System• No Other Software Required
• Easy to Use - Interactive
• Quick to Use - 15min
Integrate with FAE
Realistic - Better than Oscar!
![Page 33: Computer Science Honours Dissertation 499 Realism and Believability in MPEG-4 Facial Models](https://reader035.fdocuments.us/reader035/viewer/2022070417/568153b7550346895dc1b979/html5/thumbnails/33.jpg)
November 2000 Bernhard Tschirren 33
conclusion