Modeling and Animating Eye Blinks
description
Transcript of Modeling and Animating Eye Blinks
![Page 1: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/1.jpg)
Modeling and Animating Eye Blinks
Laura Trutoiu, Liz Carter, Iain Matthews, Jessica Hodgins
![Page 2: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/2.jpg)
What is an eye blink?
QuickTime™ and aH.264 decompressor
are needed to see this picture.
![Page 3: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/3.jpg)
Figure adapted from “Digital Character Animation”, Maestri,G . New Riders Publishing. 1996
Eye blinks: Common wisdom"... five frames is usually adequate for most situations, although four frames can make a character look more alert."
The Animator's Survival Kit by Richard Williams, Faber and Faber, NYC, 2001.
Inte
r-eyelid
dis
tance
Frame (24fps)
Inte
r-eyelid
dis
tance
Inte
r-eyelid
dis
tance
![Page 4: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/4.jpg)
Figure adapted from “Digital Character Animation”, Maestri,G . New Riders Publishing. 1996
Eye blinks: Common wisdom"... five frames is usually adequate for most situations, although four frames can make a character look more alert."
The Animator's Survival Kit by Richard Williams, Faber and Faber, NYC, 2001.
Frame (24fps)
Inte
r-eyelid
dis
tance
![Page 5: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/5.jpg)
Eye Blinks: What can we see?‣Temporal asymmetry:
‣Fast closing, slow opening
‣Closing amplitude:‣Eyes may not fully close
‣Variety:‣Varying duration & closing amplitude
‣Lower eyelid motionQuickTime™ and a
H.264 decompressorare needed to see this picture.
Frame (300 fps)
Inte
r-eyelid
d
ista
nce
(p
ixels
)
50 100 150 200 250 300
![Page 6: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/6.jpg)
Eye blinks: Can you tell the difference?
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
Video 2:Video 1:
Eye blinks show temporal asymmetry and you can tell the difference.
forward backward
![Page 7: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/7.jpg)
Eyes alive. LEE, S., BADLER, J., AND BADLER, N. ACM Trans. on Graphics 21, 3, 637–644. 2002.Automated eye motion using texture synthesis. DENG Z., LEWIS J. P., NEUMANN U. IEEE Computer Graphics and Applications 25, 2, 24– 30, 2005Eyelid kinematics for virtual characters. STEPTOE, W., OYEKOYA, O., AND STEED, A. Comput. Animat. Virtual Worlds 21 (May), 161–171. 2010
Related work: Eyes in graphicsEyes alive [Lee 2002]
eye gaze/saccades only
Eye motion with texture synthesis [Deng 2005]
no explicit eye blink modelrequires training
Eyelid kinematics [Steptoe 2010]parametric models for eyelid saccades and eye blinks using current position
10 participants
![Page 8: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/8.jpg)
How do we create more natural eye-blink animations?
Track high speed video of eye blinks
Build a generative model that closely resembles the tracked data
Validate the model through perceptual experimentsWhy simple approximations are not good enough
![Page 9: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/9.jpg)
Tracking eye blinksActor performance
Emotional vignettes and in-between pauses
High speed videoCasio Exilim F1 - 300 fps
Video trackingActive Appearance Models (AAMs) [Matthews 2004]
Inte
r-eyelid
dis
tance
(p
ixels
)
50 100 150 200 250 300
1000500 2500 3000
Inte
r-eyelid
dis
tance
(pix
els
)
Active appearance models revisited. Matthews, I. and Baker, S. International Journal of Computer Vision 60, 2, 135–164. 2004
![Page 10: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/10.jpg)
Tracking eye blinks
![Page 11: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/11.jpg)
Eye blink time series Normalized time series
Generated Data Re-timed data
Principal Component Analysis
Video = unobtrusive way to measure eye blink dynamicsHigh speed video => temporal resolution
Building a generative model
![Page 12: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/12.jpg)
Perceptual experimentsQuickTime™ and a
Photo - JPEG decompressorare needed to see this picture.Goal:
Can naive users differentiate between different eye blink dynamics?
Stimuli:Animations at 30 fps
Role of appearance:photorealistic and cartoon character
Naturalness rating (1-7)Very natural clip (7) = “what you would expect to see in the real world”
![Page 13: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/13.jpg)
Perceptual experiments
![Page 14: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/14.jpg)
Perceptual experiments
![Page 15: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/15.jpg)
Exp 1: Model vs. real blinks
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
1 2
3 4
Model, fully closed
Real, fully closed
Model, naturally closed
Real, naturally closed
Model vs. real + Closing amplitude
![Page 16: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/16.jpg)
Exp 1: Model vs. real blinks
Natu
raln
ess
R
ati
ng
Real Model
n = 32, 2 (character) x 2 (profiles) x 2 (blur) x 2 (amplitude) repeated-measures ANOVA
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
Real
Model
300 fps
p < 0.001*
![Page 17: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/17.jpg)
Exp 1: Model vs. real blinks
n = 32, 2 (character) x 2 (profiles) x 2 (blur) x 2 (amplitude) repeated-measures ANOVA
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
Modelnaturally closed
Modelfully closed
300 fps
Natu
raln
ess
R
ati
ng
Naturally closed
Fully closed
![Page 18: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/18.jpg)
Perceptual experiments
Photorealistic > Cartoon
Fully closed > Naturally closed
![Page 19: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/19.jpg)
Perceptual experiments
Photorealistic > Cartoon
Fully closed > Naturally closed
![Page 20: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/20.jpg)
Exp 2: Model vs. Approximations
Model
Linear Symmetric
Linear Asymmetric
Ease In/Ease OutSymmetric
Ease In/Ease OutAsymmetric
Hypothesis: Asymmetric > Symmetric, Non-linear > Linear
![Page 21: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/21.jpg)
Exp 2: Model vs. approximations
2 3
4 5
Model
Symmetric ease-in/ ease-out
Asymmetric linear
Symmetric linear
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
Asymmetric ease-in/ ease-out
1
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
![Page 22: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/22.jpg)
Exp 2: Model vs. approximations
n = 43, 5 (profiles) x 4 (length) x 2 (character) repeated-measures ANOVA
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
![Page 23: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/23.jpg)
Perceptual experiments
Photorealistic > Cartoon
Fully closed > Naturally closed
Model > Approximations
![Page 24: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/24.jpg)
Not symmetric: More time to open than to close Animation textbook - same number of frames for opening
and closing
Not linear: Fast closing (linear velocity) followed by slowly converging
opening Animation - linear or slowly accelerating, slowly decelerating
Eyes may not fully close: At least 50% of the time Animation - eyes always fully close In our experiments, fully closed animations preferred
?
Conclusions: Eye blinks are ...
![Page 25: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/25.jpg)
Future work
Sequences of eye blinksinter-blink distancevariability may be useful
Synchronization with other facial motion
Blink sequence patterns
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
![Page 26: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/26.jpg)
![Page 27: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/27.jpg)
Exp 3: Lower eyelid motion
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
QuickTime™ and aPhoto - JPEG decompressor
are needed to see this picture.
1 2
3 4
Vertical only
Vertical + Horizontal
Horizontal only
No Lower eyelid motion
![Page 28: Modeling and Animating Eye Blinks](https://reader036.fdocuments.us/reader036/viewer/2022062315/568150be550346895dbedf4e/html5/thumbnails/28.jpg)
Exp 3: Lower eyelid motion
n = 32, 4 (lower eyelid motion) x 1 repeated-measures ANOVA
Horizontal+ Vertical
No HorizontalNo Vertical
Horizontal Vertical