3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in...
-
date post
20-Dec-2015 -
Category
Documents
-
view
212 -
download
0
Transcript of 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in...
![Page 1: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/1.jpg)
3D Human Body Pose Estimation using GP-LVM
Moin Nabi
Computer Vision GroupInstitute for Research in Fundamental Sciences (IPM)
![Page 2: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/2.jpg)
Introduction to Human Pose Estimation
Articulated pose estimation from single-view monocular image(s)
![Page 3: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/3.jpg)
Application of Human Pose Estimation
■ Entertainment: Animation, Games■ Security: Surveillance■ Understanding: Gesture/Activity recognition
![Page 4: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/4.jpg)
Difficulties of Human Pose estimation
■ Appearance/size/shape of people can vary dramatically
■ The bones and joints are observable indirectly (obstructed by clothing)
■ Occlusions■ High dimensionality of the state space■ Lose of depth information in 2D image projections
![Page 5: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/5.jpg)
Difficulties of Human Pose estimation
■ Challenging Human Motion
![Page 6: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/6.jpg)
Problem Backgrounds
■ Pose Estimation From Monocular Image
Goal: Reliable 3D Human Pose Estimation from single-camera input
![Page 7: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/7.jpg)
Gaussian process
![Page 8: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/8.jpg)
Gaussian process
![Page 9: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/9.jpg)
Gaussian process
![Page 10: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/10.jpg)
Gaussian process
![Page 11: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/11.jpg)
Gaussian process
a 5x5 covariance matrix and a 3-d input vector was used to calculate the 2-d output mean vector and the corresponding variances
![Page 12: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/12.jpg)
Gaussian process
Use for Regression
![Page 13: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/13.jpg)
Linear Dimension Reduction
![Page 14: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/14.jpg)
Linear Dimension Reduction
Find the best latent inputs by maximizing the marginal likelihood under the constraint that all visible variables must share the same latent values.
![Page 15: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/15.jpg)
Linear Dimension Reduction
Find the best latent inputs by maximizing the marginal likelihood under the constraint that all visible variables must share the same latent values.
![Page 16: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/16.jpg)
Linear Dimension Reduction
![Page 17: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/17.jpg)
Linear Dimension Reduction
![Page 18: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/18.jpg)
Linear Dimension Reduction
![Page 19: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/19.jpg)
Gaussian process
![Page 20: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/20.jpg)
Nonlinear Dimension Reduction
![Page 21: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/21.jpg)
Nonlinear Dimension Reduction
![Page 22: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/22.jpg)
Nonlinear Dimension Reduction
![Page 23: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/23.jpg)
Nonlinear Dimension Reduction
![Page 24: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/24.jpg)
Nonlinear Dimension Reduction
![Page 25: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/25.jpg)
Nonlinear Dimension Reduction
![Page 26: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/26.jpg)
Human Pose Estimationusing GP-LVM
Image -> Pose
In Latent Space
![Page 27: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/27.jpg)
Human Pose Estimationusing GP-LVM
Motion capture example, representing 102-D data in 2-D
![Page 28: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/28.jpg)
Human Pose Estimationusing GP-LVM
![Page 29: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/29.jpg)
Result
![Page 30: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/30.jpg)
Result
![Page 31: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/31.jpg)
Pose from Action
![Page 32: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/32.jpg)
Thank You
Pose from Action
![Page 33: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/33.jpg)
Different Action has Different shape in latent space
Future Work
Guess Action from shape of model in latent space
![Page 34: 3D Human Body Pose Estimation using GP-LVM Moin Nabi Computer Vision Group Institute for Research in Fundamental Sciences (IPM)](https://reader030.fdocuments.us/reader030/viewer/2022032800/56649d425503460f94a1e5ed/html5/thumbnails/34.jpg)
Thank You