3D View Simulation Based on Face Tracking
description
Transcript of 3D View Simulation Based on Face Tracking
3D Scene Virtualization Based on Face Tracking
Final Presentation for EE7700 DVP
Shenghua Wan and Kang zhangMay, 2012
3D View Simulation Based on Face TrackingMotivationMulti-touch User InterfacePhysical MotionVirtual Environment
Motion Sensing Game ConsolesWiiKinect
Infrared sensor barInfrared LEDInfrared projector and camera
ObjectiveFace MotionTrackingTranslationsZoom
Virtual 3D Scene Explore3D scenee.g. a Cube with 8 points with different depthvalues.View Simulation
Methodology-Face Tracking 1Haar Cascade Classifier (Viola & Jones 2001)Haar-like featuresIntegral ImageAdaBoost (Freund & Schapire 1995)Cascading
ImplementationOpenCVTrained ClassifierSome Untuned Parameters
Methodology-Face Tracking 2CAMShift( Continuously Adaptive Mean-Shift )AssumptionImage histogram of foreground object is time-invariant.Back ProjectionMean Shift AlgorithmLocate new search window and goto 2ImplementationOpenCVMethodology-Face Tracking 2(cont)Some comments on CAMShiftSensitive and fastNot Robusttend to be interfered by objects with similar color distribution.
facearmfingerseven notebook!Experimental ResultsHuman face moves in real-worldViewpoint moves in the simulated 3D scene as if we are looking at the real-world objects.
Thank you!