Pose normalization

11
DeepFace: closing the gap to human-level performance in face verification -- 3D pose normalization CVPR 2014 2014/09/23 ked

description

A normalization method of the CVPR paper, "DeepFace: Closing the Gap to Human-Level Performance in Face Verification."

Transcript of Pose normalization

Page 1: Pose normalization

DeepFace: closing the gap to human-level performance in face verification

-- 3D pose normalization CVPR

20142014/09/23ked

Page 2: Pose normalization

Authors

Y. Taigman, M. Yang, M’A Ranzato, L. Wolf

Page 3: Pose normalization

Flow chart

Face alignment 2D alignment 3D alignment Frontalization

Representation Verification

Page 4: Pose normalization

Discussion about

Face alignment 2D alignment 3D alignment Frontalization

Representation Verification

Face detection

Page 5: Pose normalization

Face alignment

Face alignment 2D alignment 3D alignment Frontalization

Face detection Cropping Feature alignment 3D model

3D triangle 2D triangle Normalization

Page 6: Pose normalization

Face alignment

Face alignment 2D alignment 3D alignment Frontalization

Feature alignment

3D alignmentGet affine transformation

3D model

Feature alignment

FrontalizationDraw the 3D model using texture of the affine transformation

3D model

Page 7: Pose normalization

Solve by least square method

0 0 0 0 x y z 1

Solve affine transformation

x y z 1 0 0 0 0

Transformation8 x 1 (affine)

Vert_2D(#fea x 2) x 1

Vert_3D(#fea x 2) x 8

x

y

Page 8: Pose normalization

Warping method – not work -.-||

Page 9: Pose normalization

Implementation – labels in 3D

Page 10: Pose normalization

Implementation mapping

Page 11: Pose normalization

Thx.