CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi,...

9
CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade

Transcript of CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi,...

Page 1: CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade.

CAMEO: Face RecognitionYear 1 Progress and Year 2 Goals

Fernando de la Torre, Carlos Vallespi, Takeo Kanade

Page 2: CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade.

Face Recognition from video.

– How to learn a facial model from the

data coming from the face detector?

Page 3: CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade.

Face Recognition from video.

• Challenges:1) How to learn INVARIANTLY to spatial transformations?

Simultaneous registration and Subspace computation.

2) How to select the most discriminative features?

3) How to deal with missing data?

T

ttt

E1

2)()(),,(W1t cB)af(x,daCB

Page 4: CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade.

Face Recognition from video.

–Register w.r.t a Subspace

–Selecting the most discriminative samples.

Page 5: CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade.

Face Recognition from video.

i j

BA

i j

jBT

iABA

ji

ji

d

uu

BA, )(

Distance between Sets A and B.

Singular vectorsof A

A=

B=

- How to exploit temporal redundancy in the recognition process?

Page 6: CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade.

Face Recognition from video.

• 95 % of recognition rate (11 Subjects and 30 images per subject).

Page 7: CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade.

Plans year 2.

• Why is hard to perform face recognition from

Mosaic images?– Small images.

– Noisy images.

– Misalignments.

• But …– Temporal redundancy.

– Recognizing several people (exclusive principle).

– Superesolution.

Page 8: CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade.

Learning person-specific models.

• Unsupervised learning from video sequences:– Facial appearance models.– Behaviour models (e.g. gestures).

• Learning person-specific models can be useful to identify people, to predict actions?

Page 9: CAMEO: Face Recognition Year 1 Progress and Year 2 Goals Fernando de la Torre, Carlos Vallespi, Takeo Kanade.

Meeting visualization/summarization

• Input: – Set of several videos, with detected and

recognized faces. – Set of indicators if the person is talking, up,

down, etc…

• Output:– Low dimensional visualization of the meeting

activity and interaction between people.– Learning interaction models between people.