Gender Classification based on Facial information

19
IMTNAN QAZI ALINA OPREA KATERINE DIAZ INAYATULLAH KHAN 16 16 TH TH SUMMER SCHOOL ON IMAGE PROCESSING SUMMER SCHOOL ON IMAGE PROCESSING JULY 15, 2008. Gender Classification based on Facial information

description

Gender Classification based on Facial information. Imtnan QAZI Alina oprea Katerine diaz InayatUllah khan 16 th Summer School on Image Processing July 15, 2008. The project team. Layout. Problem statement. State of the Art. The system overview. Principal Component Analysis. - PowerPoint PPT Presentation

Transcript of Gender Classification based on Facial information

Page 1: Gender Classification based  on Facial information

IMTNAN QAZIALINA OPREA

KATERINE DIAZINAYATULLAH KHAN

1616THTH SUMMER SCHOOL ON IMAGE PROCESSING SUMMER SCHOOL ON IMAGE PROCESSING

JULY 15, 2008.

Gender Classification based

on Facial information

Page 2: Gender Classification based  on Facial information

The project team

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 3: Gender Classification based  on Facial information

Layout

Problem statement.State of the Art.The system overview.

Principal Component Analysis. Fisher Linear Discriminator. Common Vector method. Support Vector Machines.

Simulations & Results.Conclusion.Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 4: Gender Classification based  on Facial information

Men and Women: Same Species, Different Planets

Mathematical/Image processing viewpoint:

Binary classification provided constrained prior information and an elevated difficulty level for probability distribution modeling of the test data.

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

Gender ClassifierGender Classifier

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 5: Gender Classification based  on Facial information

Local features Skin colour, shape & size of the face,

amount of hairs, shape & colour of the lips… Higher difficulty level. Classification accuracies are mediocre.

Global features Whole facial signature considered as a

complete feature set. Useful training sequences required. Higher classification accuracies. Subspace methods + Statistical Learners:

Principal Component Analysis (PCAPCA). Fisher Linear Discriminator (FLDFLD). Common Vectors (CVCV). Support Vector Machines (SVMSVM).…………..

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 6: Gender Classification based  on Facial information

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

The system overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 7: Gender Classification based  on Facial information

Karhunen-Loeve Transform (KLTKLT).Maps vectors from an M-d M-d space

to a n-d n-d space ; n << M.n << M.Computes eigenvectors of the

covariancecovariance matrices for normal distributions.

,

Other distances can also be used.Optimal linear dimensionality

reducer.

Gender classifier based on Facial information

Gender classifier based on Facial information Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 8: Gender Classification based  on Facial information

Supervised method.Label information considered. Inter-class & Intra class scatter scatter

matricesmatrices; proportional to covariance matrices.

,

Generalized eigenvalue problem.Choice of suitable eigenvalue &

eigenvector for the solution.Largest eigenvalue is chosen.

Gender classifier based on Facial information

Gender classifier based on Facial information Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 9: Gender Classification based  on Facial information

Feature space is divided in two orthogonal subspaces.

Each sample in training sequence:

Difference subspace is equal to the rank of scatter matrix for each class.

Minimizes the criterion:

which takes the form:

Gender classifier based on Facial information

Gender classifier based on Facial information Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 10: Gender Classification based  on Facial information

Optimal separating hyper plane.Function that predicts best

response from some training functions.

Given, observation-label pairs:

Minimizes the criterion:

, Kernel function:

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 11: Gender Classification based  on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

Gender classifier based on Facial information

Gender classifier based on Facial information

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Stability of Stability of PCAPCA

Page 12: Gender Classification based  on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

Gender classifier based on Facial information

Gender classifier based on Facial information

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Stability of Stability of FLDFLD

Page 13: Gender Classification based  on Facial information

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Stability of CVStability of CV

Page 14: Gender Classification based  on Facial information

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Stability of Stability of SVMSVM

Page 15: Gender Classification based  on Facial information

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Stability of PCA + Stability of PCA + SVMSVM

Page 16: Gender Classification based  on Facial information

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 17: Gender Classification based  on Facial information

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 18: Gender Classification based  on Facial information

Thank GOD!! My mind can recognize female faces easily.

Stability of different methods depends on number of training sequences.

SVM proves to be stable and reliable global classifier with acceptable accuracy.

Using PCA as dimension reducer and SVM as a classifier can produce better results, if more training sequences can be used.

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.

Page 19: Gender Classification based  on Facial information

Tests with larger databases.

In depth stability analysis of different global classifiers.

Other techniques like Neural Networks may be used to validate different conclusions drawn.

To find a funding source to attend next summer school.

Gender classifier based on Facial information

Gender classifier based on Facial information

Problem statement.

State of the Art.

System overview.

Principal Component Analysis.

Fisher Linear Discriminator.

Common Vector method.

Support Vector Machines.

Simulations & Results.

Conclusion.

Future Perspectives.

16th Summer School on Image Processing, July 7th-16th 2008, Vienna, Austria.