1

Face Recognition using Artificial Neural Network

PRESENTED BY:-

SUMEET S. KAKANI

GUIDED BY:-

PROF. V. M. UMALE

2

CONTENTS:

Introduction What is an Artificial Neural Network? ANN Structure System Overview Local image sampling The Self Organizing-Map Perceptron learning rule Convolutional Network System details Implementation Applications Conclusion References

3

Introduction1. Why face recognition?

Face Recognition systems enhance security, provide secure

access control, and protect personal privacy

Improvement in the performance and reliability of face

recognition

No need to remember any passwords or carry any ID

2. Why neural network?

Adaptive learning: An ability to learn how to do tasks

Self-Organization: An ANN can create its own organisation

Remarkable ability to derive meaning from complicated or

imprecise data

4

What is an Artificial Neural Network?

Definition: A Computing system made of a number of simple,

highly interconnected processing elements, which process

information by their dynamic state response to external input.

Motivated right from its inception by the recognition.

A machine that is designed to model the way in which the brain

performs a particular task.

A massively parallel distributed processor.

Resembles the brain in two respects:

1. Knowledge is acquired through a learning process.

2. Synaptic weights, are used to store the acquired knowledge.

5

ANN Structure:

A Layer with n inputs xi.

correspondent weights Wji (i=1, 2, 3...n)

The function ∑ sums the n weighted inputs and

passes the result through a non-linear function

φ(•), called the activation function.

The function φ (•) processes the adding results

plus a threshold value θ, thus producing the output

Y.

6

Cont…a) Processing units Receive input The adjustment of the weights

Three types of units: 1. input units 2. hidden units 3. output units During operation, units can be updated either synchronously or

asynchronously.

b) Connections between units

n Y(t) = φ( ∑ wij(t) Xj(t) + θ)

j=1c) Transfer Function: The behavior of an ANN depends on both the weights and the transfer

function that is specified for the units. This function typically falls into one of two categories:

Linear : the output activity is proportional to the total weighted output.

Threshold: the output is set at one of two levels, depending on whether the total input is greater than or less than some threshold value.

7

System Overview

Following are the basic processes that are used by the system to capture and compare images:

1. Detection:Recognition software searches the field of view of a video camera for faces.Once the face is in view, it is detected within a fraction of a second.

2. Alignment: Once a face is detected, the head's position, size and poseis the first thing that is determined.

3. Normalization: The image of the head is scaled and rotated so that it can be registered and mapped into an appropriate size and pose.

8

Cont..4. Representation:

Translation of facial data into unique code is done by the system.

5. Matching:The newly acquired facial data is compared to the stored data and (ideally) linked to at least one stored facial representationThis includes-Local image samplingThe Self Organizing-MapConvolutional Network

9

Local image sampling

Figure : A representation of the local image sampling process.

• We have evaluated two different methods of representing local image samples.

• In each method a window is scanned over the image as shown in figure.

10

The Self Organizing-Map Used to reduce the dimensions of the image vector

Self-Organizing Map(SOM), is an unsupervised learning process, which learns the distribution of a set of patterns without any class information.

Unsupervised learning: a) No external teacher and is based upon only local information.b) It is also referred to as self-organization unsupervised learning.

The basic SOM consists of:I) A 2 dimensional lattice L of neurons.II) Each neuron ni belongs to L has an associated codebook vector μi belongs to Rn.III) The lattice is either rectangular or hexagonal as shown in figure

11

Cont..

Figure: Rectangular and hexagonal lattice

• Self-organizing maps learn both the distribution and topology of the input vectors they are trained on.

• Here a self-organizing feature map network identifies a winning neuron i using the same procedure as employed by a competitive layer.

• However, instead of updating only the winning neuron, all neurons within a certain neighborhood of the winning neuron are updated

12

Perceptron learning rule

Perceptrons are trained on examples ofdesired behavior.

The desired behavior can be summarized by a set of input, output pairs as:p1t1, p2t2,………….. pQtQ

Where p is an input to the network and t is the corresponding correct (target) output.

The perceptron learning rule can be written more succinctly in terms of the errore = t - a, and the change to be made to the weight vector Δw:

Case 1: If e = 0, then make a change Δw equal to 0.

Case 2: If e = 1, then make a change Δw equal to p T.

Case 3: If e = -1, then make a change Δw equal to -p T.

13

Convolutional Network

Figure : A typical convolutional network.

14

Cont..

Automatically synthesize simple problem specific feature extractor from training data.

Feature detectors applied everywhere.

Features get progressively more global and invariant.

The whole system is trained “end-to-end” with gradient based method to minimize a global loss function.

Integrate segmentation, feature extraction, and invariant classification in one stretch.

15

Cont..

1. Convolutional Mechanism Capable of extracting similar features in different

places in the image. Shifting the input only shifts the feature map (robust

to shift).

2. Subsampling Mechanism The exact positions of the extracted features are

not important. Only relative position of a feature to another

feature is relevant. Reduce spatial resolution – Reduce sensitivity to

shift and distortion.

16

System details

For the images in the training set, a fixed size

window is stepped over the entire image.

As shown in earlier figure and local image samples

are extracted at each step.

A self-organizing map is trained on the vectors from

the previous stage

17

Cont..

The same window as in the first step is stepped over

all of the images in the training and test sets.

The local image samples are passed through the SOM

at each step, thereby creating new training and test

sets in the output space created by the self-

organizing map.

A convolutional neural network is trained on the

newly created training set

18

ImplementationTraining:

Testing:

19

Applications Law Enforcement: Minimizing victim trauma by narrowing mug

shot searches, Verifying identify for court records, and comparing school Surveillance camera Images to known child molesters.

Security/Counter terrorism: Access control, comparing surveillance images to Known terrorists.

   Day Care: Verify identity of individuals picking up the children.

Missing Children/Runaways Search surveillance images and the internet

for missing children and runaways.

Residential Security: Alert homeowners of approaching personnel.

Healthcare: Minimize fraud by verifying identity. Banking: Minimize fraud by verifying identity.

20

Conclusion

There are no explicit three-dimensional models in our system, however we have found that the quantized local image samples used as input to the convolutional network represent smoothly changing shading patterns.

Higher level features are constructed from these building blocks in successive layers of the convolutional network.

In comparison with the eigenfaces approach, we believe that the system presented here is able to learn more appropriate features in order to provide improved generalization.

21

References:

 1. Steve Lawrence, C. Lee Giles , “Face Recognition: A Convolutional Neural

Network Approach”, IEEE transaction, St. Lucia, Australia.

2. David a brown, Ian craw, Julian lewthwaite, “Interactive Face retrieval using self organizing maps-A SOM based approach to skin detection with application in real time systems”, IEEE 2008 conference, Berlin, Germany.

3. Shahrin Azuan Nazeer, Nazaruddin Omar' and Marzuki Khalid, “Face Recognition System using Artificial Neural Networks Approach”, IEEE - ICSCN 2007, MIT Campus, Anna University, Chennai, India. Feb. 22-24, 2007. pp.420-425.

4. M. Prakash and M. Narasimha Murty, “Recognition Methods and Their Neural- Network Models”, IEEE TRANSACTIONS ON NEURAL NETWORKS, VOL. 8, NO. 1, JANUARY 2005.

5. E. Oja, “Neural networks, principal components and subspaces”, Int. J. Neural Syst., vol. 1, pp. 61–68, 2004.

22

THANK YOU