Scribd
Upload
35 views29 pages

The Eigenfaces Method The Eigenfaces Method: Face Recognition and Biometric Systems

The Eigenfaces method uses principal component analysis (PCA) to perform face recognition. It involves training on a set of face images to determine eigenvectors that define a face space. During training, a covariance matrix is constructed and eigenvectors corresponding to the largest eigenvalues are selected. These eigenvectors are the eigenfaces. A face image can then be projected onto the face space, resulting in a feature vector of weights that compactly represents the image. Recognition involves projecting a new image into this space and comparing the resulting feature vector to those of known individuals. The method provides a simple and computationally efficient approach to face recognition.

Uploaded by

Hussein Hammoud
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
35 views29 pages

The Eigenfaces Method The Eigenfaces Method: Face Recognition and Biometric Systems

The Eigenfaces method uses principal component analysis (PCA) to perform face recognition. It involves training on a set of face images to determine eigenvectors that define a face space. During training, a covariance matrix is constructed and eigenvectors corresponding to the largest eigenvalues are selected. These eigenvectors are the eigenfaces. A face image can then be projected onto the face space, resulting in a feature vector of weights that compactly represents the image. Recognition involves projecting a new image into this space and comparing the resulting feature vector to those of known individuals. The method provides a simple and computationally efficient approach to face recognition.

Uploaded by

Hussein Hammoud
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 29

The Eigenfaces method

Face Recognition and Biometric Systems

Plan of the lecture


Principal Components Analysis
main idea i id

Feature extraction by PCA y


face recognition

Eigenfaces
training feature extraction
Face Recognition and Biometric Systems

Literature
M.A.Turk, A.P.Pentland

Face Recognition Using Eigenfaces

Face Recognition and Biometric Systems

Phases of recognition

Detection

Normalisation

Feature vectors comparison

Feature extraction
Face Recognition and Biometric Systems

Example... Example

Face Recognition and Biometric Systems

Example... Example

Face Recognition and Biometric Systems

Example... Example

Face Recognition and Biometric Systems

PCA main issues


Dimensionality
input space data

Coordinates C di t system suited to a set t it d t t Dimensionality reduction y


reduction error

Principal Components Analysis (PCA)


statistical method
Face Recognition and Biometric Systems

PCA main issues


Input data set
vectors / points input space

Space orthonormal basis S th lb i


each vector from the input space can be expressed as a linear combination of basis vectors basis vector defines a dimension
Face Recognition and Biometric Systems

PCA main issues


Dimensions are sorted
each basis vector assigned with a weight

Main directions of variance in the input set


each direction generates one dimension

Dimension importance proportional to variance


Face Recognition and Biometric Systems

Input face space


Normalised image
described by pixel values

Image as a point in a space


e.g. 64x75 pixels 4800 dimensions g p

Information excess
too many dimensions

Elimination of redundant information


relevant information must remain feature extraction
Face Recognition and Biometric Systems

PCA for feature extraction


Set of normalised images
input vectors (a.k.a. training set)

PCA:
finds new orthogonal basis number of dimensions can be reduced creates face space

Feature extraction by PCA


find a corresponding point in a new space p works for any face image (not only from training set)

Eigenfaces method PCA for face images g g


Face Recognition and Biometric Systems

The Eigenfaces method


Training
1. 2. 2

create covariance matrix for the training set calculate eigenvalues and eigenvectors
eigenvectors are the orthonormal basis and define the face space eigenvalues are associated with eigenvectors eigenvalues proportional to variance

3 3.

select eigenvectors face image mapped to the new space (coordinates must be found) any face image may be processed y g y p
Face Recognition and Biometric Systems

Feature extraction

Eigenfaces: training
Input vectors:

u1,...,uM

u N-dimensional vector M number of vectors in the set

1 M Average vector: = ui M i =1
Covariance matrix:

1 1 M T C = (ui )(ui ) or C = A A M i =1 M
Face Recognition and Biometric Systems

Training example
Training set (M=4, N=3):
[1, [ , [0, [4, [3 [3, 0, 3, , 1, 0 0, 2] 1] ] 2] -1]

Average vector, covariance matrix

Face Recognition and Biometric Systems

Eigenfaces: training
Characteristic equation:

det(C I) = 0 ( eigenvalues ( )
Eigenvectors ( ) (v)
one for each eigenvalue g

C v = v
Jacobi method (numerical method)
OpenCV - cvEigenVV function p g
Face Recognition and Biometric Systems

Training optimisation
Problem: large size of covariance matrix (NxN), e.g. 4800x4800 T Trick: A A v = v

A A v' = 'v' T A A (A v' ) = '(A v' ) = ' v = A v'


T

Av desired eigenvectors
Face Recognition and Biometric Systems

Eigenfaces: training
Eigenvectors properties Ei t ti
dimensionality equal to input vectors orthonormal (length = 1) th l (l th sorted by corresponding eigenvalues may be scaled to pixel value range

Eigenfaces eigenvectors transformed to images


example dimensionality reduction

New space, less dimensions


Face Recognition and Biometric Systems

Eigenfaces: training

C00 ... C0n ... ... ...

Cn0 ... Cnn

Normalised images

Covariance matrix

Eigenfaces

Face Recognition and Biometric Systems

Eigenfaces: feature extraction


Feature extraction i F t t ti input: t
set of eigenvectors and eigenvalues (delivered by training) normalised image

Projection:

x' = x
T

ti ith i t - matrix with eigenvectors x normalised image after average face subtraction x transformed vector
Face Recognition and Biometric Systems

Feature extraction - example


2-dimensional space:
eigenvectors:
2 2 [ ; ] 2 2 2 2 [ ; ] [ 2 2

Vectors projection:
[3; 1], [-2; -2], [10, 9]

Dimensionality reduction Di i lit d ti


Face Recognition and Biometric Systems

Eigenfaces: feature extraction


matrix can be cut to reduce dimensions

Feature vector element is a scalar product:

wi = vi x
T

w = ' x
T

Feature vector cut projected vector x


Face Recognition and Biometric Systems

Eigenfaces: feature extraction


K1 K2 K3 ... Scalar products between normalised image and eigenvectors ... Feature vector

Face Recognition and Biometric Systems

Back projection: face image


Feature vector face description
information reduction

Back projection: face image recovered from feature vector


reduced information are lost

P j ti error: Projection
depends on similarity to the training set 2D example face images g
Face Recognition and Biometric Systems

Face Recognition and Biometric Systems

Face Recognition and Biometric Systems

Back projection: detection


Back projection of images:
face -> slightly modified face image flower -> image similar to a face g

Back projection error is higher for non face images non-face Can be used as a verifier
threshold of accepted projection error
Face Recognition and Biometric Systems

Summary
Eigenfaces a basic face recognition method
many derived methods

Training and feature extraction Holistic approach High speed Average / low effectiveness
may be improved
Face Recognition and Biometric Systems

Thank you for your attention!

Face Recognition and Biometric Systems

You might also like