Post on 20-Jan-2016
Lecture 19 Representation and description II
1. Regional descriptors
2. Principle components
3. Representation with Matlab
4. Feature selection
2
Regional Descriptors
1. area
2. perimeter
3. compactness
4. topological descriptors
5. texture
Simple descriptors
Area = the number of pixels in the region
Perimeter = length of its boundary
Compactness = (perimeter)2/area
Topological descriptors
Features that does not change when deformation
E = C – H
E = Euler number
C = number of connected region
H = number of holes
Example
Straight-line segments (polygon networks)
V – Q + F = C – H = E
V = number of vertices
Q = number of edges
F = number of faces
7-11+2 = 1-3 = -2
Example
Texture description
• Texture features measures– Smoothness, coarseness, and regularity– Three approaches: statistical, structural, and spectral
• Statistical approach yields characterization of smoothness, coarse, grainy
• Structural approach deals with arrangement of image primitives such as regularly spaced parallel lines
• Spectral approach is based on properties of Fourier spectrum to detect global periodicity in an image by identifying high-energy, narrow peaks in the spectrum.
Statistical approaches
1
0
1
0
22
2
3
The nth moment of z about the mean
( ) ( ) ( )
where ( )
The second moment is the variance ( ) ( )
1Relative smoothness: ( ) 1 .
1 ( )
The third moment ( ) measures
Ln
n i ii
L
i ii
z z m p z
m z p z
z z
R zz
z
4
12
0
1
20
the skewness
The fourth moment ( ) measures the flatness
Uniformity: ( ) ( )
Entropy: ( ) ( ) log ( ), measuring the variability.
L
ii
L
i ii
z
U z p z
e z p z p z
Example
Co-occurrence matrix and descriptors
,
Let be an image with intensity levels . Let G be a matrix,
whose element is the number of times that pixel pairs with
intensities z and z occuring in f in the position specified by
an operato
i j
i j
f L
g
r . Let be the total number of pixel pairs,
/
Then the statistical measures can be applied to to obtain
the co-occurrence descriptors.
ij ij
ij
Q n
p g n
p
Occurrence with large distance
• Example: correlation descriptor as a function of offset
Spectral approaches
• Consider the FT F(u, v) of the region. • Or represent F(u, v) in polar coordinates S(r, θ)
• Ray descriptor
• Ring descriptor
0
( ) ( , )S r S r
0
( ) ( , )R
r
S S r
Principle components
• Suppose we are given n components of an image (e.g. n = 3 for RGB image), written as
• The mean vector is
• The covariance matrix
– Real and symmetric
1
21 2( , ,..., )T
n
n
x
xX x x x
x
1
2{ } , { }X i i
n
m
mm E X m E x
m
{( )( ) }TX X XC E X m X m
Eigenvalue, eigenvector, and Hoteling transformation
1
1 2
1 2 1 2
1
2
Let a and , 1, 2, ..., be the eigenvectors and
corresponding eigenvalues of . i.e.,
Assume,
, ,
, , , ,
i i
X X i i i
i i
TT T Tn
TT T T Ty X n x n
T
T
Tn
i n
C C a a
A a a a
C AC A a a a C a a a
a
a
a
1
21 2 1 1 2 2
11 1 1 2 1 2 1
21 2 1 2 2 2 2
1 1 2 2
, , , , , ,
0 0 0
0 0 0
0 0 0
( )
T
T
x x x n n n
Tn
T T Tn n
T T Tn n
T T Tnn n n n n
X
T
a
aC a C a C a a a a
a
a a a a a a
a a a a a a
a a a a a a
Y A X m
X A
1
2,
T
T
X k X
Tk
a
aY m X Y m
a
Example 2
• Let X =(x1, x2) be the coordinates of pixel of a region or a boundary
• The eigenvalues are descriptors insensitive to size and routation
1 2 1 2Compute , , and eigenvectors , , and , , and
Hoteling transformationX xm C e e
Example 2
Lecture 19 Part IIFeature selection
• This is to select of a subset of features from a larger pool of available features
• The goal is to select those that are rich in discriminatory information with respect to the classification problem at hand.
28
Some housekeeping techniques
1. Outlier removalAn outlier is a point that lies far away from the mean value of the corresponding random variable;
e.g. for normally distributed data, a threshold of 1, 2, or 3 times the standard deviation is used to define outliers.
2. Data normalization : restrict the values of all features within predetermined ranges. E.g. transform to standard normal distribution
or transform the range to [-1, 1]or by softmax scalingr is user defined para.
29
Informative or not by hypothesis testing
• A feature is informative or not. • Statistical tests are commonly used. The idea is to test
whether the mean values of feature has in two classes differ significantly
– H1: The mean values of the feature in the two classes are different. (alternative hypothesis)
– H0: The mean values of the feature in the two classes are equal. (null hypothesis)
Receiver operating characteristic
• Measure the overlap between the pdfs describing the data distribution. This overlap is quantified in terms of an area between two curves, also known as AUC (area under the receiver operating curve).
Fisher’s discriminant Ratio
• Fisher’s discriminant ratio (FDR) is commonly employed to quantify the discriminatory power of individual features between two equiprobable classes.
Combination of features
• Divergence
Si is the covariance matrix
Bhattacharyya Distance and Chernoff Bound
Measures Based on Scatter Matrices
• Large values of J1, J2, and J3 indicate that data points in the respective feature space have small within-class variance and large between-class distance.
Feature Subset Selection
1. Reduce the number of features by discarding the less informative ones, using scalar feature selection.
2. Consider the features that survive from the previous step in different combinations in order to keep the “best” combination.
1. features are ranked in descending order according to some
criterion C.
2. Let i1 be the index of the best one. Next, the cross-correlations among the first (top-ranked) feature with each of the remaining features are computed.
3. The index, i2, of the second most important feature, x_i2 , is computed as
4. General k
Feature ranking
Feature Vector Selection
• Find the “best” combination of features.
• To examine all possible combinations of the m features
• Suboptimal Searching Techniques, e.g. sequential forward selection (SFS),