Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + +...

34
Lecture 13 Wavelet transformation II

Transcript of Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + +...

Page 1: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Lecture 13 Wavelet transformation II

Page 2: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Fourier Transform (FT)

• Forward FT:

dtetxX ti )()(~

deXtx ti)(

~)( 2

1• Inverse FT:

• Examples: )(2)(~

)( 000

dteeXetx tititi

1)()(~

)()( dtetXttx ti

++ +

Slide from Alexander Kolesnikov ’s lecture notes

Page 3: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Two test signals: What is difference?

x(t)=cos(1 t)+cos(2t)+cos(3)+cos(4t)

x1(t)=cos(1t)x2(t)=cos(2t)x3(t)=cos(3t)x4(t)=cos(4t)

x1(t) x2(t) x3(t) x4(t)

a)

b)

1= 102= 203= 404=100

Slide from Alexander Kolesnikov ’s lecture notes

Page 4: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Spectrums of the test signals

a)

b)

Signals are different, spectrums are similar

Signals are different, spectrums are similar

Why?Why?

Slide from Alexander Kolesnikov ’s lecture notes

Page 5: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Short-Time Fourier Transform (STFT)

dethxtX i)()(),(~

Window h(t)

Signal in the window

Result is localized in space and frequency: Why?Result is localized in space and frequency: Why?

Input signal

Page 6: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

STFT: Partition of the space-frequency plane

ktk

2

Page 7: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Problems with STFT

Uncertainity Principle: 1 t

Improved space resolution Degraded frequency resolution

Improved frequency resolutionDegraded space resolution

t

Problem: the same and t throught the entire plane!Problem: the same and t throught the entire plane!

STFT is redundant representationNot good for compression

Page 8: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Solution: Frequency Scaling

• Smaller frequency make the window more narrow

• Bigger frequency make the window wider

1~Const

1

t

t

)(~

)/( sHsh

More narrow time window for higher frequencies

here s is scaling factor

Page 9: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

New partition of the space-frequency plane

Coordinate, t

Frequency,

Page 10: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

New partition of the plane

Discrete wavelet transformShort-time Fourier transform

• Wavelet functions are localized in space and frequency• Hierarchical set of of functions

Page 11: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Frequency vs Time

Page 12: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

FT vs WT

• From one domain to another domain.

Page 13: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Scale and shift

• Scale

• Shift

Page 14: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Five steps to calculate WT

1. Take a wavelet and compare it to a section at the start of the original signal.

2. Calculate a number, C, that represents how closely correlated the wavelet is with this section of the signal.

3. Shift the wavelet to the right and repeat steps 1 and 2 until you’ve covered the whole signal.

4. Scale (stretch) the wavelet and repeat steps 1 through 3.

5. Repeat steps 1 through 4 for all scales.

Page 15: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Scale and frequency

Page 16: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Example of Wavelet functions

• Haar

• Ingrid Dauhechies

Page 17: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Biorthogonal

Page 18: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Example of Wavelets

• Coiflets

• Symlets

Page 19: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Examples of Wavelet functions

• Morlet

• Mexican Hat

• Meyer

Page 20: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Decomposition: approximation and detail

• One-level decomposition

• Multi-level decomposition

Page 21: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Haar wavelets

)2(2),( 2 ktkj jj

Page 22: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Scaling function and Wavelets

k

ktkht )2()(2)( 0

k

ktkht )2()(2)( 1 Wavelet function:

Scaling function:

The functions (t) and (t) are orthonormal

The most important property of the wavelets:To obtain WT coefficients for level j we can process

WT coefficients for level j+1.

The most important property of the wavelets:To obtain WT coefficients for level j we can process

WT coefficients for level j+1.

)1()1()( 01 kNhkh k where

Page 23: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Haar: Scaling function and Wavelets

)12(2

1)2(

2

12)(

)12(2

1)2(

2

12)(

ttt

ttt

)1()1()( 01 kNhkh k

Page 24: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Daubechies wavelets of order 2

Scaling function Wavelet function

k

ktkht )2()(2)( 0

k

ktkht )2()(2)( 1

Page 25: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Discrete wavelet transform

1

0

00 )2(2)()2(2)()( 22j

jj

j

k

jj

jj

k

ktkdktkstf

Wavelets detailsLow-resolution approx.

NB!NB!

k

j

j1

Page 26: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Haar wavelet transform

Page 27: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Haar wavelet transform

)(0 kh )(1 kh

Page 28: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Haar wavelet transform: Example

Input data: X={x1,x2,x3,…, x16}

Haar wavelet transform: (a,b)(s,d)

where:

1) scaling function s=(a+b)/2 (smooth, LPF)

2) Haar wavelet d=(a-b) (details, HPF)

X={10,13, 11,14, 12,15, 12,14, 12,13, 11,13, 10,11} [11.5,12.5, 13.5,13, 12.5,12, 10.5] {-3, -3, -3, -2, -1,-2,-1} [12, 13.25, 12.25, 10.5] {-2,0.5,-0.5} {-3, -3, -3, -2, -1,-2,-1} [12.625, 11.375] {-1.25, 1.75} {-2,0.5,-0.5} {-3, -3, -3, -2, -1,-2,-1} [12]{1.25} {-1.25, 1.75} {-2,0.5,-0.5} {-3, -3, -3, -2, -1,-2,-1}

Page 29: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Inverse Haar wavelet transform: Example

Inverse Haar wavelet transform: (s,d) (a,b)

1) a=s+d/2

2) b=sd/2

Y= [12]{1.25} {-1.25, 1.75} {-2,0.5,-0.5} {-3, -3, -3, -2, -1,-2,-1} [12.625,11.375] {-1.25, 1.75} {-2,0.5,-0.5} {-3, -3, -3, -2, -1,-2,-1} [12, 13.25, 12.25, 10.5] {-2,0.5,-0.5} {-3, -3, -3, -2, -1,-2,-1} [11.5,12.5, 13.5,13, 12.5,12, 10.5] {-3, -3, -3, -2, -1,-2,-1} {10,13, 11,14, 12,15, 12,14, 12,13, 11,13, 10,11}

X={10,13, 11,14, 12,15, 12,14, 12,13, 11,13, 10,11} [11.5,12.5, 13.5,13, 12.5,12, 10.5] {-3, -3, -3, -2, -1,-2,-1} [12, 13.25, 12.25, 10.5] {-2,0.5,-0.5} {-3, -3, -3, -2, -1,-2,-1} [12.625, 11.375] {-1.25, 1.75} {-2,0.5,-0.5} {-3, -3, -3, -2, -1,-2,-1} [12]{1.25} {-1.25, 1.75} {-2,0.5,-0.5} {-3, -3, -3, -2, -1,-2,-1}

Page 30: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Wavelet transform as Subband Transform

To be continued...

Page 31: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Wavelet Transform and Filter Banks

Page 32: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Wavelet Transform and Filter Banks

h0(n) is scaling function, low pass filter (LPF)

h1(n) is wavelet function, high pass filter (HPF)

is subsampling (decimation)

Page 33: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Inverse wavelet transform

Synthesis filters: g0(n)=(-1)nh1(n)

g1(n)=(-1)nh0(n)

is up-sampling (zeroes inserting)

Page 34: Lecture 13 Wavelet transformation II. Fourier Transform (FT) Forward FT: Inverse FT: Examples: + + + Slide from Alexander Kolesnikov ’s lecture notes.

Wavelet transform as Subband filtering