II. Nonparametric Spectrum Estimation for Stationary...
Transcript of II. Nonparametric Spectrum Estimation for Stationary...
![Page 1: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/1.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 1
II. Nonparametric Spectrum Estimationfor Stationary Random Signals
- Non-parametric Methods --
[p. 3] Periodogram
-
[p. 12] Periodogram properties-
[p. 23] Modified periodogram
-
[p. 25] Bartlett’s method-
[p. 30] Blackman-Tukey
procedure
- [p. 33] Welch’s procedure
- [p. 36] Minimum Variance (MV) Method- [p. 42] MultiTaper
Method (MTM)
![Page 2: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/2.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 2
-Goal: To estimate the Power Spectral Density (PSD) of a wss
process
-Two main types of approaches exist:-Non parametric methods: do not rely on data model
-based on FT and FFT, or
-Parametric methods: -based on different parametric models of the data:
-Moving Average: MA, -AutoRegressive: AR, -AutoRegressive
& Moving Average: ARMA
-based on subspace methods
![Page 3: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/3.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 3
I. Classical methodsuse FT of the data sequence or its correlation sequence
1) Periodogram• Easy to compute• Limited ability to produce accurate PS estimate
Recall PSD defined as:
( ) ( )j j kx x
k
P e R k eω ω∞
−
=−∞
= ∑
In practice: Rx (k) is approximated with estimated correlation sequence ( )xR k
![Page 4: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/4.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 4
Recall: Biased correlation estimate of x(n), n=0,…N-1, defined as
( ) ( ) ( )1
*
0
1ˆ 0 1N k
xk
R k x k x k NN
− −
=
= + ≤ < −∑
10% L N≤
( ) ( )ˆ ˆL
j j kx
k LP e R k e L Nω ω−
= −
= ≤∑
( ) ( )1
1
Assume L=N-1
ˆ ˆN
j j kx
k NP e R k eω ω
−−
=− +
= ∑ periodogram
PSD estimate sometimes known as correlogram
![Page 5: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/5.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 5
( ) ( ) ( ) ( )*1ˆ * for 0 0 1xR k x k x k x k k NN
= − ≠ ≤ < −
( ) ( ) ( )
( ) ( )
*
*
1ˆ *
1
jx N N
j jN N
P e FT x k x kN
X e X eN
ω
ω ω
⎡ ⎤⇒ = −⎢ ⎥⎣ ⎦
=
( ) ( ) 21ˆ j jx NP e X e
Nω ω=
Periodogram defined in terms of data directly
Recall
( ) ( ) ( ) ( )DFTN Nx n x n w n X k= ⋅ ⎯⎯⎯→
Define:
![Page 6: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/6.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 6
How to Compute the Periodogram
( ) ( ) ( ) ( )( )( ) ( )
DFT
22 1ˆ = , 0,... 1
N N
j k Nx N
x n x n w n X k
P e X k k NN
π
= ⋅ ⎯⎯⎯→
= −
Rectangular window of length N
Zero padding xN (n) in the time-domain increases the number of frequency PSD points available
![Page 7: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/7.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 7
Example: x(n) white noise
( )
( )
x
jx
R k
P eω
=
⇒ =
[Hayes]
![Page 8: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/8.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 8
( ){ } ( )
( ){ }
1
1
1
1
ˆ ˆ
ˆ
Nj jk
x xN
Nj k
xk N
E P e E R k e
E R k e
ω ω
ω
−−
− +
−−
= − +
⎧ ⎫• = ⎨ ⎬⎩ ⎭
=
∑
∑
( ){ } ( ) ( )
( )
( ) ( ) ( )
1*
0
1
ˆ
| |
0
N k
x
x
x B B
E R k E x k xNN k R k
NN k k N
R k w k w k Now
− −
=
⎡ ⎤• = +⎣ ⎦
−=
−⎧ ⎫≤⎪ ⎪= ⋅ = ⎨ ⎬⎪ ⎪⎩ ⎭
∑
Average behavior of the periodogram:
![Page 9: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/9.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 9
( ){ } ( ){ }1
1
ˆ ˆN
j j kx x
k NE P e E R k eω ω
−−
= − +
• = ∑
( ){ } ( ) ( ) ( )| |
,0
x x B B
N k k NE R k R k w k w k N
ow
−⎧ ⎫≤⎪ ⎪• = ⋅ = ⎨ ⎬⎪ ⎪⎩ ⎭
( ){ } ( ) ( )( )1
1
ˆN
j j kx x B
k NE P e R k w k eω ω
−−
=− +
⇒ = ∑
( ){ } ( ) ( )1ˆ *2
j j jx x BE P e P e W eω ω ω
π=
21 sin( /2)
sin( / 2)N
Nω
ω⎡ ⎤⎢ ⎥⎣ ⎦
![Page 10: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/10.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 10
[Hayes]
( ) ( ) ( )0sinx n A n v nω φ= + +
{ }0 0
2( ) ( )2
1( ) ( ) ( )2
( ) ( )4
j j jx x B
j jv B B
E P e P e W e
A W e W e
ω ω ω
ω ω ω ω
π
σ + −
= ∗
⎡ ⎤= + +⎣ ⎦
Example: x(n) 1 tone in white noise
![Page 11: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/11.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 11
x(n) = sin(2π*150*t) + 2*sin(2*π*140*t) + 0.1*randn(size(t)); fs
=1KHz
Example: set of tones in white noise x(n)
periodogram(xn,[],'twosided',1024,fs); plots the two sided periodogram(note: better to stick to one-sided when dealing with real-data)
Obtained using the MATLAB function
periodogram.m
[Mathworks]
![Page 12: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/12.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 12
Properties of the Periodogram1)
Periodogram is biased when dealing with finite windows2)
Periodogram is asymptotically unbiasedi.e.,
lim ( ) ( )j jxN xE P e P eω ω
→+∞⎡ ⎤ =⎣ ⎦
3) Periodogram has limited ability to resolve closely spaced narrowband components (limiting factor due to the rectangular window, the shorter the data length, the worse off) (not good)4) Values of the periodogram spaced in frequency by integer multiples of 2π/N are approximately uncorrelated . As data length increases, rate of fluctuation in the periodogram increases (not good).5) Variance of the periodogram does not decrease as data length increases (not good).
In statistical terms, it means the periodogram is not a consistent estimator of the PSD. Nevertheless, the periodogram can be a useful tool for spectral estimation in situations where SNR is high, and especially if the data is long.
![Page 13: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/13.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 13
xn
= sin(2*pi*150*t) + 2*sin(2*pi*140*t) + 0.1*randn(size(t));; fs=1000; nfft=1024;
[MathWorks]
CommentsPeriodogram has limited ability to resolve closely spaced narrowband components (limiting factor due to the rectangular window, the shorter the data length, the worse off) (not good)
67 samples
100 samples
![Page 14: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/14.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 14
[Hayes]
Comments:Variance of the periodogram does not decrease as the data length increases (not good).
For white noise x(n) one can show [Therrien, p.590]
( )4
lim var 0
var ( )
xj
N
jx x
P e
P e
ω
ω σ
→+∞⎡ ⎤ ≠⎣ ⎦
⎡ ⎤ =⎣ ⎦
![Page 15: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/15.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 15[Kay]
Comments: As data length increases, rate of fluctuation in the periodogram increases (not good).
![Page 16: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/16.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 16
Periodogram can be viewed as obtained by using a filterbank structure.
Recall periodogram defined for x(n), n=0,…N-1, as:
( ) ( ) ( ) ( )
( )( ) ( )
1DFT 2 /
0
22
( )
1ˆ = , 0,... 1
Nj kp N
N N Np
j k Nx N
x n x n w n X k x p e
P e X k k NN
π
π
−−
=
= ⋅ ⎯⎯⎯→ =
= −
∑
Connections between Periodogram and filterbank
![Page 17: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/17.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 17
For x(n) defined over a finite time window {x(n-N+1),…x(n)}
( ) ( ) ( ) ( )1
DFT 2 /
0( )
Nj kp N
N N Np
x n x n w n X k x n p e π−
−
=
= ⋅ ⎯⎯⎯→ = −∑( )h p
( ) ( ) ( ) ( )1
DFT
0( ) ( )
N
N N Np
x n x n w n X k x n p h p−
=
= ⋅ ⎯⎯⎯→ = −∑k=0, …N-1
![Page 18: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/18.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 18
For x(n) defined over a finite time window {x(n-N+1),…x(n)}
( ) ( ) ( ) ( )1
DFT
0( ) ( )
N
N N Np
x n x n w n X k x n p h p−
=
= ⋅ ⎯⎯⎯→ = −∑
2xN (n) ( )( )2ˆ j k NxP e π
- 2 /
Filter ( )1( ) j kp N
H z
h p eN
π=
Periodogram DFT filterbank
k=0, …N-1( )( ) ( ) 22 1ˆ = j k Nx NP e X k
Nπ
![Page 19: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/19.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 19
xN (n)
2( )( )2 0ˆ j N
xP e π
0
Filter ( )1( ) , 0
H z
h p kN
= =
2 ( )( )2ˆ j NxP e π
- 2 /1
Filter ( )1( ) , 1j p N
H z
h p e kN
π= =
2
( )( )2 ( 1)ˆ j N NxP e π −
- 2 ( 1) /1
Filter ( )1( ) , 1j p N N
N
H z
h p e k NN
π −− = = −
( )( ) ( ) 22 1ˆ = j k Nx NP e X k
Nπ
![Page 20: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/20.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 20
xN (n)
2( )( )2 0ˆ j N
xP e π
0
Filter ( )1( ) , 0
H z
h p kN
= =
2 ( )( )2ˆ j NxP e π
- 2 /1
Filter ( )1( ) , 1j p N
H z
h p e kN
π= =
2
( )( )2 ( 1)ˆ j N NxP e π −
- 2 ( 1) /1
Filter ( )1( ) , 1j p N N
N
H z
h p e k NN
π −− = = −
Lowpass filter
Modulation term
( )( ) ( ) 22 1ˆ = j k Nx NP e X k
Nπ
![Page 21: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/21.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 21
xN (n)
2( )( )2 0ˆ j N
xP e π
0
Filter ( )1( ) , 0
H z
h p kN
= =
2 ( )( )2ˆ j NxP e π
- 2 /1 0
Filter ( )( ) ( ) , 1j p N
H zh p h p e kπ= =
2
( )( )2 ( 1)ˆ j N NxP e π −
- 2 ( 1) /1 0
Filter ( )( ) ( ) , 1j p N N
N
H zh p h p e k Nπ −
− = = −
Lowpass filter
Modulation term
( )( ) ( ) 22 1ˆ = j k Nx NP e X k
Nπ
![Page 22: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/22.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 22
2
2 / 2 ( 1) /
2 ( 1) / 2 ( 1) /
1 1 1(0)1(1)
( 1) 1
1/ N ( )( 1)1/ N
( 1)1/ N
Nj N j N N
N
j N N j N NN
Xe eX
X N e e
x nx n
x n N
π π
π π
− − −
− − − −
⎡ ⎤⎡ ⎤⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥ = ⎢ ⎥⎢ ⎥⎢ ⎥⎢ ⎥− ⎢ ⎥⎣ ⎦ ⎣ ⎦
⎛ ⎡ ⎤ ⎡ ⎤⎢ ⎥ ⎢ ⎥−⎢ ⎥ ⎢ ⎥× ⎢ ⎥ ⎢ ⎥⎢ ⎥ ⎢ ⎥− +⎢ ⎥ ⎣ ⎦⎣ ⎦
⎞⎜ ⎟⎜ ⎟⎜ ⎟⎜ ⎟⎜ ⎟⎝ ⎠
Periodogram DFT matrix formulation
( )( ) ( ) 22 1ˆ = j k Nx NP e X k
Nπ
May be viewed as a rectangular window applied to data before FT operation
![Page 23: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/23.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 23
2. Modified Periodogram─
can apply a general window to x(n) prior to computing the periodogram (periodogram extension)
( ) ( ) ( ) 21ˆ j jnx R
n
P e x n w n eN
ω ω+ ∞
−
= − ∞
= ∑
( ) ( ) ( ) 21ˆ *2
j j jx x RE P e P e W e
Nω ω ω
π⎡ ⎤ =⎣ ⎦
Note: amount of smoothing is determined by the window type
Matlab implementation:Hs = spectrum.periodogram('Hamming'); create modified periodogram objectpsd(Hs,xn,'Fs',fs,'NFFT',1024,'SpectrumType',‘onesided') plot
![Page 24: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/24.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 24
• Example:
[MathWorks]
Note: lower Hamming window sidelobes, but wider mainlobes
with the Hamming window than the rect. window
xn
= sin(2*pi*150*t) + 2*sin(2*pi*140*t) + 0.1*randn(size(t));; fs=1000; nfft=1024; data length=100.
Hamming window Rectangular window
![Page 25: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/25.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 25
3. Bartlett’s Method
( ) ( ) ( )1
1ˆ ˆD efine: K
kj jB x
kP e P e
Kω ω
=
= ∑
average several periodograms (rectangular window applied to each)
leads to consistent estimate of the PSD
where K: number of segments in the data.
x(n)
…L
pointsL
pointsL points
n
x1
(n)
…n n n
x2
(n) xK (n)
12
1 0
1( ) | ( ( 1) ) |K L
j jnB
k nP e x n k L e
KLω ω
−−
= =
= + −∑ ∑
![Page 26: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/26.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 26
Note:
( ) ( ) ( )
( )
1ˆ ˆvar var
1
kj jB x
jx
P e P eK
P eK
ω ω
ω
⎡ ⎤⎡ ⎤⎣ ⎦ ⎣ ⎦
⎡ ⎤⎣ ⎦
Examples: ─
white noise
[Hayes]
─
two sinusoids in noise
![Page 27: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/27.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 27[Hayes, Fig. 8.9]
Compare: basic periodograms
Periodogram of white noise with variance 1.
a)
Overlay 50 plots, N=64 & b) average
c)
Overlay 50 plots, N=128 & d) average
e)
Overlay 50 plots, N=256 & f) average
![Page 28: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/28.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 28[Hayes, Fig. 8.14]
K: number of segmentsL: segment length
Spectrum estimation of white noise with unit variance
a)
50-plot overlay, N=512, b) ensemble average.
c)
Overlay of 50 Bartlett estimates with K=4 & L=128, N=512, d) ensemble average.
e)
Overlay of 50 Bartlett estimates with K=8 & L=64, N=512, f) ensemble average.
Bartlett estimates
![Page 29: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/29.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 29
[Hayes, Fig. 8.15]( ) ( )1 2( ) sin 0.2 sin 0.25 ( )x n A n n v nπ φ π φ= + + + +
Note: Spectral peaks broadening, why?
Spectrum estimation of 2 tones in white noise
a)
50-plot overlay, N=512, b) ensemble average.
c)
Overlay of 50 Bartlett estimates with K=4 & L=128, N=512, d) ensemble average.
e)
Overlay of 50 Bartlett estimates with K=8 & L=64, N=512, f) ensemble average.
![Page 30: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/30.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 30
4. Blackman-Tukey (BT) Procedure
( ) ( ) ( )ˆ ˆM
j j kBT x
k MP e w k R k eω ω−
=−
= ∑
─
apply windowing to correlation samples prior to transformation to reduce variance of the estimator
where the window w(k) length is much smaller than data length, w(k) = 0 for |k| > M where M << N
Maximum recommended window length M<N/5
![Page 31: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/31.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 31[Kay, Fig.4.9]
( ) 10 exp(2 (0.15) ) 20 exp(2 (0.2) ) ( )x n j n j n w nπ π= + +
Periodogram BT PSD estimateTriangular window, length=4
Data length=20
( ) ~ (0,0.1)w n N
![Page 32: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/32.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 32
( ) 10 exp(2 (0.15) ) 20 exp(2 (0.2) ) ( )x n j n j n w nπ π= + +
Periodogram
Data length=100
( ) ~ (0,0.1)w n N BT PSD estimateTriangular window, length=20
[Kay, Fig.4.10]
![Page 33: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/33.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 33
5. Welch’s Procedure─
Modification to the Bartlett procedure: Averaging modified periodograms
─
Dataset split into K possibly overlapping segments of length L
where
─
window applied to each segment
─
all K periodograms are averaged
( ) ( ) ( )1
1ˆ ˆK
kj jw x
kP e P e
Kω ω
=
= ∑
( ) ( ) ( ) ( )1 2
0
1ˆL
k k j nx
nP w n x n e
Nω
−−
=
= ∑window data x(n) located in Kth
segment
MATLABHs = spectrum.welch('rectangular', segmentLength, overlap %); define Welch spectrum objectpsd(Hs,xn,'Fs',fs,'NFFT',512); plot
![Page 34: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/34.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 34
Note: what do we gain with the Welch’s method?Reduction in spectral leakage that takes place thru
the sidelobes of the data window
[Hayes]
![Page 35: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/35.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 35
Performance comparison
variability resolution Figure of merit
Periodogram 1 0.89 (2π/N) 0.89 (2π/N)
Bartlett 1/K 0.89 K(2π/N) 0.89 (2π/N)
Welch (50% overlap, triang. window)
9/8K 1.28 (2π/L) 0.72 (2π/N)
BT 2M/2N 0.64 (2π/M) 0.43 (2π/N)
[Table 8.7, Hayes]
{ }{ }2
Definitions:
var ( )variability ( )
( )
figure of merit variability resoluti
normalized variance
should be as small on
.resolution mainlobe width a
as possibt its 1/2
le
jx
jx
P e
E P e
ω
ω
×⇒
power (6dB) down level
K: number of data segmentsN: overall data lengthL: data section lengthM: BT window length
All schemes limited by data length
![Page 36: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/36.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 36
6. Minimum Variance (MV) Spectrum Estimate – Capon PSD
PSD estimated by a filterbank where each filter of length P<=N (data length) adapts itself to data characteristics, i.e.,
-
has center frequency fi (spread between 0 and fs
)-
has bandwidth Δ ( P filters spread over [0,fs
] Δ∼1/fs )-
depends on Rx-
designed so components at fi are passed without distortionand rejects maximum amount of out-of-band power
( ) 1
( 1)
ˆ ,
[1, ,..., ]
jMV H
x
j j P T
PP ee R e
e e e
ω
ω ω
−
−
=
=
[Manolakis, p.474]
![Page 37: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/37.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 37
( ) ( 1)1
ˆ , [1, ,..., ]j j j P TMV H
x
PP e e e ee R e
ω ω ω−−
= =
MATLAB implementation
1 1 1
1
Note:
( )
= ( ) ( )
H H HH Hx
H H H
e R e e U U e e U U e
e U e U
− − −
−
= Λ = Λ
Λ
[ ]
( 1)1
1
[1, ,..., ]
= FT( ), , FT( )
H j j PP
P
e U e e u u
u u
ω ω− − −
⎡ ⎤⎢ ⎥= ⎢ ⎥⎢ ⎥⎣ ⎦
![Page 38: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/38.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 38
[ ][ ]
1 1
11
1
2 211 P
P1 2
kk=1
( ) ( )
FT( ), , FT( )
FT( ), , FT( )
= (1/ )|FT( ) | +(1/ )|FT( ) |
= (1/ )|FT( ) |
H H H Hx
P
HP
P
Hkx
e R e e U e U
u u
u u
u u
e R e u
λ λ
λ
− −
−
−
= Λ
= Λ
×
⎡ ⎤+⎣ ⎦
⇒ ∑
( ) P2
kk=1
ˆ(1/ )|FT( ) |
jMV
k
PP eu
ω
λ=
∑
![Page 39: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/39.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 39
Application:2 (0.1) 2 (0.12( ) 10( ) ( ), ( ) ~ (0,1)j n j nx n e e w n w n Nπ π= + +
[Manolakis, ex. 9.5.1]
Filter order M=PData length N=500100 averaged trials
MV: solid lineBartlett method: small dashed lineAll-pole: large dashed line
0.02Wind. Length ~ 50
fΔ =⇒
![Page 40: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/40.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 40
MATLAB Implementation
R=covar(x,P);[v,d]=eig®;UI=diag(inv(d)+eps);VI=abs(fft(v,nfft)).^2;Px=10log10(P)-10log10(VI*UI);
In practice, -
pick P <N
-
zeropad
FFT to insure accurate
measurements
![Page 41: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/41.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 41
7. MultiTaper Method (MTM) Spectrum Estimate (Thompson)
•
Periodogram can be viewed as obtained by using a filterbank structure, (using rectangular windows).
•Multitaper
method (MTM) can be viewed the same way, with different filters, i.e., different windows. These optimal FIR filters are derived from a set of sequences known as discrete prolate spheroidal sequences.
•A set of independent estimates of the power spectrum is computed, by pre-
multiplying the data by orthogonal tapered windows designed to minimize spectral leakage.
[Mathworks, statistical signal processing, spectral analysis, non parametric methods]
[Victorin]
![Page 42: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/42.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 42
7. MultiTaper Method (MTM) cont’•
PSD variance is reduced by averaging over different tapered windows using the full data. Since the data length is not shortened, the overall PSD bias is smaller than that obtained when splitting data in segments.
•
MTM method provides a time-bandwidth parameter, NW, with which to balance the variance and resolution. NW is directly related to the number of tapers used to compute the spectrum. There are always 2*NW-1 tapers used to form the estimate.
• As NW increases,-
there are more estimates of the power spectrum, and the variance of the estimate decreases, -
each estimate exhibits more spectral leakage (i.e., wider peaks) and the overall spectral estimate is more biased.
•
For each data set, there is usually a value for NW that allows an optimal trade-off between bias and variance.
[Mathworks, statistical signal processing, spectral analysis, non parametric methods]
![Page 43: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/43.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 43
fs
= 1000Hz; N=1000; 2 sines, Amplitude = [1 2]; Sinusoid frequencies f = [150;140]; Hs1 = spectrum.mtm(4,'adapt'); psd(Hs1,xn,'Fs',fs,'NFFT',1024)
Periodogram
MTM, NW=4 MTM, NW=3/2
![Page 44: II. Nonparametric Spectrum Estimation for Stationary ...faculty.nps.edu/fargues/teaching/ec4440/SpringFY09/ec4440-II-SpFY... · Nonparametric Spectrum Estimation. for Stationary Random](https://reader030.fdocuments.us/reader030/viewer/2022013120/5b88b4867f8b9a5b688bffff/html5/thumbnails/44.jpg)
04/01/09 EC4440.SpFY09/MPF -Section II 44
References:[Manolakis][Hayes] Statistical digital signal processing and modeling, M. M. Hayes, 1996, Wiley.[Kay] Modern spectral estimation, S. M. Kay, 1988, Prentice Hall.[Victorin] A. Victorin, Multi-Taper Method for Spectral Analysis and Signal Reconstruction of Solar Wind Data, MS Plasma Physics, Sept. 2007, Royal Institute of Technology, Sweeden, http://www.ee.kth.se/php/modules/publications/reports/2007/TRITA-
EE_2007_054.pdf