Use of Kalman filters in time and frequency analysis John Davis 1st May 2011
description
Transcript of Use of Kalman filters in time and frequency analysis John Davis 1st May 2011
![Page 1: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/1.jpg)
Use of Kalman filters in time and frequency analysis
John Davis1st May 2011
![Page 2: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/2.jpg)
Overview of Talk
Simple example of Kalman filter
Discuss components and operation of filter
Models of clock and time transfer noise and deterministic properties
Examples of use of Kalman filter in time and frequency
![Page 3: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/3.jpg)
Predictors, Filters and Smoothing Algorithms
Predictor: predicts parameter values ahead of current measurements
Filter: estimates parameter values using current and previous measurements
Smoothing Algorithm: estimates parameter values using future, current and previous measurements
![Page 4: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/4.jpg)
What is a Kalman Filter ?
A Kalman filter is an optimal recursive data processing algorithm
The Kalman filter incorporates all information that can be provided to it. It processes all available measurements, regardless of their precision, to estimate the current value of the variables of interest
Computationally efficient due to its recursive structure
Assumes that variables being estimated are time dependent
Linear Algebra application
![Page 5: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/5.jpg)
Simple Example
-1.0E-08
-5.0E-09
0.0E+00
5.0E-09
1.0E-08
1.5E-08
0 2 4 6 8 10 12 14 16 18 20
Date
Off
set
Truth Measurement
![Page 6: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/6.jpg)
Simple Example (Including Estimates)
-1.0E-08
-5.0E-09
0.0E+00
5.0E-09
1.0E-08
1.5E-08
0 2 4 6 8 10 12 14 16 18 20
Truth Measurement Filter Estimate
![Page 7: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/7.jpg)
Estimation Errors and Uncertainty
-6.0E-09
-4.0E-09
-2.0E-09
0.0E+00
2.0E-09
4.0E-09
6.0E-09
0 2 4 6 8 10 12 14 16 18 20
Date
Err
or
Error Uncertainty (lower) Uncertainty (upper)
![Page 8: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/8.jpg)
Operation of Kalman Filter
Provides an estimate of the current parameters using current measurements and previous parameter estimates
Should provide a close to optimal estimate if the models used in the filter match the physical situation
World is full of badly designed Kalman filters
![Page 9: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/9.jpg)
What are the applications in time and frequency?
Analysis of time transfer / clock measurements where measurement noise is significant
Clock and time scale predictors
Clock ensemble algorithms
Estimating noise processes
Clock and UTC steering algorithms
GNSS applications
![Page 10: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/10.jpg)
Starting point for iteration 11 of filter
-2.0E-09
0.0E+00
2.0E-09
4.0E-09
6.0E-09
8.0E-09
1.0E-08
1.2E-08
1.4E-08
0 2 4 6 8 10 12 14 16 18 20
Date
Offs
et
Measurement Filter Estimate
![Page 11: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/11.jpg)
Five steps in the operation of a Kalman filter
(1) State Vector propagation
(2) Parameter Covariance Matrix propagation
(3) Compute Kalman Gain
(4) State Vector update
(5) Parameter Covariance Matrix update
![Page 12: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/12.jpg)
Components of the Kalman Filter (1)
State vector x Contains required parameters. These parameters
usually contain deterministic and stochastic components.
Normally include: time offset, normalised frequency offset, and linear frequency drift between two clocks or timescales.
State vector components may also include: Markov processes where we have memory within noise processes and also components of periodic instabilities
![Page 13: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/13.jpg)
Components of the Kalman Filter (2)
State Propagation Matrix () Matrix used to extrapolate the deterministic
characteristics of the state vector from time t to t+
![Page 14: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/14.jpg)
Steps in the operation of the Kalman Filter Step 1: State vector propagation from iteration n-1 to n
Estimate of the state vector at iteration n not including measurement n.
State propagation matrix calculated for time spacing
Estimate of the state vector at iteration n-1 including measurement n-1.
)(ˆ)()(ˆ 1 nn txtx
)(ˆ ntx
)(
)(ˆ 1
ntx
![Page 15: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/15.jpg)
Step 1: State Vector Extrapolation
-2.0E-09
0.0E+00
2.0E-09
4.0E-09
6.0E-09
8.0E-09
1.0E-08
1.2E-08
1.4E-08
0 2 4 6 8 10 12 14 16 18 20
Date
Offs
et
Measurement Filter Estimate State Vector Extrapolation
![Page 16: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/16.jpg)
Components of the Kalman Filter (3)
Parameter Covariance Matrix P Contains estimates of the uncertainty and correlation
between uncertainties of state vector components. Based on information supplied to the Kalman filter. Not obtained from measurements.
Process Covariance Matrix Q() Matrix describing instabilities of components of the
state vector, e.g. clock noise, time transfer noise moving from time t to t+
Noise parameters Parameters used to determine the elements of the
process covariance matrix, describe individual noise processes.
![Page 17: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/17.jpg)
Steps in the operation of the Kalman Filter
Step 2: Parameter covariance matrix propagation from iteration n-1 to n
Parameter covariance matrix, at iteration n-1 including measurement n-1
State propagation matrix and transpose calculated for time spacing
Parameter covariance matrix, at iteration n not including measurement n
Process covariance matrix
)()()()()( 1 nT
nn tQtPtP
)( )(T
)( ntP
)( ntQ
![Page 18: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/18.jpg)
Uncertainty Extrapolation
-6.0E-09
-4.0E-09
-2.0E-09
0.0E+00
2.0E-09
4.0E-09
6.0E-09
0 2 4 6 8 10 12 14 16 18 20
Date
Err
or /
Unc
erta
inty
Error Uncertainty (lower)
Uncertainty (upper) Uncertainty Extrapolation (lower)
Uncertainty Extrapolation (upper)
![Page 19: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/19.jpg)
Components of the Kalman Filter (4)
Design Matrix H Matrix that relates the measurement vector and the
state vector using y =H x
Measurement Covariance Matrix R Describes measurement noise, white but individual
measurements may be correlated. May be removed.
Kalman Gain K Determines the weighting of current measurements and
estimates from previous iteration. Computed by filter.
![Page 20: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/20.jpg)
Steps in the operation of the Kalman Filter
Step 3 :Kalman gain computation
Parameter covariance matrix, at iteration n not including measurement n
Design Matrix and Transpose
Kalman Gain
Measurement covariance matrix
1)()()()(
nT
nT
nn tRHtPHHtPtK
)( ntP
)( ntR)( ntK
H TH
![Page 21: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/21.jpg)
Components of the Kalman Filter (5)
Measurement Vector y Vector containing measurements input during a
single iteration of the filter
Identity Matrix I
![Page 22: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/22.jpg)
Steps in the operation of the Kalman Filter
)(ˆ)()()(ˆ)(ˆ nnnnn txHtytKtxtx
Step 4 :State vector update
Estimate of the state vector at iteration n including and not including measurement n respectively. Kalman Gain Measurement Vector Design Matrix
)( ntK
)(ˆ ntx )(ˆ ntx
)( ntyH
![Page 23: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/23.jpg)
Step 4 :State Vector Update
-2.0E-09
0.0E+00
2.0E-09
4.0E-09
6.0E-09
8.0E-09
1.0E-08
1.2E-08
1.4E-08
0 2 4 6 8 10 12 14 16 18 20
Date
Off
set
Measurement Filter Estimate State Vector Extrapolation State Vector Update
![Page 24: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/24.jpg)
Steps in the operation of the Kalman Filter
Step 5 :Parameter Covariance Matrix update
Kalman Gain Design Matrix
Parameter Covariance Matrix, at iteration n, including and not including measurement n respectively
Identity Matrix
)()()( nnn tPHtKItP
)( ntKH
)()( nn tPtP
I
I
![Page 25: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/25.jpg)
Steps in the operation of the Kalman FilterIf Kalman gain is deliberately set sub-optimal, then use
Kalman Gain Design Matrix
Parameter Covariance Matrix, at iteration n, including and not including measurement n respectively
Identity Matrix
Tnnnn HtKItPHtKItP )()()()(
)( ntK
)()( nn tPtP
H
I
![Page 26: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/26.jpg)
Step 5: Uncertainty Update
-6.0E-09
-4.0E-09
-2.0E-09
0.0E+00
2.0E-09
4.0E-09
6.0E-09
0 2 4 6 8 10 12 14 16 18 20
Date
Err
or /
Unc
erta
inty
Error Uncertainty (lower) Uncertainty (upper)
Uncertainty Extrapolation (lower) Uncertainty Extrapolation (upper) Uncertainty Update (lower)
Uncertainty update (upper)
![Page 27: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/27.jpg)
Constructing a Kalman Filter: Lots to think about!
Choice of State Vector components Choice of Noise Parameters Choice of measurements Description of measurement noise Choice of Design Matrix Choice of State Propagation Matrix Initial set up conditions Dealing with missing data Testing out the filter Computational methods
![Page 28: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/28.jpg)
Initialising the Kalman Filter Set the initial parameters to physically realistic values
If you have no information set diagonal values of Parameter Covariance Matrix high, filter will then give a high weight to the first measurement.
Set Parameters with known variances e.g. Markov components of Parameter Covariance Matrices to their steady state values.
Set Markov State Vector components and periodic elements to zero.
Elements of H, (), Q(), R are pre-determined
![Page 29: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/29.jpg)
Simulating Noise and Deterministic Processes
Use the same construction of state vector components x, state propagation matrix (), parameter covariance matrix P, process covariance matrix Q(), design matrix H and measurement covariance matrix R.
Simulate all required data sets
Simulate “true” values of state vector for error analysis
May determine ADEV, HDEV, MDEV and TDEV statistics from parameter covariance matrix
![Page 30: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/30.jpg)
Simulating Noise and Deterministic Processes
Where
= Process Covariance Matrix
= State Vector at iteration n and n-1 respectively
= State Propagation Matrix calculated for time spacing
Vector of normal distribution noise of unity magnitude
)()()()()( 1 nnQnn tetLtxtx )()( n
T
QnQtLtLQ
Q
)()( 1nn txtx
)(
)( nte
![Page 31: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/31.jpg)
Simulating Noise and Deterministic Processes
)()()()()( 1 nT
nn tQtPtP
Process Covariance Matrix at iterations n and n-1 respectively
State Propagation Matrix and transpose computed at time spacing .
Process Covariance Matrix calculated at time spacing
)()( 1nn tPtP
)()( T
)( ntQ
![Page 32: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/32.jpg)
Simulating Noise and Deterministic Processes
where
Measurement Vector
Design Matrix
Measurement Covariance Matrix
Vector of normal distribution noise of unity magnitude
)()()()( nnRnn tetLtxHty
)()( nTRnR tLtLR
)( ntyHR
)( nte
![Page 33: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/33.jpg)
ADEV, HDEV, and MDEV determined from Parameter Covariance Matrix and simulation
z
102
103
104
105
106
107
10-15
10-14
10-13
10-12
tau
Sig
ma
ADEV simulationHDEV simulationMDEV simulationADEV theoryHDEV theoryMDEV theory
![Page 34: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/34.jpg)
Simulating Noise and Deterministic Processes
Test Kalman filter with a data set with same stochastic and deterministic properties as is expected by the Kalman filter.
Very near optimal performance of Kalman filter under these conditions.
![Page 35: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/35.jpg)
Deterministic Properties
Linear frequency drift
Use three state vector components, time offset, normalised frequency offset and linear frequency drift
100
10
21 2
![Page 36: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/36.jpg)
Markov Noise Process
White Noise Random Walk Noise Markov Noise Flicker noise, combination of Markov processes with
continuous range of relaxation parameters k Markov noise processes and flicker noise have
memory Kalman filters tend to work very well with Markov
noise processes May only construct an approximation to flicker noise
in a Kalman filter
exn exx nn 1
ekxx nn 1 10 k
![Page 37: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/37.jpg)
Markov Noise Process
6 6.5 7 7.5 8-6
-4
-2
0
2
4
6x 10
-6
MJD
Tim
e O
ffse
t
![Page 38: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/38.jpg)
Describing Measurement Noise
Kalman filter assumes measurement noise introduced via matrix R is white
Time transfer noise e.g TWSTFT and GNSS noise is often far from white
Add extra components to state vector to describe non white noise, particularly useful if noise has “memory” e.g. flicker phase noise
NPL has not had any problems in not using a measurement noise matrix R
![Page 39: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/39.jpg)
White Phase Modulation
0 5 10 15 20
-0.5
0
0.5
x 10-10 WPM Noise
MJD
Tim
e O
ffse
t
![Page 40: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/40.jpg)
White Phase Modulation
10 10.2 10.4 10.6 10.8 11
-4
-2
0
2
4
6
8x 10
-11 WPM Noise (sample)
MJD
Tim
e O
ffse
t
![Page 41: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/41.jpg)
White Phase Modulation
102
103
104
105
106
10-17
10-16
10-15
10-14
10-13
10-12
ADEV, HDEV MDEV of WPM
tau
Sig
ma
ADEV MeasurementsHDEV MeasurementsMDEV MeasurementsADEV TheoryHDEV TheoryMDEV Theory
![Page 42: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/42.jpg)
Flicker Phase Modulation
0 5 10 15 20-2.5
-2
-1.5
-1
-0.5
0
0.5
1
1.5
2x 10
-10 Simulated FPM Noise
MJD
Tim
e O
ffse
t
![Page 43: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/43.jpg)
Flicker Phase Modulation
102
103
104
105
106
10-16
10-15
10-14
10-13
10-12
ADEV, HDEV MDEV of FFM
tau
Sig
ma
ADEV MeasurementsHDEV MeasurementsMDEV MeasurementsADEV TheoryHDEV TheoryMDEV Theory
![Page 44: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/44.jpg)
Measurement noise used in Kalman filter
0 5 10 15 20-2
-1
0
1
2x 10
-10Simulated Time Transfer Noise
MJD
Tim
e O
ffse
t
![Page 45: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/45.jpg)
Measurement noise ADEV, MDEV and HDEV
102
103
104
105
106
10-16
10-15
10-14
10-13
10-12ADEV, HDEV MDEV of measurements noise
tau
Sig
ma
ADEV MeasurementsHDEV MeasurementsMDEV MeasurementsADEV TheoryHDEV TheoryMDEV Theory
![Page 46: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/46.jpg)
Clock Noise
White Frequency Modulation and Random Walk Frequency Modulation easy to include as single noise parameters.
Flicker Frequency Modulation may be modelled as linear combination of Integrated Markov Noise Parameters
![Page 47: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/47.jpg)
White Frequency Modulation
0 5 10 15 20-15
-10
-5
0
5x 10
-8 WFM Noise
MJD
Tim
e O
ffse
t
![Page 48: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/48.jpg)
White Frequency Modulation
102
103
104
105
106
10-13
10-12
10-11
ADEV, HDEV MDEV of WFM
tau
Sig
ma
ADEV MeasurementsHDEV MeasurementsMDEV MeasurementsADEV TheoryHDEV TheoryMDEV Theory
![Page 49: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/49.jpg)
Random Walk Frequency Modulation
0 5 10 15 20-9
-8
-7
-6
-5
-4
-3
-2
-1
0x 10
-7 RWFM Noise
MJD
Tim
e O
ffse
t
![Page 50: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/50.jpg)
Random Walk Frequency Modulation
102
103
104
105
106
10-15
10-14
10-13
10-12
ADEV, HDEV MDEV of RWFM
tau
Sig
ma
ADEV MeasurementsHDEV MeasurementsMDEV MeasurementsADEV TheoryHDEV TheoryMDEV Theory
![Page 51: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/51.jpg)
FFM Noise
0 5 10 15 20-7
-6
-5
-4
-3
-2
-1
0
1
2x 10
-9
MJD
Tim
e O
ffse
t
FFM Noise
![Page 52: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/52.jpg)
Flicker Frequency Modulation
102
103
104
105
106
10-15
10-14
ADEV, HDEV MDEV of FFM noise
tau
Sig
ma
ADEV MeasurementsHDEV MeasurementsMDEV MeasurementsADEV TheoryHDEV TheoryMDEV Theory
![Page 53: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/53.jpg)
Periodic Instabilities
Often occur in GNSS Applications Orbit mis-modelling Diurnal effects on Time Transfer hardware Periodicity decays over time Model as combination of Markov noise process and
periodic parameter Two extra state vector component to represent
periodic variations
![Page 54: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/54.jpg)
GPS Time – Individual Clock (Real Data)
0 1 2 3 4 5 6 7
1.619
1.6195
1.62
1.6205
1.621
1.6215
1.622 x 10
-5 Input data space clock prn 9
DayD
Tim
e O
ffset
Input Data
![Page 55: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/55.jpg)
GPS Time – Individual Clock (Simulated Data)
6 7 8 9 10 11 12 13-1.5
-1
-0.5
0
0.5
1x 10
-8Simulated data with similar characteristics
MJD
Tim
e O
ffse
t
GPS CV
![Page 56: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/56.jpg)
ADEV, HDEV, MDEV Real Data
102
103
104
105
106
10-14
10-13
10-12
10-11 ADEV / HDEV / MDEV Prn 9
Tau
AD
EV
/ H
DE
V / M
DE
V
ADEVHDEVMDEV
![Page 57: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/57.jpg)
ADEV, HDEV, MDEV Simulated Data
10 2
10 3
10 4
10 5
10 6 10
-14
10 -13
10 -12
10 -11
ADEV, HDEV MDEV Theory and Measurement
tau
AD
EV
ADEV Measurements HDEV Measurements MDEV Measurements ADEV Theory HDEV Theory MDEV Theory
![Page 58: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/58.jpg)
Kalman Filter Residuals
Residuals Residual Variance (Theory)
In an optimally constructed Kalman Filter the Residuals should be white!
Residual Variance obtained from Parameter Covariance matrix should match that obtained from statistics applied to residuals
)ˆ( xHy THHPV
![Page 59: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/59.jpg)
Kalman Filter Residuals (Simulated Data)
5 5.5 6 6.5 7 7.5 8-1.5
-1
-0.5
0
0.5
1x 10
-9Kalman Filter Residuals (simulated data)
MJD
Tim
e O
ffse
t
![Page 60: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/60.jpg)
Kalman Filter Residuals (Real Data)
2 2.5 3 3.5 4 4.5 5-1.5
-1
-0.5
0
0.5
1
1.5x 10
-9Kalman Filter Residuals (real data)
MJD
Tim
e O
ffse
t
![Page 61: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/61.jpg)
Computational Issues
Too many state vector components result in a significant computational overhead
Observability of state vector components
Direct computation vs factorisation
Direct use of Kalman filter equations usually numerically stable and easy to follow.
Issue of RRFM scaling if a linear frequency drift state vector component is used
![Page 62: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/62.jpg)
Clock Predictor Application
May provide a close to optimal prediction in an environment that contains complex noise and deterministic characteristics
If noise processes are simple e.g. WFM and no linear frequency drift then very simple predictors will work very well.
![Page 63: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/63.jpg)
Clock Predictor Equations (Prediction)
)(ˆ)()(ˆ 1
nn txtx
• Repeated application of above equation.
•Apply above equations with calculated at the required prediction length
)(
![Page 64: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/64.jpg)
Clock Predictor Equations (PED)
Repeated application of above equation.
Apply above equations with calculated at the required prediction length
)()()()()( 1 nT
nn tQtPtP
)(
![Page 65: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/65.jpg)
Example: Predicting clock offset in presence of periodic instabilities
ADEV = PED/Tau
Above equation exact in case of WFM and RWFM noise processes, and a reasonable approximation in other situations
![Page 66: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/66.jpg)
ADEV, HDEV, MDEV Simulated Data
10 2
10 3
10 4
10 5
10 6 10
-14
10 -13
10 -12
10 -11
ADEV, HDEV MDEV Theory and Measurement
tau
AD
EV
ADEV Measurements HDEV Measurements MDEV Measurements ADEV Theory HDEV Theory MDEV Theory
![Page 67: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/67.jpg)
(PED /Tau) Prediction of Space Clocks (simulated data)
2 2.5 3 3.5 4 4.5 5 5.5-13.4
-13.2
-13
-12.8
-12.6
-12.4
-12.2
-12
-11.8
-11.6
-11.4Mean PED / tau
log Tau
log
PE
D/ ta
u
Prediction Deviation Clock and NoisePrediction Error
![Page 68: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/68.jpg)
ADEV, HDEV, MDEV Real Data
102
103
104
105
106
10-14
10-13
10-12
10-11 ADEV / HDEV / MDEV Prn 9
Tau
AD
EV
/ H
DE
V / M
DE
V
ADEVHDEVMDEV
![Page 69: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/69.jpg)
(PED /Tau) Prediction of Space Clocks (real data)
Add plot
2 2.5 3 3.5 4 4.5 5 5.5-13.4
-13.2
-13
-12.8
-12.6
-12.4
-12.2
-12
-11.8
-11.6
-11.4Mean PED / tau
log Tau
log
PE
D/ ta
u
Prediction Deviation Clock and NoisePrediction Error
![Page 70: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/70.jpg)
Kalman Filter Ensemble Algorithm
Most famous time and frequency application of the Kalman filter
Initially assume measurements are noiseless. Measurements (Cj – C1), difference between pairs of
individual clocks Estimates (T – Ci), where T is a “perfect” clock.
Parameters being estimated cannot be constructed from the measurements:
Badly designed Kalman filter. Problem solved using covariance x reduction
![Page 71: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/71.jpg)
Stability of Composite Timescales
![Page 72: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/72.jpg)
Advantage of Kalman Filter based Ensemble Algorithm
Potential of close to optimal performance over a range of averaging times
Clasical Ensemble Algorithms provide a very close to optimal performance at a single averaging time
![Page 73: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/73.jpg)
Combining TWSTFT and GPS Common-View measurements
Time transfer noise modelled using Markov Noise processes
Calibration biases modelled using long relaxation time Markov
![Page 74: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/74.jpg)
Real Time Transfer Data Example
5.4405 5.441 5.4415 5.442 5.4425
x 104
2.5
3
3.5
4
4.5
5
5.5
6
6.5x 10
-8 Measurements actually used
MJD
Tim
e-O
ffse
t (s
)
GPS CV
TWSTFT
![Page 75: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/75.jpg)
Kalman Filter Estimates
5.4405 5.441 5.4415 5.442 5.4425
x 104
3.5
4
4.5
5
5.5x 10
-8 True time-offset and estimates
MJD
Tim
e-O
ffse
t (s
)
Estimated Time-Offset
![Page 76: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/76.jpg)
Kalman Filter Residuals
5.4405 5.441 5.4415 5.442 5.4425
x 104
-12
-10
-8
-6
-4
-2
0
2
4
6
8x 10
-9 Kalman Filter Residuals
MJD
Tim
e-O
ffse
t (s
)
GPS CV
TWSTFT
![Page 77: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/77.jpg)
Summary
Operation of the Kalman filter
Stochastic and deterministic models for time and frequency applications
Real examples of use Kalman Filter
![Page 78: Use of Kalman filters in time and frequency analysis John Davis 1st May 2011](https://reader034.fdocuments.us/reader034/viewer/2022051417/56814871550346895db57c20/html5/thumbnails/78.jpg)
Title of Presentation
Name of SpeakerDate
The National Measurement System is the UK’s national infrastructure of measurement
Laboratories, which deliver world-class measurement science and technology through four
National Measurement Institutes (NMIs): LGC, NPL the National Physical Laboratory, TUV NEL
The former National Engineering Laboratory, and the National Measurement Office (NMO).
The National Measurement System delivers world-class measurement science & technology through these organisations