B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,
description
Transcript of B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,
![Page 1: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/1.jpg)
Meta-optimization of the Extended Kalman filter’s parameters for improved feature extraction on hyper-temporal images.
B.P. Salmon1,2* , W. Kleynhans1,2, F. van den Bergh2, J.C. Olivier1, W.J. Marais3 and K.J. Wessels2
1. Department of Electrical Engineering, University of Pretoria, South Africa2. Remote Sensing Research Unit, Meraka, CSIR, South Africa3. Space Science and Engineering Center, University of Wisconsin-Madison, Wisconsin, USA* Presenting author
![Page 2: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/2.jpg)
Overview
• Problem statement – Reliable surveying of land cover and transformation
• Discuss the importance of time series analysis
• Study area: Gauteng province, South Africa
• Using the EKF as feature extractor from time series data
• Meta-optimization of EKF’s parameters
• Results: Land cover classification
• Conclusions
![Page 3: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/3.jpg)
Problem Statement
Reliable surveying of land cover and transformation
Year Estimated Population Change
2000 8,038,200 -
2001 8,243,719 2.56%
2002 8,499,900 3.11%
2003 8,775,200 3.23%
2004 8,851,455 0.87%
2005 9,002,534 1.71%
2006 9,193,800 2.12%
2007 9,665,841 5.13%
2008 10,450,000 8.11%
2009 10,531,300 0.77%
![Page 4: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/4.jpg)
Time Series Analysis
MODIS Band 1
MODIS Band 2
Band 2 Separation
Band 1 Separation
Band 2 Separation
Band 1 Separation
Band 2 Vegetation
Band 1 Vegetation
Band 2 Settlement
Band 1 Settlement
![Page 5: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/5.jpg)
Objective
Time series can be modulated with a triply modulated cosine function [1].
[1] W. Kleynhans et. al, 'Improving land cover class separation using an extended Kalman filter on MODIS NDVI time-series data', IEEE Geoscience and Remote Sensing Letters, vol. 6, no. 4. April 2010
![Page 6: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/6.jpg)
Objective
Parameters of a triply modulated cosine can be used to distinguish between several different land cover classes.
Parameters derived using a EKF framework has been proven as a feasible solution.
Introduce a meta-optimization approach for setting the parameters of a Extended Kalman filter to rapidly estimate better features for a triply modulated cosine function.
![Page 7: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/7.jpg)
• Time series modelled as a triply modulated cosine function
• Where = Mean
= Amplitude
= Angular frequency
= Spectral band
= Time index
Triply modulated time series
= Seasonal cycle (8/365)
= Phase
= Noise
= Pixel index
![Page 8: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/8.jpg)
• State vector
• Process model
• Observation model
Extended Kalman Filter Framework
Mean Amplitude Phase
![Page 9: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/9.jpg)
Modelling the time series
Unstable parameter
Unstable parameter
Unstable parameter
Mean
AmplitudePhase
![Page 10: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/10.jpg)
• Process model
• Observation model
Tuneable parameters
Observation noise covariance matrix
Process covariance matrix
Initial estimates of state vector
![Page 11: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/11.jpg)
Tuneable parameters
Observation noise covariance matrix
Process covariance matrix
Initial estimates of state vector
Tunable parameters
Where j denotes the epoch number
![Page 12: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/12.jpg)
What do we want?
Mean
Amplitude
Phase
Absolute Error
Tunable parameters
![Page 13: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/13.jpg)
Creating extreme conditions
Absolute Error
Tunable parameters
Set
Capture a probability density function (PDF) for each time increment k using all the pixels and if ideal will be denoted by
![Page 14: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/14.jpg)
Creating extreme conditions
Tunable parameters
Mean
Set
Capture a probability density function (PDF) for each timeIncrement k using all the pixels and if ideal will be denoted by
![Page 15: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/15.jpg)
Creating extreme conditions
Tunable parameters
Set
Capture a probability density function (PDF) for each timeIncrement k using all the pixels and if ideal will be denoted by
Amplitude
![Page 16: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/16.jpg)
Creating extreme conditions
Tunable parameters
Set
Capture a probability density function (PDF) for each timeIncrement k using all the pixels and if ideal will be denoted by
Phase
![Page 17: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/17.jpg)
Creating a metric
• Set an initial (candidate) state as
• Calculated the f-divergent distance as Absolute error Mean
Amplitude
Phase
![Page 18: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/18.jpg)
Define a comparison metric
• Create a vector containing all the f-divergent distances as
• Define a metric for an unbiased Extended Kalman filter
• Optimize the vector using comparison metric
![Page 19: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/19.jpg)
Iterative updates
![Page 20: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/20.jpg)
Results: Standard deviation for MODIS spectral band 1
1142 MODIS pixels = 285.5km2
Mean
Amplitude
Absolute Error
![Page 21: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/21.jpg)
Results: Standard deviation for MODIS spectral band 2
1142 MODIS pixels = 285.5km2
Mean
Amplitude
Absolute Error
![Page 22: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/22.jpg)
Results: Standard deviation for MODIS bands
1142 MODIS pixels = 285.5km2
![Page 23: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/23.jpg)
Results: Classification on labelled data K-means (Band 1, Band 2)
1142 MODIS pixels = 285.5km2
Vegetation Accuracy
Settlement accuracy
![Page 24: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/24.jpg)
Results: Accuracy for MODIS bands
1142 MODIS pixels = 285.5km2
![Page 25: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/25.jpg)
Results: Gauteng province settlements
78704 MODIS pixels = 19676km2
23.16% Settlement
![Page 26: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/26.jpg)
Conclusions
• Temporal property is of high importance in remote sensing
• A meta-optimization for the EKF using a spatio-temporal window was proposed.
• Proper feature analysis can greatly enhance analysis of data.
• Presentation of features to any machine learning algorithm
![Page 27: B.P. Salmon 1,2* , W. Kleynhans 1,2 , F. van den Bergh 2 , J.C. Olivier 1 ,](https://reader035.fdocuments.us/reader035/viewer/2022062500/56815a0c550346895dc758fe/html5/thumbnails/27.jpg)
Questions?
Expansion of irrigationCommercial forestry
Mining Informal settlements
Alien tree removal