Automated Registration of Synthetic Aperture Radar Imagery to LIDAR
description
Transcript of Automated Registration of Synthetic Aperture Radar Imagery to LIDAR
![Page 1: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/1.jpg)
Automated Registration of Synthetic Aperture Radar
Imagery to LIDAR
Mark Pritt, PhDLockheed Martin
Gaithersburg, [email protected]
Kevin LaTouretteLockheed MartinGoodyear, [email protected]
IGARSS 2011, Vancouver, CanadaJuly 24-29, 2011
![Page 2: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/2.jpg)
2
Problem: SAR Image Registration
· Registration of SAR and optical imagery is difficult. Features appear different. Different viewpoints and illumination conditions cause difficulties:
SAR layover does not match optical foreshortening. Shadows do not match.
· Conventional techniques rely on linear features. But these features can be rare and noisy in SAR imagery.
SAR image
MSI image
![Page 3: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/3.jpg)
3
Solution
· Our solution is image registration to a high-resolution digital elevation model (DEM): A DEM post spacing of 1 or 2 meters yields good results. It also works with coarser post spacing.
· Works with terrain data derived from many sources: LIDAR: BuckEye, ALIRT, Commercial Stereo Photogrammetry: Socet Set® DSM SAR: Stereo and Interferometry USGS DEMs
![Page 4: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/4.jpg)
4
· Create a predicted image from the DEM, illumination conditions and sensor model estimate.
· Register the predicted and the actual images.· Refine the sensor model.
Methods
SAR ImagePredicted SAR Image
![Page 5: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/5.jpg)
5
· The same approach works for SAR and optical sensors. Projection into the imaging plane is similar. Layover in SAR images is similar to occlusion in optical images. Radar shadow is similar to optical shadow.
Methods (cont)
SAR Sensor
Image Plane
SceneLayover Shadow SceneOcclusion
Optical Sensor
Image Plane
Shadow
![Page 6: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/6.jpg)
6
Methods (cont)
· To register SAR and optical images, use the DEM as the “bridge”. Generate a predicted “DEM” image for each SAR and optical
image. Register the predicted images to the actual images. This neatly bypasses the problem of direct SAR-optical registration.
SAR Image DEM MSI Image
![Page 7: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/7.jpg)
7
Example 1: SAR-LIDAR Registration
COSMO-SkyMed SAR Image of Mosul, Iraq BuckEye LIDAR DEM
Area: 100 km2
21,000 x 20,000 pixels
Post Spacing: 1 meterAbsolute Accuracy: 1.5 m (CE90)
![Page 8: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/8.jpg)
8
Results
COSMO-SkyMed SAR Image
![Page 9: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/9.jpg)
9
Results (cont)
Predicted SAR Image from DEM and Estimated SAR Camera Model
Flicker with previous slide
![Page 10: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/10.jpg)
10
Results (cont)
Normalized Cross-Correlation Image Between Predicted and Actual Images
Flicker with previous slide
![Page 11: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/11.jpg)
11
Results: Zoom
COSMO-SkyMed SAR ImageNote the
SAR layover and shadow
![Page 12: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/12.jpg)
12
Zoom (cont)
Predicted SAR Image from DEM
Flicker with previous slide
Note the SAR layover and shadow
![Page 13: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/13.jpg)
13
Zoom (cont)
Cross Correlation
Flicker with previous slide
![Page 14: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/14.jpg)
14
Registration Accuracy
NCC Registration Tie Points
After least-squares fit to shift-only registration function with RANSAC outlier removal, 4572 tie points remained.
Best shift:Δx = 16.76mΔy = 4.27m
![Page 15: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/15.jpg)
15
Registration Accuracy (cont)
Error Propagation
Statistic x y
Mean Residual 0 pixels 0 pixels
Sigma Residual 0.948 pixels 0.981 pixels
RMSE 1.364 pixels
Circular ErrorPropagated to DEM 1.48 m (CE90)
Circular ErrorPropagated to Ground 2.1 m (CE90)
This includes the geospatial errors in the DEM and the registration.
CE90 = circular error 90%
![Page 16: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/16.jpg)
16
Results: SAR-MSI RegistrationSAR Image: COSMO-SkyMed, Date: Oct 2008, GSD: 1 m
![Page 17: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/17.jpg)
17
SAR-MSI Registration (cont)MSI Image: IKONOS, Date: Oct 2010, GSD: 2.2 m
Flicker with previous slide
![Page 18: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/18.jpg)
18
SAR-MSI Registration (cont)SAR Image: COSMO-SkyMed, Date: Oct 2008, GSD: 1 m
![Page 19: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/19.jpg)
19
SAR-MSI Registration (cont)MSI Image: IKONOS, Date: Oct 2010, GSD: 2.2 m
Flicker with previous slide
![Page 20: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/20.jpg)
20
SAR-MSI Registration (cont)SAR Image: COSMO-SkyMed, Date: Oct 2008, GSD: 1 m
![Page 21: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/21.jpg)
21
SAR-MSI Registration (cont)MSI Image: IKONOS, Date: Oct 2010, GSD: 2.2 m
Flicker with previous slide
![Page 22: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/22.jpg)
22
Example 2: SAR-MSI-LIDAR Fusion
Waterton, Colorado
IkonosMSI
COSMO- SkyMed
SAR
BuckEyeLIDAR DEM
BuckEye Lidar: March 2003 (4.1 x 5.2 km, 0.75-m post spacing)Ikonos: July 9, 2001 (1-m GSD). COSMO SkyMed SAR: Oct 31, 2008 (0.5-m GSD)
![Page 23: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/23.jpg)
23
Results: EO Image Draped Over DEM
Note alignmentof features
![Page 24: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/24.jpg)
24
Results: SAR Image Draped Over DEM
Note alignmentof features
Flicker with previous slide
![Page 25: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/25.jpg)
25
Results: MSI Image Draped Over DEM
Note alignmentof features
Flicker with previous slide
![Page 26: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/26.jpg)
26
Results: Fly-Through
Click picture above to play movie
![Page 27: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/27.jpg)
27
Conclusion
· We have introduced a new method for registering SAR images with other sensor data: LIDAR, Digital Elevation Models, Optical Images, MSI
· It works by image registration to a high-resolution DEM. It does this by generating a predicted image from the DEM and
sensor model estimate. It then registers the predicted and actual images and refines the
sensor model estimate.· Accuracy: 1-2 m CE90· Our approach also extends to the case where no DEM
is available: DEM can be generated from stereo EO or interferometric SAR.
![Page 28: Automated Registration of Synthetic Aperture Radar Imagery to LIDAR](https://reader035.fdocuments.us/reader035/viewer/2022062222/568165fe550346895dd92e34/html5/thumbnails/28.jpg)
28
Conclusion (cont.)
· For an extension to Video Geo-registration: Pritt, M & LaTourette, K., Stabilization and Georegistration of Aerial Video Over
Mountain Terrain by Means of LIDAR. FR1.T08.4