Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem...
-
Upload
damian-cunningham -
Category
Documents
-
view
232 -
download
0
Transcript of Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem...
![Page 1: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/1.jpg)
Multiframe Image Restoration
![Page 2: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/2.jpg)
Outline
• Introduction
• Mathematical Models
• The restoration Problem
• Nuisance Parameters and Blind Restoration
• Applications
![Page 3: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/3.jpg)
Introduction
• Multiframe image restoration is concerned with the improvement of imagery acquired in the presence of varying degradations.
• In most situations digital data are acquired, and the restoration processing is carried out by a generator special-purpose digital computer.
![Page 4: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/4.jpg)
The general idea of restoration processing
![Page 5: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/5.jpg)
Google Image Search -- monkey
![Page 6: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/6.jpg)
![Page 7: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/7.jpg)
Image Blur and Sampling
• System and environmental blur
• detector sampling
![Page 8: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/8.jpg)
System and Environmental Blur
• f is blurred by the imaging system, and the observable signal is
• the continuous-domain intensity is formed through a convolution relationship with the image intensity:
![Page 9: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/9.jpg)
System and Environmental Blur
• The point-spread function for diffraction is modeled by the space invariant function:
• the inner product operation
![Page 10: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/10.jpg)
System and Environmental Blur
• Imaging systems often suffer from various types of optical aberrations -imperfections in the figure of the system’s focusing element (usually a mirror or lens).
• The point-spread function takes the form:
![Page 11: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/11.jpg)
System and Environmental Blur
• e(u) is the aberration function
• An out-of-focus blur induces a quadratic aberration function:
• where r is the distance to the scene, d is the focal setting, and f is the focal length.
![Page 12: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/12.jpg)
System and Environmental Blur
• Wave propagation through an inhomogeneous medium such as the Earth’s atmosphere can induce additional distortions. These distortions are due to temperature-induced variations in the atmosphere’s refractive index, and they are frequently modeled in a manner similar to that used for system aberrations:
![Page 13: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/13.jpg)
Sampling
• The detection of imagery with discrete detector arrays results in the measurement of the (time-varying) sampled intensity:
![Page 14: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/14.jpg)
Sampling
• A sequence of image frames
is available for detection
•Each frame is recorded at the time t = t k , and the blur parameter takes the value 8k = 8, during the frame so that we write
![Page 15: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/15.jpg)
Nosie Models
• Electromagnetic waves such as light interact with matter in a fundamentally random way
• Quantum electrodynamics (QED) is the most sophisticated theory available for describing the detection of electromagnetic radiation.
• Electromagnetic energy is transported according to the classical theory of wave propagation, and the field energy is quantized only during the detection process
![Page 16: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/16.jpg)
Object Category Recognition
• the expected photocount for the nth detector during the k-th frame is:
• Read-out noise
![Page 17: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/17.jpg)
The Restoration Problem• The intensity function
![Page 18: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/18.jpg)
Restoration as an Optimization Problem
An optimization problem
![Page 19: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/19.jpg)
Methods
• Maximum-Likelihood Estimation
Gaussian Noise
Poisson Noise
![Page 20: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/20.jpg)
Methods
• Sieve-Constrained Maximum-Likelihood Estimation
![Page 21: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/21.jpg)
Methods
• Penalized Maximum-Likelihood Estimation
![Page 22: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/22.jpg)
Methods
• Maximum a Posteriori Estimation
![Page 23: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/23.jpg)
Methods
• Regularized Least-Squares Estimation
![Page 24: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/24.jpg)
Methods
• Minimum I-Divergence Estimation
![Page 25: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/25.jpg)
Linear Methods
• Linear methods for solving multiframe restoration problems are usually derived as solutions to the regularized least-squares problem:
![Page 26: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/26.jpg)
Linear Methods
• Linear methods for solving multiframe restoration problems are usually derived as solutions to the regularized least-squares problem:
![Page 27: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/27.jpg)
Linear Methods
• C is called the regularizing operator
![Page 28: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/28.jpg)
Linear Methods
• In matrix-vector notation, the regularized least-squares optimization problem can be reposed as
with the minimun-norm solution satisfying:
or
![Page 29: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/29.jpg)
Nonlinear (Iterative) Methods
• General optimization problem:
![Page 30: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/30.jpg)
Applications
• Fine-Resolution Imaging from Undersampled Image Sequences
• Ground-Based Imaging through Atmospheric Turbulence
• Ground-Based Solar Imaging I with Phase Diversity
![Page 31: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/31.jpg)
Applications
• Fine-Resolution Imaging from Undersampled Image Sequences
![Page 32: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/32.jpg)
Applications
• Ground-Based Imaging through Atmospheric Turbulence
![Page 33: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/33.jpg)
Applications
• Ground-Based Solar Imaging I with Phase Diversity
![Page 34: Multiframe Image Restoration. Outline Introduction Mathematical Models The restoration Problem Nuisance Parameters and Blind Restoration Applications.](https://reader034.fdocuments.us/reader034/viewer/2022051018/56649e245503460f94b1233b/html5/thumbnails/34.jpg)