Multilevel approaches for the total least squares method in deblurring problems
description
Transcript of Multilevel approaches for the total least squares method in deblurring problems
![Page 1: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/1.jpg)
Multilevel approaches for the total least squares method in deblurring problems
Malena Español, Tufts UniversityMisha Kilmer, Tufts University
Dianne O’Leary, University of Maryland, College Park
![Page 2: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/2.jpg)
ICIAM 2007 - Zurich, Switzerland
2
Outline Problem Multilevel Method Algorithm Numerical Example Conclusion and Future Work
![Page 3: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/3.jpg)
ICIAM 2007 - Zurich, Switzerland
3
Problem
noiseGaussian additiveunknown contain and
matrix dconditione-ill large, a is
where
,
system theand ,given , Find
bA
RA
bAx
bAx
nm
![Page 4: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/4.jpg)
ICIAM 2007 - Zurich, Switzerland
4
Total Least-Squares Method
rbxEALxrE
rbxEArE
bAx
p
p
p
xE,r
xE,r
)( s.t. min
isn formulatio TLS dRegularizeA
)( s.t. min
solve we, system thesolve To
2
2
2
F,
2
2
2
F,
Regularization by Truncated TLS by Fierro, Golub, Hansen and O’Leary (1997)
![Page 5: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/5.jpg)
ICIAM 2007 - Zurich, Switzerland
5
Classical Two-Level Method
cii
ici
iiii
iTiii
iii
Tiiii
iii
iiii
iii
xxx
rxA
xAbr
ecPxx
reA
PAPA
rPr
xAbr
bxA
Solve""
Solve""
Solve""
1
111
1
1
Pre-Smoothing
Post-Smoothing
Coarse-Grid Correction
Restriction
Prolongation
![Page 6: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/6.jpg)
ICIAM 2007 - Zurich, Switzerland
6
Classical Multilevel Method
cii
ici
iiii
iTiii
iii
Tiiiiiii
iiii
iii
iii
xxx
rxA
xAbr
xPxx
),bV(Ax
PAPArPr
xAbr
bxA
bxA
),bV(Ax
Solve
,
Solve
Else
Solve
gridcoarsest If
function
1
111
11
000
![Page 7: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/7.jpg)
ICIAM 2007 - Zurich, Switzerland
7
Two-level TLS Method
00 , xE
c
c
TT
xxxEEE
rrxEA
ePxxPEPEE
11
1
00101
,~~
~~)~~
(
,~
rreEA ~)~~
( 00
“Post-Smoothing”
Pre-Smoothing
![Page 8: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/8.jpg)
ICIAM 2007 - Zurich, Switzerland
8
Restriction and Prolongation Operators
11000000
00110000
00001100
00000011
11000000
00110000
00001100
00000011
2
2W
Haar wavelet transform V
W1V1
![Page 9: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/9.jpg)
ICIAM 2007 - Zurich, Switzerland
9
Changing basis
.ˆ and ˆ ,ˆ ,ˆ
where
ˆˆˆ)ˆˆ(
have webasis of change aBy
)(
WrrWbbWEWEWAWA
rbxEA
rbxEA
TT
Optical Tomography: Zhu, Wang and Zhang (1998)
![Page 10: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/10.jpg)
ICIAM 2007 - Zurich, Switzerland
10
Properties
A
43
21
ˆˆ
ˆˆˆ
AA
AAA
.ˆin are ˆ of entrieslargest The 3)
.ˆˆ and, symmetric are ˆ ,ˆ then symmetric, is If 2)
Toeplitz. are ˆ and ˆ,ˆ,ˆ then Toeplitz, is If 1)
1
2341
4321
AA
AAAAA
AAAAAT
![Page 11: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/11.jpg)
ICIAM 2007 - Zurich, Switzerland
11
Bandwidth reduction
![Page 12: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/12.jpg)
ICIAM 2007 - Zurich, Switzerland
12
p
p
p
FExxLbxEAE
xEArbxEA
r
r
b
b
x
x
EE
EE
AA
AA
rbxEA
1
2
21111
2
1ˆ,ˆ
22211111
2
1
2
1
2
1
43
21
43
21
ˆˆˆ)ˆˆ(ˆmin
ˆ)ˆˆ(ˆˆˆ)ˆˆ(
ˆ
ˆˆ
ˆ
ˆ
ˆˆˆ
ˆˆ
ˆˆ
ˆˆ
ˆˆˆ)ˆˆ(
11
Pre-Smoothing
![Page 13: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/13.jpg)
ICIAM 2007 - Zurich, Switzerland
13
2
11
3
11
2
1132
4
2
4
2
ˆ
ˆˆ
ˆ
ˆˆ
ˆ
ˆˆˆˆ
ˆ
ˆ
ˆ
ˆ
r
rx
A
EA
b
bxEx
E
E
A
A
Post-Smoothing
p
p
Tp
FFFEEEx x
xLWxEx
E
E
A
AEEE
2
1
2
2
132
4
2
4
22
3
2
4
2
2ˆ,ˆ,ˆ,ˆ ˆ
ˆˆˆˆ
ˆ
ˆ
ˆ
ˆˆˆˆmin
4322
![Page 14: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/14.jpg)
ICIAM 2007 - Zurich, Switzerland
14
Two-Level Method
bA,
p
p
Tp
FFFEEEx x
xLWrxEx
E
E
A
AEEE
2
1
2
2
132
4
2
4
22
3
2
4
2
2ˆ,ˆ,ˆ,ˆ ˆ
ˆˆˆˆˆ
ˆ
ˆ
ˆ
ˆˆˆˆmin
4322
p
p
p
FExxLbxEAE 1
2
21111
2
1ˆ,ˆˆˆˆ)ˆˆ(ˆmin
11
V
V1 W1
xEAbr
VEVExVx TT
)(
ˆ,ˆ 11111
WEE
EEWE
xWxVx
T
TT
43
21
2111
ˆˆ
ˆˆ
ˆˆ
![Page 15: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/15.jpg)
ICIAM 2007 - Zurich, Switzerland
15
Multilevel Method
V
V1
V2
V3 W3
W2
W1
![Page 16: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/16.jpg)
ICIAM 2007 - Zurich, Switzerland
16
Numerical Example
01.1 Operator, DerivativeFirst
)01.0,0( with )~
(
solution edgy :
)1.0,0(~
h matrix wit Toeplitz symmetric, :~
matrix symmetric Toeplitz, Gaussian, :
2
2
pL
bNeexEAb
x
ANEE
A
true
true
![Page 17: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/17.jpg)
ICIAM 2007 - Zurich, Switzerland
17
Numerical Example
truex b
![Page 18: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/18.jpg)
ICIAM 2007 - Zurich, Switzerland
18
Numerical Example
truex
recx
![Page 19: Multilevel approaches for the total least squares method in deblurring problems](https://reader035.fdocuments.us/reader035/viewer/2022062518/568142bd550346895daf04d2/html5/thumbnails/19.jpg)
ICIAM 2007 - Zurich, Switzerland
19
Conclusions and Future work
General Cases – Non Structured Matrices
Extension to 2D, 3D Parameter Selection Additional Constraint on E