Approximation Theory
description
Transcript of Approximation Theory
![Page 1: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/1.jpg)
IMIIMI
1
Approximation Theory
Metric:
Complicated Function
SignalImage
Solution to PDE
Simple Function
PolynomialsSplines
Rational Func
![Page 2: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/2.jpg)
IMIIMI
2
1. Linear space of
dimension n.
2. Nonlinear manifold of
dimension n.
3. Highly nonlinear: Highly
redundant dictionary.
Functions g chosen from:
![Page 3: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/3.jpg)
IMIIMI
3
Examples:
(i) -- Alg. poly. of degree .
(ii) -- Trig. poly. of degree .
(iii) Splines -- piecewise poly. of degree r, pieces.
(iv) span ,CONS
0 1
Linear: 1, 2 , . . . , n,. . .
![Page 4: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/4.jpg)
IMIIMI
4
Nonlinear: n dimensional manifold
(i) : Rational function .
(ii) Splines with
(iii) - term approximation
CONS
free knots.
0 1
pieces
IN
![Page 5: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/5.jpg)
IMIIMI
5
Highly Nonlinear
, arbitrary,
Bases B1, B2, . . . Bm, . . .
Bj best n-term
choose best basis choose n-term approximation
![Page 6: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/6.jpg)
IMIIMI
6
Main Question
Characterize
We shall restrict ourselves toapproximation by piecewise constants in what follows.
![Page 7: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/7.jpg)
IMIIMI
7
Linear
Theorem (DeVore-Richards) Fix
Piecewise Constants
0 11/n
.
close to
![Page 8: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/8.jpg)
IMIIMI
8
Theorem (DeVore-Richards)
, ,
for .
![Page 9: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/9.jpg)
IMIIMI
9
Noninear
Theorem (Kahane)
.
Linear Nonlinear
Know (Petrushev)
.
![Page 10: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/10.jpg)
IMIIMI
10
n - term
Haar Basis0 1
1
-1
Dyadic Interval
I0 1
![Page 11: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/11.jpg)
IMIIMI
11
CONS
![Page 12: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/12.jpg)
IMIIMI
12
Theorem (DeVore-Jawerth-Popov)
known.
Simple strategy:
Choose n terms where
largest.
![Page 13: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/13.jpg)
IMIIMI
13
Lin
ear
Nonlin
ear
![Page 14: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/14.jpg)
IMIIMI
14
ApplicationImage Compression
Piecewise constant function
(Haar)
Threshold
Problem: Need to encode positions.
Dominate Bits
Image
![Page 15: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/15.jpg)
IMIIMI
15
Tree Approximation
Cohen-Dahmen-Daubechies-DeVore:
are almost the same requirements.
![Page 16: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/16.jpg)
IMIIMI
16
Generate tree as follows:
1) Threshold:
2) Complete to Tree:
3) Encode the subtree:
1
00 0 0
0
0
0
0 1
1 1
1 1
(Each bit tells whether the child is in the tree.)
![Page 17: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/17.jpg)
IMIIMI
17
• Progressive
• Universal
• Optimal
• Burn In
Features of Tree Encoder
![Page 18: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/18.jpg)
IMIIMI
18
Encoder
P BB B B B BP P0 00 1 10 11 2 20 21 22 . . .
Pk = Position Bits of
B { bit bjk = j of , }
![Page 19: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/19.jpg)
IMIIMI
19
Cohen-Dahmen-DeVore
Elliptic Equation
Wavelet transform gives
- positive definite.
- has decay properties.
CDD gives an adaptive algorithm
![Page 20: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/20.jpg)
IMIIMI
20
Theorem If , then
using n computations the adaptive algorithm produces :
Theorem If , then the
adaptive algorithm produces :
![Page 21: Approximation Theory](https://reader033.fdocuments.us/reader033/viewer/2022061322/568140a1550346895dac5970/html5/thumbnails/21.jpg)
IMIIMI
21
Error:
“Error Indicators”:
Refinement: Let be the smallest
set of indices such that
residual
Define new set
.