Computer Vision – Enhancement(Part III)
description
Transcript of Computer Vision – Enhancement(Part III)
![Page 1: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/1.jpg)
Computer Vision – Computer Vision – Enhancement(Part III)Enhancement(Part III)
Hanyang University
Jong-Il Park
![Page 2: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/2.jpg)
Department of Computer Science and Engineering, Hanyang University
dxuxjxfuF )2exp()()(
duuxjuFxf )2exp()()(
dydxvyuxjyxfvuF
))(2exp(),(),(
dvduyvxujvuFyxf
))(2exp(),(),(
The Fourier transformThe Fourier transform
Definition 1-D Fourier transform
2-D Fourier transform
![Page 3: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/3.jpg)
Department of Computer Science and Engineering, Hanyang University
1-D case
n
unujnxuX 5.05.0),2exp()()(
5.0
5.0)2exp()()( dunujuXnx
Fourier seriesFourier series
![Page 4: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/4.jpg)
Department of Computer Science and Engineering, Hanyang University
M-point spectrumM-point spectrum
![Page 5: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/5.jpg)
Department of Computer Science and Engineering, Hanyang University
22D Fourier seriesD Fourier series
2-D case
is periodic : period = 1
Sufficient condition for existence of
m n
vunvmujnmxvuX 5.0,5.0),)(2exp(),(),(
5.0
5.0
5.0
5.0 1 ))(2exp(),(),( dudvnvmujvuXnmx
),( vuX
,2,1,0,),,(),( lklvkuXvuX
|))(2exp(),(||),(|
m n
nvmujnmxvuX
m nm n
nmxnvmujnmx |),(||))(2exp(||),(|
),( vuX
![Page 6: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/6.jpg)
Department of Computer Science and Engineering, Hanyang University
original 256x256 lena
Centered andnormalized spectrum(log-scale)
Eg. 2D Fourier transformEg. 2D Fourier transform
![Page 7: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/7.jpg)
Department of Computer Science and Engineering, Hanyang University
Filtering in Frequency DomainFiltering in Frequency Domain
![Page 8: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/8.jpg)
Department of Computer Science and Engineering, Hanyang University
Unitary TransformsUnitary Transforms
Unitary Transformation for 1-Dim. Sequence Series representation of
Basis vectors : Energy conservation :
}10),({ Nnnu
1
0
10),(),()(N
n
NknunkakvAuv
)matrixunitary ( where *1 TAA
1
0
** 10),(),()(N
n
NnkvnkanuvAu
TNnnka }10),,({ * *ka
22 |||||||| uvAuv
)|||||)(||)(||||| ( 21
0
2*1
0
22 uuuAuAuv **
N
n
TTTN
k
nukv
![Page 9: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/9.jpg)
Department of Computer Science and Engineering, Hanyang University
Unitary Transformation for 2-D Sequence Definition :
Basis images : Separable Unitary Transforms:
1,0),,(),(),(1
0
1
0,
NlknmanmulkvN
m
N
nlk
1,0),,(),(),(1
0
1
0
*,
NnmnmalkvnmuN
k
N
llk
)},({ *, nma lk
22D Unitary TransformationD Unitary Transformation
)()(),(, nbmanma lklk
Tl
N
m
N
nk nanmumalkv AUAV
)(),()(),(1
0
1
0
**1
0
1
0
* )(),()(),( VAAUT
l
N
k
N
lk nalkvmanmu
![Page 10: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/10.jpg)
Department of Computer Science and Engineering, Hanyang University
NNNN
NnmwwlkvN
nmu
NlkwwnmuN
lkv
T
T
T
TT
N
k
N
l
lnN
kmN
N
m
N
n
lnN
kmN
2
*
*
1
0
1
0
1
0
1
0
log2 DFT D-1 2separable.2
where
and
notation spacevector
since , .1
1,0,),(1
),(
1,0,),(1
),(
is DFTunitary D2
O
FFFF
vuuv
VFFU
FFFUFFFUV
F
FF
2-2-D DFTD DFT
![Page 11: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/11.jpg)
Department of Computer Science and Engineering, Hanyang University
1,0,,
~,~
,~
,~
,~
1,,0
1,0,,,~
1,,0
1,0,,,
~
1,,,,
n theoremconvolutiocircular D2 .4
1,0,,,
real is if symmetry, e3.conjugat
1
*
MnmlkYDFTnmy
lkUlkHlkY
MnmN
Lnmnmunmu
MnmN
Nnmnmhnmh
LNMnmunmhnmy
NlklNkNvlkv
u(m,n)
NNLLMM
N+L-1
M
MN+L-1
![Page 12: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/12.jpg)
Department of Computer Science and Engineering, Hanyang University
1,,0, ,),(11
),(1
0
1
0
NlkWnmfN
WN
lkFN
m
N
n
lnN
kmN
1,,0 ,),(11
),(1
0
1
0
Nm,nWlkFN
WN
nmfN
k
N
l
lnN
kmN
SeparabilitySeparability
![Page 13: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/13.jpg)
Department of Computer Science and Engineering, Hanyang University
Transform OperationsTransform Operations
mask zonal ,;,,,
filteringlinear dgeneralize
image enhanced :
operationt enhancemen :,,then
image ed transform:,
imageinput :,
11
lkglkvlkglkv
lkvflkv
lkv
nmu
T
T
AVAU
AUAV
U
![Page 14: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/14.jpg)
Department of Computer Science and Engineering, Hanyang University
Centered SpectrumCentered Spectrum
)2/,2/()1)(,( . NvMuFyxf nsFourierTrayx
![Page 15: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/15.jpg)
Department of Computer Science and Engineering, Hanyang University
Generalized Linear FilteringGeneralized Linear Filtering
Generalized Linear Filtering
maskzonallkglkvlkglkv :),(),,(),(),(
Unitarytransform
TAUA
),( nmu ),( lkv Pointoperation
)(f
),( lkv Inversetransform
11 ][ TAVA
),( nmu
HPF
BPF
LPF
Zonal masks forOrthogonal(DCT, DHT etc) transforms
BPF
LPF
HPF
BPF
LPF
BPF
LPF
BPF
LPF
Zonal masks for DFT
![Page 16: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/16.jpg)
Department of Computer Science and Engineering, Hanyang University
Eg. Filtering - DFTEg. Filtering - DFT
![Page 17: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/17.jpg)
Department of Computer Science and Engineering, Hanyang University
Eg. Filtering - LPF and HPFEg. Filtering - LPF and HPF
![Page 18: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/18.jpg)
Department of Computer Science and Engineering, Hanyang University
Eg. Filtering - HPF + DC Eg. Filtering - HPF + DC
![Page 19: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/19.jpg)
Department of Computer Science and Engineering, Hanyang University
Correspondence between Spatial Domain Correspondence between Spatial Domain and Frequency Domainand Frequency Domain
![Page 20: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/20.jpg)
Department of Computer Science and Engineering, Hanyang University
Ideal LPFIdeal LPF
NOT practical because of “ringing”
![Page 21: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/21.jpg)
Department of Computer Science and Engineering, Hanyang University
RingingRinging
![Page 22: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/22.jpg)
Department of Computer Science and Engineering, Hanyang University
Illustration of RingingIllustration of Ringing
convolution
Ideal LPF
![Page 23: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/23.jpg)
Department of Computer Science and Engineering, Hanyang University
Butterworth LPFButterworth LPF
![Page 24: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/24.jpg)
Department of Computer Science and Engineering, Hanyang University
Ringing in BLPFRinging in BLPF
![Page 25: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/25.jpg)
Department of Computer Science and Engineering, Hanyang University
Eg. 2Eg. 2ndnd order Butterworth LPF order Butterworth LPF
A good compromise between Effective LPFand Acceptable ringing
![Page 26: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/26.jpg)
Department of Computer Science and Engineering, Hanyang University
Gaussian LPF(GLPF)Gaussian LPF(GLPF)
![Page 27: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/27.jpg)
Department of Computer Science and Engineering, Hanyang University
Eg. GLPFEg. GLPF
No ringing!
![Page 28: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/28.jpg)
Department of Computer Science and Engineering, Hanyang University
Application of GLPF(1)Application of GLPF(1)
![Page 29: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/29.jpg)
Department of Computer Science and Engineering, Hanyang University
Application of GLPF(2)Application of GLPF(2)
Soft and pleasing
![Page 30: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/30.jpg)
Department of Computer Science and Engineering, Hanyang University
Homomorphic FilteringHomomorphic Filtering
Homomorphic Filtering f(x, y) = i(x, y) • r(x, y)
i(x,y) : - illumination component
- responsible for the dynamic range
- low freq. Components
r(x,y) : - reflectance component
- responsible for local contrast
- high frequency component
enhancement based on the image model
- reduce the illumination components
- enhance the reflectance components
![Page 31: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/31.jpg)
Department of Computer Science and Engineering, Hanyang University
Transform OperationsTransform Operations
Homomorphic System
note
log LinearSystem exp
log exp
HP
LP
g(x, y)f(x, y)
<1
>1
yxrFyxiFyxfF
yxryxiyxf
,,,
,,,
![Page 32: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/32.jpg)
Department of Computer Science and Engineering, Hanyang University
Eg. Homomorphic filtering(1)Eg. Homomorphic filtering(1)
![Page 33: Computer Vision – Enhancement(Part III)](https://reader034.fdocuments.us/reader034/viewer/2022051116/568157c9550346895dc5512b/html5/thumbnails/33.jpg)
Department of Computer Science and Engineering, Hanyang University
Eg. Homomorphic filtering(2)Eg. Homomorphic filtering(2)