Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as...
Transcript of Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as...
![Page 1: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/1.jpg)
Sistemes lineals(Filtrat lineal)
Felipe LumbrerasDept. Ciències de la Computació / Centre de Visió per Computador
Universitat Autònoma de Barcelonahttp://www.cvc.uab.es/shared/teach/a102784/
![Page 2: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/2.jpg)
Linear Systems(images as 2D signals)
1. Signals2. Linear systems. Convolution.3. Linear filters
1. Smoothing2. Edges3. Pattern matching
![Page 3: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/3.jpg)
signals
• continuous signal f(x)
• discrete space signal f(x1)
• digital signal f(x1) (quantized)
![Page 4: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/4.jpg)
2D signals
Mathematically, what a discrete 2d-signal is?
A infinite sequence, defined at integer coordinates:
A special and simple signal:
Dirac delta function (unit impulse)
![Page 5: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/5.jpg)
Dirac delta function
Any signal can be decomposed as a linear combination (weighted sum) of shifted impulses.
weights
(values of f at (k1,k2))Shifted unit impulses
![Page 6: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/6.jpg)
Systems
What a system is?
T can be a lot of things, but we are only interested on systems that are:– Simple (= easy to study, characterize and compute)– Representing interesting transformations– Model real transformations applied to signals
![Page 7: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/7.jpg)
Linear Shift-invariant Systems
• A system is linear if:
The output for a linear combination of input signals = the same linear
combination of the outputs for each of the input signals
• A systems is shift-invariant if: “do the same anywhere”
The output for a shifted input signal = The output of the non-shifted signal
shifted in the same way
![Page 8: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/8.jpg)
Linear shift-invariant systems?
• How these transformations are?
• What does T1 do?
![Page 9: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/9.jpg)
Convolution
a signal can be expressed as a
linear combination of Dirac deltas
![Page 10: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/10.jpg)
Convolution
linearity
![Page 11: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/11.jpg)
Convolution
h is defined as the centered unitary
impulse response of the system
![Page 12: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/12.jpg)
Convolution
definition of the convolution operator (*)
![Page 13: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/13.jpg)
Convolution
![Page 14: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/14.jpg)
Convolution
![Page 15: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/15.jpg)
Convolution
Fix (x1,x2) = (2,3) as example. Now, (k1,k2) can vary.
![Page 16: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/16.jpg)
Convolution
Fix (x1,x2) = (2,3) as example. Now, (k1,k2) can vary.
![Page 17: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/17.jpg)
Convolution
![Page 18: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/18.jpg)
Convolution
What is the impulsive response h of the previous system?
![Page 19: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/19.jpg)
Convolution
What could I do at borders?
![Page 20: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/20.jpg)
Convolution
Why this operator is so important?
– Permits to characterize any linear shift-invariant through its impulsive response h.
– Characterize = compute, have only one property to define it.
– Very simple systems (products and additions).
– Field very well studied (signal processing).
– Changing h we can have several and very different behaviors.
– Some of them (useful): to finding contours, reducing noise, for pattern matching purposes.
– Model signal degradations, for example: defocused images.
– Needed if these degradations want to be removed.
![Page 21: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/21.jpg)
CorrelationEqual to convolution, but without reflecting the h kernel.
![Page 22: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/22.jpg)
Convolution
![Page 23: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/23.jpg)
Concepts
• Padding: add extra pixels around the boundary. Different strategies:
0 (normal), value, Symmetric, Replicate, Circular
• Output size: same, full, valid
• Stride (DL): skip intermediate locations in convolution
• À trous (scale, wavelets, DL) : the convolution kernels increase its size adding intermediate zeros.
![Page 24: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/24.jpg)
Image as a 2d signal
Images can be seen as digital 2d signals (discrete spacing and quantized values).
We can think that outside a certain range the values are zero, or the image (signal, function) is not defined, or has a periodicity, or doesn’t matter.
z grey level
![Page 25: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/25.jpg)
Image convolution
![Page 26: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/26.jpg)
Linear filtersSmoothing: reduce the intensity local variations, often due to
acquisition noise.
Result for correlation should be the same?
![Page 27: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/27.jpg)
Linear filters
![Page 28: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/28.jpg)
Linear filtersEdges: point out intensity local variations, when these variations are due to object contours.
shows (0,0) origin.
![Page 29: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/29.jpg)
Linear filters
![Page 30: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/30.jpg)
Linear filters
• Gradient
• Magnitude
• Orientation
![Page 31: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/31.jpg)
Linear filters
![Page 32: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/32.jpg)
Edge detectors
(1) Roberts
(2) Sobel
(3) Prewitt
(4) Laplacian of Gaussian (zero crossing)
(5) Canny
(1) (2)
(3) (4) (5)
![Page 33: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/33.jpg)
Pattern Matching
Find patterns = find subimages, templates or structures, in an image, defining a similarity measure.
Correlation is a useful technique to start with this topic.
– Binary images: the result is the number of points that matches with the model
– Grey level images: we need a similarity measure:
well suited if Sf 2(x+i) is nearly constant (strong restriction)
iii
ixfxfxtitixfitxs )()()(2)()]()([)( 222
![Page 34: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/34.jpg)
NCC (Normalized cross-correlation)
normxcorr2 (Matlab function)
Pattern Matching
![Page 35: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/35.jpg)
Fourier Transform
1. Motivation
2. Definition
3. Interpretation
4. Linear systems characterization
5. Frequency filtering
6. Fast computation of correlation/convolution
![Page 36: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/36.jpg)
Jean Baptiste Joseph Fourier
![Page 37: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/37.jpg)
Motivation
What is FT used for in image processing?
1. Change in the representation of the images: from a spatial domain (x,y) to a frequency domain (u,v)
space / time frequency
![Page 38: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/38.jpg)
Motivation
![Page 39: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/39.jpg)
MotivationIn the frequency representation we can process (filter) in a different way than in the spatial one.
noise
mask
![Page 40: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/40.jpg)
Motivation
2. Alternative characterization of the linear shift-invariant systems:
• Output computation of a system from an input
![Page 41: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/41.jpg)
Motivation
2. Fast computation of convolution and correlations. using the FFT (Fast Fourier Transform).
Note:
![Page 42: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/42.jpg)
Definition
• Continuous 2D signals
• Discrete space 2D signals
for
for integers, but
![Page 43: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/43.jpg)
Definition
• Discrete space periodic M x N 2D signals
Discrete space periodic N x N 2D signals
direct
inverse
![Page 44: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/44.jpg)
Properties
• Shift in space domain (x0 , y0) → phase changes
![Page 45: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/45.jpg)
Properties
• Correlation and convolution in space: product
• Correlation and convolution with module and phase:
![Page 46: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/46.jpg)
Properties
• Rotation
• Scale
• Periodicity
• Symmetry
• Dirac delta
![Page 47: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/47.jpg)
Properties
• Derivatives
• Energy conservation (Parseval theorem)
![Page 48: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/48.jpg)
Properties
• Separability: 2D FT computation, starts with 1D FT
![Page 49: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/49.jpg)
Fourier Transform
![Page 50: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/50.jpg)
Fourier Transform
![Page 51: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/51.jpg)
Fourier Transform
![Page 52: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/52.jpg)
Fourier Transform
![Page 53: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/53.jpg)
Fourier Transform
![Page 54: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/54.jpg)
Interpretation
![Page 55: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/55.jpg)
Interpretation
![Page 56: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/56.jpg)
Interpretation
![Page 57: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/57.jpg)
Interpretation
![Page 58: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/58.jpg)
Linear Systems: convolution
Convolution theorem:
if
f (x, y) ↔ F (u, v) ( F {f} = F )
h (x, y) ↔ H (u, v) ( F {h} = H )
then
f *h (x, y) ↔ F·H (u, v) ( F {f * h} = F·H )
• Convolution at space domain is product at frequency domain. And vice versa.
![Page 59: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/59.jpg)
Linear Systems: convolution
Then, as there is only one FT of a function, and for each FT there is only one function.
H express how amplitude and phase
of F change at each u,v
![Page 60: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/60.jpg)
Linear Systems: correlation
And also for definition:
![Page 61: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/61.jpg)
Frequency domain filtering
![Page 62: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/62.jpg)
Frequency domain filtering
![Page 63: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/63.jpg)
Frequency domain filtering
![Page 64: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/64.jpg)
Fast correlation / convolution
• Template matching by correlation
![Page 65: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/65.jpg)
Fast correlation / convolution
– Space domain
– Frequency domainproducts
products
![Page 66: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/66.jpg)
Convolution, correlation and Fourier transform in MatLab– Spatial domain
conv2
convn
imfilter
– Frequency domainfft2
ifft2
fftshift
conj, abs, atan2
single, double
.*
![Page 67: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/67.jpg)
Related topics
1. Gaussian Derivatives
2. Laplacian of Gaussian (LoG)
3. Scale space
4. Gabor filters
5. Wavelets
6. Pyramids
![Page 68: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/68.jpg)
Gaussian Derivatives
• Derivates are sensible to noise (higher orders worst).
• Smoothing with a Gaussian reduce noise.
• Radius of the Gaussian integrates local information (scale)
• Derivatives and convolution
![Page 69: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/69.jpg)
Gaussian Derivatives
• Regularized derivatives
![Page 70: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/70.jpg)
Gaussian Derivatives
Gaussian derivatives filter bank
![Page 71: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/71.jpg)
Laplacian of Gaussian
• Second order derivative
s=0.5 s=1.0 s=2.0 s=4.0
LoG
![Page 72: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/72.jpg)
Scale space
• Analyse Image structure at different scales.
• Human visual system extracts multiscale information.
• Representation with a family of smoothed images– linearity (no knowledge, no model, no memory)
– spatial shift invariance (no preferred location)
– isotropy (no preferred orientation)
– scale invariance (no preferred size, or scale)
![Page 73: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/73.jpg)
Gabor filters
• Tunable filter on frequency and orientation.
• Similarities established with the human visual system.
• Well suited for texture analysis.
Gabor filter bank
frequency
representation
![Page 74: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/74.jpg)
Wavelets
• Time frequency (scale) representation of a signal
• Multiresolution representation
![Page 75: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/75.jpg)
Wavelets
• Related with Fourier analysis but …– Fourier bases (sin, cos) well localized in frequency and bad in space.
– Wavelets bases are well localized in frequency and space
mexican hat haargabordaubechies
![Page 76: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/76.jpg)
Wavelets
• Discrete Wavelet Transform of an image
HH1HH1HL1
LH1
HH2
LL2 LH2
HL2
source: wikipedia
![Page 77: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/77.jpg)
Pyramids
• Multiresolution image representation (redundant)
source: Brian A. Wandell, Foundations of Vision
Gaussian pyramid
Laplacian pyramid:
differences between one gaussian step
and its interpolation
![Page 78: Linear Systems (images as 2D signals) - UAB Barcelona · 2020. 2. 26. · Linear Systems (images as 2D signals) 1. Signals 2. Linear systems. Convolution. 3. Linear filters 1. Smoothing](https://reader035.fdocuments.us/reader035/viewer/2022071414/610efa4dad153c12f02389f5/html5/thumbnails/78.jpg)
Bibliography• Joan Serrat, Processament d’Imatges.
http://www.cvc.uab.es/shared/teach/a20380/c20380.htm
• D. A. Forsyth, J. Ponce. Computer Vision: A Modern Approach. Prentice Hall,
2003.
• Laplacian of Gaussian (LoG).
http://fourier.eng.hmc.edu/e161/lectures/gradient/node10.html
• Bart M. ter Haar Romeny, Introduction to Scale-Space Theory: Multiscale Geometric Image Analysis Tutorial VBC ’96, Hamburg, Germany