Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem...
Transcript of Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem...
![Page 1: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/1.jpg)
Total Variation
Total Variation in Image Analysis(The Homo Erectus Stage?)
François Lauze
1Department of Computer ScienceUniversity of Copenhagen
Hólar Summer School on Sparse Coding, August 2010
![Page 2: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/2.jpg)
Total Variation
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 3: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/3.jpg)
Total Variation
Motivation
Origin and uses of Total Variation
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 4: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/4.jpg)
Total Variation
Motivation
Origin and uses of Total Variation
In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimalarea with a given boundary
In image analysis: denoising, image reconstruction, segmentation...
An ubiquitous prior for many image processing tasks.
![Page 5: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/5.jpg)
Total Variation
Motivation
Origin and uses of Total Variation
In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimalarea with a given boundary
In image analysis: denoising, image reconstruction, segmentation...
An ubiquitous prior for many image processing tasks.
![Page 6: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/6.jpg)
Total Variation
Motivation
Origin and uses of Total Variation
In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimalarea with a given boundary
In image analysis: denoising, image reconstruction, segmentation...
An ubiquitous prior for many image processing tasks.
![Page 7: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/7.jpg)
Total Variation
Motivation
Denoising
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 8: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/8.jpg)
Total Variation
Motivation
Denoising
Denoising
Determine an unknown image from a noisy observation.
![Page 9: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/9.jpg)
Total Variation
Motivation
Denoising
Methods
All methods based on some statistical inference.
Fourier/Wavelets
Markov Random Fields
Variational and Partial Differential Equations methods
...
We focus on variational and PDE methods.
![Page 10: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/10.jpg)
Total Variation
Motivation
Denoising
A simple corruption model
A digital image u of size N ×M pixels, corrupted by Gaussian white noise ofvariance σ2
write it as observed image u0 = u + η, ‖u − u0‖2 =∑
ij (uij − u0ij )2 = NMσ2
(noise variance = σ2),∑
ij uij =∑
ij u0ij (zero mean noise).
could add a blur degradation u0 = Ku + η for instance, so to have‖Ku − u0‖2 = NMσ2.
![Page 11: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/11.jpg)
Total Variation
Motivation
Denoising
A simple corruption model
A digital image u of size N ×M pixels, corrupted by Gaussian white noise ofvariance σ2
write it as observed image u0 = u + η, ‖u − u0‖2 =∑
ij (uij − u0ij )2 = NMσ2
(noise variance = σ2),∑
ij uij =∑
ij u0ij (zero mean noise).
could add a blur degradation u0 = Ku + η for instance, so to have‖Ku − u0‖2 = NMσ2.
![Page 12: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/12.jpg)
Total Variation
Motivation
Denoising
A simple corruption model
A digital image u of size N ×M pixels, corrupted by Gaussian white noise ofvariance σ2
write it as observed image u0 = u + η, ‖u − u0‖2 =∑
ij (uij − u0ij )2 = NMσ2
(noise variance = σ2),∑
ij uij =∑
ij u0ij (zero mean noise).
could add a blur degradation u0 = Ku + η for instance, so to have‖Ku − u0‖2 = NMσ2.
![Page 13: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/13.jpg)
Total Variation
Motivation
Denoising
A simple corruption model
A digital image u of size N ×M pixels, corrupted by Gaussian white noise ofvariance σ2
write it as observed image u0 = u + η, ‖u − u0‖2 =∑
ij (uij − u0ij )2 = NMσ2
(noise variance = σ2),∑
ij uij =∑
ij u0ij (zero mean noise).
could add a blur degradation u0 = Ku + η for instance, so to have‖Ku − u0‖2 = NMσ2.
![Page 14: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/14.jpg)
Total Variation
Motivation
Denoising
A simple corruption model
A digital image u of size N ×M pixels, corrupted by Gaussian white noise ofvariance σ2
write it as observed image u0 = u + η, ‖u − u0‖2 =∑
ij (uij − u0ij )2 = NMσ2
(noise variance = σ2),∑
ij uij =∑
ij u0ij (zero mean noise).
could add a blur degradation u0 = Ku + η for instance, so to have‖Ku − u0‖2 = NMσ2.
![Page 15: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/15.jpg)
Total Variation
Motivation
Denoising
Recovery
The problem: Find u such that
‖u − u0‖2 = NMσ2,∑
ij
uij =∑
ij
u0ij (1)
is not well-posed. Many solutions possible.
In order to recover u, extra information is needed, e.g. in the form of a prior on u.
For images, smoothness priors often used.
Let Ru a digital gradient of u, Then find smoothest u that satisfy constraints (1),the smoothest meaning with smallest
T (u) = ‖Ru‖ =
√∑ij
|Ru|2ij .
![Page 16: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/16.jpg)
Total Variation
Motivation
Denoising
Recovery
The problem: Find u such that
‖u − u0‖2 = NMσ2,∑
ij
uij =∑
ij
u0ij (1)
is not well-posed. Many solutions possible.
In order to recover u, extra information is needed, e.g. in the form of a prior on u.
For images, smoothness priors often used.
Let Ru a digital gradient of u, Then find smoothest u that satisfy constraints (1),the smoothest meaning with smallest
T (u) = ‖Ru‖ =
√∑ij
|Ru|2ij .
![Page 17: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/17.jpg)
Total Variation
Motivation
Denoising
Recovery
The problem: Find u such that
‖u − u0‖2 = NMσ2,∑
ij
uij =∑
ij
u0ij (1)
is not well-posed. Many solutions possible.
In order to recover u, extra information is needed, e.g. in the form of a prior on u.
For images, smoothness priors often used.
Let Ru a digital gradient of u, Then find smoothest u that satisfy constraints (1),the smoothest meaning with smallest
T (u) = ‖Ru‖ =
√∑ij
|Ru|2ij .
![Page 18: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/18.jpg)
Total Variation
Motivation
Denoising
Recovery
The problem: Find u such that
‖u − u0‖2 = NMσ2,∑
ij
uij =∑
ij
u0ij (1)
is not well-posed. Many solutions possible.
In order to recover u, extra information is needed, e.g. in the form of a prior on u.
For images, smoothness priors often used.
Let Ru a digital gradient of u, Then find smoothest u that satisfy constraints (1),the smoothest meaning with smallest
T (u) = ‖Ru‖ =
√∑ij
|Ru|2ij .
![Page 19: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/19.jpg)
Total Variation
Motivation
Denoising
Recovery
The problem: Find u such that
‖u − u0‖2 = NMσ2,∑
ij
uij =∑
ij
u0ij (1)
is not well-posed. Many solutions possible.
In order to recover u, extra information is needed, e.g. in the form of a prior on u.
For images, smoothness priors often used.
Let Ru a digital gradient of u, Then find smoothest u that satisfy constraints (1),the smoothest meaning with smallest
T (u) = ‖Ru‖ =
√∑ij
|Ru|2ij .
![Page 20: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/20.jpg)
Total Variation
Motivation
Tikhonov regularization
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 21: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/21.jpg)
Total Variation
Motivation
Tikhonov regularization
Tikhonov regularization
It can be show that this is equivalent to minimize
E(u) = ‖Ku − u0‖2 + λ‖Ru‖2
for a λ = λ(σ) (Wahba?).
E(u) minimizaton can be derived from a Maximum a Posteriori formulation
Arg.maxu
p(u|u0) =p(u0|u)p(u)
p(u0)
Rewriting in a continuous setting:
E(u) =
∫Ω
(Ku − uo)2 dx + λ
∫Ω|∇u|2 dx
![Page 22: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/22.jpg)
Total Variation
Motivation
Tikhonov regularization
Tikhonov regularization
It can be show that this is equivalent to minimize
E(u) = ‖Ku − u0‖2 + λ‖Ru‖2
for a λ = λ(σ) (Wahba?).
E(u) minimizaton can be derived from a Maximum a Posteriori formulation
Arg.maxu
p(u|u0) =p(u0|u)p(u)
p(u0)
Rewriting in a continuous setting:
E(u) =
∫Ω
(Ku − uo)2 dx + λ
∫Ω|∇u|2 dx
![Page 23: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/23.jpg)
Total Variation
Motivation
Tikhonov regularization
Tikhonov regularization
It can be show that this is equivalent to minimize
E(u) = ‖Ku − u0‖2 + λ‖Ru‖2
for a λ = λ(σ) (Wahba?).
E(u) minimizaton can be derived from a Maximum a Posteriori formulation
Arg.maxu
p(u|u0) =p(u0|u)p(u)
p(u0)
Rewriting in a continuous setting:
E(u) =
∫Ω
(Ku − uo)2 dx + λ
∫Ω|∇u|2 dx
![Page 24: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/24.jpg)
Total Variation
Motivation
Tikhonov regularization
Tikhonov regularization
It can be show that this is equivalent to minimize
E(u) = ‖Ku − u0‖2 + λ‖Ru‖2
for a λ = λ(σ) (Wahba?).
E(u) minimizaton can be derived from a Maximum a Posteriori formulation
Arg.maxu
p(u|u0) =p(u0|u)p(u)
p(u0)
Rewriting in a continuous setting:
E(u) =
∫Ω
(Ku − uo)2 dx + λ
∫Ω|∇u|2 dx
![Page 25: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/25.jpg)
Total Variation
Motivation
Tikhonov regularization
Tikhonov regularization
It can be show that this is equivalent to minimize
E(u) = ‖Ku − u0‖2 + λ‖Ru‖2
for a λ = λ(σ) (Wahba?).
E(u) minimizaton can be derived from a Maximum a Posteriori formulation
Arg.maxu
p(u|u0) =p(u0|u)p(u)
p(u0)
Rewriting in a continuous setting:
E(u) =
∫Ω
(Ku − uo)2 dx + λ
∫Ω|∇u|2 dx
![Page 26: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/26.jpg)
Total Variation
Motivation
Tikhonov regularization
How to solve?
Solution satisfies the Euler-Lagrange equation for E :
K∗ (Ku − u0)− λ∆u = 0.
(K∗ is the adjoint of K )
A linear equation, easy to implement, and many fast solvers exit, but...
![Page 27: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/27.jpg)
Total Variation
Motivation
Tikhonov regularization
How to solve?
Solution satisfies the Euler-Lagrange equation for E :
K∗ (Ku − u0)− λ∆u = 0.
(K∗ is the adjoint of K )
A linear equation, easy to implement, and many fast solvers exit, but...
![Page 28: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/28.jpg)
Total Variation
Motivation
Tikhonov regularization
How to solve?
Solution satisfies the Euler-Lagrange equation for E :
K∗ (Ku − u0)− λ∆u = 0.
(K∗ is the adjoint of K )
A linear equation, easy to implement, and many fast solvers exit, but...
![Page 29: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/29.jpg)
Total Variation
Motivation
Tikhonov regularization
Tikhonov example
Denoising example, K = Id .
Original λ = 50 λ = 500
Not good: images contain edges but Tikhonov blur them. Why?
The term∫
Ω(u − u0)2 dx : not guilty!
Then it must be∫
Ω |∇u|2 dx . Derivatives and step edges do not go too welltogether?
![Page 30: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/30.jpg)
Total Variation
Motivation
Tikhonov regularization
Tikhonov example
Denoising example, K = Id .
Original λ = 50 λ = 500
Not good: images contain edges but Tikhonov blur them. Why?
The term∫
Ω(u − u0)2 dx : not guilty!
Then it must be∫
Ω |∇u|2 dx . Derivatives and step edges do not go too welltogether?
![Page 31: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/31.jpg)
Total Variation
Motivation
Tikhonov regularization
Tikhonov example
Denoising example, K = Id .
Original λ = 50 λ = 500
Not good: images contain edges but Tikhonov blur them. Why?
The term∫
Ω(u − u0)2 dx : not guilty!
Then it must be∫
Ω |∇u|2 dx . Derivatives and step edges do not go too welltogether?
![Page 32: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/32.jpg)
Total Variation
Motivation
Tikhonov regularization
Tikhonov example
Denoising example, K = Id .
Original λ = 50 λ = 500
Not good: images contain edges but Tikhonov blur them. Why?
The term∫
Ω(u − u0)2 dx : not guilty!
Then it must be∫
Ω |∇u|2 dx . Derivatives and step edges do not go too welltogether?
![Page 33: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/33.jpg)
Total Variation
Motivation
1-D computation on step edges
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 34: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/34.jpg)
Total Variation
Motivation
1-D computation on step edges
Set Ω = [−1, 1], a a real number and u the step-edge function
u(x) =
0 x ≤ 0a x > 0
Not differentiable at 0, but forget about it and try to compute∫ 1
−1|u′(x)|2 dx .
Around 0 “approximate” u′(x) by
u(h)− u(−h)
2h, h > 0, small
![Page 35: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/35.jpg)
Total Variation
Motivation
1-D computation on step edges
Set Ω = [−1, 1], a a real number and u the step-edge function
u(x) =
0 x ≤ 0a x > 0
Not differentiable at 0, but forget about it and try to compute∫ 1
−1|u′(x)|2 dx .
Around 0 “approximate” u′(x) by
u(h)− u(−h)
2h, h > 0, small
![Page 36: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/36.jpg)
Total Variation
Motivation
1-D computation on step edges
Set Ω = [−1, 1], a a real number and u the step-edge function
u(x) =
0 x ≤ 0a x > 0
Not differentiable at 0, but forget about it and try to compute∫ 1
−1|u′(x)|2 dx .
Around 0 “approximate” u′(x) by
u(h)− u(−h)
2h, h > 0, small
![Page 37: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/37.jpg)
Total Variation
Motivation
1-D computation on step edges
with this finite difference approximation
u′(x) ≈a
2h, x ∈ [−h, h]
then ∫ 1
−1|u′(x)|2 dx =
∫ −h
−1|u′(x)|2 dx +
∫ h
−h|u′(x)|2 dx +
∫ 1
h|u′(x)|2 dx
= 0 + 2h ×( a
2h
)2+ 0
=a2
2h→∞, h→ 0
So a step-edge has “infinite energy”. It cannot minimizes Tikhonov.
What went “wrong”: the square:
![Page 38: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/38.jpg)
Total Variation
Motivation
1-D computation on step edges
with this finite difference approximation
u′(x) ≈a
2h, x ∈ [−h, h]
then ∫ 1
−1|u′(x)|2 dx =
∫ −h
−1|u′(x)|2 dx +
∫ h
−h|u′(x)|2 dx +
∫ 1
h|u′(x)|2 dx
= 0 + 2h ×( a
2h
)2+ 0
=a2
2h→∞, h→ 0
So a step-edge has “infinite energy”. It cannot minimizes Tikhonov.
What went “wrong”: the square:
![Page 39: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/39.jpg)
Total Variation
Motivation
1-D computation on step edges
with this finite difference approximation
u′(x) ≈a
2h, x ∈ [−h, h]
then ∫ 1
−1|u′(x)|2 dx =
∫ −h
−1|u′(x)|2 dx +
∫ h
−h|u′(x)|2 dx +
∫ 1
h|u′(x)|2 dx
= 0 + 2h ×( a
2h
)2+ 0
=a2
2h→∞, h→ 0
So a step-edge has “infinite energy”. It cannot minimizes Tikhonov.
What went “wrong”: the square:
![Page 40: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/40.jpg)
Total Variation
Motivation
1-D computation on step edges
with this finite difference approximation
u′(x) ≈a
2h, x ∈ [−h, h]
then ∫ 1
−1|u′(x)|2 dx =
∫ −h
−1|u′(x)|2 dx +
∫ h
−h|u′(x)|2 dx +
∫ 1
h|u′(x)|2 dx
= 0 + 2h ×( a
2h
)2+ 0
=a2
2h→∞, h→ 0
So a step-edge has “infinite energy”. It cannot minimizes Tikhonov.
What went “wrong”: the square:
![Page 41: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/41.jpg)
Total Variation
Motivation
1-D computation on step edges
with this finite difference approximation
u′(x) ≈a
2h, x ∈ [−h, h]
then ∫ 1
−1|u′(x)|2 dx =
∫ −h
−1|u′(x)|2 dx +
∫ h
−h|u′(x)|2 dx +
∫ 1
h|u′(x)|2 dx
= 0 + 2h ×( a
2h
)2+ 0
=a2
2h→∞, h→ 0
So a step-edge has “infinite energy”. It cannot minimizes Tikhonov.
What went “wrong”: the square:
![Page 42: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/42.jpg)
Total Variation
Motivation
1-D computation on step edges
Replace the square in the previous computation by p > 0 and redo:
Then∫ 1
−1|u′(x)|p dx =
∫ −h
−1|u′(x)|p dx +
∫ h
−h|u′(x)|p dx +
∫ 1
h|u′(x)|p dx
= 0 + 2h ×∣∣∣ a2h
∣∣∣p + 0
= |a|p(2h)1−p <∞ when p ≤ 1
When p ≤ 1 this is finite! Edges can survive here!
Quite ugly when p < 1 (but not uninteresting)
When p = 1, this is the Total Variation of u.
![Page 43: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/43.jpg)
Total Variation
Motivation
1-D computation on step edges
Replace the square in the previous computation by p > 0 and redo:
Then∫ 1
−1|u′(x)|p dx =
∫ −h
−1|u′(x)|p dx +
∫ h
−h|u′(x)|p dx +
∫ 1
h|u′(x)|p dx
= 0 + 2h ×∣∣∣ a2h
∣∣∣p + 0
= |a|p(2h)1−p <∞ when p ≤ 1
When p ≤ 1 this is finite! Edges can survive here!
Quite ugly when p < 1 (but not uninteresting)
When p = 1, this is the Total Variation of u.
![Page 44: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/44.jpg)
Total Variation
Motivation
1-D computation on step edges
Replace the square in the previous computation by p > 0 and redo:
Then∫ 1
−1|u′(x)|p dx =
∫ −h
−1|u′(x)|p dx +
∫ h
−h|u′(x)|p dx +
∫ 1
h|u′(x)|p dx
= 0 + 2h ×∣∣∣ a2h
∣∣∣p + 0
= |a|p(2h)1−p <∞ when p ≤ 1
When p ≤ 1 this is finite! Edges can survive here!
Quite ugly when p < 1 (but not uninteresting)
When p = 1, this is the Total Variation of u.
![Page 45: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/45.jpg)
Total Variation
Motivation
1-D computation on step edges
Replace the square in the previous computation by p > 0 and redo:
Then∫ 1
−1|u′(x)|p dx =
∫ −h
−1|u′(x)|p dx +
∫ h
−h|u′(x)|p dx +
∫ 1
h|u′(x)|p dx
= 0 + 2h ×∣∣∣ a2h
∣∣∣p + 0
= |a|p(2h)1−p <∞ when p ≤ 1
When p ≤ 1 this is finite! Edges can survive here!
Quite ugly when p < 1 (but not uninteresting)
When p = 1, this is the Total Variation of u.
![Page 46: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/46.jpg)
Total Variation
Motivation
1-D computation on step edges
Replace the square in the previous computation by p > 0 and redo:
Then∫ 1
−1|u′(x)|p dx =
∫ −h
−1|u′(x)|p dx +
∫ h
−h|u′(x)|p dx +
∫ 1
h|u′(x)|p dx
= 0 + 2h ×∣∣∣ a2h
∣∣∣p + 0
= |a|p(2h)1−p <∞ when p ≤ 1
When p ≤ 1 this is finite! Edges can survive here!
Quite ugly when p < 1 (but not uninteresting)
When p = 1, this is the Total Variation of u.
![Page 47: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/47.jpg)
Total Variation
Motivation
1-D computation on step edges
Replace the square in the previous computation by p > 0 and redo:
Then∫ 1
−1|u′(x)|p dx =
∫ −h
−1|u′(x)|p dx +
∫ h
−h|u′(x)|p dx +
∫ 1
h|u′(x)|p dx
= 0 + 2h ×∣∣∣ a2h
∣∣∣p + 0
= |a|p(2h)1−p <∞ when p ≤ 1
When p ≤ 1 this is finite! Edges can survive here!
Quite ugly when p < 1 (but not uninteresting)
When p = 1, this is the Total Variation of u.
![Page 48: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/48.jpg)
Total Variation
Total Variation I
First definition
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 49: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/49.jpg)
Total Variation
Total Variation I
First definition
Let u : Ω ⊂ Rn → R. Define total variation as
J(u) =
∫Ω|∇u| dx , |∇u| =
√√√√ n∑i=1
u2xi.
When J(u) is finite, one says that u has bounded variations and the space offunction of bounded variations on Ω is denoted BV (Ω).
![Page 50: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/50.jpg)
Total Variation
Total Variation I
First definition
Let u : Ω ⊂ Rn → R. Define total variation as
J(u) =
∫Ω|∇u| dx , |∇u| =
√√√√ n∑i=1
u2xi.
When J(u) is finite, one says that u has bounded variations and the space offunction of bounded variations on Ω is denoted BV (Ω).
![Page 51: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/51.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 52: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/52.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 53: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/53.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 54: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/54.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 55: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/55.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 56: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/56.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 57: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/57.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 58: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/58.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 59: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/59.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 60: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/60.jpg)
Total Variation
Total Variation I
First definition
Expected: when minimizing J(u) with other constraints, edges are less penalizedthat with Tikhonov.
Indeed edges are “naturally present” in bounded variation functions. In fact:functions of bounded variations can be decomposed in
1 smooth parts,∇u well defined,
2 Jump discontinuities (our edges)
3 something else (Cantor part) which can be nasty...
The functions that do not possess this nasty part form a subspace of BV (Ω)called SBV (Ω), The Special functions of Bounded Variation, (used for instancewhen studying Mumford-Shah functional)
![Page 61: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/61.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 62: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/62.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
ROF Denoising
State the denoising problem as minimizing J(u) under the constraints∫Ω
u dx =
∫Ω
uo dx ,∫
Ω(u − u0)2 dx = |Ω|σ2 (|Ω| = area/volume of Ω)
Solve via Lagrange multipliers.
![Page 63: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/63.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
ROF Denoising
State the denoising problem as minimizing J(u) under the constraints∫Ω
u dx =
∫Ω
uo dx ,∫
Ω(u − u0)2 dx = |Ω|σ2 (|Ω| = area/volume of Ω)
Solve via Lagrange multipliers.
![Page 64: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/64.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
ROF Denoising
State the denoising problem as minimizing J(u) under the constraints∫Ω
u dx =
∫Ω
uo dx ,∫
Ω(u − u0)2 dx = |Ω|σ2 (|Ω| = area/volume of Ω)
Solve via Lagrange multipliers.
![Page 65: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/65.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
TV-denoising
Chambolle-Lions: there exists λ such the solution minimizes
ETV (u) =12
∫Ω
(Ku − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange equation:
K∗(Ku − u0)− λdiv(∇u|∇u|
)= 0.
The term div(∇u|∇u|
)is highly non linear. Problems especially when |∇u| = 0.
In fact ∇u/|∇u| (x) is the unit normal of the level line of u at x and div
(∇u|∇u|
)is the
(mean)curvature of the level line: not defined when the level line is singular ordoes not exist!
![Page 66: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/66.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
TV-denoising
Chambolle-Lions: there exists λ such the solution minimizes
ETV (u) =12
∫Ω
(Ku − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange equation:
K∗(Ku − u0)− λdiv(∇u|∇u|
)= 0.
The term div(∇u|∇u|
)is highly non linear. Problems especially when |∇u| = 0.
In fact ∇u/|∇u| (x) is the unit normal of the level line of u at x and div
(∇u|∇u|
)is the
(mean)curvature of the level line: not defined when the level line is singular ordoes not exist!
![Page 67: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/67.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
TV-denoising
Chambolle-Lions: there exists λ such the solution minimizes
ETV (u) =12
∫Ω
(Ku − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange equation:
K∗(Ku − u0)− λdiv(∇u|∇u|
)= 0.
The term div(∇u|∇u|
)is highly non linear. Problems especially when |∇u| = 0.
In fact ∇u/|∇u| (x) is the unit normal of the level line of u at x and div
(∇u|∇u|
)is the
(mean)curvature of the level line: not defined when the level line is singular ordoes not exist!
![Page 68: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/68.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
TV-denoising
Chambolle-Lions: there exists λ such the solution minimizes
ETV (u) =12
∫Ω
(Ku − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange equation:
K∗(Ku − u0)− λdiv(∇u|∇u|
)= 0.
The term div(∇u|∇u|
)is highly non linear. Problems especially when |∇u| = 0.
In fact ∇u/|∇u| (x) is the unit normal of the level line of u at x and div
(∇u|∇u|
)is the
(mean)curvature of the level line: not defined when the level line is singular ordoes not exist!
![Page 69: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/69.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
TV-denoising
Chambolle-Lions: there exists λ such the solution minimizes
ETV (u) =12
∫Ω
(Ku − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange equation:
K∗(Ku − u0)− λdiv(∇u|∇u|
)= 0.
The term div(∇u|∇u|
)is highly non linear. Problems especially when |∇u| = 0.
In fact ∇u/|∇u| (x) is the unit normal of the level line of u at x and div
(∇u|∇u|
)is the
(mean)curvature of the level line: not defined when the level line is singular ordoes not exist!
![Page 70: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/70.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
Acar-Vogel
Replace it by regularized version
|∇u|β =√|∇u|2 + β, β > 0
Acar - Vogel show that
limβ→0
(Jβ(u) =
∫Ω|∇u|β dx
)= J(u).
Replace energy by
E ′(u) =
∫Ω
(Ku − u0)2 dx + λJβ(u)
Euler-Lagrange equation:
K∗(Ku − u0)− λdiv(∇u|∇u|β
)= 0
The null denominator problem disappears.
![Page 71: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/71.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
Acar-Vogel
Replace it by regularized version
|∇u|β =√|∇u|2 + β, β > 0
Acar - Vogel show that
limβ→0
(Jβ(u) =
∫Ω|∇u|β dx
)= J(u).
Replace energy by
E ′(u) =
∫Ω
(Ku − u0)2 dx + λJβ(u)
Euler-Lagrange equation:
K∗(Ku − u0)− λdiv(∇u|∇u|β
)= 0
The null denominator problem disappears.
![Page 72: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/72.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
Acar-Vogel
Replace it by regularized version
|∇u|β =√|∇u|2 + β, β > 0
Acar - Vogel show that
limβ→0
(Jβ(u) =
∫Ω|∇u|β dx
)= J(u).
Replace energy by
E ′(u) =
∫Ω
(Ku − u0)2 dx + λJβ(u)
Euler-Lagrange equation:
K∗(Ku − u0)− λdiv(∇u|∇u|β
)= 0
The null denominator problem disappears.
![Page 73: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/73.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
Acar-Vogel
Replace it by regularized version
|∇u|β =√|∇u|2 + β, β > 0
Acar - Vogel show that
limβ→0
(Jβ(u) =
∫Ω|∇u|β dx
)= J(u).
Replace energy by
E ′(u) =
∫Ω
(Ku − u0)2 dx + λJβ(u)
Euler-Lagrange equation:
K∗(Ku − u0)− λdiv(∇u|∇u|β
)= 0
The null denominator problem disappears.
![Page 74: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/74.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
Example
Implementation by finite differences, fixed-point strategy, linearization.
Original λ = 1.5, β = 10−4
![Page 75: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/75.jpg)
Total Variation
Total Variation I
Rudin-Osher-Fatemi
Example
Implementation by finite differences, fixed-point strategy, linearization.
Original λ = 1.5, β = 10−4
![Page 76: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/76.jpg)
Total Variation
Total Variation I
Inpainting/Denoising
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 77: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/77.jpg)
Total Variation
Total Variation I
Inpainting/Denoising
Filling u in the subset H ⊂ Ω where data is missing, denoise known data
Inpainting energy (Chan & Shen):
EITV (u) =12
∫Ω\H
(u − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange Equation:
(u − u0)χ− λdiv(∇u|∇u|
)= 0.
(χ(x) = 1 is x 6∈ H, 0 otherwise).
Very similar to denoising. Can use the same approximation/implementation.
![Page 78: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/78.jpg)
Total Variation
Total Variation I
Inpainting/Denoising
Filling u in the subset H ⊂ Ω where data is missing, denoise known data
Inpainting energy (Chan & Shen):
EITV (u) =12
∫Ω\H
(u − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange Equation:
(u − u0)χ− λdiv(∇u|∇u|
)= 0.
(χ(x) = 1 is x 6∈ H, 0 otherwise).
Very similar to denoising. Can use the same approximation/implementation.
![Page 79: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/79.jpg)
Total Variation
Total Variation I
Inpainting/Denoising
Filling u in the subset H ⊂ Ω where data is missing, denoise known data
Inpainting energy (Chan & Shen):
EITV (u) =12
∫Ω\H
(u − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange Equation:
(u − u0)χ− λdiv(∇u|∇u|
)= 0.
(χ(x) = 1 is x 6∈ H, 0 otherwise).
Very similar to denoising. Can use the same approximation/implementation.
![Page 80: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/80.jpg)
Total Variation
Total Variation I
Inpainting/Denoising
Filling u in the subset H ⊂ Ω where data is missing, denoise known data
Inpainting energy (Chan & Shen):
EITV (u) =12
∫Ω\H
(u − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange Equation:
(u − u0)χ− λdiv(∇u|∇u|
)= 0.
(χ(x) = 1 is x 6∈ H, 0 otherwise).
Very similar to denoising. Can use the same approximation/implementation.
![Page 81: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/81.jpg)
Total Variation
Total Variation I
Inpainting/Denoising
Filling u in the subset H ⊂ Ω where data is missing, denoise known data
Inpainting energy (Chan & Shen):
EITV (u) =12
∫Ω\H
(u − u0)2 dx + λ
∫Ω|∇u| dx
Euler-Lagrange Equation:
(u − u0)χ− λdiv(∇u|∇u|
)= 0.
(χ(x) = 1 is x 6∈ H, 0 otherwise).
Very similar to denoising. Can use the same approximation/implementation.
![Page 82: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/82.jpg)
Total Variation
Total Variation I
Inpainting/Denoising
Degraded Inpainted
![Page 83: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/83.jpg)
Total Variation
Total Variation I
Inpainting/Denoising
Segmention
Inpainting - driven segmention (Lauze, Nielsen 2008, IJCV)
Aortic calcifiction Detection Segmention
![Page 84: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/84.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 85: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/85.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
With definition of total variation as
J(u) =
∫Ω|∇u| dx
u must have (weak) derivatives.
But we just saw that the computation is possible for a step-edge u(x) = 0, x < 0,u(x) = a, x > 0: ∫ 1
−1|u′(x)| dx = |a|
Can we avoid the use of derivatives of u?
![Page 86: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/86.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
With definition of total variation as
J(u) =
∫Ω|∇u| dx
u must have (weak) derivatives.
But we just saw that the computation is possible for a step-edge u(x) = 0, x < 0,u(x) = a, x > 0: ∫ 1
−1|u′(x)| dx = |a|
Can we avoid the use of derivatives of u?
![Page 87: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/87.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
With definition of total variation as
J(u) =
∫Ω|∇u| dx
u must have (weak) derivatives.
But we just saw that the computation is possible for a step-edge u(x) = 0, x < 0,u(x) = a, x > 0: ∫ 1
−1|u′(x)| dx = |a|
Can we avoid the use of derivatives of u?
![Page 88: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/88.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
With definition of total variation as
J(u) =
∫Ω|∇u| dx
u must have (weak) derivatives.
But we just saw that the computation is possible for a step-edge u(x) = 0, x < 0,u(x) = a, x > 0: ∫ 1
−1|u′(x)| dx = |a|
Can we avoid the use of derivatives of u?
![Page 89: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/89.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Assume first that ∇u exists.
|∇u| = ∇u ·∇u|∇u|
(except when ∇u = 0) and ∇u|∇u| is the normal to the level lines of u, it has
everywhere norm 1.
Let V the set of vector fields v(x) on Ω with |v(x)| ≤ 1. I claim
J(u) = supv∈V
∫Ω∇u(x) · v(x) dx
(consequence of Cauchy-Schwarz inequality).
![Page 90: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/90.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Assume first that ∇u exists.
|∇u| = ∇u ·∇u|∇u|
(except when ∇u = 0) and ∇u|∇u| is the normal to the level lines of u, it has
everywhere norm 1.
Let V the set of vector fields v(x) on Ω with |v(x)| ≤ 1. I claim
J(u) = supv∈V
∫Ω∇u(x) · v(x) dx
(consequence of Cauchy-Schwarz inequality).
![Page 91: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/91.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Assume first that ∇u exists.
|∇u| = ∇u ·∇u|∇u|
(except when ∇u = 0) and ∇u|∇u| is the normal to the level lines of u, it has
everywhere norm 1.
Let V the set of vector fields v(x) on Ω with |v(x)| ≤ 1. I claim
J(u) = supv∈V
∫Ω∇u(x) · v(x) dx
(consequence of Cauchy-Schwarz inequality).
![Page 92: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/92.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Restrict to the set W of such v ’s that are differentiable and vanishing at ∂Ω, theboundary of Ω Then
J(u) = supv∈W
∫Ω∇u(x) · v(x) dx
But then I can use Divergence theorem: H ⊂ D ⊂ Rn, f : D → R differentiablefunction, g = (g1, . . . , gn) : D → Rn differentiable vector field anddiv g =
∑ni=1 g i
xi,∫
H∇f · g dx = −
∫H
fdiv g dx +
∫∂H
fg · n(s) ds
with n(s) exterior normal field to ∂H.
Apply it to J(u) above:
J(u) = supv∈W
(−∫
Ωu(x) div v(x) dx
)The gradient has disappeared from u! This is the classical definition of totalvariation.
Note that when ∇u(x) 6= 0, optimal v(x) = (∇u/|∇|u)(x) and divv(x) is themean curvature of the level set of u at x . Geometry is there!
![Page 93: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/93.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Restrict to the set W of such v ’s that are differentiable and vanishing at ∂Ω, theboundary of Ω Then
J(u) = supv∈W
∫Ω∇u(x) · v(x) dx
But then I can use Divergence theorem: H ⊂ D ⊂ Rn, f : D → R differentiablefunction, g = (g1, . . . , gn) : D → Rn differentiable vector field anddiv g =
∑ni=1 g i
xi,∫
H∇f · g dx = −
∫H
fdiv g dx +
∫∂H
fg · n(s) ds
with n(s) exterior normal field to ∂H.
Apply it to J(u) above:
J(u) = supv∈W
(−∫
Ωu(x) div v(x) dx
)The gradient has disappeared from u! This is the classical definition of totalvariation.
Note that when ∇u(x) 6= 0, optimal v(x) = (∇u/|∇|u)(x) and divv(x) is themean curvature of the level set of u at x . Geometry is there!
![Page 94: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/94.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Restrict to the set W of such v ’s that are differentiable and vanishing at ∂Ω, theboundary of Ω Then
J(u) = supv∈W
∫Ω∇u(x) · v(x) dx
But then I can use Divergence theorem: H ⊂ D ⊂ Rn, f : D → R differentiablefunction, g = (g1, . . . , gn) : D → Rn differentiable vector field anddiv g =
∑ni=1 g i
xi,∫
H∇f · g dx = −
∫H
fdiv g dx +
∫∂H
fg · n(s) ds
with n(s) exterior normal field to ∂H.
Apply it to J(u) above:
J(u) = supv∈W
(−∫
Ωu(x) div v(x) dx
)The gradient has disappeared from u! This is the classical definition of totalvariation.
Note that when ∇u(x) 6= 0, optimal v(x) = (∇u/|∇|u)(x) and divv(x) is themean curvature of the level set of u at x . Geometry is there!
![Page 95: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/95.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Restrict to the set W of such v ’s that are differentiable and vanishing at ∂Ω, theboundary of Ω Then
J(u) = supv∈W
∫Ω∇u(x) · v(x) dx
But then I can use Divergence theorem: H ⊂ D ⊂ Rn, f : D → R differentiablefunction, g = (g1, . . . , gn) : D → Rn differentiable vector field anddiv g =
∑ni=1 g i
xi,∫
H∇f · g dx = −
∫H
fdiv g dx +
∫∂H
fg · n(s) ds
with n(s) exterior normal field to ∂H.
Apply it to J(u) above:
J(u) = supv∈W
(−∫
Ωu(x) div v(x) dx
)The gradient has disappeared from u! This is the classical definition of totalvariation.
Note that when ∇u(x) 6= 0, optimal v(x) = (∇u/|∇|u)(x) and divv(x) is themean curvature of the level set of u at x . Geometry is there!
![Page 96: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/96.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Restrict to the set W of such v ’s that are differentiable and vanishing at ∂Ω, theboundary of Ω Then
J(u) = supv∈W
∫Ω∇u(x) · v(x) dx
But then I can use Divergence theorem: H ⊂ D ⊂ Rn, f : D → R differentiablefunction, g = (g1, . . . , gn) : D → Rn differentiable vector field anddiv g =
∑ni=1 g i
xi,∫
H∇f · g dx = −
∫H
fdiv g dx +
∫∂H
fg · n(s) ds
with n(s) exterior normal field to ∂H.
Apply it to J(u) above:
J(u) = supv∈W
(−∫
Ωu(x) div v(x) dx
)The gradient has disappeared from u! This is the classical definition of totalvariation.
Note that when ∇u(x) 6= 0, optimal v(x) = (∇u/|∇|u)(x) and divv(x) is themean curvature of the level set of u at x . Geometry is there!
![Page 97: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/97.jpg)
Total Variation
Total Variation II
Relaxing the derivative constraints
Restrict to the set W of such v ’s that are differentiable and vanishing at ∂Ω, theboundary of Ω Then
J(u) = supv∈W
∫Ω∇u(x) · v(x) dx
But then I can use Divergence theorem: H ⊂ D ⊂ Rn, f : D → R differentiablefunction, g = (g1, . . . , gn) : D → Rn differentiable vector field anddiv g =
∑ni=1 g i
xi,∫
H∇f · g dx = −
∫H
fdiv g dx +
∫∂H
fg · n(s) ds
with n(s) exterior normal field to ∂H.
Apply it to J(u) above:
J(u) = supv∈W
(−∫
Ωu(x) div v(x) dx
)The gradient has disappeared from u! This is the classical definition of totalvariation.
Note that when ∇u(x) 6= 0, optimal v(x) = (∇u/|∇|u)(x) and divv(x) is themean curvature of the level set of u at x . Geometry is there!
![Page 98: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/98.jpg)
Total Variation
Total Variation II
Definition in action
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 99: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/99.jpg)
Total Variation
Total Variation II
Definition in action
Step-edge
u the step-edge function defined in previous slides. We compute J(u) with thenew definition.
here W = φ : [−1, 1]→ R differentiable, φ(−1) = φ(1) = 0, |φ(x)| ≤ 1,
J(u) = supφ∈W
∫ 1
−1u(x)φ′(x) dx
we compute ∫ 1
−1u(x)φ′(x) dx = a
∫ 1
0φ′(x) dx
= a (φ(1)− φ(0))
= −aφ(0)
As −1 ≤ φ(0) ≤ 1, the maximum is |a|.
![Page 100: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/100.jpg)
Total Variation
Total Variation II
Definition in action
Step-edge
u the step-edge function defined in previous slides. We compute J(u) with thenew definition.
here W = φ : [−1, 1]→ R differentiable, φ(−1) = φ(1) = 0, |φ(x)| ≤ 1,
J(u) = supφ∈W
∫ 1
−1u(x)φ′(x) dx
we compute ∫ 1
−1u(x)φ′(x) dx = a
∫ 1
0φ′(x) dx
= a (φ(1)− φ(0))
= −aφ(0)
As −1 ≤ φ(0) ≤ 1, the maximum is |a|.
![Page 101: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/101.jpg)
Total Variation
Total Variation II
Definition in action
Step-edge
u the step-edge function defined in previous slides. We compute J(u) with thenew definition.
here W = φ : [−1, 1]→ R differentiable, φ(−1) = φ(1) = 0, |φ(x)| ≤ 1,
J(u) = supφ∈W
∫ 1
−1u(x)φ′(x) dx
we compute ∫ 1
−1u(x)φ′(x) dx = a
∫ 1
0φ′(x) dx
= a (φ(1)− φ(0))
= −aφ(0)
As −1 ≤ φ(0) ≤ 1, the maximum is |a|.
![Page 102: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/102.jpg)
Total Variation
Total Variation II
Definition in action
Step-edge
u the step-edge function defined in previous slides. We compute J(u) with thenew definition.
here W = φ : [−1, 1]→ R differentiable, φ(−1) = φ(1) = 0, |φ(x)| ≤ 1,
J(u) = supφ∈W
∫ 1
−1u(x)φ′(x) dx
we compute ∫ 1
−1u(x)φ′(x) dx = a
∫ 1
0φ′(x) dx
= a (φ(1)− φ(0))
= −aφ(0)
As −1 ≤ φ(0) ≤ 1, the maximum is |a|.
![Page 103: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/103.jpg)
Total Variation
Total Variation II
Definition in action
Step-edge
u the step-edge function defined in previous slides. We compute J(u) with thenew definition.
here W = φ : [−1, 1]→ R differentiable, φ(−1) = φ(1) = 0, |φ(x)| ≤ 1,
J(u) = supφ∈W
∫ 1
−1u(x)φ′(x) dx
we compute ∫ 1
−1u(x)φ′(x) dx = a
∫ 1
0φ′(x) dx
= a (φ(1)− φ(0))
= −aφ(0)
As −1 ≤ φ(0) ≤ 1, the maximum is |a|.
![Page 104: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/104.jpg)
Total Variation
Total Variation II
Definition in action
Step-edge
u the step-edge function defined in previous slides. We compute J(u) with thenew definition.
here W = φ : [−1, 1]→ R differentiable, φ(−1) = φ(1) = 0, |φ(x)| ≤ 1,
J(u) = supφ∈W
∫ 1
−1u(x)φ′(x) dx
we compute ∫ 1
−1u(x)φ′(x) dx = a
∫ 1
0φ′(x) dx
= a (φ(1)− φ(0))
= −aφ(0)
As −1 ≤ φ(0) ≤ 1, the maximum is |a|.
![Page 105: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/105.jpg)
Total Variation
Total Variation II
Definition in action
2D example
B open set with regular boundary curve partialB, Ω large enough to contain B andχB the characteristic function of B
χB(x) =
1 x ∈ B0 x 6∈ B
For v ∈ W , by the divergence theorem on B and its boundary ∂B∫Ωχ(x)div v(x) dx =
∫B
div v(x) dx
= −∫∂B
v(s) · n(s) ds
(n(s) is the exterior normal to ∂B)
This integral is maximized when v = −n : length of ∂B perimeter of B.
![Page 106: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/106.jpg)
Total Variation
Total Variation II
Definition in action
2D example
B open set with regular boundary curve partialB, Ω large enough to contain B andχB the characteristic function of B
χB(x) =
1 x ∈ B0 x 6∈ B
For v ∈ W , by the divergence theorem on B and its boundary ∂B∫Ωχ(x)div v(x) dx =
∫B
div v(x) dx
= −∫∂B
v(s) · n(s) ds
(n(s) is the exterior normal to ∂B)
This integral is maximized when v = −n : length of ∂B perimeter of B.
![Page 107: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/107.jpg)
Total Variation
Total Variation II
Definition in action
2D example
B open set with regular boundary curve partialB, Ω large enough to contain B andχB the characteristic function of B
χB(x) =
1 x ∈ B0 x 6∈ B
For v ∈ W , by the divergence theorem on B and its boundary ∂B∫Ωχ(x)div v(x) dx =
∫B
div v(x) dx
= −∫∂B
v(s) · n(s) ds
(n(s) is the exterior normal to ∂B)
This integral is maximized when v = −n : length of ∂B perimeter of B.
![Page 108: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/108.jpg)
Total Variation
Total Variation II
Definition in action
2D example
B open set with regular boundary curve partialB, Ω large enough to contain B andχB the characteristic function of B
χB(x) =
1 x ∈ B0 x 6∈ B
For v ∈ W , by the divergence theorem on B and its boundary ∂B∫Ωχ(x)div v(x) dx =
∫B
div v(x) dx
= −∫∂B
v(s) · n(s) ds
(n(s) is the exterior normal to ∂B)
This integral is maximized when v = −n : length of ∂B perimeter of B.
![Page 109: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/109.jpg)
Total Variation
Total Variation II
Definition in action
Sets of finite perimeter
Let H ⊂ Ω. If its characteristic function χH satisfies
J(χH ) <∞
H is called set of finite perimeter (and PerΩ(H) := J(χH ) is its perimeter)
This is used for instance in the Chan and Vese algorithm.
If J(u) <∞ and Ht = x ∈ Ω, u(x) < t the lower t-level set of u,
J(u) =
∫ +∞
−∞J(χHt ) dt Coarea formula
![Page 110: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/110.jpg)
Total Variation
Total Variation II
Definition in action
Sets of finite perimeter
Let H ⊂ Ω. If its characteristic function χH satisfies
J(χH ) <∞
H is called set of finite perimeter (and PerΩ(H) := J(χH ) is its perimeter)
This is used for instance in the Chan and Vese algorithm.
If J(u) <∞ and Ht = x ∈ Ω, u(x) < t the lower t-level set of u,
J(u) =
∫ +∞
−∞J(χHt ) dt Coarea formula
![Page 111: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/111.jpg)
Total Variation
Total Variation II
Definition in action
Sets of finite perimeter
Let H ⊂ Ω. If its characteristic function χH satisfies
J(χH ) <∞
H is called set of finite perimeter (and PerΩ(H) := J(χH ) is its perimeter)
This is used for instance in the Chan and Vese algorithm.
If J(u) <∞ and Ht = x ∈ Ω, u(x) < t the lower t-level set of u,
J(u) =
∫ +∞
−∞J(χHt ) dt Coarea formula
![Page 112: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/112.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 113: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/113.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Chambolle algorithm
Let K ∈ L2(Ω) the closure of the set div v , v ∈ C10 (Ω)2, |v(x)| ≤ 1 i.e. the
image of W by div.
Then
J(u) = supφ∈K
(∫Ω
u φ dx = 〈u, φ〉L2(Ω)
)Solution of the denoising problem arg.min
∫Ω(u − u0)2 + λJ(u) given by
u = u0 − πλK (u0)
with πλK orthogonal projection onto the convex set λK (Chambolle).
Needs a bit of convex analysis to show that: subdifferentials and subgradients,Fenchel transforms, indicators/characteristic functions and elementary results onthem
![Page 114: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/114.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Chambolle algorithm
Let K ∈ L2(Ω) the closure of the set div v , v ∈ C10 (Ω)2, |v(x)| ≤ 1 i.e. the
image of W by div.
Then
J(u) = supφ∈K
(∫Ω
u φ dx = 〈u, φ〉L2(Ω)
)Solution of the denoising problem arg.min
∫Ω(u − u0)2 + λJ(u) given by
u = u0 − πλK (u0)
with πλK orthogonal projection onto the convex set λK (Chambolle).
Needs a bit of convex analysis to show that: subdifferentials and subgradients,Fenchel transforms, indicators/characteristic functions and elementary results onthem
![Page 115: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/115.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Chambolle algorithm
Let K ∈ L2(Ω) the closure of the set div v , v ∈ C10 (Ω)2, |v(x)| ≤ 1 i.e. the
image of W by div.
Then
J(u) = supφ∈K
(∫Ω
u φ dx = 〈u, φ〉L2(Ω)
)Solution of the denoising problem arg.min
∫Ω(u − u0)2 + λJ(u) given by
u = u0 − πλK (u0)
with πλK orthogonal projection onto the convex set λK (Chambolle).
Needs a bit of convex analysis to show that: subdifferentials and subgradients,Fenchel transforms, indicators/characteristic functions and elementary results onthem
![Page 116: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/116.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Chambolle algorithm
Let K ∈ L2(Ω) the closure of the set div v , v ∈ C10 (Ω)2, |v(x)| ≤ 1 i.e. the
image of W by div.
Then
J(u) = supφ∈K
(∫Ω
u φ dx = 〈u, φ〉L2(Ω)
)Solution of the denoising problem arg.min
∫Ω(u − u0)2 + λJ(u) given by
u = u0 − πλK (u0)
with πλK orthogonal projection onto the convex set λK (Chambolle).
Needs a bit of convex analysis to show that: subdifferentials and subgradients,Fenchel transforms, indicators/characteristic functions and elementary results onthem
![Page 117: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/117.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Chambolle algorithm
Let K ∈ L2(Ω) the closure of the set div v , v ∈ C10 (Ω)2, |v(x)| ≤ 1 i.e. the
image of W by div.
Then
J(u) = supφ∈K
(∫Ω
u φ dx = 〈u, φ〉L2(Ω)
)Solution of the denoising problem arg.min
∫Ω(u − u0)2 + λJ(u) given by
u = u0 − πλK (u0)
with πλK orthogonal projection onto the convex set λK (Chambolle).
Needs a bit of convex analysis to show that: subdifferentials and subgradients,Fenchel transforms, indicators/characteristic functions and elementary results onthem
![Page 118: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/118.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Chambolle algorithm
Let K ∈ L2(Ω) the closure of the set div v , v ∈ C10 (Ω)2, |v(x)| ≤ 1 i.e. the
image of W by div.
Then
J(u) = supφ∈K
(∫Ω
u φ dx = 〈u, φ〉L2(Ω)
)Solution of the denoising problem arg.min
∫Ω(u − u0)2 + λJ(u) given by
u = u0 − πλK (u0)
with πλK orthogonal projection onto the convex set λK (Chambolle).
Needs a bit of convex analysis to show that: subdifferentials and subgradients,Fenchel transforms, indicators/characteristic functions and elementary results onthem
![Page 119: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/119.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel Transform
X Hilbert space, f : X → R convex, proper. Fenchel transform of F :
F∗(v) = supu∈X
(〈u, v〉X − F (u))
Geometric meaning: take u∗ such that F∗(u∗) < +∞: the affine function
a(u) = 〈u, u∗〉 − F∗(u∗)
is tangent to F and a(0) = −F∗(u∗).
![Page 120: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/120.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel Transform
X Hilbert space, f : X → R convex, proper. Fenchel transform of F :
F∗(v) = supu∈X
(〈u, v〉X − F (u))
Geometric meaning: take u∗ such that F∗(u∗) < +∞: the affine function
a(u) = 〈u, u∗〉 − F∗(u∗)
is tangent to F and a(0) = −F∗(u∗).
![Page 121: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/121.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel Transform
X Hilbert space, f : X → R convex, proper. Fenchel transform of F :
F∗(v) = supu∈X
(〈u, v〉X − F (u))
Geometric meaning: take u∗ such that F∗(u∗) < +∞: the affine function
a(u) = 〈u, u∗〉 − F∗(u∗)
is tangent to F and a(0) = −F∗(u∗).
![Page 122: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/122.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel transform
Interesting properties:Convexif Φ is the transform of F and λ > 0, then the transform of u 7→ λF (λ−1(u) is λΦ.if F 1-homogeneous, i.e. F (λu) = λF (u) then F∗(u) only take values 0 and +∞ as theproperty above implies F∗ = λF∗, λ > 0.In that case, the set where F∗ = 0 i a closed convex set of X , F∗ = δC , the indicatorfunction of C,
δC (x) =
0 , x ∈ C+∞ , x 6∈ C
For x ∈ R 7→ |x|, C = [−1, 1]For J(u), C = K .
![Page 123: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/123.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel transform
Interesting properties:Convexif Φ is the transform of F and λ > 0, then the transform of u 7→ λF (λ−1(u) is λΦ.if F 1-homogeneous, i.e. F (λu) = λF (u) then F∗(u) only take values 0 and +∞ as theproperty above implies F∗ = λF∗, λ > 0.In that case, the set where F∗ = 0 i a closed convex set of X , F∗ = δC , the indicatorfunction of C,
δC (x) =
0 , x ∈ C+∞ , x 6∈ C
For x ∈ R 7→ |x|, C = [−1, 1]For J(u), C = K .
![Page 124: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/124.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel transform
Interesting properties:Convexif Φ is the transform of F and λ > 0, then the transform of u 7→ λF (λ−1(u) is λΦ.if F 1-homogeneous, i.e. F (λu) = λF (u) then F∗(u) only take values 0 and +∞ as theproperty above implies F∗ = λF∗, λ > 0.In that case, the set where F∗ = 0 i a closed convex set of X , F∗ = δC , the indicatorfunction of C,
δC (x) =
0 , x ∈ C+∞ , x 6∈ C
For x ∈ R 7→ |x|, C = [−1, 1]For J(u), C = K .
![Page 125: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/125.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel transform
Interesting properties:Convexif Φ is the transform of F and λ > 0, then the transform of u 7→ λF (λ−1(u) is λΦ.if F 1-homogeneous, i.e. F (λu) = λF (u) then F∗(u) only take values 0 and +∞ as theproperty above implies F∗ = λF∗, λ > 0.In that case, the set where F∗ = 0 i a closed convex set of X , F∗ = δC , the indicatorfunction of C,
δC (x) =
0 , x ∈ C+∞ , x 6∈ C
For x ∈ R 7→ |x|, C = [−1, 1]For J(u), C = K .
![Page 126: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/126.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel transform
Interesting properties:Convexif Φ is the transform of F and λ > 0, then the transform of u 7→ λF (λ−1(u) is λΦ.if F 1-homogeneous, i.e. F (λu) = λF (u) then F∗(u) only take values 0 and +∞ as theproperty above implies F∗ = λF∗, λ > 0.In that case, the set where F∗ = 0 i a closed convex set of X , F∗ = δC , the indicatorfunction of C,
δC (x) =
0 , x ∈ C+∞ , x 6∈ C
For x ∈ R 7→ |x|, C = [−1, 1]For J(u), C = K .
![Page 127: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/127.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel transform
Interesting properties:Convexif Φ is the transform of F and λ > 0, then the transform of u 7→ λF (λ−1(u) is λΦ.if F 1-homogeneous, i.e. F (λu) = λF (u) then F∗(u) only take values 0 and +∞ as theproperty above implies F∗ = λF∗, λ > 0.In that case, the set where F∗ = 0 i a closed convex set of X , F∗ = δC , the indicatorfunction of C,
δC (x) =
0 , x ∈ C+∞ , x 6∈ C
For x ∈ R 7→ |x|, C = [−1, 1]For J(u), C = K .
![Page 128: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/128.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel transform
Interesting properties:Convexif Φ is the transform of F and λ > 0, then the transform of u 7→ λF (λ−1(u) is λΦ.if F 1-homogeneous, i.e. F (λu) = λF (u) then F∗(u) only take values 0 and +∞ as theproperty above implies F∗ = λF∗, λ > 0.In that case, the set where F∗ = 0 i a closed convex set of X , F∗ = δC , the indicatorfunction of C,
δC (x) =
0 , x ∈ C+∞ , x 6∈ C
For x ∈ R 7→ |x|, C = [−1, 1]For J(u), C = K .
![Page 129: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/129.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Fenchel transform
Interesting properties:Convexif Φ is the transform of F and λ > 0, then the transform of u 7→ λF (λ−1(u) is λΦ.if F 1-homogeneous, i.e. F (λu) = λF (u) then F∗(u) only take values 0 and +∞ as theproperty above implies F∗ = λF∗, λ > 0.In that case, the set where F∗ = 0 i a closed convex set of X , F∗ = δC , the indicatorfunction of C,
δC (x) =
0 , x ∈ C+∞ , x 6∈ C
For x ∈ R 7→ |x|, C = [−1, 1]For J(u), C = K .
![Page 130: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/130.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Subdifferentials
subdifferential of F at u: ∂F (u) = v ∈ X ,F (w)− F (u) ≥ 〈w − u, v〉, ∀w ∈ X.v ∈ ∂F (u) is a subgradient of F at u.Three fundamental (and easy) properties:
0 ∈ ∂F (u) iff u global minimizer of Fu∗ ∈ ∂F (u)⇔ F (u) + F∗(u∗) = 〈u, u∗〉Duality: u∗ ∈ ∂F (u)⇔ u ∈ ∂F∗(u)
The duality above allows to transform optimization of homogeneous functions intodomain constraints!
![Page 131: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/131.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Subdifferentials
subdifferential of F at u: ∂F (u) = v ∈ X ,F (w)− F (u) ≥ 〈w − u, v〉, ∀w ∈ X.v ∈ ∂F (u) is a subgradient of F at u.Three fundamental (and easy) properties:
0 ∈ ∂F (u) iff u global minimizer of Fu∗ ∈ ∂F (u)⇔ F (u) + F∗(u∗) = 〈u, u∗〉Duality: u∗ ∈ ∂F (u)⇔ u ∈ ∂F∗(u)
The duality above allows to transform optimization of homogeneous functions intodomain constraints!
![Page 132: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/132.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Subdifferentials
subdifferential of F at u: ∂F (u) = v ∈ X ,F (w)− F (u) ≥ 〈w − u, v〉, ∀w ∈ X.v ∈ ∂F (u) is a subgradient of F at u.Three fundamental (and easy) properties:
0 ∈ ∂F (u) iff u global minimizer of Fu∗ ∈ ∂F (u)⇔ F (u) + F∗(u∗) = 〈u, u∗〉Duality: u∗ ∈ ∂F (u)⇔ u ∈ ∂F∗(u)
The duality above allows to transform optimization of homogeneous functions intodomain constraints!
![Page 133: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/133.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Subdifferentials
subdifferential of F at u: ∂F (u) = v ∈ X ,F (w)− F (u) ≥ 〈w − u, v〉, ∀w ∈ X.v ∈ ∂F (u) is a subgradient of F at u.Three fundamental (and easy) properties:
0 ∈ ∂F (u) iff u global minimizer of Fu∗ ∈ ∂F (u)⇔ F (u) + F∗(u∗) = 〈u, u∗〉Duality: u∗ ∈ ∂F (u)⇔ u ∈ ∂F∗(u)
The duality above allows to transform optimization of homogeneous functions intodomain constraints!
![Page 134: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/134.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Subdifferentials
subdifferential of F at u: ∂F (u) = v ∈ X ,F (w)− F (u) ≥ 〈w − u, v〉, ∀w ∈ X.v ∈ ∂F (u) is a subgradient of F at u.Three fundamental (and easy) properties:
0 ∈ ∂F (u) iff u global minimizer of Fu∗ ∈ ∂F (u)⇔ F (u) + F∗(u∗) = 〈u, u∗〉Duality: u∗ ∈ ∂F (u)⇔ u ∈ ∂F∗(u)
The duality above allows to transform optimization of homogeneous functions intodomain constraints!
![Page 135: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/135.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Subdifferentials
subdifferential of F at u: ∂F (u) = v ∈ X ,F (w)− F (u) ≥ 〈w − u, v〉, ∀w ∈ X.v ∈ ∂F (u) is a subgradient of F at u.Three fundamental (and easy) properties:
0 ∈ ∂F (u) iff u global minimizer of Fu∗ ∈ ∂F (u)⇔ F (u) + F∗(u∗) = 〈u, u∗〉Duality: u∗ ∈ ∂F (u)⇔ u ∈ ∂F∗(u)
The duality above allows to transform optimization of homogeneous functions intodomain constraints!
![Page 136: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/136.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Subdifferentials
subdifferential of F at u: ∂F (u) = v ∈ X ,F (w)− F (u) ≥ 〈w − u, v〉, ∀w ∈ X.v ∈ ∂F (u) is a subgradient of F at u.Three fundamental (and easy) properties:
0 ∈ ∂F (u) iff u global minimizer of Fu∗ ∈ ∂F (u)⇔ F (u) + F∗(u∗) = 〈u, u∗〉Duality: u∗ ∈ ∂F (u)⇔ u ∈ ∂F∗(u)
The duality above allows to transform optimization of homogeneous functions intodomain constraints!
![Page 137: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/137.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
TV-denoising
To minimize:12‖u − u0‖2
L2(Ω+ λJ(u)
optimality condition:
0 ∈ u − u0 + λ∂J(u)⇔u0 − uλ
∈ ∂J(u)
Dualityu0
λ∈
u0 − uλ
+1λ∂J∗(
u0 − uλ
)
Set w =u0−uλ
: w satisfies
0 ∈ w −u0
λ+
1λ∂J∗(w)
This is the subdifferential of the convex function
12‖w − u0/λ‖2 +
1λ
J∗(w)
But J∗(w) = δK (w): we get w = πK (gλ).
![Page 138: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/138.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
TV-denoising
To minimize:12‖u − u0‖2
L2(Ω+ λJ(u)
optimality condition:
0 ∈ u − u0 + λ∂J(u)⇔u0 − uλ
∈ ∂J(u)
Dualityu0
λ∈
u0 − uλ
+1λ∂J∗(
u0 − uλ
)
Set w =u0−uλ
: w satisfies
0 ∈ w −u0
λ+
1λ∂J∗(w)
This is the subdifferential of the convex function
12‖w − u0/λ‖2 +
1λ
J∗(w)
But J∗(w) = δK (w): we get w = πK (gλ).
![Page 139: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/139.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
TV-denoising
To minimize:12‖u − u0‖2
L2(Ω+ λJ(u)
optimality condition:
0 ∈ u − u0 + λ∂J(u)⇔u0 − uλ
∈ ∂J(u)
Dualityu0
λ∈
u0 − uλ
+1λ∂J∗(
u0 − uλ
)
Set w =u0−uλ
: w satisfies
0 ∈ w −u0
λ+
1λ∂J∗(w)
This is the subdifferential of the convex function
12‖w − u0/λ‖2 +
1λ
J∗(w)
But J∗(w) = δK (w): we get w = πK (gλ).
![Page 140: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/140.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
TV-denoising
To minimize:12‖u − u0‖2
L2(Ω+ λJ(u)
optimality condition:
0 ∈ u − u0 + λ∂J(u)⇔u0 − uλ
∈ ∂J(u)
Dualityu0
λ∈
u0 − uλ
+1λ∂J∗(
u0 − uλ
)
Set w =u0−uλ
: w satisfies
0 ∈ w −u0
λ+
1λ∂J∗(w)
This is the subdifferential of the convex function
12‖w − u0/λ‖2 +
1λ
J∗(w)
But J∗(w) = δK (w): we get w = πK (gλ).
![Page 141: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/141.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
TV-denoising
To minimize:12‖u − u0‖2
L2(Ω+ λJ(u)
optimality condition:
0 ∈ u − u0 + λ∂J(u)⇔u0 − uλ
∈ ∂J(u)
Dualityu0
λ∈
u0 − uλ
+1λ∂J∗(
u0 − uλ
)
Set w =u0−uλ
: w satisfies
0 ∈ w −u0
λ+
1λ∂J∗(w)
This is the subdifferential of the convex function
12‖w − u0/λ‖2 +
1λ
J∗(w)
But J∗(w) = δK (w): we get w = πK (gλ).
![Page 142: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/142.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
TV-denoising
To minimize:12‖u − u0‖2
L2(Ω+ λJ(u)
optimality condition:
0 ∈ u − u0 + λ∂J(u)⇔u0 − uλ
∈ ∂J(u)
Dualityu0
λ∈
u0 − uλ
+1λ∂J∗(
u0 − uλ
)
Set w =u0−uλ
: w satisfies
0 ∈ w −u0
λ+
1λ∂J∗(w)
This is the subdifferential of the convex function
12‖w − u0/λ‖2 +
1λ
J∗(w)
But J∗(w) = δK (w): we get w = πK (gλ).
![Page 143: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/143.jpg)
Total Variation
Total Variation II
Using the new definition in denoising: Chambolle algorithm
Example
The usual original Denoised by projection
![Page 144: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/144.jpg)
Total Variation
Total Variation II
Image Simplification
Outline
1 MotivationOrigin and uses of Total VariationDenoisingTikhonov regularization1-D computation on step edges
2 Total Variation IFirst definitionRudin-Osher-FatemiInpainting/Denoising
3 Total Variation IIRelaxing the derivative constraintsDefinition in actionUsing the new definition in denoising: Chambolle algorithmImage Simplification
4 Bibliography
5 The End
![Page 145: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/145.jpg)
Total Variation
Total Variation II
Image Simplification
Camerman Example
Solution of denoising energy present numerically stair-casing effect (Nikolova)
Original
xc
λ = 100 λ = 500
The gradient becomes “sparse”.
![Page 146: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/146.jpg)
Total Variation
Bibliography
Bibliography
Tikhonov, A. N.; Arsenin, V. Y. 1977. Solution of Ill-posed Problems.
Wahba, G, 1990. Spline Models for Observational Data.
Rudin, L.; Osher, S.; Fatemi, E. 1992. Nonlinear Total Variation Based NoiseRemoval Algorithms.
Chambolle, A. 2004. An algorithm for Total Variation Minimization andApplications.
Nikolova, M. 2004. Weakly Constrained Minimization: Application to theEstimation of Images and Signals Involving Constant Regions
![Page 147: Total Variation in Image Analysis (The Homo Erectus Stage?) · In mathematics: the Plateau problem of minimal surfaces, i.e. surfaces of minimal area with a given boundary In image](https://reader033.fdocuments.us/reader033/viewer/2022050105/5f436feaffe699594612957e/html5/thumbnails/147.jpg)
Total Variation
The End
The End