-Linearities and Multiple View Tensors Class 19 Multiple View Geometry Comp 290-089 Marc Pollefeys.
Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.
-
date post
22-Dec-2015 -
Category
Documents
-
view
227 -
download
1
Transcript of Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.
![Page 1: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/1.jpg)
Projective 2D geometrycourse 2
Multiple View GeometryComp 290-089Marc Pollefeys
![Page 2: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/2.jpg)
Content
• Background: Projective geometry (2D, 3D), Parameter estimation, Algorithm evaluation.
• Single View: Camera model, Calibration, Single View Geometry.
• Two Views: Epipolar Geometry, 3D reconstruction, Computing F, Computing structure, Plane and homographies.
• Three Views: Trifocal Tensor, Computing T.• More Views: N-Linearities, Multiple view
reconstruction, Bundle adjustment, auto-calibration, Dynamic SfM, Cheirality, Duality
![Page 3: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/3.jpg)
Multiple View Geometry course schedule(tentative)
Jan. 7, 9 Intro & motivation Projective 2D Geometry
Jan. 14, 16
(no course) Projective 2D Geometry
Jan. 21, 23
Projective 3D Geometry Parameter Estimation
Jan. 28, 30
Parameter Estimation Algorithm Evaluation
Feb. 4, 6 Camera Models Camera Calibration
Feb. 11, 13
Single View Geometry Epipolar Geometry
Feb. 18, 20
3D reconstruction Fund. Matrix Comp.
Feb. 25, 27
Structure Comp. Planes & Homographies
Mar. 4, 6 Trifocal Tensor Three View Reconstruction
Mar. 18, 20
Multiple View Geometry MultipleView Reconstruction
Mar. 25, 27
Bundle adjustment Papers
Apr. 1, 3 Auto-Calibration Papers
Apr. 8, 10
Dynamic SfM Papers
Apr. 15, 17
Cheirality Papers
Apr. 22, 24
Duality Project Demos
![Page 4: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/4.jpg)
• Points, lines & conics• Transformations & invariants
• 1D projective geometry and the Cross-ratio
Projective 2D Geometry
![Page 5: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/5.jpg)
Homogeneous coordinates
0 cbyax Ta,b,c
0,0)()( kkcykbxka TT a,b,cka,b,c ~
Homogeneous representation of lines
equivalence class of vectors, any vector is representative
Set of all equivalence classes in R3(0,0,0)T forms P2
Homogeneous representation of points
0 cbyax Ta,b,cl Tyx,x on if and only if
0l 11 x,y,a,b,cx,y, T 0,1,,~1,, kyxkyx TT
The point x lies on the line l if and only if xTl=lTx=0
Homogeneous coordinates
Inhomogeneous coordinates Tyx, T321 ,, xxx but only 2DOF
![Page 6: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/6.jpg)
Points from lines and vice-versa
l'lx
Intersections of lines
The intersection of two lines and is l l'
Line joining two points
The line through two points and is x'xl x x'
Example
1x
1y
![Page 7: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/7.jpg)
Ideal points and the line at infinity
T0,,l'l ab
Intersections of parallel lines
TTand ',,l' ,,l cbacba
Example
1x 2x
Ideal points T0,, 21 xx
Line at infinity T1,0,0l
l22 RP
tangent vector
normal direction
ab , ba,
Note that in P2 there is no distinction
between ideal points and others
![Page 8: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/8.jpg)
A model for the projective plane
exactly one line through two points
exaclty one point at intersection of two lines
![Page 9: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/9.jpg)
Duality
x l
0xl T0lx T
l'lx x'xl
Duality principle:
To any theorem of 2-dimensional projective geometry there corresponds a dual theorem, which may be derived by interchanging the role of points and lines in the original theorem
![Page 10: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/10.jpg)
Conics
Curve described by 2nd-degree equation in the plane
022 feydxcybxyax
0233231
2221
21 fxxexxdxcxxbxax
3
2
3
1 , xxyx
xx or homogenized
0xx CT
or in matrix form
fed
ecb
dba
2/2/
2/2/
2/2/
Cwith
fedcba :::::5DOF:
![Page 11: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/11.jpg)
Five points define a conic
For each point the conic passes through
022 feydxcyybxax iiiiii
or
0,,,,, 22 cfyxyyxx iiiiii Tfedcba ,,,,,c
0
1
1
1
1
1
552555
25
442444
24
332333
23
222222
22
112111
21
c
yxyyxx
yxyyxx
yxyyxx
yxyyxx
yxyyxx
stacking constraints yields
![Page 12: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/12.jpg)
Tangent lines to conics
The line l tangent to C at point x on C is given by l=Cx
lx
C
![Page 13: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/13.jpg)
Dual conics
0ll * CTA line tangent to the conic C satisfies
Dual conics = line conics = conic envelopes
1* CCIn general (C full rank):
![Page 14: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/14.jpg)
Degenerate conics
A conic is degenerate if matrix C is not of full rank
TT mllm C
e.g. two lines (rank 2)
e.g. repeated line (rank 1)
TllC
l
l
m
Degenerate line conics: 2 points (rank 2), double point (rank1)
CC **Note that for degenerate conics
![Page 15: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/15.jpg)
Projective transformations
A projectivity is an invertible mapping h from P2 to itself such that three points x1,x2,x3 lie on the same line if and
only if h(x1),h(x2),h(x3) do.
Definition:
A mapping h:P2P2 is a projectivity if and only if there exist a non-singular 3x3 matrix H such that for any point in P2 reprented by a vector x it is true that h(x)=Hx
Theorem:
Definition: Projective transformation
3
2
1
333231
232221
131211
3
2
1
'
'
'
x
x
x
hhh
hhh
hhh
x
x
x
xx' Hor
8DOF
projectivity=collineation=projective transformation=homography
![Page 16: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/16.jpg)
Mapping between planes
central projection may be expressed by x’=Hx(application of theorem)
![Page 17: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/17.jpg)
Removing projective distortion
333231
131211
3
1
'
''
hyhxh
hyhxh
x
xx
333231
232221
3
2
'
''
hyhxh
hyhxh
x
xy
131211333231' hyhxhhyhxhx 232221333231' hyhxhhyhxhy
select four points in a plane with know coordinates
(linear in hij)
(2 constraints/point, 8DOF 4 points needed)
Remark: no calibration at all necessary, better ways to compute (see later)
![Page 18: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/18.jpg)
More examples
![Page 19: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/19.jpg)
Transformation of lines and conics
Transformation for lines
ll' -TH
Transformation for conics-1-TCHHC '
Transformation for dual conicsTHHCC **'
xx' HFor a point transformation
![Page 20: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/20.jpg)
A hierarchy of transformations
Projective linear group Affine group (last row (0,0,1)) Euclidean group (upper left 2x2 orthogonal) Oriented Euclidean group (upper left 2x2 det 1)
Alternative, characterize transformation in terms of elements or quantities that are preserved or invariant
e.g. Euclidean transformations leave distances unchanged
![Page 21: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/21.jpg)
Class I: Isometries(iso=same, metric=measure)
1100
cossin
sincos
1
'
'
y
x
t
t
y
x
y
x
1
11
orientation preserving:orientation reversing:
x0
xx'
1
tT
RHE IRR T
special cases: pure rotation, pure translation
3DOF (1 rotation, 2 translation)
Invariants: length, angle, area
![Page 22: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/22.jpg)
Class II: Similarities(isometry + scale)
1100
cossin
sincos
1
'
'
y
x
tss
tss
y
x
y
x
x0
xx'
1
tT
RH
sS IRR T
also know as equi-form (shape preserving)
metric structure = structure up to similarity (in literature)
4DOF (1 scale, 1 rotation, 2 translation)
Invariants: ratios of length, angle, ratios of areas, parallel lines
![Page 23: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/23.jpg)
Class III: Affine transformations
11001
'
'
2221
1211
y
x
taa
taa
y
x
y
x
x0
xx'
1
tT
AH A
non-isotropic scaling! (2DOF: scale ratio and orientation)
6DOF (2 scale, 2 rotation, 2 translation)
Invariants: parallel lines, ratios of parallel lengths,
ratios of areas
DRRRA
2
1
0
0
D
![Page 24: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/24.jpg)
Class VI: Projective transformations
xv
xx'
vP T
tAH
Action non-homogeneous over the plane
8DOF (2 scale, 2 rotation, 2 translation, 2 line at infinity)
Invariants: cross-ratio of four points on a line
(ratio of ratio)
T21,v vv
![Page 25: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/25.jpg)
Action of affinities and projectivities
on line at infinity
2211
2
1
2
1
0v
xvxvx
xx
x
vAA
T
t
000 2
1
2
1
x
xx
x
vAA
T
t
Line at infinity becomes finite,
allows to observe vanishing points, horizon,
Line at infinity stays at infinity,
but points move along line
![Page 26: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/26.jpg)
Decomposition of projective transformations
vv
sPAS TTTT v
t
v
0
10
0
10
t AIKRHHHH
Ttv RKA s
K 1det Kupper-triangular,decomposition unique (if chosen s>0)
0.10.20.1
0.2242.8707.2
0.1586.0707.1
H
121
010
001
100
020
015.0
100
0.245cos245sin2
0.145sin245cos2
H
Example:
![Page 27: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/27.jpg)
Overview transformations
1002221
1211
y
x
taa
taa
1002221
1211
y
x
tsrsr
tsrsr
333231
232221
131211
hhh
hhh
hhh
1002221
1211
y
x
trr
trr
Projective8dof
Affine6dof
Similarity4dof
Euclidean3dof
Concurrency, collinearity, order of contact (intersection, tangency, inflection, etc.), cross ratio
Parallellism, ratio of areas, ratio of lengths on parallel lines (e.g midpoints), linear combinations of vectors (centroids). The line at infinity l∞
Ratios of lengths, angles.The circular points I,J
lengths, areas.
![Page 28: Projective 2D geometry course 2 Multiple View Geometry Comp 290-089 Marc Pollefeys.](https://reader036.fdocuments.us/reader036/viewer/2022062304/56649d7a5503460f94a5d7ff/html5/thumbnails/28.jpg)
Number of invariants?
The number of functional invariants is equal to, or greater than, the number of degrees of freedom of the configuration less the number of degrees of freedom of the transformation
e.g. configuration of 4 points in general position has 8 dof (2/pt)
and so 4 similarity, 2 affinity and zero projective invariants