More single view geometry Describes the images of planes, lines,conics and quadrics under...

70
More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties

Transcript of More single view geometry Describes the images of planes, lines,conics and quadrics under...

Page 1: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

More single view geometry

Describes the images of planes, lines,conics and quadrics under perspective projection and their

forward and backward properties

Page 2: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Camera properties

• Images acquired by the cameras with the same centre are related by a plane projective transformation

• Image entities on the plane at infinity, inf , do not depend on camera position, only on camera rotation and internal parameters, K

Page 3: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Camera properties 2

• The image of a point or a line on inf , depend on both K and camera rotation.

• The image of the absolute conic, , depends only on K; it is unaffected by camera rotation and position.

• = ( KKT )-1

Page 4: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Camera properties 2

• defines the angle between the rays back-projected from image points

• Thus camera rotation can be computed from vanishing points independent from camera position.

• In turn, K may be computed from the known angle between rays; in particular, K may be computed from vanishing points corresponding to orthogonal scene directions.

Page 5: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Perspective image of points on a plane

Page 6: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Action of a projective camera on planes

Page 7: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Action of a projective camera on lines

Page 8: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Action of a projective camera on lines

Page 9: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Line projection

Page 10: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Action of a projective camera on conics

Page 11: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Action of a projective camera on conics 2

Page 12: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

On conics

Page 13: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Images of smooth surfaces

Page 14: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Images of smooth surfaces 2

Page 15: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Contour generator and apparent contour: for parallel projection

Page 16: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Contour generator and apparent contour: for central projection

Page 17: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Action of a projective camera on quadrics

• Since intersection and tangency are preserved, the contour generator is a (plane) conic. Thus the apparent contour of a general quadric is a conic, so is the contour generator.

Page 18: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Result 7.8

Page 19: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

On quadrics

Page 20: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Result 7.9

• The cone with vertex V and tangent to the quadric is the degenerate quadric

• QCO = (VT QV) Q – (QV)(QV)T

• Note that QCOV = 0, so that V is the vertex of the cone as assumed.

Page 21: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The cone rays of a quadric

Page 22: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The cone rays with vertex the camera centre

Page 23: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Example 7.10

Page 24: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The importance of the camera centre

Page 25: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The camera centre

Page 26: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Moving image plane

Page 27: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Moving image plane 2

Page 28: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Moving image plane 3

Page 29: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Camera rotation

Page 30: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Example

Page 31: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

(a), (b) camera rotates about camera centre. (c) camera rotates about camera centre and translate

Page 32: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Synthetic views

Page 33: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Synthetic views. (a) Source image(b) Frontal parallel view of corridor floor

Page 34: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Synthetic views. (a) Source image(c) Frontal parallel view of corridor wall

Page 35: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Planar panoramic mosaicing

Page 36: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Three images acquired by a rotating camera may be registered to the frame of

the middle one

Page 37: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Planar panoramic mosaicing 1

Page 38: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Planar panoramic mosaicing 2

Page 39: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Planar panoramic mosaicing 3

Page 40: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Projective (reduced) notation

Page 41: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Moving camera centre

Page 42: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Parallax

• Consider two 3-space points which has coincident images in the first view( points are on the same ray). If the camera centre is moved (not along that ray), the iamge coincident is lost. This relative displacement of image points is termed Parallax.

• An important special case is when all scene points are coplanar. In this case, corresponding image points are related by planar homography even if the camera centre is moved. Vanishing points, which are points on inf are related by planar homography for any camera motion.

Page 43: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Motion parallax

Page 44: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Camera calibration and image of the absolute conic

Page 45: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The angles between two rays

Page 46: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The angle between two rays

Page 47: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Relation between an image line and a scene plane

Page 48: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The image of the absolute conic

Page 49: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The image of the absolute conic 2

Page 50: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The image of the absolute conic 3

Page 51: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The image of the absolute conic 4

Page 52: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The image of the absolute conic 5

Page 53: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Example: A simple calibration device

Page 54: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Calibration from metric planes

100

395.91097.80

525.89.8-1108.3

K

Page 55: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Outline of the calibration algorithm

Page 56: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Orthogonality in the image

Page 57: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Orthogonality in the image 2

Page 58: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Orthogonality represented by pole- polar relationship

Page 59: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Reading the internal parameters K from the calibrated conic

Page 60: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

To construct the line perpendicular to the ray through image point x

Page 61: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Vanishing point formation(a) Plane to line camera

Page 62: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Vanishing point formation:3-space to plane camera

Page 63: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Vanishing line formation(a)

Page 64: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Vanishing line formation (b)

Page 65: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Vanishing points and lines

Page 66: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

Image plane and principal point

Page 67: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The principal point is the orthocentre of an orthongonal triad of vanishing points

in image (a)

Page 68: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The principal point is the orthocentre of the triangle with the vanishing point as the vertices

Page 69: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The calibrating conic computed from the three orthogonal vanishing point

Page 70: More single view geometry Describes the images of planes, lines,conics and quadrics under perspective projection and their forward and backward properties.

The calibrating conic for the image (a)