Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE...

26
Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July 2001

Transcript of Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE...

Page 1: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Caustics of Catadioptric Cameras

Rahul Swaminathan,Michael D. Grossberg and Shree K. Nayar

CAVE Lab, Columbia University

ICCV Conference

Vancouver, July 2001

Page 2: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Imaging Systems.

Camera

Page 3: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

All incoming rays of light meet at a point.

Detector

Effective Viewpoint

Camera

Incoming light rays

The Single Viewpoint

Page 4: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Catadioptric Systems: Single Viewpoint.

Only combinations of conic reflectors produce single viewpoint systems.

(Nayar , Baker Peri )

Parashot 360 Acquired image.

Parabolicmirror

Telecentriclens.

Page 5: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

What about such systems?

Page 6: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Non-Single Viewpoint Cameras.

• No single viewpoint. – Locus of Viewpoints formed.

• Can we elegantly describe the geometry of viewpoints?

• Effect of new geometry on imaging characteristics.

• Is there a simple technique to calibrate such systems?

Page 7: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Locus of Viewpoints: Caustics.

Adapted from [ Jensen, 1997 ]

Page 8: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

How is a Caustic formed?

Reflector

Incoming light rays

Caustic

Page 9: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Computing the Caustic.

Reflector

)(tVr

Entry Pupil

)(tVi

Caustic

)(tSr

)()(),( tVrtSrtS rrc

r

At the caustic, there exists a singularity :

0))(( rr VrSJDet

Burkhard & Shealy, 1973

Page 10: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Conic Catadioptrics

(t)

z(t)

)(tVr

)(tVi

Imaging plane

Reflector

d

Op

222 2)1()(

)(

ppttet

ttz

Ellipse : e < 1Parabola : e = 1

Hyperbola : e > 1

Page 11: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Conic Catadioptric Cameras

Imaging plane

Reflector

Op

Reflector

d

Op

Perspective lens based Telecentric lens based

Imaging plane

d

Page 12: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Some Caustics.

Elliptical Reflector : e =.75 , p = 1.0 , d = 0.5

p

d

Pinhole

Reflector

Caustic

Page 13: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Some Caustics.

Parabolic Reflector : e =1.0 , p = 1.0 , d = 1.0

p

d

Pinhole

Reflector

Caustic

Page 14: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Some Caustics.

Elliptical Reflector :

e =.75 , p = 1.0 , d =

Reflector

Caustic

Page 15: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Some Caustics.

Elliptical Reflector :

e =.75 , p = 1.0 , d =

Reflector

Caustic

Page 16: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Caustic surface

Reflector surface

Some Caustics.

Caustic surface

Reflector surface

Lens pinhole

Page 17: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

3D Caustic Surfaces.

Caustic for a parabola, source outside the reflector and along the axis of symmetry.

Caustic surface for a source placed off-axis with respect to the reflector.

All caustics are computed in closed form, then plotted.

Page 18: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

3D Caustic Surfaces.

Caustic for a parabola, source outside the reflector and along the axis of symmetry.

Caustic surface for a source placed off-axis with respect to the reflector.

All caustics are computed in closed form, then plotted.

Page 19: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Deriving Resolution Characteristics.

Reflector

2

22

))()(( tzdCos

rfA

c

c

A

Caustic

S

f

Z

Page 20: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Resolution Characteristics.

(t)

p

z(t)Reflector

O

Page 21: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Resolution Characteristics.

(t)

p

z(t)Reflector

O

Page 22: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Calibration.

Page 23: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Calibration.

Page 24: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Calibration.

Page 25: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Calibration.

Page 26: Caustics of Catadioptric Cameras Rahul Swaminathan, Michael D. Grossberg and Shree K. Nayar CAVE Lab, Columbia University ICCV Conference Vancouver, July.

Caustics formed by the refracting water surface,lead to such exotic light patterns.

Realistic reproduction, requires modeling of caustics

Importance of Caustics to Graphics.