Fourier optics - graphics.cs.cmu.edu

72
Fourier optics 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 24 http://graphics.cs.cmu.edu/courses/15-463

Transcript of Fourier optics - graphics.cs.cmu.edu

Page 1: Fourier optics - graphics.cs.cmu.edu

Fourier optics

15-463, 15-663, 15-862Computational Photography

Fall 2018, Lecture 24http://graphics.cs.cmu.edu/courses/15-463

Page 2: Fourier optics - graphics.cs.cmu.edu

Course announcements

• Any questions about homework 6?

• If you haven’t already, please sign up for project checkpoint meetings.

Page 3: Fourier optics - graphics.cs.cmu.edu

Overview of today’s lecture

• The scalar wave equation.

• Basic waves and coherence.

• The plane wave spectrum.

• Fraunhofer diffraction and transmission.

• Fresnel lenses.

• Fraunhofer diffraction and reflection.

Page 4: Fourier optics - graphics.cs.cmu.edu

Slide credits

Some of these slides were directly adapted from:

• Anat Levin (Technion).

Page 5: Fourier optics - graphics.cs.cmu.edu

Scalar wave equation

Page 6: Fourier optics - graphics.cs.cmu.edu

Simplifying the EM equations

𝛻2 −1

𝑐2𝜕2

𝜕𝑡2𝑢 𝑟, 𝑡 = 0

Scalar wave equation:

• Homogeneous and source-free medium

• No polarization

speed of light in medium

Page 7: Fourier optics - graphics.cs.cmu.edu

Simplifying the EM equations

Helmholtz equation:

• Either assume perfectly monochromatic light at wavelength λ

• Or assume different wavelengths independent of each other

what is this?

𝛻2 + 𝑘2 ψ 𝑟 = 0

𝑢 𝑟, 𝑡 = 𝑅𝑒 ψ 𝑟 𝑒−𝑗

2𝜋𝑐𝜆

𝑡

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

Page 8: Fourier optics - graphics.cs.cmu.edu

Simplifying the EM equations

Helmholtz equation:

• Either assume perfectly monochromatic light at wavelength λ

• Or assume different wavelengths independent of each other

what is this?

𝛻2 + 𝑘2 ψ 𝑟 = 0

𝑢 𝑟, 𝑡 = 𝑅𝑒 ψ 𝑟 𝑒−𝑗

2𝜋𝑐𝜆

𝑡

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

Wave is a sinusoid at frequency 2𝜋/𝜆:

Page 9: Fourier optics - graphics.cs.cmu.edu

Simplifying the EM equations

Helmholtz equation:

• Either assume perfectly monochromatic light at wavelength λ

• Or assume different wavelengths independent of each other

𝛻2 + 𝑘2 ψ 𝑟 = 0

𝑢 𝑟, 𝑡 = 𝑅𝑒 ψ 𝑟 𝑒−𝑗

2𝜋𝑐𝜆

𝑡

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

Wave is a sinusoid at frequency 2𝜋/𝜆:

At every point, wave has amplitude A(r) and phase 𝜑(r):

Page 10: Fourier optics - graphics.cs.cmu.edu

Simplifying the EM equations

𝛻2 + 𝑘2 ψ 𝑟 = 0

Helmholtz equation:

• Either assume perfectly monochromatic light at wavelength λ

• Or assume different wavelengths independent of each other

𝑢 𝑟, 𝑡 = 𝑅𝑒 ψ 𝑟 𝑒−𝑗

2𝜋𝑐𝜆

𝑡

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

Wave is a sinusoid at frequency 2𝜋/𝜆:

At every point, wave has amplitude A(r) and phase 𝜑(r):

This is how we will describe waves for the rest of lecture

Page 11: Fourier optics - graphics.cs.cmu.edu

Basic waves and coherence

Page 12: Fourier optics - graphics.cs.cmu.edu

Visualizing a waveWavefront: A set of points that have the same phase

• Points on the wavefront have “travelled” the same distance from wave source

• Gives us “shape” of the wave

𝜑(r)=c1

𝜑(r)=c2

𝜑(r)=c3

𝜑(r)=c4

𝜑(r)=c5

𝜑(r)=c6

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

At every point, wave has amplitude A(r) and phase 𝜑(r):

Page 13: Fourier optics - graphics.cs.cmu.edu

Visualizing a waveWavefront: A set of points that have the same phase

• Points on the wavefront have “travelled” the same distance from wave source

• Gives us “shape” of the wave

𝜑(r)=c1

𝜑(r)=c2

𝜑(r)=c3

𝜑(r)=c4

𝜑(r)=c5

𝜑(r)=c6Roughly speaking, in ray optics we replace waves with “rays” that are always normal to wavefront

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

At every point, wave has amplitude A(r) and phase 𝜑(r):

Page 14: Fourier optics - graphics.cs.cmu.edu

Two important waves

Spherical wave Plane wave

How can you create a spherical wave?

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

At every point, wave has amplitude A(r) and phase 𝜑(r):

Page 15: Fourier optics - graphics.cs.cmu.edu

Creating a spherical wave using pinholes

• Any problems with this procedure?

• Do you know of any alternatives?

Page 16: Fourier optics - graphics.cs.cmu.edu

Creating a spherical wave using lasers

• Lasers are high-power “point” sources

• Standard lasers are also monochromatic (temporally coherent)

Page 17: Fourier optics - graphics.cs.cmu.edu

Two important waves

Spherical wave Plane wave

How can you create a plane wave?

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

At every point, wave has amplitude A(r) and phase 𝜑(r):

Page 18: Fourier optics - graphics.cs.cmu.edu

Creating plane waves1. Use a thin lens:

Page 19: Fourier optics - graphics.cs.cmu.edu

Creating plane waves1. Use a thin lens:

2. Let a spherical wave propagate a very long distance:

• This is often called the “far-field” assumption.

… …

Page 20: Fourier optics - graphics.cs.cmu.edu

Two important waves

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

At every point, wave has amplitude A(r) and phase 𝜑(r):

Spherical wave Plane wave

What is the equation of a plane wave?

Page 21: Fourier optics - graphics.cs.cmu.edu

The plane wave spectrum

Page 22: Fourier optics - graphics.cs.cmu.edu

Plane wave equation

direction of travel

nlocation

r

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

At every point, wave has amplitude A(r) and phase 𝜑(r):

Page 23: Fourier optics - graphics.cs.cmu.edu

Plane wave equation

direction of travel

nlocation

r

ψ𝑝,𝑘 𝑟 = 𝑒𝑗𝑘⋅𝑟

Plane wave equation:

𝑘 =2𝜋𝑐

𝜆𝑛

Wave vector:

does this remind you of something?

Page 24: Fourier optics - graphics.cs.cmu.edu

Plane wave spectrum

Every wave can be written as the weighted superposition of planar waves at different directions

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

How are these weights determined?

ψ 𝑟 = න

𝑘

Ψ 𝑘 ψ𝑝,𝑘 𝑟 𝑑𝑘

ψ 𝑟 = න

𝑘

Ψ 𝑘 𝑒𝑗𝑘⋅𝑟𝑑𝑘

Page 25: Fourier optics - graphics.cs.cmu.edu

Plane wave spectrum

Every wave can be written as the weighted superposition of planar waves at different directions

ψ 𝑟 = න

𝑘

Ψ 𝑘 ψ𝑝,𝑘 𝑟 𝑑𝑘

ψ 𝑟 = 𝐴 𝑟 𝑒𝑗𝜑 𝑟

ψ 𝑟 = න

𝑘

Ψ 𝑘 𝑒𝑗𝑘⋅𝑟𝑑𝑘

Ψ 𝑘 = Fourier ψ 𝑟This is the wave’s

plane wave spectrum

Page 26: Fourier optics - graphics.cs.cmu.edu

Fraunhofer diffraction and transmission

Page 27: Fourier optics - graphics.cs.cmu.edu

Fraunhofer diffractionWave-optics model for transmission through apertures

• Far-field assumption: Light is coming from and measured

planar wavefront

aperture

diffracted wavefront

x

z

Page 28: Fourier optics - graphics.cs.cmu.edu

Fraunhofer diffractionWave-optics model for transmission through apertures

• Far-field assumption: Light is coming from and measured

planar wavefront

aperture

diffracted wavefront

x

z

• transmission function:

p(r) = A(r) ⋅ exp( j ⋅ Φ(r) )

amplitude modulation

phase modulation

Page 29: Fourier optics - graphics.cs.cmu.edu

Fraunhofer diffractionWave-optics model for transmission through apertures

• Far-field assumption: Light is coming from and measured

planar wavefront

aperture

diffracted wavefront

x

z

• transmission function:

p(r) = A(r) ⋅ exp( j ⋅ Φ(r) )

amplitude modulation

phase modulation

• transfer function:

P(k) = Fourier{p(r)}

Page 30: Fourier optics - graphics.cs.cmu.edu

Fraunhofer diffractionWave-optics model for transmission through apertures

• Far-field assumption: Light is coming from and measured

planar wavefront

aperture

diffracted wavefront

x

z

• transmission function:

p(r) = A(r) ⋅ exp( j ⋅ Φ(r) )

amplitude modulation

phase modulation

• transfer function:

P(k) = Fourier{p(r)}

• plane spectrum of outgoing wave:

Ψout(k) = P(k) ⋅ Ψin(k)

Page 31: Fourier optics - graphics.cs.cmu.edu

Fraunhofer diffractionWave-optics model for transmission through apertures

• Far-field assumption: Light is coming from and measured

planar wavefront

aperture

diffracted wavefront

x

z

• transmission function:

p(r) = A(r) ⋅ exp( j ⋅ Φ(r) )

amplitude modulation

phase modulation

• transfer function:

P(k) = Fourier{p(r)}

• plane spectrum of outgoing wave:

Ψout(k) = P(k) ⋅ Ψin(k)

• outgoing wave:

ψout(r) = Fourier-1{ Ψout(k) }

Page 32: Fourier optics - graphics.cs.cmu.edu

Example: pinhole

planar wavefront

aperture

x

z

What is the transmission function?

width W

Page 33: Fourier optics - graphics.cs.cmu.edu

Example: pinhole

planar wavefront

aperture

x

z

What is the transmission function?

width W

What is the transfer function?

p(r) = rect(W ⋅ r)

Page 34: Fourier optics - graphics.cs.cmu.edu

Example: pinhole

planar wavefront

aperture

x

z

What is the transmission function?

width W

What is the transfer function?

P(k) = sinc(k / W)

p(r) = rect(W ⋅ r)

Page 35: Fourier optics - graphics.cs.cmu.edu

Example: pinhole

planar wavefront

aperture

x

z

p(r) = rect(W ⋅ r)

What is the transmission function?

What is the transfer function?

P(k) = sinc(k / W)

Page 36: Fourier optics - graphics.cs.cmu.edu

Example: pinhole

Why does the diffraction pattern become wider as we increase width?

small pinhole

wide diffraction

pattern

narrow diffraction

pattern

large pinhole

Page 37: Fourier optics - graphics.cs.cmu.edu

Remember: 2D Fourier transform

circular aperture (Airy disk)

rectangular aperture

Page 38: Fourier optics - graphics.cs.cmu.edu

Fresnel lenses

Page 39: Fourier optics - graphics.cs.cmu.edu

Thin lenses

What is the transmission function of a thin lens?

Page 40: Fourier optics - graphics.cs.cmu.edu

Thin lenses

Complicated expression, but phase-only: p(r) = exp( j ⋅ Φ(r) )

What is the transmission function of a thin lens?

• Delay all plane waves so that they have the same phase at focal point

Page 41: Fourier optics - graphics.cs.cmu.edu

Thin lenses

Complicated expression, but phase-only: p(r) = exp( j ⋅ Φ(r) )

What is the transmission function of a thin lens?

• Delay all plane waves so that they have the same phase at focal point

• The aperture of a real lens creates additional diffraction

Page 42: Fourier optics - graphics.cs.cmu.edu

Diffraction in lenses

Page 43: Fourier optics - graphics.cs.cmu.edu

Chromatic aberration

glass has dispersion (refractive index changes

with wavelength)

focal length shifts with wavelength

glasses of different refractive index

one lens cancels out dispersion of other

How does Fraunhofer diffraction explain chromatic aberration?

Page 44: Fourier optics - graphics.cs.cmu.edu

Chromatic aberration

glass has dispersion (refractive index changes

with wavelength)

focal length shifts with wavelength

glasses of different refractive index

one lens cancels out dispersion of other

How does Fraunhofer diffraction explain chromatic aberration?

𝑘 =2𝜋𝑐

𝜆𝑛

Ψ 𝑘 = Fourier ψ 𝑟

𝑃 𝑘 = Fourier 𝑝 𝑟• All our Fourier transforms are wavelength-dependent

Page 45: Fourier optics - graphics.cs.cmu.edu

Good “thin” lenses are compound lenses

dreaded camera bulge

Page 46: Fourier optics - graphics.cs.cmu.edu

A small demonstrationhyperspectral camera

depth-of-field target

wavelength

depth

wavelength

depth

standard lens apochromatic lens

Page 47: Fourier optics - graphics.cs.cmu.edu

Fresnel lensesalso called diffractive lenses

• operation based on diffraction

• width stays roughly constant with aperture size

• width scales roughly linearly with aperture size

Page 48: Fourier optics - graphics.cs.cmu.edu

Fresnel lensessolar grill

Page 49: Fourier optics - graphics.cs.cmu.edu

Fresnel lens

planar wavefront

aperture

diffracted wavefront

x

z

A(r) = const, Φ(r) = c(λ) ⋅ h(r)

sub-micron height function

h(r)

• transmission function:

p(r) = A(r) ⋅ exp( j ⋅ Φ(r) )

Like a standard lens:

• Phase-only modulation.

• Delay all plane waves so that they have the same phase at focal point.

Page 50: Fourier optics - graphics.cs.cmu.edu

Fresnel lens

planar wavefront

aperture

diffracted wavefront

x

z

A(r) = const, Φ(r) = c(λ) ⋅ h(r)

sub-micron height function

h(r)

• transmission function:

p(r) = A(r) ⋅ exp( j ⋅ Φ(r) )

Like a standard lens:

• Phase-only modulation.

• Delay all plane waves so that they have the same phase at focal point.

Page 51: Fourier optics - graphics.cs.cmu.edu

Fresnel lensesalso called diffractive lenses

• width stays roughly constant with aperture size

• width scales roughly linearly with aperture size

very thin

very dispersing

Page 52: Fourier optics - graphics.cs.cmu.edu

Diffractive achromat

conventional approach:

• multiple layers canceling out each other’s aberration

• same principle as achromatic compound lens

bulky design (thick and heavy)

Page 53: Fourier optics - graphics.cs.cmu.edu

Diffractive achromat

conventional approach:

• multiple layers canceling out each other’s aberration

• same principle as achromatic compound lens

bulky design (thick and heavy)

computational imaging approach:

• design single layer that has aberration that can be easily undone computationally

• possible because Fresnel lenses offer a lot more design flexibility (arbitrary height function)

Page 54: Fourier optics - graphics.cs.cmu.edu

Diffractive achromat

regular Fresnel lens

achromatic Fresnel lens

sharp PSF at center

wavelength

blurry but same PSF at all

wavelengths

• Instead of making one wavelength sharp, make all of them equally blurred

• Fix aberration using non-blind deconvolution with same kernel for all wavelengths

Page 55: Fourier optics - graphics.cs.cmu.edu

Diffractive achromat

Page 56: Fourier optics - graphics.cs.cmu.edu

Fraunhofer diffraction and reflection

Page 57: Fourier optics - graphics.cs.cmu.edu

Bidirectional Reflectance Distribution Function (BRDF)

pi

Ri

ωi

Ro

ωo

poh

z

x

s = (x, h(x))

Page 58: Fourier optics - graphics.cs.cmu.edu

pi

Ri

ωi

Ro

ωo

po

Setting

z

x

s = (x, h(x))

Huygen’s principle

h

coherent illumination

Page 59: Fourier optics - graphics.cs.cmu.edu

Huygen’s principle

Under far-field approximation, it’s equivalent to Fraunhofer diffraction

Page 60: Fourier optics - graphics.cs.cmu.edu

Far-field setting

z

x

s = (x, h(x))

pi

Ri

ωi

Ro

ωo

poh

Φ(r) = c(λ) ⋅ h(r)reflection function: p(r) = Ao ⋅ exp( j ⋅ Φ(r) ),

Page 61: Fourier optics - graphics.cs.cmu.edu

Far-field setting

z

x

s = (x, h(x))

pi

Ri

ωi

Ro

ωo

poh

Φ(r) = c(λ) ⋅ h(r)reflection function: p(r) = Ao ⋅ exp( j ⋅ Φ(r) ),

Page 62: Fourier optics - graphics.cs.cmu.edu

Photolithography

20mm

x

z𝒂𝟏 𝒂𝟐 𝒂𝟑 𝒂𝟒 𝒂𝟓

𝒛𝟏 𝒛𝟐𝒛𝟑 𝒛𝟓𝒛𝟒

Page 63: Fourier optics - graphics.cs.cmu.edu

Inverse width relationship

x

Wide surfacefeatures

Narrow (shiny) reflectance

Page 64: Fourier optics - graphics.cs.cmu.edu

Inverse width relationship

x

Wide (diffuse) reflectance

Narrow surfacefeatures

Page 65: Fourier optics - graphics.cs.cmu.edu

x

impulse (mirror) reflectance

Flat surface

Inverse width relationship

Page 66: Fourier optics - graphics.cs.cmu.edu

Diffractive BRDF renderings

close-up of CD surface

rendering

Page 67: Fourier optics - graphics.cs.cmu.edu

Setting

z

x

s = (x, h(x))

pi

Ri

ωi

Ro

ωo

poh

(spatially) incoherent illumination

Page 68: Fourier optics - graphics.cs.cmu.edu

Δa

Far-field setting

z

x

s = (x, h(x))

Ri

ωi

Ro

ωo

h

Page 69: Fourier optics - graphics.cs.cmu.edu

Speckles

x

Noisy reflectance from an inexact surface

Page 70: Fourier optics - graphics.cs.cmu.edu

Reflectance averaged over illumination angleis smooth

x

70Incoherent reflectance: blurring coherent reflectance by source angle

Page 71: Fourier optics - graphics.cs.cmu.edu
Page 72: Fourier optics - graphics.cs.cmu.edu

References

Basic reading:• Goodman, “Introduction to Fourier Optics,” W. H. Freeman 2004.

This comprehensive textbook is the standard reference when it comes to Fourier optics.• Peng et al., “The Diffractive Achromat: Full Spectrum Computational Imaging with Diffractive Optics,”

SIGGRAPH 2016.This paper discusses Fresnel lenses and how to use computational imaging to deal with chromatic aberration.

• Stam, “Diffractive shaders,” SIGGRAPH 1999.• Levin et al., “Fabricating BRDFs at high spatial resolution using wave optics,” SIGGRAPH 2013

These two papers discuss Fraunhofer diffraction for the reflective case.

Additional reading:• Glasner et al., “A Reflectance Display,” SIGGRAPH 2014.• Ye et al., “Toward BxDF Display using Multilayer Diffraction,” SIGGRAPH Asia 2014.• Levin et al., “Passive light and viewpoint sensitive display of 3D content,” ICCP 2016.

These three papers discuss how to use diffraction to build passive reactive displays.• Damberg et al., “High Brightness HDR Projection Using Dynamic Freeform Lensing,” TOG 2016

This paper discusses how to use diffraction to create lenses of arbitrary focusing patterns.• Zhang and Levoy, “Wigner Distributions and How They Relate to the Light Field”, ICCP 2009.• Cuypers et al., “Reflectance Model for Diffraction”, TOG 2012.

These two papers discuss the relationship between Fourier optics, ray optics and lightfields, and the Wigner transformation.