SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)
-
Upload
matthewotoole -
Category
Education
-
view
644 -
download
6
description
Transcript of SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)
![Page 1: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/1.jpg)
Gordon Wetzsteinhttp://web.media.mit.edu/~gordonw
MIT Media Lab / Stanford University
Computational Cameras and Displays
Matthew O’Toolewww.dgp.toronto.edu/~motoole
University of Toronto
www.dgp.toronto.edu/~motoole/computationalcamerasanddisplays.html
![Page 2: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/2.jpg)
evolution of digital imaging2000 20142002 2004 2006 2008 2010 2012
![Page 3: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/3.jpg)
evolution of digital imaging2000 20142002 2004 2006 2008 2010 2012
Canon EOS D303.1 megapixels
![Page 4: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/4.jpg)
evolution of digital imaging2000 20142002 2004 2006 2008 2010 2012
Canon EOS D303.1 megapixels
EOS 10D6.3 MPs
EOS D606.3 MPs
EOS 20D8.2 MPs
EOS 30D8.2 MPs
EOS 40D10.1 MPs
EOS 50D15.1 MPs
EOS 60D17.9 MPs
Canon EOS 70D20.2 megapixels
reso
lutio
n(m
egap
ixel
s)
2000 2014
![Page 5: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/5.jpg)
evolution of digital imaging2000 20142002 2004 2006 2008 2010 2012
Canon EOS D303.1 megapixels
EOS 10D6.3 MPs
EOS D606.3 MPs
EOS 20D8.2 MPs
EOS 30D8.2 MPs
EOS 40D10.1 MPs
EOS 50D15.1 MPs
EOS 60D17.9 MPs
Canon EOS 70D20.2 megapixels
reso
lutio
n(m
egap
ixel
s)qu
antu
m
effici
ency
(%)
2000 2014
2000 2014
measurements by DxOMark.com
![Page 6: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/6.jpg)
evolution of digital imaging2000 20142002 2004 2006 2008 2010 2012
Canon EOS D303.1 megapixels
EOS 10D6.3 MPs
EOS D606.3 MPs
EOS 20D8.2 MPs
EOS 30D8.2 MPs
EOS 40D10.1 MPs
EOS 50D15.1 MPs
EOS 60D17.9 MPs
Canon EOS 70D20.2 megapixels
reso
lutio
n(m
egap
ixel
s)qu
antu
m
effici
ency
(%)
2000 2014
2000 2014
measurements by DxOMark.com
nearing end of the megapixel race for cameras and displays…
![Page 7: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/7.jpg)
evolution of digital imaging
“Retina” display: pixels imperceptible to the eye
nearing end of the megapixel race for cameras and displays
2000 20142002 2004 2006 2008 2010 2012
Canon EOS D303.1 megapixels
EOS 10D6.3 MPs
EOS D606.3 MPs
EOS 20D8.2 MPs
EOS 30D8.2 MPs
EOS 40D10.1 MPs
EOS 50D15.1 MPs
EOS 60D17.9 MPs
Canon EOS 70D20.2 megapixels
![Page 8: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/8.jpg)
evolution of digital imaging
“Retina” display: pixels imperceptible to the eye
nearing end of the megapixel race for cameras and displays
2000 20142002 2004 2006 2008 2010 2012
Canon EOS D303.1 megapixels
EOS 10D6.3 MPs
EOS D606.3 MPs
EOS 20D8.2 MPs
EOS 30D8.2 MPs
EOS 40D10.1 MPs
EOS 50D15.1 MPs
EOS 60D17.9 MPs
Canon EOS 70D20.2 megapixels
compressive displays[Lanman et al. 2011]light field imaging [Ng et al. 05]
![Page 9: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/9.jpg)
cameras and displays revolutionca
mer
as
LytroPelican Imaging
[Venkataraman et al. SIG Asia 2013]Raytrix
![Page 10: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/10.jpg)
cameras and displays revolution
Nintendo 3DSGoogle Glass
disp
lays
cam
eras
LytroPelican Imaging
[Venkataraman et al. SIG Asia 2013]Raytrix
![Page 11: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/11.jpg)
cameras and displays revolution
Microsoft Kinect for Xbox OneLeap Motion
Nintendo 3DSGoogle Glass
disp
lays
light
tr
ansp
ort
cam
eras
LytroPelican Imaging
[Venkataraman et al. SIG Asia 2013]Raytrix
![Page 12: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/12.jpg)
cameras and displays revolution
Microsoft Kinect for Xbox OneLeap Motion
Nintendo 3DSGoogle Glass
disp
lays
light
tr
ansp
ort
use computation to reform digital imaging (display, capture, …)
cam
eras
LytroPelican Imaging
[Venkataraman et al. SIG Asia 2013]Raytrix
![Page 13: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/13.jpg)
three domains of computation
computational cameras
![Page 14: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/14.jpg)
three domains of computation
computational cameras
computational displays
![Page 15: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/15.jpg)
three domains of computation
computational cameras
computational displays
physicalworld
computational light transport
![Page 16: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/16.jpg)
speakers
Gordon Wetzstein
• assistant professor at Stanford University (EE)• received an award for his dissertation titled
“Computational Plenoptic Image Acquisition and Display”
• spent last 3 years as a Postdoc at MIT Media Lab’s camera culture group
![Page 17: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/17.jpg)
speakers
Matthew O’Toole
Gordon Wetzstein
• Ph.D. student at the University of Toronto supervised by Kyros Kutulakos
• focus on light transport analysis
• assistant professor at Stanford University (EE)• received an award for his dissertation titled
“Computational Plenoptic Image Acquisition and Display”
• spent last 3 years as a Postdoc at MIT Media Lab’s camera culture group
![Page 18: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/18.jpg)
overview
10 min | computational cameras (Wetzstein)
![Page 19: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/19.jpg)
overview
30 min | computational displays (Wetzstein)
10 min | computational cameras (Wetzstein)
![Page 20: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/20.jpg)
overview
35 min | computational light transport (O’Toole)
30 min | computational displays (Wetzstein)
10 min | computational cameras (Wetzstein)
![Page 21: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/21.jpg)
overview
35 min | computational light transport (O’Toole)
30 min | computational displays (Wetzstein)
10 min | computational cameras (Wetzstein)
10 min | summary and Q&A (both)
![Page 22: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/22.jpg)
takeaways from the course
• review current research topics and recent work in computational sensing and displays
• introduce core concepts, including plenoptic cameras, compressive displays and transport matrices
• provide a sense as to possible directions for future research
![Page 23: SIGGRAPH 2014 Course on Computational Cameras and Displays (part 1)](https://reader037.fdocuments.us/reader037/viewer/2022103014/548020e0b4af9fd9218b4636/html5/thumbnails/23.jpg)
Computational CamerasPart 1: