CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1)...
Transcript of CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1)...
![Page 1: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/1.jpg)
CS 129 Computational Photography
Instructor: James Hays
TAs: Sam Birch and Emanuel Zgraggen
Some slides from Alexei
Efros and Derek Hoiem
![Page 2: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/2.jpg)
Today
1) Introductions
2) Syllabus
3) Why Computational Photography?
![Page 3: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/3.jpg)
A bit about me
![Page 4: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/4.jpg)
Thesis: Large Scale Scene Matching for Graphics and Vision
![Page 5: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/5.jpg)
My Research
An Empirical Study of Context in Object Detection
![Page 6: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/6.jpg)
Categories of the SUN database
![Page 7: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/7.jpg)
Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,
Annotating, and Recognizing Scene Attributes. Proceedings of CVPR 2012.
![Page 8: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/8.jpg)
Mathias Eitz, James Hays and Marc Alexa. How Do Humans Sketch Objects?
ACM Transactions on Graphics (Proc. SIGGRAPH 2012)
Libin Sun, James Hays. Super-resolution from Internet-scale Scene Matching.
Proceedings of the IEEE Conf. on International Conference on Computational
Photography (ICCP), 2012.
![Page 9: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/9.jpg)
![Page 10: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/10.jpg)
![Page 11: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/11.jpg)
![Page 12: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/12.jpg)
![Page 13: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/13.jpg)
![Page 14: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/14.jpg)
CS 129 TAs
Sam Birch
Emanuel Zgraggen
![Page 15: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/15.jpg)
A Brief History of Visual Media
Why Computational Photography?
![Page 16: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/16.jpg)
Depicting Our World: The Beginning
Prehistoric Painting, Lascaux Cave, France
~ 13,000 -- 15,000 B.C.
![Page 17: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/17.jpg)
The Empress Theodora with her court.
Ravenna, St. Vitale 6th c.
Depicting Our World: Middle Ages
![Page 18: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/18.jpg)
Nuns in Procession. French ms. ca. 1300.
Depicting Our World: Middle Ages
![Page 19: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/19.jpg)
Depicting Our World: Renaissance
East Doors (1452) North Doors (1424) Lorenzo
Ghiberti
(1378-1455)
![Page 20: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/20.jpg)
Depicting Our World: Renaissance
Paolo Uccello,
Miracle of the Profaned Host (c.1467-9)
![Page 21: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/21.jpg)
Depicting Our World: Toward Perfection
Jan van Eyck, The Arnolfini Marriage (c.1434)
![Page 22: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/22.jpg)
Depicting Our World: Toward Perfection
Lens Based Camera Obscura, 1568
![Page 23: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/23.jpg)
Depicting Our World: Perfection!
Still Life, Louis Daguerre, 1837
![Page 24: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/24.jpg)
‘Still photographs are the most powerful
weapon in the world.”
Eddie Adams, Pulitzer Prize winning
photographer.
![Page 25: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/25.jpg)
Earth from ISS
![Page 26: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/26.jpg)
Pale Blue Dot
… Look again at that dot. That's here,
that's home, that's us. On it everyone you
love, everyone you know, everyone you
ever heard of, every human being who
ever was, lived out their lives. The
aggregate of our joy and suffering,
thousands of confident religions,
ideologies, and economic doctrines,
every hunter and forager, every hero and
coward, every creator and destroyer of
civilization, every king and peasant, every
young couple in love, every mother and
father, hopeful child, inventor and
explorer, every teacher of morals, every
corrupt politician, every "superstar," every
"supreme leader," every saint and sinner
in the history of our species lived there –
on a mote of dust suspended in a
sunbeam. …
Carl Sagan
![Page 27: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/27.jpg)
Depicting Our World: Ongoing Quest
Pablo Picasso David Hockney
![Page 28: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/28.jpg)
Enter Computer Graphics...
![Page 29: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/29.jpg)
Traditional Computer Graphics
3D geometry
physics
Simulation
projection
![Page 30: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/30.jpg)
State of the Art (10 years ago)
•Amazingly real
•But so sterile, lifeless, futuristic (why?)
![Page 31: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/31.jpg)
The richness of our everyday world
Photo by Svetlana Lazebnik
![Page 32: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/32.jpg)
Which parts are hard to model?
Photo by Svetlana Lazebnik
![Page 33: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/33.jpg)
People
From “Final Fantasy”
On the Tube, London
![Page 34: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/34.jpg)
Faces / Hair
Photo by Joaquin Rosales Gomez
From “Final Fantasy”
![Page 35: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/35.jpg)
![Page 36: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/36.jpg)
Creating Realistic Imagery
+ great creative possibilities
+ easy to manipulate
objects/viewpoint
-Tremendous expertise and
work for realism
+ instantly realistic
+ easy to aquire
- very hard to manipulate
objects/viewpoint
Computer Graphics Photography Computational
Photography
Realism
Manipulation
Ease of capture
![Page 37: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/37.jpg)
Computational Photography
How can I use computational techniques to capture light in new ways?
How can I use computational techniques to breathe new life into the photograph?
How can I use computational techniques to synthesize and organize photo collections?
![Page 38: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/38.jpg)
Comp Photo and Related Fields
• Computer Graphics: Models to Images
• Comp. Photography: Images to Images
• Computer Vision: Images to Models
![Page 39: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/39.jpg)
Building Rome in a Day
Sameer Agarwal, University of Washington
Yasutaka Furukawa, University of Washington
Noah Snavely, Cornell University
Ian Simon, University of Washington
Steve Seitz, University of Washington
Richard Szeliski, Microsoft Research
![Page 40: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/40.jpg)
Patchmatch
![Page 41: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/41.jpg)
Course objectives
1. You will have new abilities for visual creation.
Graphic by James Hays
![Page 42: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/42.jpg)
Course objectives
2. You will get a foundation in computer vision.
Safety Health Security
Comfort Access Fun
![Page 43: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/43.jpg)
Course objectives
3. You’ll better appreciate your own visual ability.
Is that a queen or a
bishop?
![Page 44: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/44.jpg)
Course objectives
4. You’ll have fun doing cool stuff!
![Page 45: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/45.jpg)
Project 1: Image alignment to Colorize the Prokudin-Gorskii photo collection
![Page 46: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/46.jpg)
Project 2: Poisson Blending
![Page 47: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/47.jpg)
Project 2: Poisson Blending
By Evan Wallace
![Page 48: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/48.jpg)
Project 3: Image Retargeting with Seam Carving
• Movie
![Page 49: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/49.jpg)
Project 4: Texture Synthesis and Transfer with Image Quilting
![Page 50: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/50.jpg)
Project 5: High Dynamic Range Imaging
![Page 51: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/51.jpg)
Project 6: Automatic Panorama Construction
![Page 52: CS 129 Computational PhotographySome slides from Alexei Efros and Derek Hoiem . Today 1) Introductions 2) Syllabus ... Genevieve Patterson, James Hays. SUN Attribute Database: Discovering,](https://reader034.fdocuments.us/reader034/viewer/2022042101/5e7e0440b900b243fa444899/html5/thumbnails/52.jpg)
Final Project: your choice