Microsoft Photosynth
-
Upload
sayem-mohammad-siam -
Category
Documents
-
view
224 -
download
0
description
Transcript of Microsoft Photosynth
![Page 1: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/1.jpg)
Photosynthby Microsoft Live Labs
C@CM PresentationTeam Members
Greg YoonSaki KoizumiMike PenrodHui Han ChinSoojin Yoon
![Page 2: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/2.jpg)
Introduction
• Photosynth is an entirely new visual medium developed by Microsoft Live Labs.
![Page 3: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/3.jpg)
Introduction
• It analyzes a set of photos of a place to discover similarities between the photos and uses that data to estimate where a photo was taken and build a model of the subject.
![Page 4: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/4.jpg)
Introduction
• It then re-creates the environment and uses that as a canvas on which to display the photos.
![Page 5: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/5.jpg)
History of Photosynth
• 2006: Microsoft acquired small, Seattle-area startup Seadragon
![Page 6: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/6.jpg)
History of Photosynth
• Seadragon’s was capable of delivering a smooth experience browsing massive quantities of visual information over the Internet
![Page 7: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/7.jpg)
History of Photosynth
• 2006: Groundbreaking research of Noah Snavely (UW), Steve Seitz (UW), and Richard Szeliski (Microsoft Research), developed a prototype called ‘photo tourism’, which form the basis of the synther in photosynth
![Page 8: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/8.jpg)
History of Photosynth
![Page 9: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/9.jpg)
History of Photosynth• November 9, 2006 : Microsoft released a free
tech preview version• August 6-20, 2007 : Microsoft teamed up with
NASA on allowing users to preview its Photosynth technology showing the Space Shuttle Endeavour.
![Page 10: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/10.jpg)
History of Photosynth
• August 20, 2008, Microsoft officially released Photosynth to the public, allowing users to upload their images and generate their own Photosynth models.
![Page 11: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/11.jpg)
Key Technology
• Feature Tracking• 3D Transformation • Geo Registration
![Page 12: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/12.jpg)
How do humans compare?
![Page 13: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/13.jpg)
Feature Tracking
• Algorithm of Choice: • Scale-space Invariant Feature Transform by
David G Lowe, (2000)• Most stable to affine transformation• Uses Difference of Gaussians to find extrema
across scale spaces as interest points
![Page 14: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/14.jpg)
Feature Tracking
![Page 15: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/15.jpg)
Feature Tracking
• Discover correspondence between pictures
![Page 16: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/16.jpg)
3D Transformation
• Uses the Direct Linear Transformation Algorithm, Richard Hartley and Andrew Zisserman (2000)
![Page 17: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/17.jpg)
Find the matrix H that describe the perspective transformation
![Page 18: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/18.jpg)
3D Transformation – Scary math
![Page 19: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/19.jpg)
Geo Registration
• Aligns the estimated position of the pictures with a GPS map of the location
![Page 20: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/20.jpg)
Capabilities of photosynth
• Walk or fly through a scene to see photos from any angle
• Zoom in or out of a photo• See where pictures were taken in relation to one
another• Smoothly change viewing angle between nearby photos• Smoothly zoom in and out of high-resolution photos• Find similar photos to the one you're currently viewing• Send pictures
![Page 21: Microsoft Photosynth](https://reader030.fdocuments.us/reader030/viewer/2022033101/55cf925c550346f57b95d5fa/html5/thumbnails/21.jpg)
Demonstration
• http://photosynth.net/Default.aspx