Panorama Creation by Image stitching
description
Transcript of Panorama Creation by Image stitching
![Page 1: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/1.jpg)
Panorama Creation by Image stitching
Ms. Sophea CHAN
December 20, 2010
![Page 2: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/2.jpg)
Sophea Chan Page 2 / 17
Theory Compositing Surface
Image stitching processResulting
References
Over ViewTheory
Idea
Compositing SurfaceReference Image
Image stitching processImage RegistrationOverlapped AreaBlending
ResultingReferences
12/13/2010
![Page 3: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/3.jpg)
Sophea Chan Page 3 / 17
TheoryCompositing Surface
Image stitching processResulting
References
Idea:Choose 2 images I1(n1xm1), I2(n2xm2) with overlapping fields of view.
The main idea is to create a panorama images out of the input images.
The approaches to create image stitching (panorama) require nearly exact overlaps between images and identical exposures to produce seamless results.
12/13/2010
Idea
![Page 4: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/4.jpg)
Sophea Chan Page 4 / 17
TheoryCompositing Surface
Image stitching processResulting
References
Over ViewTheory
Idea
Compositing surface Reference Image
Image stitching processImage RegistrationOverlapping AreaBlending
ResultingReferences
12/13/2010
![Page 5: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/5.jpg)
Sophea Chan Page 5 / 17
TheoryCompositing Surface
Image stitching processResulting
References
12/13/2010
Image to be warped Reference Image
Reference ImageWe select one of the images as a reference . It is the one that is geometrically most center. Other image is warped into the reference coordinate system.
Reference Image
![Page 6: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/6.jpg)
Sophea Chan Page 6 / 17
TheoryCompositing Surface
Image stitching processResulting
References
Over ViewTheory
Idea
Training Compositing surface
Image stitching processImage RegistrationOverlapping AreaBlending
ResultingReferences
12/13/2010
Image RegistrationOverlapping AreaBlending Images
![Page 7: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/7.jpg)
Sophea Chan Page 7 / 17
TheoryCompositing Surface
Image stitching processResulting
References
Image registrationThe purpose is to first extract distinctive features from each images, to match these features to a global correspondence, and to estimate the geometric transformation between the images.
1- Extract feature2- Feature matching3- Align images (Compute Transformation Matrix)
12/13/2010
Image RegistrationOverlapping AreaBlending Images
![Page 8: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/8.jpg)
Sophea Chan Page 8 / 17
TheoryCompositing Surface
Image stitching processResulting
References
- Extract featuresFinding interest points of both images
By using Harris Detector (Mathematics ).
12/13/2010
Image RegistrationOverlapped AreaBlending Images
𝐄(𝐮,𝐯) = 𝑾ሺ𝒙,𝒚ሻ[𝑰ሺ𝒙+ 𝒖,𝒚+ 𝒗ሻ− 𝑰(𝒙,𝒚)]𝟐𝒙,𝒚
Window function Shifted intensity Intensity
![Page 9: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/9.jpg)
Sophea Chan Page 9 / 17
TheoryCompositing Surface
Image stitching processResulting
References
Features matchingUsing SIFT to extract the frames (interest Points) and the descriptors
from the image I. (SIFT function is provided in the solution of exercise 4).
12/13/2010
Image RegistrationOverlapped AreaBlending Images
![Page 10: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/10.jpg)
Sophea Chan Page 10 / 17
TheoryCompositing Surface
Image stitching processResulting
References
- Overlapping area:
12/13/2010
Overlapping area between image1 and image 2
Image RegistrationOverlapped AreaBlending Images
![Page 11: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/11.jpg)
Sophea Chan Page 11 / 17
TheoryCompositing Surface
Image stitching processResulting
References
-Geometric Transformation (Homography)RANSAC is used to remove outliers.Compute Transformation Matrix T by projective transformation ( or homography).
Shift Img = Original Image * T
RANSAC function is Provided in the solution of exe. 4
12/13/2010
Image RegistrationOverlapping AreaBlending Images
Removed outlier by RANSACShift Image
![Page 12: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/12.jpg)
Sophea Chan Page 12 / 17
TheoryCompositing Surface
Image stitching processResulting
References
Technique 1: Featuring
12/13/2010
Shift image + Reference Image = Mapped Image
Image RegistrationOverlapped AreaBlending Images
+
![Page 13: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/13.jpg)
Sophea Chan Page 13 / 17
TheoryCompositing Surface
Image stitching processResulting
References
Technique 1: FeaturingThe median filter is an effective method that can suppress isolated noise without blurring sharp edges.y[m,n]=median{ x[i,j], (i,j) w } , w is represented a neighborhood centered around location in the image.
12/13/2010
Median filtering n=m=5
Image RegistrationOverlapped AreaBlending Images
Cutting Plan
![Page 14: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/14.jpg)
Sophea Chan Page 14 / 17
TheoryCompositing Surface
Image stitching processResulting
References
Technique 2: Central weightingCompute the average value of each pixel.
12/13/2010
Image RegistrationOverlapped AreaBlending Images
+
Cሺxሻ= 𝑤𝑘 𝐼ሚ𝑘ሺ𝑥ሻ 𝑘 / 𝑤𝑘 (𝑥)𝑘
wk(x) = |หargminy ൛หa&ya&ห Ikෙ� ሺx+ yሻis invalidൟห|
![Page 15: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/15.jpg)
Sophea Chan Page 15 / 17
TheoryCompositing Surface
Image stitching processResulting
References
Technique 2: Central weightingThe median filter is an effective method that can suppress isolated noise without blurring sharp edges.y[m,n]=median{ x[i,j], (i,j) w } , w is represented a neighborhood centered around location in the image.
12/13/2010
Median filtering n=m=5
Image RegistrationOverlapped AreaBlending Images
Average
![Page 16: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/16.jpg)
Sophea Chan Page 16 / 17
Theory Compositing Surface
Image stitching processResulting
References
12/20/2010
Out put
Output 1:
Featuring
Average
image1 image2
![Page 17: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/17.jpg)
Sophea Chan Page 17 / 17
Theory Compositing Surface
Image stitching processResulting
References
12/20/2010
Out put
Output:
Featuring
image2
Average
image1
![Page 18: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/18.jpg)
Sophea Chan Page 18 / 17
Theory Compositing Surface
Image stitching processResulting
References
ResourcesB. Ommer.
Representation Feature.Object Recognition Lecture (Chapter 2), 2010.
Richard Szeliski.Image Alignement and StitchingTechnical Report MSR-TR-2004-92Last Updated, December 10, 2006.
12/20/2010
Resources
![Page 19: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/19.jpg)
Sophea Chan Page 19 / 17
Theory Compositing Surface
Image stitching processResulting
References
Questions ?
12/20/2010
Questions
![Page 20: Panorama Creation by Image stitching](https://reader035.fdocuments.us/reader035/viewer/2022062410/56816647550346895dd9be1b/html5/thumbnails/20.jpg)
Sophea Chan Page 20 / 17
Theory Compositing Surface
Image stitching processResulting
References
Thanks !
12/20/2010
End