Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture...
-
Upload
marina-sword -
Category
Documents
-
view
213 -
download
0
Transcript of Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture...
![Page 1: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/1.jpg)
Image Quilting and Apples
By Zach BroderickA presentation of the paper “Image Quilting
for Texture Synthesis and Transfer” by Alexei A. Efros and William T. Freeman
![Page 2: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/2.jpg)
Texture Synthesis
(Images taken from paper)
![Page 3: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/3.jpg)
Sample of Texture
Infinitely Large Output
Output texture is:• Same resolution
• Non-repeating
• Seamless
• Must be perceived as “same”
![Page 4: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/4.jpg)
Previous Methods
• Tiling (bad seams, repetitive)
• Stochastic (doesn’t work for structured)
• Pixel-based (SLOW, poor for structured)
• Random Patches/Blending (poor seams)
![Page 5: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/5.jpg)
Image Quilting• Copy patches (like the random patch method) based on
neighborhood (like pixel method)• Faster (predetermined pixels/less search space), maintains
structure of regular textures• Seams smoothed with graph cut through least error path
(Image from Wikipedia)
![Page 6: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/6.jpg)
Image Quilting
(Diagram from paper)
![Page 7: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/7.jpg)
An In-Depth Look at the Image Quilting Algorithm: Overview
• Copy tiles from the source image to the destination image in a left to right, top to bottom fashion, with an overlap of about 1/6 the tile size on the top and left regions.
• In selecting each of these tiles, search the source image space S for the tile with the least mean squared error in the overlap region (the first tile can be selected at random).
• When copying each tile, calculate the minimum error path cut in each of the overlap regions, and only copy the portion of the tile within the cut.
![Page 8: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/8.jpg)
![Page 9: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/9.jpg)
Error Calculation
![Page 10: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/10.jpg)
Path Cut
![Page 11: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/11.jpg)
Path Cut Cont’d…
![Page 12: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/12.jpg)
Texture Transfer• Algorithm can be generalized to provide texture transfer
capabilities (image from paper)
![Page 13: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/13.jpg)
Problems• Repetition often occurs (see raspberries)• Occasional glaring seams (mutant tomatoes)
![Page 14: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/14.jpg)
Demonstration
![Page 15: Image Quilting and Apples By Zach Broderick A presentation of the paper Image Quilting for Texture Synthesis and Transfer by Alexei A. Efros and William.](https://reader030.fdocuments.us/reader030/viewer/2022032516/56649c3c5503460f948e5481/html5/thumbnails/15.jpg)
Questions?