Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan...
Transcript of Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan...
![Page 1: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/1.jpg)
Adaptive Image and Video Retargeting Technique Based on Fourier Analysis
Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su KimSchool of Electrical Engineering, Korea University, Seoul, Korea
Reporter: Chia-Hao HsiehDate: 20100316
![Page 2: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/2.jpg)
2
Outline
• Introduction• Methods• Simulation results
![Page 3: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/3.jpg)
3
Introduction
Original Scaled Cropped Retargeted
![Page 4: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/4.jpg)
4
Introduction
![Page 5: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/5.jpg)
5
Methods
• Partitioning• Scaling distortions• Adaptive scaling
![Page 6: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/6.jpg)
6
Partitioning
K = 10 in this work
![Page 7: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/7.jpg)
7
Scaling distortions
• z[n]: a row signal of length lk in the kth strip
• Reduce the length by removing rk pixels to obtain a downsampled signal zd[n]
• The sampling rate is reduced by a factor of (1-(rk/lk))π
![Page 8: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/8.jpg)
8
Scaling distortions
• The signal should be lowpass-filtered with a cutoff frequency ωc = (1-(rk/lk))π to avoid aliasing artifacts
• Scaling distortions (The energy of the lost high frequency components)
Can be approximated by
Except for the dominant DC component
A smaller sk makes the exponential function decrease more quickly
![Page 9: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/9.jpg)
9
Scaling distortions
Can be approximated by
Scaling distortion of the kth strip:
Except for the dominant DC component
![Page 10: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/10.jpg)
10
Adaptive scaling
To minimize the sum of the distortions of strips
R = Ws − Wt
Constrained optimization problemCan be solved by minimizing the Lagrangian cost function
![Page 11: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/11.jpg)
11
Adaptive scaling
![Page 12: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/12.jpg)
12
Extension to video retargeting
• Cut the volume into parallelepipeds along the time axis
• Each parallelpiped is scaled down spatially Partitioning of a video sequence
for horizontal resizing.
![Page 13: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/13.jpg)
13
Simulation Results
![Page 14: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/14.jpg)
14
Simulation Results
![Page 15: Adaptive Image and Video Retargeting Technique Based on Fourier Analysis Jun-Seong Kim, Jin-Hwan Kim, and Chang-Su Kim School of Electrical Engineering,](https://reader035.fdocuments.us/reader035/viewer/2022062303/5517e400550346c6568b4646/html5/thumbnails/15.jpg)
15
Conclusions
• The proposed algorithm requires much less computations than the seam carving
• Excellent temporal coherence without jitter artifacts