Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension
description
Transcript of Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension
![Page 1: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/1.jpg)
Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension
Xin Lu, Student Member, IEEEGraham R. Martin, Member, IEEE
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 23, NO. 5, MAY 2013
![Page 2: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/2.jpg)
OutlineIntroductionObservations and AnalysisProposed methodsExperimental Results
![Page 3: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/3.jpg)
Introduction #18 modes
![Page 4: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/4.jpg)
Introduction #2Three new prediction methods
◦Interlayer motion prediction◦Interlayer residual prediction◦Interlayer intra prediction
Two layer◦Base layer◦Enhancement layer
![Page 5: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/5.jpg)
Observations and Analysis #1In the spatial enhancement layer, the
reference index of a macroblock is more likely to be the same as that of the corresponding block in the base layer.
![Page 6: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/6.jpg)
Observations and Analysis #2Analyze the probability of macroblocks in
the enhancement layer being encoded as MODE−SKIP when the mode of the colocated macroblock in the base layer is also MODE−SKIP.
![Page 7: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/7.jpg)
Observations and Analysis #3
![Page 8: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/8.jpg)
Observations and Analysis #4There is also a significant dependency
between neighboring macroblocks in the enhancement layer.
![Page 9: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/9.jpg)
Observations and Analysis #5
![Page 10: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/10.jpg)
Observations and Analysis #6
![Page 11: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/11.jpg)
Flow Chart
![Page 12: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/12.jpg)
Observations and Analysis #7The energy distribution property of the
DCT coefficients is employed to evaluate the homogeneity of a macroblock.
![Page 13: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/13.jpg)
Observations and Analysis #8In a smooth region of an image, the DCT
energy generally tends to be concentrated in the low frequency components.
![Page 14: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/14.jpg)
Observations and Analysis #9A threshold value of less than optimal
makes the prediction accuracy increase, but the computational cost is increased.
A threshold value larger than optimal reduces the computational cost, but the picture quality is degraded.
![Page 15: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/15.jpg)
Observations and Analysis #10
![Page 16: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/16.jpg)
Flow Chart
![Page 17: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/17.jpg)
Observations and Analysis #11Not all lower layer up-sampling data is
suitable for interlayer prediction, especially when the video sequence contains slow motion and high spatial detail.
![Page 18: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/18.jpg)
Observations and Analysis #12MVD (motion vector difference) from the
colocated macroblock in the base layer is chosen as the measure.
![Page 19: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/19.jpg)
Observations and Analysis #13Exclude unnecessary mode candidates as
much as possible, thus maximizing the time saving.
Maintain a prediction accuracy as high as that of an exhaustive evaluation, thus minimizing picture quality degradation.
![Page 20: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/20.jpg)
Observations and Analysis #14
![Page 21: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/21.jpg)
Flow Chart
![Page 22: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/22.jpg)
Proposed Methods
![Page 23: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/23.jpg)
Experimental Result #1
![Page 24: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/24.jpg)
Experimental Result #2
![Page 25: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/25.jpg)
Experimental Result #3
![Page 26: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/26.jpg)
Experimental Result #4
![Page 27: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/27.jpg)
Experimental Result #5
![Page 28: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/28.jpg)
Experimental Result #6
![Page 29: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/29.jpg)
Experimental Result #7
![Page 30: Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension](https://reader036.fdocuments.us/reader036/viewer/2022062310/5681642b550346895dd5ed6b/html5/thumbnails/30.jpg)
Experimental Result #8