Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan [email protected]...
-
Upload
nancy-davis -
Category
Documents
-
view
216 -
download
0
Transcript of Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan [email protected]...
![Page 2: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/2.jpg)
• 50% more bitrate savings compared to H.264/AVC • HD and beyond HD video streaming & playback quality compared
to H.264/AVC. • Efficient bandwidth utilization• New features like parallel processing• HM9.2 – latest HEVC version• HM 9.1 – Version on which fast intra prediction is to be ported• HM7.0 – Fast Intra prediction implemented
High Efficiency Video Coding[1]
![Page 3: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/3.jpg)
Fig 1:HEVC Encoder[2]
![Page 4: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/4.jpg)
Fig 2: HEVC decoder [5]
![Page 5: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/5.jpg)
Fig 3: Chroma Subsampling[6]
![Page 6: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/6.jpg)
Fig 4:Formation of a CU. Adopted from [2]
![Page 7: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/7.jpg)
Fig 5:Partitioning of a Macro block [2]
CTB->CBs andTBsSolid lines indicate CB boundariesand dotted lines indicate TB boundaries
Corresponding QUAD TREE
![Page 8: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/8.jpg)
Fig 6: Adaptive angular Intra Prediction [2]
Left: 33 modes;Right: Example of mode 29 intra prediction
![Page 9: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/9.jpg)
Adaptive angular Intra Pediction contd..
• Rough Mode Decision (RMD) can be used to find the Most Probable Mode (MPM) and Rate Distortion Optimization (RDO) can be implemented on those modes.
• Context Adaptive Binary Arithmetic Coding (CABAC) is used to encode the transformed residual.
• Deblocking filter and Sample Adaptive Offset (SAO) filtering is used in the decoder loop and decoder side to smoothen out the effects of the processes.
![Page 10: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/10.jpg)
Fast Intra prediction on HM6 proposed by Zhang and Ma [10]
• 38% reduction in encoding time and 2.9% BD rate increase.
• SATD determines the modes for RMD.• Progressive scanning• Early RDOQ termination
Fig 7: Down sampling by averaging operator
![Page 11: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/11.jpg)
Migration from HM7.0 to HM9.2
• Porting of fast Intra implemented on HM7.0 to HM9.2 is proposed.• Encoding time, bitrate, PSNR and QP are some of the metrics that
can be compared.• In future, [11-18] proposed methods can be combined along with
[10] to further reduce the complexity of intra prediction mode decision.
![Page 12: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/12.jpg)
References
• [1] B. Bross et al, “High efficiency video coding (HEVC) text specification draft 8”, Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 10th Meeting: Stockholm, SE, 11–20 July 2012
• [2] G. Sullivan et al, “Overview of the high efficiency video coding (HEVC) standard”, IEEE Transactions on Circuits and Systems for Video Technology, vol 22, n 12, pp 1649-1668, Dec. 2012
• [3] A. Luthra and P. Topiwala, “Overview of the H.264/AVC video coding standard”, Proceedings of SPIE - The International Society for Optical Engineering, vol 5203, pp 417-431, Applications of Digital Image Processing XXVI, 5-8 Aug. 2003
• [4] F. Bossen et al, "HEVC complexity and Implementation analysis", IEEE Transactions on Circuits and Systems for Video Technology, vol 22 , pp 1685-1696, Dec. 2012
![Page 13: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/13.jpg)
References
• [5] C. Fogg, “Suggested figures for the HEVC specification”, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC) document JCTVC- J0292r1, July 2012.
• [6] Basics of video: http://lea.hamradio.si/~s51kq/V-BAS.HTM• [7] Y.H. Tan et al, “On residual quad-tree coding in HEVC”, MMSP 2011 -
IEEE International Workshop on Multimedia Signal Processing, 17-19 Nov. 2011.
• [8] A. Saxena and F.C. Fernandes, “ Mode dependent DCT/DST for intra prediction in block-based image/video coding”, Proceedings - International Conference on Image Processing, IEEE ICIP, pp 1685-1688, 11-14 Sept. 2011
• [9] V. Sze and M. Budagavi, “High throughput CABAC entropy coding in HEVC”, IEEE Transactions on Circuits and Systems for Video Technology, vol 22, n 12, pp 1778-1791, Dec. 2012
![Page 14: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/14.jpg)
References
• [10] HMX.X, HEVC code: http://hevc.kw.bbc.co.uk/svn/jctvc-a124/branches/
• [11] H. Zhang and Z. Ma, “Fast intra prediction for high efficiency video coding”, Advances in Multimedia Information Processing, 13th Pacific-Rim Conference on Multimedia, Proceedings, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol 7674 LNCS, pp 568-577, 4-6 Dec. 2012
• [12] A.S. Motra et al, “Fast intra mode decision for HEVC video encoder”, 2012 20th International Conference on Software, Telecommunications and Computer Networks, SoftCOM, 11-13 Sept. 2012
• [13] J. Kim et al, “Fast intra mode decision of HEVC based on hierarchical structure”, ICICS 2011 - 8th International Conference on Information, Communications and Signal Processing, 13-16 Dec. 2011
![Page 15: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/15.jpg)
References
• [14] K. Choi and E.S. Jang, “Early TU decision method for fast video encoding in high efficiency video coding”, IET, Electronic Letters, vol. 48, No. 12, pp 689-691, 7th June 2012
• [15] W. Jiang, H. Ma and Y. Chen, “Gradient based fast mode decision algorithm for intra prediction in HEVC”, 2nd International Conference on Consumer Electronics, Communications and Networks, pp 1836-1840, 21-23 April 2012
• [16] X. Shen, L. Yu and J. Chen, “Fast coding unit size selection for HEVC based on Bayesian decision rule”, 2012 Picture Coding Symposium, PCS 2012, Proceedings, pp 453-456, 7-9 May 2012
• [17] S.W. Teng, H.M. Hang and Y.F. Chen, “Fast mode decision algorithm for residual quadtree coding in HEVC”, Conference Article no.6116062, IEEE Visual Communications and Image Processing, 6-9 Nov. 2011
![Page 16: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/16.jpg)
References
• [18] J. Leng et al, “Content based hierarchical fast coding unit decision algorithm for HEVC”, International Conference on Multimedia and Signal Processing, vol 1, pp 56-59, 14-15 May 2011.
![Page 17: Porting of Fast Intra Prediction in HM7.0 to HM9.2 Sapna Vasudevan sapna.vasudevan@mavs.uta.edu 1000800184.](https://reader033.fdocuments.us/reader033/viewer/2022051417/5697c0221a28abf838cd32cd/html5/thumbnails/17.jpg)
THANK YOU