Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And...
-
Upload
gertrude-brooks -
Category
Documents
-
view
220 -
download
5
Transcript of Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And...
![Page 1: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/1.jpg)
Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro
And AVS P2
By Sudeep GangavatiEE5359 Spring 2012,
UT Arlington
![Page 2: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/2.jpg)
Proposal
• The goal – to compare H.264/AVC, AVS P2 and Dirac Pro
• Video quality assessment – MSE, PSNR, SSIM
![Page 3: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/3.jpg)
H.264/AVC Features
• The most widely used video coding standard
Fig. 1 Video coding standards evolution [12]
![Page 4: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/4.jpg)
Features
• Motion compensated coding structure • Picture slices MBs subMBs blocks
pixels. This is shown in Figure 3.• Only 4:2:0 chroma format was supported
earlier and 4:2:2 , 4:4:4 were added later. This is shown in Figure 2.
• I , P and B slices • Derived slices SI and SP
![Page 5: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/5.jpg)
Fig 2. 4:2:4, 4:2:2, 4:4:0 sampling patterns
![Page 6: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/6.jpg)
Fig 3. H.264 syntax
![Page 7: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/7.jpg)
Profiles and levels
• Main Profile• Baseline Profile• Extended Profile• High Profile
![Page 8: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/8.jpg)
H.264 Profiles
Fig.4 H.264 profiles [1]
![Page 9: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/9.jpg)
H.264 Encoder
Fig. 5 Encoder structure for H.264 [2]
![Page 10: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/10.jpg)
H.264 Decoder
Fig.6 Decoder structure of H.264 [2]
![Page 11: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/11.jpg)
Intra and Inter Predictions
Intra Prediction :
• Uses spatial prediction to reduce spatial redundancy. • 4 X 4 luma – 9 modes • 16 X 16 luma – 4 modes • 8 X 8 luma- 9 modes
![Page 12: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/12.jpg)
Intra prediction modes for 4X4 luma
Fig.7(a) Intra prediction modes [6]
The samples above and to the left, labelled A-M in Figure 7 have previously been encoded and reconstructed and are therefore available in the encoder and decoder to form a prediction reference.
![Page 13: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/13.jpg)
Intra Prediction Modes for 16x16 luma
• Again the previously encoded samples directly above and to the left of the macroblock have been reconstructed and are used for the prediction
Fig 7 (b) Intra prediction modes for 16x16 luma [6]
![Page 14: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/14.jpg)
Inter prediction
Uses motion estimation and motion compensation (MC).
0
Sub-macroblock partitions
0
1 0 1
0 1
2 3
0 0
1 0 1
0
2
1
3
1 macroblock partition of 16*16 luma samples and
associated chroma samples
Macroblock partitions
2 macroblock partitions of 16*8 luma samples and
associated chroma samples
4 sub-macroblocks of 8*8 luma samples and
associated chroma samples
2 macroblock partitions of 8*16 luma samples and
associated chroma samples
1 sub-macroblock partition of 8*8 luma samples and
associated chroma samples
2 sub-macroblock partitions of 8*4 luma samples and
associated chroma samples
4 sub-macroblock partitions of 4*4 luma samples and
associated chroma samples
2 sub-macroblock partitions of 4*8 luma samples and
associated chroma samples
Fig.8 H.264 Inter prediction [5]
![Page 15: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/15.jpg)
De-blocking filter[5]
• Is used to reduce the blocking artifacts.• Since the filter is present in the loop , it prevents the propagation of the
blocking artifacts.
Fig. 9 Boundaries in a macroblock to be filtered (luma boundaries shown with solid lines and chroma boundaries shown with dotted lines) [1]
![Page 16: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/16.jpg)
AVS China[7]
• AVS-Audio Video Standard• Standardization includes system, audio, video
and digital copyright management. • Goal – to achieve coding efficiency with
reduced complexity.
![Page 17: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/17.jpg)
AVS Parts [3]
Fig. 10 AVS China parts [3]
![Page 18: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/18.jpg)
AVS P2 Encoder [7]
Fig. 11 AVS part 2 encoder [7]
![Page 19: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/19.jpg)
AVS P2 decoder
Fig 11 (a) AVS P2 decoder block diagram [7]
![Page 20: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/20.jpg)
Intra Prediction in AVS[7]
• Spatial prediction is used in intra coding in AVS part 2.
• The Intra prediction is based on 8x8 block
• The intra prediction method is derived from the neighboring pixels in left and top blocks
![Page 21: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/21.jpg)
Intra Prediction contd.
Fig.12 (a) Five different modes for intra luminance prediction[16]
![Page 22: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/22.jpg)
Inter prediction [16]
• Inter prediction in AVS is by motion compensation and motion estimation [16].
• As shown in the Figure 12 (b), the macroblock can have 16 x 16, 8 x 16, 16 x 8 or 8 x 8 [16].
Fig 12 (b) Macroblock sizes [16]
![Page 23: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/23.jpg)
Dirac pro
• Dirac is a video codec originally developed by BBC
• This technique is used from web streaming of videos to HD TV applications to storage of content.
• Dirac can compress any resolution picture• The encoder and decoder diagrams are shown
in Figure 13 (a) and (b) respectively.
![Page 24: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/24.jpg)
Figure 13 (a) Dirac encoder[8]
Figure 13 (b) Dirac decoder[8]
Dirac encoder and decoder :
![Page 25: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/25.jpg)
Dirac pro features[7]
• Dirac pro is intra-coding only a version of Dirac• Mainly optimized for video production• Intended for high quality applications
![Page 26: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/26.jpg)
Dirac pro Features
Dirac pro supports the following technical aspects [9]:
• Intra-frame coding only • 10 bit 4:2:2• No subsampling• Lossless or visually lossless compression• Low latency on encode/decode• Support for multiple HD image formats and frame rates• Low complexity for decoding
![Page 27: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/27.jpg)
References[1] Soon-kak Kwon, A. Tamhankar and K.R. Rao, “Overview of H.264 / MPEG-4 Part 10 (pp.186-216)”, Special issue on “ Emerging H.264/AVC video coding standard”, J. Visual Communication and Image Representation, vol. 17, pp.186-216, April 2006.[2] T. Wiegand, G. Sullivan, G. Bjontegaard and A. Luthra, “Overview of the H.264/AVC video coding standard,” IEEE Trans. on Circuits and Systems for Video Technology, vol. 13, pp.560-576, July 2003.[3] T. Sikora, “Digital video coding standards and their role in video communications”, Signal Processing for Multimedia, J.S. Byrnes (Ed.), IOS press, pp. 225-251, 1999. [4] K. R. Rao, and D. N. Kim, “Current video coding standards: H.264/AVC, Dirac, AVS China and VC-1,” IEEE 42nd Southeastern symposium on system theory (SSST), March 7-9 2010, pp. 1-8, March 2010.[5]Z. Wang and A.C. Bovik, “A universal image quality index”, IEEE Signal Processing Letters,Vol.9, pp. 81-84, March 2002.[6] Iain Richardson, “ The H.264 advanced video coding standard”, Second Edition,Wiley, 2010[7] L. Yu et al, “An Overview of AVS-Video: tools, performance and complexity”, Visual Communications and Image Processing, Proc. of SPIE, vol. 5960, pp. 679-690, July 2005.[8] “ The Dirac web page” :http://www.bbc.co.uk/rd/projects/dirac/intro.shtml[9] “Dirac Codec Wiki Page ” at http://en.wikipedia.org/wiki/Dirac(codec)[10]“Dirac Pro web page” at http://www.bbc.co.uk/rd/projects/dirac/diracpro.shtml [11] “Video on the web “ a http://etill.net/projects/dirac_theora_evaluation/[12] J.Lou “Advanced video codec optimization techniques”, Doctoral Dissertation, Electrical Engineering Department, University of Washington, August 2009
![Page 28: Video Compression Standards for High Definition Video : A Comparative Study Of H.264, Dirac pro And AVS P2 By Sudeep Gangavati EE5359 Spring 2012, UT Arlington.](https://reader035.fdocuments.us/reader035/viewer/2022062720/56649ef95503460f94c0ae3a/html5/thumbnails/28.jpg)
References [13] H.264 AVC JM Software : http://iphome.hhi.de/suehring/tml/ [14] H.264 decoder: http://www.adalta.it/Pages/407/266881_266881.jpg [15] W. Gao et al, “AVS - The Chinese next-generation video coding Standard” NAB, Las Vegas, 2004. [16] X. Wang et al., “Performance comparison of AVS and H.264/AVC video coding standards” J. Comput. Sci. & Technol., vol.21, No.3, pp.310-314, May 2006. [17] AVS China part 2 video software, password protected : ftp://124.207.250.92/ [18] S. Swaminathan and K.R. Rao, “Multiplexing and demultiplexing of AVS CHINA video with AAC audio,” TELSIKS 2011, Nis, Serbia, 5-8 Oct. 2011. [19] Dirac Pro Software : http://diracvideo.org/download/ [20] M. Tun, K.K. Loo and J. Cosmas, “Semi-hierarchical motion estimation for the Dirac video codec,” 2008 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting, pp.1–6, March 31-April 2, 2008. [21] T. Davies, “The Dirac Algorithm”: http://dirac.sourceforge.net/documentation/algorithm/, 2008. [22] Dirac video codec – A programmer's guide: http://dirac.sourceforge.net/documentation/code/programmers_guide/toc.htm [23] A. Ravi and K.R. Rao, “Performance analysis and comparison of the Dirac video codec with H.264 / MPEG-4 Part 10 AVC,”IJWMIP, vol.4, pp.635-654, No.4, 2011.