Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image...
Transcript of Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image...
![Page 2: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/2.jpg)
l Introduction
l Signals and formats
l The need for compression
l Lossless and lossy coding
l General image coding scheme
l Measures of the compression quality
l Scalability and symmetry
l Image and video coding standards
![Page 3: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/3.jpg)
Photo
Analog film
Analog TV
Real images...
Others
Scanner
A/D
Digital camera...
Others
Y, u, v Image
PCM 8 bits
Coder
u = B - Yv = R - Y
Y = 0.30 R + 0.59 G + 0.11 B
![Page 4: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/4.jpg)
Y u v Format
Y
U V
RGB 24 bits/pixel YUV 4:2:0 (12 bits/pixel)
![Page 5: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/5.jpg)
l 512 x 512 pixel color image
512 x 512 x 24bits = 786 Kbytes
l Videoconference QCIF (quarter common intermediate format)
(176 x 144 + 88 x 72 + 88 x 72) x 8 x 25 = 7.6 Mbits/s
l Digital television
(720 x 576 + 360 x 288 + 360 x 288 ) x 8 x 25 = 124 Mbits/s
l High definition television - HDTV
(1440 x 1152 + 720 x 576 + 720 x 576 ) x 8 x 25 = 497 Mbits/s
l Multispectral images (satellite)
(6000 x 6000) x 8 x 6 = 216 Mbytes
![Page 6: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/6.jpg)
Objective: To find a way to representthe original image without (?) distortionwith the minimum number of bits possible
Coder
Bit stream
....
Lossless image coding Lossy image coding
![Page 7: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/7.jpg)
l Lossless image coding :
The decoded image is pixel by pixel identical to the original
l Lossy image coding :
The decoded image is NOT pixel by pixel identical to the original
Coder
Original
Visually indistinguishable
Visually distinguishable
![Page 8: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/8.jpg)
QuantizerQ
• Quantizer• Scalar or vectorial• This an optional block.
Although almost always exists
Entropic coder
• Entropic coder• This block always exists
Bit stream
Do something
• To prepare the image• To remove redundancy• This an optional block.
Although almost always exists
• DCT, wavelets, hybrid
Original image
Lossy scheme Lossless scheme
Reversible Non-reversible
![Page 9: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/9.jpg)
Entropiccoder
Code2
42
64
6
Do something
Q
![Page 10: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/10.jpg)
Input digital levels Output levels
Output
levels
Input levels0 1 2 3 4 5 6 7 8 9
1
3
5
7
Entropiccoder
![Page 11: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/11.jpg)
1 bit/pixel image(binary) Input levels
Output values
2 level quantizer
128 255
64
192
0
Reconstruction
levels
Decision levels
8 bits/pixel image
![Page 12: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/12.jpg)
2 bit/pixel image Input levels
Output values
4 level quantizer
64 128 192 255
32
96
160
224
0
Reconstruction
levels
Decision levels
8 bits/pixel image
![Page 13: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/13.jpg)
4 bits
1 bit
2 bits
3 bits
![Page 14: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/14.jpg)
ITU - 601 CIF
Sampled signals Y, u, v Y, u, v
Sampling frequency Mhz. (Y) 13.5 - (u,v) 6.75 (Y) 6.75 - (u,v) 3.375
Sampling structure orthogonal 1:1 orthogonal 1:1
Pixels / image (Y): 720 x 576 (Y): 352 x 288(u,v): 360 x 288 (u,v): 176 x 144
Bits/pixel 8 8
![Page 15: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/15.jpg)
Compression factor = Bits original image
Bits compressed image
Bits compressed image
Number of pixelsBits/pixel =
![Page 16: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/16.jpg)
Original image256 x 256 x 8 bits
Compressed image40.000 bits
40.000
256 x 256 Bits/pixel = = 0.61 bpp
8 bpp
0.61 bpp C. F. = = 13.1
![Page 17: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/17.jpg)
Coder
Y(m,n)X(m,n)
Subjective measure Opinions over a scale of 5
Objective measureMSE255
log10PSNR(dB)2
10=
2
1 1
)(MN
1MSE ij
M
i
N
jij xy −= ∑ ∑
= =
![Page 18: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/18.jpg)
l Spatial scalability
l PSNR scalability (quality)
l Non-scalable
Coder
Scalable bit stream
....
![Page 19: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/19.jpg)
Scalable bit stream
Decoder 1
Decoder 4Decoder 3
Decoder 2
![Page 20: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/20.jpg)
Scalable Bit stream
Decoder 1 Decoder 2 Decoder 3
![Page 21: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/21.jpg)
![Page 22: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/22.jpg)
Non-scalable Bit stream
Decoder 1 Decoder 2 Decoder 3
![Page 23: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/23.jpg)
l Coder complexity different than decoder complexity
l The decoder should be as simple as possible
JPEG: Symmetric
MPEG 1- 2: Very asymmetric
![Page 24: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/24.jpg)
QuantizerQ Entropic coder
Bit stream
Do something
Original image
Transform coding – JPEG
Wavelets – JPEG 2000Still image coding
VideoHybrid coding – H.26x, MPEG-1, MPEG-2, MPEG-4
![Page 25: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/25.jpg)
QuantizerQ
Entropycoder
N
Ti AAU
UiVi
QVi
Cha
nnel
EntropydecoderC
hann
el
ViQ Ui
Q
AVA QTi
UiQ
Ui
![Page 26: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/26.jpg)
• Error resilience • Arbitrarily shaped region of interest• Random access• Lossless and lossy coding• Fully scalable bit stream
ComponentDecorrelation
Wavelettransform
QArithmetic
coding
Bit streamordering
Coefficient bitmodeling
Reversible No Reversible
Errorresilience
Region ofinterest
Bit-stream
![Page 27: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/27.jpg)
![Page 28: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/28.jpg)
1 bits/pixel
0.25 bits/pixel
0.5 bits/pixel
JPEG 2000 - JPEG JPEG 2000 - JPEG
![Page 29: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/29.jpg)
Control
DCT Q VLC MUX Buffer
Overhead information
Q -1
IDCT
+
+
+ -
Predictor
Mem
ory
Motion estimation
VLC
![Page 30: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/30.jpg)
1986 1988 1990 1992 1994 1996
JPEG
1998 2000
20% more compression than JPEG for same qualityMore functionalities
0.15 bits / pixel : Recognizable 0.75 bits / pixel: Excellent
0.25 bits / pixel : Useful 1.50 bits / pixel: Indistinguishable
JPEG 2000
![Page 31: Polytechnic University of Catalonia Barcelona, Spainbouman/ece637/...l 512 x 512 pixel color image 512 x 512 x 24bits = 786 Kbytes l Videoconference QCIF (quarter common intermediate](https://reader034.fdocuments.us/reader034/viewer/2022052021/603552398d68662d8c57b152/html5/thumbnails/31.jpg)
1984 1986 1988 1990 1992 1994
H.261 H.263H.263+, H.26L
MPEG-2MPEG-1
ISO
ITU
MPEG-4
1996 1998
Frame-basedObject-based
2000
JVT