Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in...
Transcript of Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in...
![Page 1: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/1.jpg)
1
Analysis of Rate-distortion Functions and Congestion Control in Scalable Internet Video Streaming
Min DaiElectrical Engineering, Texas A&M University
Dmitri LoguinovComputer Science, Texas A&M University
![Page 2: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/2.jpg)
2
Motivation
• Scalable coding is widely applied in Internet streaming.– Fine Granular Scalability (FGS) has been chosen in
MPEG-4 standard
– Study the statistical properties of FGS encoder and propose a more accurate statistical model for it
• The Rate-distortion (R-D) theory is a powerful tool in Internet streaming.– Choose appropriate compression schemes
– Optimally allocate bits in joint source-channel coding
– Rate adaptation in the Internet
![Page 3: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/3.jpg)
3
Motivation (cont.)
• R-D theory (cont.): – No current closed-form R-D model has been developed
for scalable coding– Derive an R-D model for scalable video coding
• Constant quality control: – Another application of R-D model in Internet streaming – Human eyes are sensitive to quality fluctuation – Many video sequences have severe quality fluctuations
![Page 4: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/4.jpg)
4
Motivation (cont.)
• Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth is varying in a real network
– Congestion control is necessary to allow fair and efficient usage of network bandwidth
• Most existing congestion control methods (e.g., AIMD) are not proven to be asymptotically stable.– Kelly’s continuous-feedback congestion control
– Combine our R-D model with Kelly’s control in Internet streaming
![Page 5: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/5.jpg)
5
Overview of this Talk
• Background on rate-distortion theory and FGS scalable coding
• A big picture of this work– R-D modeling of an FGS encoder
– Kelly’s control
– Constant quality control
• Experimental results
• Conclusion
![Page 6: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/6.jpg)
6
Background • Rate-distortion (R-D) theory
– The theoretical discipline that treats data compression from the viewpoint of information theory
A typical R-D curve
R Theoretical R(D)
D
Operational R(D)
• Theoretical R-D model:– A lower bound for any encoder given a statistical
distribution of the source – Often unachievable in the real world
• Operational R-D model– An achievable bound for a practical encoder
![Page 7: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/7.jpg)
7
Background (cont.)
• Scalable coding:– Provides the capability of recovering image or video
information by partially decoding the compressed bitstream
• Fine granular scalability (FGS): – One low bitrate base layer (BL) to provide a low but
guaranteed level of quality
– One high bitrate enhancement layer (EL) to provide finer quality improvement
– EL can be truncated at any codeword
![Page 8: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/8.jpg)
8
Background (cont.)
FGS at the Server FGS at the DecoderFGS at the Encoder
BL
EL
Portion of the FGS EL transmitted in the Internet
![Page 9: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/9.jpg)
9
A Big Picture
Statistical Model of FGS EL input
Distortion Model of FGS EL
R-D Model of FGS EL
Congestion Control
Constant Quality Control
![Page 10: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/10.jpg)
10
Related work on Statistical Models• Input to FGS EL:
– DCT residue between the original image and the reconstructed image from BL
• The two most popular models for DCT residue:– Zero-mean Gaussian distribution:
2
2
2
21)( σ
−
σπ=
x
exf
– Laplacian distribution (double exponential):
||
2)( xexf λ−λ=
![Page 11: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/11.jpg)
11
Related work on Statistical Models
0.0
0.1
0.2
0.3
0.4
-15 -10 -5 0 5 10 15
DCT residue
Prob
abili
ty
real PMFGaussianLaplacian
1.E-06
1.E-04
1.E-02
1.E+00
0 10 20 30 40DCT residue
Prob
abili
ty
real PMFGaussianLaplacian
• The PMF of DCT residue with Gaussian and Laplacianestimations (left). Logarithmic scale of PMFs for the positive residue (right). All testing sequences shown in this paper are coded at 10fps and 128 kb/s in the base layer
![Page 12: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/12.jpg)
12
Proposed Statistical Model• Mixture Laplacian model:
||1||0 10
2)1(
2)( xx epepxf λ−λ− λ
−+λ
=
where λ0 denotes the small variance Laplacian distribution and λ1 denotes the large variance Laplacian distribution
• Use Expectation-Maximization (EM) algorithm to give Maximum-likelihood (ML) estimation for parameters { p, λ0, λ1 }
![Page 13: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/13.jpg)
13
Proposed Statistical Model (cont.)
• Real PMF and mixture Laplacian (left) and Logarithmic scale of the positive part (right)
0.0
0.1
0.2
0.3
0.4
-20 -10 0 10 20DCT residue
Prob
abili
ty
real PMFmixture
1.E-06
1.E-04
1.E-02
1.E+00
0 10 20 30 40
DCT residue
Prob
abili
ty
real PMFmixture
![Page 14: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/14.jpg)
14
More Results
• The weighted absolute error of estimations in Foreman CIF (left) and Coastguard CIF (right)
0
0.02
0.04
0.06
0.08
0.1
0 90 180 270frame number
erro
r
GaussianLaplacianmixture
0
0.01
0.02
0.03
0.04
0.05
0.06
0 90 180 270frame number
erro
r
Gaussian
Laplacian
mixture
0.12
![Page 15: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/15.jpg)
15
A Big Picture
Statistical Model of FGS EL input
Distortion Model of FGS EL
R-D Model of FGS EL
Congestion Control
Constant Quality Control
![Page 16: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/16.jpg)
16
Current Distortion Models
• Classical model:R
XD 222 2 −σε=– where ε2 is a signal-dependent constant, σX
2 denotes the signal variance and R is the bitrate
• A variation of the classical model ( proposed by Chiang et al. in 1997):
21 −− += bDaDR– where parameters a, b are obtained empirically
![Page 17: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/17.jpg)
17
Current Distortion Models (cont.)
• Distortion model for Uniform Quantizer (UQ):
β∆
=∆2
)(D
where ∆ is quantization parameter (QP) and β equals 12
![Page 18: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/18.jpg)
18
Current Distortion Models (cont.)
• Performances of current models in frame 0 (left) and frame 252 of Foreman CIF (right)
30
40
50
60
70
0.E+00 2.E+05 4.E+05 6.E+05
FGS EL bits
PSN
R (d
B)
Chiang et al.real PSNRUQclassical
20
30
40
50
60
70
0.E+00 2.E+05 4.E+05 6.E+05 8.E+05
FGS EL bits
PSN
R (d
B)
Chiang et al.real PSNRUQclassical
![Page 19: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/19.jpg)
19
A more Accurate Distortion Model
• For each Laplacian component in the mixture Laplacian model, the distortion is:
λ−
λ+
λ
+−∆−−
=∆ −∆λ−∆λ− 22
2)1( 2111
)1(1)(
nnnn
nn
ee
D
• Final version:)()1()()( 10 ∆⋅−+∆⋅=∆ DpDpD
where ∆ is the quantization step of each bitplane in the FGS EL and p is the probability of related Laplacian component
![Page 20: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/20.jpg)
20
Results of Distortion Model
• The average absolute errors in Foreman CIF (left) and Coastguard CIF (right)
0
2
4
6
8
0 90 180 270frame number
avg
abs
erro
r (dB
)
classicalUQ modelour model
0
2
4
6
8
0 90 180 270frame number
aveg
abs
err
or(d
B)
classicalUQ modelour model
![Page 21: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/21.jpg)
21
A Big Picture
Statistical Model of FGS EL input
Distortion Model of FGS EL
R-D Model of FGS EL
Congestion Control
Constant Quality Control
![Page 22: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/22.jpg)
22
Operational R-D model
• Peak Signal-to-Noise Ratio (PSNR) is the most popular quality measurement in video coding
)/255(log10 210 DPSNR =
• Based on our distortion model, we found that PSNR could be described with a quadratic function of bitplane number z ( z= log2(∆) )
21 2 3( )PSNR z d z d z d≈ + +
![Page 23: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/23.jpg)
23
Operational R-D model (cont.)
• In traditional R-D models, bitrate R is a linear function of the bitplane number z
0
1
2
3
4
0 1 2 3 4 5 6 7
bitplane z
bits
per
pix
el
actualquadraticlinear
0
1
2
3
4
5
0 1 2 3 4 5 6 7 8
bitplane z
bits
per
pix
el
actualquadraticlinear
• Experimental results show that a quadratic function of z is a much better model of R
bazzR +=)(
![Page 24: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/24.jpg)
24
Operational R-D model (cont.)
Distortion model D(∆)
Quality PSNR (z) == d1z2 + d2z + d3
PSNR ~ log(D)
Rate R(z) =a1z2 + a2z + a3
CRBARPSNR ++=
cRbaRRD ++= 2)(
![Page 25: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/25.jpg)
25
Operational R-D model (cont.)
• The proposed R-D function is:
– where a, b, c are constants
• Notice that the classical model is a special case of our model with a = -2 and b=0.
cRbaRRD ++= 2)(
)(log2 2222)( xRRD σε+−=
![Page 26: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/26.jpg)
26
Results of R-D models (1)
• The average absolute errors in Foreman CIF (left) and Coastguard CIF (right)
012345678
1 31 61 91Frame number
avg
abs
erro
r(dB
)
classical
UQ
our model
0
1
2
3
4
5
6
7
1 31 61 91Frame number
avg
abs
erro
r (dB
)
classicalUQour model
![Page 27: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/27.jpg)
27
Results of R-D models (2)
• The maximum absolute errors in Foreman CIF (left) and Coastguard CIF (right)
0
2
4
6
8
10
12
14
0 90 180 270
Frame number
max
abs
err
or (d
B)
classicalUQour model
0
2
4
6
8
10
12
14
0 90 180 270Frame number
max
abs
err
or (d
B)
classicalUQour model
![Page 28: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/28.jpg)
28
A Big Picture
Statistical Model of FGS EL input
Distortion Model of FGS EL
R-D Model of FGS EL
Congestion Control
Constant Quality Control
![Page 29: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/29.jpg)
29
Constant Quality in CBR
25262728293031323334
0 1 2 3 4 5 6 7 8 9 10
time (s)
PSN
R(d
B)
baselayer
30
32
34
36
38
40
42
0 1 2 3 4 5 6 7 8 9time (s)
PSN
R (d
B)
OursClassicalJPEG2000
• Notice that most CQ papers stop here, while the available bandwidth is varying in the real case
![Page 30: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/30.jpg)
30
A Big Picture
Statistical Model of FGS EL input
Distortion Model of FGS EL
R-D Model of FGS EL
Congestion Control
Constant Quality Control
![Page 31: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/31.jpg)
31
Congestion Control
• Current status:– AIMD, TFRC and binomial algorithms oscillate around
the average rate
• Continuous-feedback controller is proposed by Kelly et al. in 1998 :
)log()(,))(()( rrUwhereprUrdttdr
Pll =β−′α= ∑
∈
where r is the current sending rate and α, β are constants. Uis the utility function of the end user and pl is the price that the flow pays for using router l along the end-to-end path P
![Page 32: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/32.jpg)
32
Congestion Control (cont.)
• An application-friendly version:
)()()( trtpdttdr
⋅⋅β−α=
• Bottleneck packet loss p is used as the feedback instead of prices
∑∑ −
=i i
i lil tr
Ctrtp
)()(
)(
where ri is the sending rate of the i-th flow passing through the bottleneck router l, Cl is the speed of router l
![Page 33: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/33.jpg)
33
A Big Picture
Statistical Model of FGS EL input
Distortion Model of FGS EL
R-D Model of FGS EL
Congestion Control
Constant Quality Control
![Page 34: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/34.jpg)
34
Experimental Results (1)
• Comparison between a single AIMD flow and a single Kelly’s flow. Bottleneck bandwidth C is 1mb/s and RTT=100ms
30
32
34
36
38
40
0 1 2 3 4 5 6 7 8 9t im e (s)
PSN
R(d
B)
K ellyA IM D
![Page 35: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/35.jpg)
35
Experimental Results (2)
• Two Kelly flows are sharing the same bottleneck link C under identical delay
25
30
35
40
0 1 2 3 4 5 6 7 8 9time (s)
PSN
R (d
B)
flow1flow2base
![Page 36: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/36.jpg)
36
Experimental Results (3)
• Examine the effect of different round-trip delays (fixed and random) on fairness
D
25
30
35
0 1 2 3 4 5 6 7 8 9time (s)
PSN
R (d
B)
D=100 msD=400 msbase
25
30
35
0 1 2 3 4 5 6 7 8 9time (s)
PSN
R (d
B)
flow1flow2base
40 40
![Page 37: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/37.jpg)
37
Experimental Results (4)
• Examine the situation n flows sharing the bottleneck bandwidth and each flow has a random delay
40 500
25
30
35
0 1 2 3 4 5 6 7 8 9time (s)
PSN
R (d
B)
flowbase
0
100
200
300
400
0 2 4 6 8 10
time (s)
dela
y D
(ms)
A single-flow PSNR when n = 10 flows share a 10 mb/s bottleneck link (left), Random delay for the flow (right)
![Page 38: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/38.jpg)
38
Conclusion to this Work
• This paper derives a simple but accurate operational R-D model based on the properties of FGS encoders
• Based on this R-D model, we show a simple algorithm that can achieve better constant quality in CBR for scalable streaming than many other CQ methods
• Another contribution of this work is the successful combination of our R-D model with Kelly’s congestion control in Internet streaming
![Page 39: Analysis of Rate-distortion Functions and Congestion ... · • Most existing CQ methods in scalable streaming are limited to the constant bitrate (CBR) case. – Channel bandwidth](https://reader035.fdocuments.us/reader035/viewer/2022070221/613a438f0051793c8c00f18a/html5/thumbnails/39.jpg)
39
Thank You!