G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November...
-
Upload
ellen-harrison -
Category
Documents
-
view
217 -
download
2
Transcript of G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November...
![Page 1: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/1.jpg)
G. Valenzise*, M. Tagliasacchi*, S. Tubaro*, L. Piccarreta
Picture Coding Symposium 2007November 7-9, 2007 – Lisboa, Portugal
*Dipartimento di Elettronica e Informazione,Politecnico di Milano
![Page 2: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/2.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Transmit multiple video streams over a shared channel◦ Broadcast television◦ Video-surveillance◦ etc…
The channel bandwidth is limited Equal bandwidth partitioning is not
optimal
band
wid
th
time
Stream 1
Stream 2
Stream 3band
wid
th
time
Stream 1
Stream 2
Stream 3
![Page 3: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/3.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Find an optimal way to allocate channel bandwidth among sequences
Example: two video sequences
time
time time
![Page 4: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/4.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Formulate the MINAVE and MINVAR problems in the -domain
Assumptions:◦ Constant bit rate (CBR) channel◦ Frame-by-frame optimization
Find a closed form solution for the MINVAR Compare the MINAVE and MINVAR criteria
◦ Check the coding efficiency loss for the average distortion
Relax the CBR assumption◦ Temporal smoothing
![Page 5: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/5.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Rate-distortion operational curve of each frame can be described in the ρ-domain (He and Mitra, 2002):
ρ-domain parameters can be estimated from decoded sequences
![Page 6: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/6.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
(He and Mitra, 2002)
![Page 7: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/7.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Which is equivalent to solving
When
![Page 8: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/8.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
MINAVE
MINVAR
![Page 9: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/9.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Average distortion of MINAVE
Average distortion of MINVAR
We know (by definition!) QUESTION:
◦ What is the coding efficiency loss?
![Page 10: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/10.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
![Page 11: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/11.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Average distortion of MINAVE
Average distortion of MINVAR
The coding efficiency loss is
![Page 12: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/12.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
![Page 13: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/13.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Relax the CBR assumption◦ Introduce a shared encoder buffer to perform VBR encoding
We apply the MINVAR rate allocation while at the same time achieving temporal smoothing
For each time instant:1.Compute the CBR distortion profile2.Smooth it with the low-pass filter (He, Zen and Chen, 2005)
3.Set Dsmooth as the target distortion and compute rates Ri
Relax or tighten the rate constraint according to the current buffer level
![Page 14: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/14.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
![Page 15: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/15.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
H.264decoder
H.264decoder
H.264decoder
...
H.264 bitstream
H.264 bitstream
H.264 bitstream
Rate controller
H.264encoder
H.264encoder
H.264encoder
![Page 16: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/16.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
MINAVE
MINVARsmoothed MINVAR
![Page 17: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/17.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
MINAVE
MINVARsmoothedMINVAR
![Page 18: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/18.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Summary:◦ Proposed a MINVAR bit allocation for multiplexed
video sequences◦ The MINVAR allocation leverages on the -domain
model (but works on any exponential model, i.e. at high rates)
◦ The coding efficiency loss w.r.t. MINAVE is, on average, of 0.5 dB
Future work:◦ Apply the MINVAR approach to Scalable Video
Coding solve a discrete optimization problem…
![Page 19: G. Valenzise *, M. Tagliasacchi *, S. Tubaro *, L. Piccarreta Picture Coding Symposium 2007 November 7-9, 2007 – Lisboa, Portugal * Dipartimento di Elettronica.](https://reader035.fdocuments.us/reader035/viewer/2022081519/56649d895503460f94a6f74f/html5/thumbnails/19.jpg)
A -domain Rate Controller for Multiplexed Video SequencesPCS 2007, November 7, 2007
Questions?