Integrated Control-Path Design and Error Recovery in the ...
Error Recovery
description
Transcript of Error Recovery
![Page 1: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/1.jpg)
1
NUS.SOC.CS5248Ooi Wei Tsang
Error Recovery
![Page 2: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/2.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
2
Problems with Internet
Limited BandwidthVarying ConditionsDelay JitterPacket LossDelayHeterogeneity :
![Page 3: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/3.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
3
Network
Encoder
Sender
Middlebox
Receiver
Decoder
You Are Here
![Page 4: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/4.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
4
Overview
Characteristics of the InternetGeneral techniquesError recovery for audioEffect of loss on MPEGError recovery for MPEG
![Page 5: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/5.jpg)
5
NUS.SOC.CS5248Ooi Wei Tsang
Loss Characteristics of The Internet
![Page 6: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/6.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
6
Characteristics of Internet
60-70% of paths do not show any loss
Those with loss have an average of 4.5 – 6% packet loss
[Paxson97] End-to-end Internet packet dynamics
![Page 7: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/7.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
7
Packet Loss Pattern
1000
30
Number of Occurrences
Burst Length
![Page 8: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/8.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
8
Characteristics of Internet
Bursts of loss are typically short (2-3 consecutively loss packets)
Long burst do occur
Burst may occur periodically
![Page 9: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/9.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
9
Wireless Link
Loss rate measured in my office 10 ~ 20%
up to 50% reported!
![Page 10: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/10.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
10
Gilbert Model
GOOD BAD
![Page 11: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/11.jpg)
11
NUS.SOC.CS5248Ooi Wei Tsang
A Survey of Packet-Loss Recovery Techniques for Streaming Audio
Perkins, Hodson and HardmanIEEE Network Magazine 1998
![Page 12: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/12.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
12
Retransmission
1 2 3 4
1 2 4
3
3
X
![Page 13: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/13.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
13
Redundant Data
1 2 3 4
1 2 4
2
2 3
3 4 5
53
![Page 14: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/14.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
14
2 4
Error Concealment
1 2 3 4
1
![Page 15: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/15.jpg)
15
NUS.SOC.CS5248Ooi Wei Tsang
Retransmission
for audio
![Page 16: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/16.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
16
Pros/Cons of Retransmissions
![Page 17: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/17.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
17
Scalable Retransmission
On packet loss T = random(0, RTT) wait for T multicast NACK
On receiving NACK from others suppress own NACK
![Page 18: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/18.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
18
Retransmit when
Group size is small Loss rate is lowLarge latency acceptable
![Page 19: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/19.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
19
Selective Retransmission
Retransmission based on priority of packets
Important/urgent packets are retransmitted first
![Page 20: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/20.jpg)
20
NUS.SOC.CS5248Ooi Wei Tsang
Redundant Data
for audio
![Page 21: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/21.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
21
Parity Forward Error Correction
1011001
1000010
0001001
XOR 0010010
![Page 22: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/22.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
22
Parity Forward Error Correction
1011001
1000010
0001001
0010010
![Page 23: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/23.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
23
Parity FEC Ordering
![Page 24: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/24.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
24
Parity FEC Ordering
![Page 25: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/25.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
25
Parity FEC Ordering
![Page 26: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/26.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
26
Parity FEC Ordering
![Page 27: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/27.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
27
Parity FEC Ordering
![Page 28: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/28.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
28
Reed-Solomon Code
RS(n,k)
RS
n k
![Page 29: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/29.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
29
Reed-Solomon Code
![Page 30: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/30.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
30
Media Specific FEC
1 2 3 4
1 2 4
2
2 3
3 4 5
53
![Page 31: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/31.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
31
Pros/Cons of Redundant Data
![Page 32: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/32.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
32
Interleaving
![Page 33: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/33.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
33
Pros/Cons of Interleaving
![Page 34: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/34.jpg)
34
NUS.SOC.CS5248Ooi Wei Tsang
Error Concealment
![Page 35: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/35.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
35
Effect of Loss on Audio
Speech Human ears can interpolate Loss up to length of phoneme can
still be tolerable
![Page 36: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/36.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
36
Insertion-based Repair
SpliceSilence SubstitutionNoise SubstitutionRepetition
![Page 37: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/37.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
37
Other Repair Methods
InterpolationRegeneration
![Page 38: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/38.jpg)
38
NUS.SOC.CS5248Ooi Wei Tsang
Colin’s Recommendations
![Page 39: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/39.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
39
Non-Interactive Apps
InterleavingFECRetransmission for unicast only
![Page 40: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/40.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
40
Interactive Applications
Media Specific FEC
![Page 41: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/41.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
41
Error Concealment
Repeat
![Page 42: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/42.jpg)
42
NUS.SOC.CS5248Ooi Wei Tsang
Packet Loss Effects on MPEG Video Sent over the Public Internet
Jill Boyce and Robert GaglianelloACM Multimedia 1998
![Page 43: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/43.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
43
Measurement-based Study
Need to understand the problem before proposing solution
![Page 44: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/44.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
44
Data Gathering Method
From: NYC13 , Austin21, London18
To: Holmdel, NJ
![Page 45: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/45.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
45
Data Gathering Method
Video: Two 5-mins MPEG 30 fps 384 kbps and 1 Mbps IBBPBBPBBPBBPBB QSIF 176x112 and SIF 352x240 One row per slice
![Page 46: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/46.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
46
Average Packet Loss
0
2
4
6
8
10
12
14
Packet Loss Rate
(%)
New York Texas London
1Mbps384kbps
![Page 47: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/47.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
47
Frame Effected by Errors
% Frames in Error
Packet Loss Rate
![Page 48: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/48.jpg)
48
NUS.SOC.CS5248Ooi Wei Tsang
Overview of Error Recovery for Video
![Page 49: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/49.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
49
Methods
Retransmission InterleavingError ConcealmentFECLimiting Error Propagation
Reference Frame Selection
![Page 50: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/50.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
50
Reference Frame Selection
I P B B P
X
I
![Page 51: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/51.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
51
Methods
Retransmission InterleavingError ConcealmentFECLimiting Error Propagation
Reference Frame Selection Changing Temporal Pattern
![Page 52: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/52.jpg)
52
NUS.SOC.CS5248Ooi Wei Tsang
Error Control Techniques for Interactive Low Bitrate Video Transmission over The Internet
Injong RheeSIGCOMM ‘98
![Page 53: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/53.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
53
Basic Idea
“Better Late Than Never!”, orLate packet is still useful
![Page 54: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/54.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
54
MPEG Frame Pattern
I B B P B B P
I P B B P B B
![Page 55: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/55.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
55
H.261 Error Propagation
I P P P P P PX X X X X X
I P P P P P PX X X X
retransmission
loss
![Page 56: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/56.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
56
H.261 Frame Pattern
I P P P P P PX
loss
![Page 57: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/57.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
57
I P P P P P P
H.261 Frame Pattern
X
loss
X X
retransmission
![Page 58: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/58.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
58
PTDD
Periodic Temporal Dependency Distance
Large PTDD Higher Chance of Repair Longer Error Propagations Less Temporal Redundancy
![Page 59: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/59.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
59
QAL
I P P P
I P P P Base Layer
EnhancementLayer
![Page 60: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/60.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
60
QAL
I P P P
I P P P Base Layer + FEC
EnhancementLayer
X
![Page 61: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/61.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
61
QAL + PTDD
I P P P
I P P P Base Layer
EnhancementLayer
![Page 62: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/62.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
62
Error Propagation
![Page 63: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/63.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
63
Recovery from Error Propagation
![Page 64: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/64.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
64
Frame “quality”
PSNR =
![Page 65: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/65.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
65
PSNR vs. Loss Rate
Packet Loss Rate
PSNR
![Page 66: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/66.jpg)
66
NUS.SOC.CS5248Ooi Wei Tsang
Today’s Summary
![Page 67: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/67.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
67
How to recover packet loss
RetransmissionFECError Concealment
![Page 68: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/68.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
68
Limit the damage of error
InterleavingKey frame selectionChange reference frame
![Page 69: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/69.jpg)
69
NUS.SOC.CS5248Ooi Wei Tsang
Project Stage 2
Packet Reassembly and MPEG Decoding
![Page 70: Error Recovery](https://reader036.fdocuments.us/reader036/viewer/2022062314/56814483550346895db11ca6/html5/thumbnails/70.jpg)
NUS.SOC.CS5248Ooi Wei Tsang
70
Decoding Pipeline
MntRTPFileReader MntRTPDropper MntRTPMPEGReassembler
MntRTPMPEGFrameDecoder
MntPPMWriter
MntPSNRCalculator
MntRTPMPEGPacket
MntMPEGRTPReassemblerBuffer
MntRTPMPEGPacket
MntYUVFrame
MntYUVFrame