Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung...
-
Upload
elfreda-pitts -
Category
Documents
-
view
215 -
download
0
Transcript of Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung...
![Page 1: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/1.jpg)
Joint Optimization of Data Hiding and Video Compression
Jithendra K. Paruchuri & Sen-ching S. Cheung
Department of Electrical and Computer Engineering
Center for Visualization and Virtual Environments
University of Kentucky, Lexington, KY 40507
ISCAS - May 21, 2008
![Page 2: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/2.jpg)
Overview
• Motivation and Problem• Data Hiding Framework• Rate-Distortion Optimized Data Hiding• Results• Conclusion & Future Work
www.vis.uky.edu | Dedicated to Research, Education and Industrial Outreach | 859.257.1257
![Page 3: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/3.jpg)
• Smart video surveillance
• Biometric theft
• Mobile-media processing
• RFID tracking
Signal Privacy
![Page 4: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/4.jpg)
Identity ObfuscationOriginal
Pixelation/Blurring
Black Box
Object Removal- Segmentation + Video In-painting[Venkatesh 06, 08]
![Page 5: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/5.jpg)
Problem with Obfuscation
Police: Where were you 9am on Oct 1?
A: I was in my office.
Police: Do you have any proof?
A: ……
• Obfuscation destroys the authenticity• Original needed to legitimize the modification.• Accessed with proper authorization.
![Page 6: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/6.jpg)
Privacy Data Preservation
• Separate Files or Meta-data• Cryptographic Scrambling [Boult05],
[Dufaux06]
• Data Hiding in DCT [Zhang05]
– Works with any obfuscation techniques– High capability and low distortion– Fragile embedding– Eight-fold increase in output bit-rate!
![Page 7: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/7.jpg)
Data Hiding with Compression
Motion Compensation
DCTEntropyCoding
• DCT Domain• Frequency, contrast and luminance masking [Watson]
DCT PerceptualMask
ParityEmbedding
Last decodedframe
www.vis.uky.edu | Dedicated to Research, Education and Industrial Outreach | 859.257.1257
![Page 8: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/8.jpg)
Embedding & Perceptual Distortion
• To embed x in a quantized DCT coeff. c(i,j,k)
• Select coefficients to minimize distortion– Contrast masking
– Frequency masking
– Distortion
![Page 9: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/9.jpg)
Causes of Bit-rate Explosion
• Disturbing the ‘favorable characteristics’ (zero blocks & long run-lengths) for entropy coding
• Data embedding inserts noise into motion compensation loop
www.vis.uky.edu | Dedicated to Research, Education and Industrial Outreach | 859.257.1257
Proposed solution: Identify specific DCT coefficients for data hiding that minimizes both the output rate and distortion
Proposed solution: Identify specific DCT coefficients for data hiding that minimizes both the output rate and distortion
![Page 10: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/10.jpg)
R-D optimized Data Hiding
Motion Compensation
DCTEntropyCoding
• DCT Domain• Frequency, contrast and luminance masking [Watson]
H.263 H.263
DCT PerceptualMask
ParityEmbedding
R-D Optimization
Positions of the “optimal’DCT coeff forembedding
Last decodedframe
www.vis.uky.edu | Dedicated to Research, Education and Industrial Outreach | 859.257.1257
ParityEmbedding
![Page 11: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/11.jpg)
Constrained Optimization
Let Rk(Mk) and Dk(Mk) be the rate and distortion after hiding Mk bits into the k-th DCT block. δ is a user-defined weight
Optimization Problem:
![Page 12: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/12.jpg)
Calculations of Rk(Mk) and Dk(Mk)
• Two Issues:– Parity embedding depends on hidden data– Need to find optimal selection as well
• “Worst-case” embedding on previous frame
• Optimal selection– Dk(Mk) is additive (easy)– Rk(Mk) is not: Rk(N) and Rk(N+1) may use
very different coefficients
![Page 13: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/13.jpg)
• Dynamic Programming
• Greedy Approximation– Pick next coefficient to minimize cost– Fast implementation
Dynamic Programming versus Greedy approach
EmbeddingK-th bit
EmbeddingK+1-st bit
i+1
i
i+2
i+1
i+2
i+3 i+3
![Page 14: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/14.jpg)
Performance Comparison
• For CIF, Greedy needs 26 second/frame vs. DP needs 22 minutes/frame
![Page 15: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/15.jpg)
Dual of the optimization• Lower bounded by unconstrained opt:
• Search λ to meet constraint – Start at 2nd order approximation of Ck(Mk)
• 3-5 seconds per one CIF frame
0 10 20 30 40 50 60 700
2
4
6
8
10
12
14
Nof of bits embedded
Dis
tort
ion
Distortion versus N for a DCT block in frame 1
![Page 16: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/16.jpg)
Experiment 1: Hall Monitor
![Page 17: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/17.jpg)
Hall Monitor (QP=10)
Weight δ
Rate In kbps
Perceptual Distortion
Rate Increase
Separate Files
119.5+81= 200.5 0 0%
0 328 21.65 63.8%
0.5 302 27 50.9%
1 287 102 43.4%
www.vis.uky.edu | Dedicated to Research, Education and Industrial Outreach | 859.257.1257
![Page 18: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/18.jpg)
Hall Monitor (QP=10)Original Distortion Optimized
Weight = 0.5 Rate Optimized
![Page 19: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/19.jpg)
Surveillance Video
![Page 20: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/20.jpg)
Surveillance (QP=10)
www.vis.uky.edu | Dedicated to Research, Education and Industrial Outreach | 859.257.1257
Weight δ
Rate In kbps
Perceptual Distortion
Rate Increase
Separate Files
153.97+77.34 =231.31
0 0%
0 379.73 17.55 64.2%
0.5 359.76 21.58 55.5%
1 341.72 74.79 47.7%
![Page 21: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/21.jpg)
Surveillance (QP=10)
Original
Distortion Optimized
Rate Optimized
Weight=0.5
![Page 22: Joint Optimization of Data Hiding and Video Compression Jithendra K. Paruchuri & Sen-ching S. Cheung Department of Electrical and Computer Engineering.](https://reader034.fdocuments.us/reader034/viewer/2022051517/5697bfbc1a28abf838ca1795/html5/thumbnails/22.jpg)
Conclusions
• Privacy Data Preservation with Data Hiding• R-D Optimization Framework for Data Hiding• Current work
– Reversible Data Embedding: ICIP 2008– Privacy Data Management: ICIP 2008– Incorporate temporal dimension in perceptual and
rate model– Joint encryption and data hiding
www.vis.uky.edu | Dedicated to Research, Education and Industrial Outreach | 859.257.1257