Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J....

Post on 20-Sep-2020

0 views 0 download

Transcript of Creating cinematic wide gamut HDR-video for the evaluation ...froehlichj/hdm-hdr-2014... · J....

J. Froehlich, S. Grandinetti! Slide 1 of 35!Creating Wide Gamut High Dynamic Range Video!

Creating cinematic wide gamut HDR-video for the evaluation of tone mapping operators and HDR-displays !

SPIE Electronic Imaging 2014!!

Jan Froehlich, Stefan Grandinetti, Bernd Eberhardt, Simon Walter, Andreas Schilling, Harald Brendel

!!

J. Froehlich, S. Grandinetti! Slide 2 of 35!Creating Wide Gamut High Dynamic Range Video!

Outline of the Talk!

-  Motivation!-  Methods!

-  Mirror Rig!

-  Limitations!-  Ghostings!-  Flare and Straylight!

-  Results!-  Future Work!-  Conclusion!

J. Froehlich, S. Grandinetti! Slide 3 of 35!Creating Wide Gamut High Dynamic Range Video!

Motivation!

-  Brightness and dynamic range of consumer displays will probably increase over the next years:!

h"p://variety.com/2014/digital/columns/when<it<comes<to<tvs<forget<4k<its<the<brightness<stupid<1201055191/B(receivedB19.01.2014)B

J. Froehlich, S. Grandinetti! Slide 4 of 35!Creating Wide Gamut High Dynamic Range Video!

Motivation!

-  Plenty of test image sets for still image manipulation!-  No comprehensive data set for HDR-Video manipulation yet

established.!

Kodak,BKodimBImageBSequenceB ‘Lena’BImageB

J. Froehlich, S. Grandinetti! Slide 5 of 35!Creating Wide Gamut High Dynamic Range Video!

Motivation!

-  Existing HDR video data sets show non-staged everyday scenes without cinematic staging and lighting!

Krawczyk,BG.B,BHDRBVideoBSamplesB Ungers,BJ.,BLiUBHDRvBRepositoryB<BResourcesB

J. Froehlich, S. Grandinetti! Slide 6 of 35!Creating Wide Gamut High Dynamic Range Video!

Motivation!

Image quality is not only determined by !-  Signal quality of the image acquisition system!

But also by!-  Lighting!-  Make-up!-  Staging!-  Framing!-  Acting!

‘Lena’BImageBStefanBinBhisBofficeB

J. Froehlich, S. Grandinetti! Slide 7 of 35!Creating Wide Gamut High Dynamic Range Video!

Methods!

Use a mirror rig to enhance dynamic range!

Quelle: http://www.dlp.com!

J. Froehlich, S. Grandinetti! Slide 8 of 35!Creating Wide Gamut High Dynamic Range Video!

Methods!

Image processing pipeline (In-camera processing)!

Quelle: http://www.dlp.com!

J. Froehlich, S. Grandinetti! Slide 9 of 35!Creating Wide Gamut High Dynamic Range Video!

Methods!

Image processing pipeline (Postproduction)!!

Quelle: http://www.dlp.com!

J. Froehlich, S. Grandinetti! Slide 10 of 35!Creating Wide Gamut High Dynamic Range Video!

Quelle: http://www.dlp.com!

LowlightBPreservingBImageB

J. Froehlich, S. Grandinetti! Slide 11 of 35!Creating Wide Gamut High Dynamic Range Video!

Quelle: http://www.dlp.com!

HighlightBPreservingBImageB

J. Froehlich, S. Grandinetti! Slide 12 of 35!Creating Wide Gamut High Dynamic Range Video!

Quelle: http://www.dlp.com!

RecWfiedBHighlightBPreservingBImageB

J. Froehlich, S. Grandinetti! Slide 13 of 35!Creating Wide Gamut High Dynamic Range Video!

Quelle: http://www.dlp.com!

CombinaWonB

J. Froehlich, S. Grandinetti! Slide 14 of 35!Creating Wide Gamut High Dynamic Range Video!

Limitations!

Double contours in long focal length shots!

Quelle: http://www.dlp.com!

HighlightBPreservingB(HLP)BBHLPBw.BDeConvoluWonBBBBBBHLPBCombinedBwithBLowlightBBB B B BBBBBPreservingBImageB

TheBreflecWonBatBtheBsideBofBtheBmirrorBtowardsBtheBLowBlightBpreservingBCameraB(94%)BcausesBdoubleBcontoursBinBtheBBHighlightBperservingBcamera.B(DashedBLine)B

J. Froehlich, S. Grandinetti! Slide 15 of 35!Creating Wide Gamut High Dynamic Range Video!

Limitations!

Flares & Straylight!

J. Froehlich, S. Grandinetti! Slide 16 of 35!Creating Wide Gamut High Dynamic Range Video!

Staging HDR challenges!

Quelle: http://www.dlp.com!

< BCinemaWcBlookBofBmoviesBorBcommercialsB< BCharacterfulBlighWngBdesignBinBstudio<scenesB<BDocumentaryBsceneriesBrepresentBdifficultBlighWngBsituaWonsB

J. Froehlich, S. Grandinetti! Slide 17 of 35!Creating Wide Gamut High Dynamic Range Video!

Four categories!

1.  Sunlight Scenes!!!2.  Low Key Scenes!!!3.  Wide Gamut and Moving Lights!!!4.  High Contrast Skintones!

B BB

Quelle: http://www.dlp.com!

J. Froehlich, S. Grandinetti! Slide 18 of 35!Creating Wide Gamut High Dynamic Range Video!

Presentation of the Material!

B BB

Quelle: http://www.dlp.com!

-  Note:!

-  The interactive presentation of the HDR-video test set is not included in this presentation.!

J. Froehlich, S. Grandinetti! Slide 29 of 35!Creating Wide Gamut High Dynamic Range Video!

Results!

0BStopsB

B<5BStopsB

95%BQuanWleBBB50%BQuanWleB(Median)BBB5%BQuanWleBB

J. Froehlich, S. Grandinetti! Slide 30 of 35!Creating Wide Gamut High Dynamic Range Video!

Results!

-  High temporal contrasts present challenges for video tone mapping operators!

„Showgirl“B OffsetBbetweenBfirstBandBsecondBrowBbeforeBdelinearisaWonBtoBsRGB:B5BStopsB/B1:32B

J. Froehlich, S. Grandinetti! Slide 31 of 35!Creating Wide Gamut High Dynamic Range Video!

Results!

-  Different display technologies show different weaknesses!

Example:BDeficienciesBofBvariableBbacklightBmonitorsB

J. Froehlich, S. Grandinetti! Slide 32 of 35!Creating Wide Gamut High Dynamic Range Video!

Results – Evaluation of HDR Displays:!

-  Example: Deficiencies of variable backlight monitors !

-  FOTOS DOLBY KERZEN!

J. Froehlich, S. Grandinetti! Slide 33 of 35!Creating Wide Gamut High Dynamic Range Video!

Results – Evaluation of HDR Displays:!

-  Example: Deficiencies of variable backlight monitors !

-  FOTOS DOLBY KERZEN!

J. Froehlich, S. Grandinetti! Slide 34 of 35!Creating Wide Gamut High Dynamic Range Video!

Future Work!

-  Material appearance is improved through capturing a wider dynamic range e.g. specular highlights!

-  Reproduction of bright light sources and saturated highlights closer to human perception!!!

-  High contrast images provide new esthetics for image design!

-  HDR is a new enrichment for cinematic storytelling !!

J. Froehlich, S. Grandinetti! Slide 35 of 35!Creating Wide Gamut High Dynamic Range Video!

Conclusion!

-  We created a new HDR-Video dataset.!

-  Cinematically staged scenes facilitate image quality assessment.!

-  High temporal and spatial contrasts provide a challenge for tone mapping operators and HDR-displays.!

-  Freely available for academic use. Download at the project website: http://www.hdm-stuttgart.de/~froehlichj/hdm-hdr-2014/ !

J. Froehlich, S. Grandinetti! Slide 36 of 35!Creating Wide Gamut High Dynamic Range Video!

Thank you for joining our talk!!