ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered...
Transcript of ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered...
![Page 1: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/1.jpg)
ITU-R Workshop Topics on the Future of Audio in Broadcasting
Movies and the immersive experience
Hubert Henle [email protected]
15.7.2015
![Page 2: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/2.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Overview
o Adaption of theatrical immersive sound formats
o Options for user interactivity
![Page 3: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/3.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Overview
Adaption of theatrical immersive sound formats
Options for user interactivity
![Page 4: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/4.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Audio formats currently in use for feature film soundtracks
• Channel based
• 5.1 (L-C-R-Ls-Rs-SW)
• 7.1 (L-C-R-Ls-Bsl-Bsr-Rs-SW)
• 11.1 Auro 3D (5.1 + 5 Height + 1 Overhead)
• Formats supporting audio objects
• Dolby Atmos (9.1 + 118 objects, 64 speaker positions)
Immersive
Non-Immersive
Adaption of theatrical immersive sound formats
![Page 5: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/5.jpg)
Adaption of theatrical immersive sound formats
![Page 6: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/6.jpg)
Adaption of theatrical immersive sound formats
![Page 7: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/7.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Audio formats currently in use for feature film soundtracks
• Channel based
• 5.1 (L-C-R-Ls-Rs-SW)
• 7.1 (L-C-R-Ls-Bsl-Bsr-Rs-SW)
• 11.1 Auro 3D (5.1 + 5 Height + 1 Overhead)
• Formats supporting audio objects
• Dolby Atmos (9.1 + 118 objects, 64 speaker positions)
Immersive
Non-Immersive
Adaption of theatrical immersive sound formats
![Page 8: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/8.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Challenge: Number of Objects and speakers
• Dolby Atmos supports 9.1 „bed“ and 118 simultaneous objects rendered into 64 speaker locations
• However: Not all objects will actually be dynamic i.e. moving!
• It is unrealistic to replicate this in a consumer format • Bandwidth of transmission and playback renderer • Speaker resolution
Adaption of theatrical immersive sound formats
![Page 9: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/9.jpg)
Adaption of theatrical immersive sound formats
![Page 10: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/10.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Manage Objects
• Pre-Rendering into channel format
• Transform into Higher-Order Ambisonic format
• Preserve (selected) objects
Adaption of theatrical immersive sound formats
![Page 11: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/11.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Manage Dynamic Objects: Pre-Rendering
• 7.1 + 4 channel format
• Rendering tools for ProTools available
• Full control on production side
• No metadata
• Possibly limited flexibility with speaker placement in the home
Adaption of theatrical immersive sound formats
![Page 12: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/12.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Manage Dynamic Objects: Higher-Order Ambisonic
Adaption of theatrical immersive sound formats
• More flexibility with speaker placement
• Preserves location information
![Page 13: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/13.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Manage Dynamic Objects: Preserve selected objects
Adaption of theatrical immersive sound formats
• Conversion of source metadata into MPEG-H format
• Remaining objects processed as described above
• Requires artistic decisions by the content creator
![Page 14: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/14.jpg)
ITU-R Workshop “Topics on the Future of Audio in Broadcasting” Hubert Henle 15.7.2015
Overview
Adaption of theatrical immersive sound formats
Options for user interactivity
![Page 15: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/15.jpg)
Interactivity for movie soundtracks?
Options for user interactivity
• Rebalance dialogue against music and effects
• Choice between different language versions
Dialogue must be delivered separately!
![Page 16: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/16.jpg)
5.1 Workflow in feature film mixing
Options for user interactivity
Effects
Music
DialogDialog
Music
Effects
Dialog
Dialog
.
.
.
Music
Music
.
.
.
Effects
Effects
.
.
.
ProToolsand/or
Mixing Console
Sound-Elements Pre-Dubs Final Mix
5.1 Dialog
5.1 Music
5.1 Effects
ProToolsand/or
Mixing Console
5.1 M&E
![Page 17: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/17.jpg)
Interactivity for movie soundtracks
Options for user interactivity
• 5.1 dialogue and M&E available as standard deliverable from (almost) all feature film mixes
• Dialogue can be delivered as an audio object in MPEG-H
• Bandwidth overhead reasonable
![Page 18: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/18.jpg)
Rebalance dialogue against M&E
Options for user interactivity
• Personal preferences
• Adapt to listening environment
• Simple GUI to allow rebalancing within reasonable limits (set by metadata)
![Page 19: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/19.jpg)
Choice between different language versions
Options for user interactivity
• Multiple language versions in single transport stream
• Alternative delivery methods for additional languages
• Broadcaster’s webpage
![Page 20: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/20.jpg)
Other benefits
Options for user interactivity
• DRC
• Dialogue and M&E can be processed independently
• Less prone to unwanted side effects
![Page 21: ITU-R Workshop 150715 · • Choice between different language versions Dialogue must be delivered separately! ... 5.1 Effects ProTools and/or Mixing Console 5.1 M&E. Interactivity](https://reader035.fdocuments.us/reader035/viewer/2022070903/5f5e1f929ffc48648a1f4fc0/html5/thumbnails/21.jpg)
ITU-R Workshop Topics on the Future of Audio in Broadcasting
Movies and the immersive experience
Hubert Henle [email protected]
15.7.2015
Thank you!