Where are my Closed Captions? Managing and...
Transcript of Where are my Closed Captions? Managing and...
![Page 1: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/1.jpg)
Where are my Closed Captions? Managing and Monitoring
Ancillary Data
Sara Kudrle Miranda Technologies
A BELDEN Brand
![Page 2: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/2.jpg)
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
![Page 3: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/3.jpg)
Ingest and Quality Control
Playout and Graphics
Publishing for On Demand
Editing and Content Prep
Live Production
Media Management and Storage
Automation
Linear Channels
Pre- Produced Content and Ads
WAN Non Linear Delivery WAN
Typical Television Broadcast Facility and Workflow
![Page 4: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/4.jpg)
Broadcast Facilities Have Been Stream / SDI Centric
Ingest and Quality Control
Playout and Graphics
Non Linear Publishing
Editing and Content Prep
Live Production
Media Management and Storage
Automation
Linear Channels
Pre- Produced Content and Ads
WAN
Linear Feeds
Tape (Linear Medium)
Linear Streams
Isolated Islands of IT / File Based Infrastructure
Broadcast Industry Specific SDI Infrastructure
Non Linear Delivery WAN
![Page 5: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/5.jpg)
Today Facilities Becoming Increasingly “File Based”
Ingest and Quality Control
Playout and Graphics
Non Linear Publishing
Editing and Content Prep
Live Production
Media Management and Storage
Automation
Editing and Content Prep
Live Production
Linear Channels
Pre- Produced Content and Ads
WAN
Tape (Linear Medium) Non Linear
Delivery WAN
Media Files
Media Files
Linear Feeds
Linear Streams
Isolated Islands of IT / File Based Infrastructure
Broadcast Industry Specific SDI Infrastructure
Broadcast Industry Specific SDI Infrastructure
IT / File Base Infrastructure
![Page 6: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/6.jpg)
It Was So Easy in the Good Old Days
Video: Location Fixed, Format Specified (SMPTE-292M / 274M …) Audio: 16 Channel, Location Fixed in ANC Data Space (SMPTE-299M) Timecode: Location Fixed in ANC (SMPTE-291M) Captions: Location Fixed in ANC (SMPTE-299M) AFD: Location Fixed in ANC (SMPTE-2016M) Dolby Metadata: Location Fixed in ANC (SMPTE-2020M)
HD-SDI
![Page 7: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/7.jpg)
Perhaps Too Easy?
Essence Descriptors: • SOM: HH:MM:SS:FF • EOM: HH:MM:SS:FF
• Audio 1, 2:e Dolby E Descriptive Metadata:
• Title • Episode
• Creation Date
THESE DATA?
HD-SDI
![Page 8: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/8.jpg)
Contrasting the good ‘ol days versus today
• File wrapper format “standards” that are too loose and interpreted in too many different ways (e.g. MXF)
WAN Files
• Missing / misplaced meta data
SDI
• “Iron Clad” tape formats • “Cast in stone” device
interconnect (SMPTE SDI) with precise
• No provisions for descriptive meta data
Then (the good ‘ol days)
Today (the wild west)
![Page 9: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/9.jpg)
The Early Days of File Based Same Vendor Provides Ingest and Playout
SDI
SDI
SDI
Third party media server
Homogeneous Environment ONE Common File Format
INGEST PLAYOUT
STORE
![Page 10: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/10.jpg)
Today’s Reality – The Wild West of Files
SDI
Third party media server
INGEST
PLAYOUT
STORE
Networked VTRS
WAN File Delivery Service
IMX
LXF
?XF Ethernet /
IP Network
MXF Flv A
![Page 11: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/11.jpg)
Most File Formats are Not
Interoperable
IMX LXF ?XF MXF Flv X X X X
![Page 12: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/12.jpg)
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
![Page 13: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/13.jpg)
Anatomy of a Media File
Wrapper
Codec
Essence
![Page 14: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/14.jpg)
Anatomy of a Media File
Ties Essence together & describes it • Structural metadata such as SOM, EOM,
Duration, types of media included in file, etc. • Descriptive metadata such as creation date, usage
rules, key words • Time References and Index
• Video (typically compressed) • Multiple Audio (often compressed) • Ancillary Data (e.g. Captions, AFD, …)
“Essence”:The actual media which includes:
Wrapper:
Media File
![Page 15: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/15.jpg)
Two Storage Approaches
Wrapper
Descriptive Metadata
Timecode / index
Video Essence
Audio Essence(s) Audio Essence(s)
Ancillary Data Essence
Method 1: Embedded Essence
Examples: • MXF XDCAM • GXF • LXF
One File
Structural Metadata
Method 2: Reference Files / External Essence
Wrapper
Descriptive Metadata
Timecode / index
Video Essence
Audio Essence(s) Audio Essence(s)
Ancillary Data Essence
Structural Metadata
Main File
Multiple “Referenced” Files
Examples: • Omneon MOV • MXF P2 • MXF AS-02
![Page 16: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/16.jpg)
Two Storage Approaches
Wrapper
Descriptive Metadata
Timecode / index
Video Essence
Audio Essence(s) Audio Essence(s)
Ancillary Data Essence
Method 1: Embedded Essence
Examples: • MXF XDCAM • GXF • LXF
One File
Structural Metadata
Method 2: Reference Files / External Essence
Wrapper
Descriptive Metadata
Timecode / index
Video Essence
Audio Essence(s) Audio Essence(s)
Ancillary Data Essence
Structural Metadata
Main File
Multiple “Referenced” Files
Examples: • Omneon MOV • MXF P2 • MXF AS-02
Benefit: one file includes everything, easier media management
Benefit: Additional essences can be more quickly added after the fact (e.g multiple languages audio and captions)
![Page 17: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/17.jpg)
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
![Page 18: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/18.jpg)
Popular Wrapper Formats
Vendor Specific Wrappers Associated with Camera and VTR Formats
Vendor Specific Server Formats
Generic Industry Wrappers
.MOV
P2 MXF (Panasonic)
Wrappers Originating in PC/Multi-Media
MXF OP1a
MXF-AS-XX
GXF (Grass Valley)
LXF (Harris)
IMX/XDCAM MXF (Sony)
.AVI
MPEG TS File
Television Distribution format
![Page 19: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/19.jpg)
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2 MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Popular Wrapper Formats
![Page 20: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/20.jpg)
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2 MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Key Features / Functionality
![Page 21: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/21.jpg)
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2 MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Not Supported
(Bad)
Strongly Supported (Very Good)
Partially Supported
![Page 22: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/22.jpg)
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Observation 1: There are a lot of wrapper formats and they are obviously very different
Observation 2: No ONE wrapper format supports all the identified functionality
![Page 23: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/23.jpg)
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Observation 3: There are a couple clear “bad choices”
![Page 24: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/24.jpg)
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Observation 4: At first glance MXF appears promising but in reality has turned out to have major interoperability issues
Key Features of Popular Media Wrappers
![Page 25: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/25.jpg)
Key Features of Popular Media Wrappers
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom)
MXF AS-02
Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Observation 5: Hard-core constraints (Tape Fmt Heritage), Clearly Documented, No Ambiguity Reasonable bit rate (HD at 50 Mbps), Wide NLE and Server Support IMX / XDCAM MXF has turned out to be a very popular Generic File Format
![Page 26: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/26.jpg)
Wrapper Divergence!
![Page 27: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/27.jpg)
Why MXF Cannot Solve All The Issues
More Specific More constraints Better Generic MXF
LXF Leitch Harris
GXF Grass Valley
IMX/XDCAM MXF Sony
Vendor Specific Variants
Generic Variants
• Far too loose & flexible
• Subject to broad interpretation
• No hard reference
• Vendor specific • Some published • Some proprietary • Overly constrained • Harder to Extend • No reference
implementation
AS-02 Versioning
AMWA Application Specifications
AS-03 Program Delivery
AS-10 Production AS-12
Ad Delivery
AS-11 Contribution
• Constraints on MXF for different Applications
• Industry Standard ?
![Page 28: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/28.jpg)
AMWA MXF AS-XX Application Specifications • Defined by AMWA (Advanced Media Workflow Association)
• AS-XX MXF Specifications Define a set of rules / constraints on MXF to suit a particular use
• Defines MXF use for different situations / applications • Shims constrain further to meet needs of a user
MXF
Constrained Parameters, and Values
Available Codecs
Constraints on Codecs and
Bit-rate ranges
AS-XX - Application Specification User A SHIM User B SHIM
![Page 29: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/29.jpg)
AS-XX Format Summary
Number Application Domain Essences CODECs
HD Bit Rates (Mbps)
Meta Data
AS-02 Versioning External Not Specified Depends on Codec
AS-03 Program Delivery
Embedded MPEG2, H.264 LGOP
5-50 Mb/s
AS-10 Production (e.g. Sony XDCAM MXF)
Embedded MPEG-2 MP@HL, MPEG-2 422P@HL MPEG-2 MP@H14 LGOP
Depends on Codec
AS-11 Contribution Embedded AVC Intra 100 Mbps
AS-12 Ad Delivery Embedded MPEG2, H.264 LGOP
5-50 Mb/s
![Page 30: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/30.jpg)
PGMX_HDVideo.mxf -
AS02_clips
PGMX_Audio_English.mxf PGMX_Audio_Spanish.mxf
PGMX - PGMX_English.mxf
Media
PGMX_Spanish.mxf
-
PGMX_ANC_English.mxf PGMX_ANC_Spanish.mxf Extra
• Defined by users (AMWA members)
• Places constraints on MXF for versioning of synchronized essences
• Allows any number of audio and caption tracks to be added and chosen at playout time
MXF AS-02
![Page 31: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/31.jpg)
MXF AS-03
• Optimized for the delivery of finished programs • Carries built-in metadata relevant to playout:
– House ID, ISAN, Ad ID/ISCI or UUID – Slate Title – Series Code and Episode number – SOM/EOM – AFD Code, V-Chip Rating, Nielsen Stream ID
![Page 32: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/32.jpg)
MXF AS-02 to AS-03 Re-Wrapping
• Going from AS-02 to AS-03 is a simple re-wrap operation
• Think of AS-03 as a flattened, single language version of AS-02
PGMX_English_AS-03.mxf
PGMX_HDVideo.mxf -
AS02_clips
PGMX_Audio_English.mxf PGMX_Audio_Spanish.mxf
PGMX - PGMX_English.mxf
Media
PGMX_Spanish.mxf
-
PGMX_ANC_English.mxf PGMX_ANC_Spanish.mxf Extra
AS-03
![Page 33: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/33.jpg)
Different AS-XX Specifications for Different Apps
AS-12 Ad Delivery
Regional Playout Facility Central Broadcaster / Playout Content Creation
AS-02 Versioning
AS-10 End to End ( Acquisition – Production – Playout)
AS-11 Contribution
Aquisition Post Contribution Playout Preparation Distribution
AS-03 Program Delivery
Packaging of multiple versions of same program Multiple Languages, Multiple Editorial Versions
Delivery of finished programs. Single File, single audio language, constrained codecs
Delivery of finished Commercials. Identical to AS-03 but with Advertising specific Meta Data
Enable Interoperation and an end to end workflow without transcoding. Specifies Long GOP MPEG2 codec at a decent bit rate Designed as extension to SMPTE RDD 9 and is used by IMX & XDCAM-HD
Vendor-neutral file format for the delivery of finished program material. Similar to AS-03 but features higher bit rate AVC-Intra video and uncompressed Audio
![Page 34: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/34.jpg)
Different AS-XX Specifications for Different Apps
AS-12 Ad Delivery
Regional Playout Facility
Central Broadcaster / Playout
Content Creation
AS-02 Versioning
AS-10 Production using Long GOP Codec (e.g. XDCAM)
AS-11 Contribution
Aquisition Post Contribution Playout Preparation Distribution
AS-03 Program Delivery
Delivery of finished programs. Single audio language, constrained codecs
= User A SHIM User B SHIM Observation : Even within versions, AMWA has specified that “An Application Specification can be further constrained to meet the needs of a user through use of a SHIM”
In other words, they are different
![Page 35: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/35.jpg)
• Constraints on MXF for different Application
• Industry Standard ? More
Specific Better
MXF
LXF Leitch/Harri
s
GXF Grass Valley
IMX/XDCAM MXF Sony
Vendor Specific Variants
Generic Variants
AS-02 Versioning
AMWA Application Specifications
AS-03 Program Delivery
AS-10 Production AS-12
Ad Delivery
AS-11 Contributio
n
Why MXF Cannot Solve All The Issues
![Page 36: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/36.jpg)
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
![Page 37: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/37.jpg)
MPEG2 TS
MOV/ MP4 AVI
GXF or
LXF
Gen MXF
IMX/ XDCAM
MXF
P2 MXF
Avid MXF
(OP Atom)
MXF AS-02 / AS-03
Timecode *** *** *** *** *** *** ***
Captions *** ** *** *** ** ** ***
AFD *** *** *** ** ** ***
Dolby Metadata
*** *** *** ** ** ***
V-chip *** *** *** ** ** ***
Ad Insertion Triggers
*** *** *** ** ** ***
Ancillary Data Support by Wrapper
![Page 38: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/38.jpg)
Ancillary Data Four main ways to carry Ancillary data in files
In the VBI portion of video (IMX only) In the MPEG GOP Header (limited) In the wrapper (limited) As a s436m payload
![Page 39: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/39.jpg)
ANC Data In Legacy File Formats Was Inconsistent and Incomplete
HANC Audio T/C
VANC AFD, Dolby, CC, VCHIP, SCTE Triggers, Private Data
Active Video
File Wrapper
Video Essence
Audio Essence (s)
Some ANC in Codec Header
Some ANC in Wrapper Meta
SDI
Time Code
And / Or
Some, Not All
Some ANC in VBI (SD only)
Legacy File Formats
![Page 40: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/40.jpg)
Ancillary Data
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
XDS V-Chip WSS AFD
Timecode Closed Captions
![Page 41: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/41.jpg)
VBI (IMX Only)
Ancillary Data
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
XDS V-Chip WSS AFD
Timecode Closed Captions
![Page 42: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/42.jpg)
VBI (IMX Only) Codec Header
Ancillary Data
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
XDS V-Chip WSS AFD
Timecode Closed Captions
![Page 43: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/43.jpg)
VBI (IMX Only) Codec Header
Wrapper Metadata
Ancillary Data
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
XDS V-Chip WSS AFD
Timecode Closed Captions
![Page 44: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/44.jpg)
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
VBI (IMX Only) Codec Header
Wrapper Metadata
Key ANC Data not Captured
Ancillary Data
XDS V-Chip WSS AFD
Timecode Closed Captions
![Page 45: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/45.jpg)
ANC Data In Legacy File Formats Was Inconsistent and Incomplete
HANC Audio T/C
VANC Various ANC Data
Active Video
Original Source Video Legacy File Formats
File Wrapper
Video Essence
Audio Essence (s) Time Code
Playback Video
Ingest HANC Audio T/C
VANC Various ANC Data
Active Video
Playback
Missing ANC Data
Can’t Easily Add or Modify ANC Data to File
Original ANC Data Subset of
ANC Data
![Page 46: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/46.jpg)
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
What We Can Do Now
![Page 47: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/47.jpg)
SMPTE To the Rescue
SMPTE 436M: MXF Mappings for
VBI Lines and Ancillary Data Packets
![Page 48: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/48.jpg)
Codec Header
Wrapper Metadata
SMPTE 436m
Key ANC Data NOW Captured
Ancillary Data
XDS V-Chip WSS AFD
Timecode Closed Captions
Dolby Metadata
SCTE-104 Ad Triggers
Broadcast Flag
OP47 Teletext
Private Data
$
![Page 49: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/49.jpg)
Wrapper
Video Essence
Audio Essence
SMPTE 436 ANC Essence CC
AFD DOLBY SCTE Propri
Frame Accurate Index DID ANC
Data Line Num H C
S
MXF File with 436M Essence
CC AFD
DOLBY SCTE Propri
CC AFD
DOLBY SCTE Propri
CC AFD
DOLBY SCTE Propri
Typical SMPTE 436 Packet
SMPTE 436 Dramatically Improves ANC Carriage
![Page 50: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/50.jpg)
SMPTE 436 Dramatically Improves ANC Carriage
HANC Audio T/C
VANC AFD, Dolby, CC, VCHIP, SCTE Triggers, Special Data
Active Video
SMPTE 436 ANC Essence
SDI MXF File with 436M Essence
File Wrapper
Video Essence
Audio Essence (s) Time Code
ALL ANC
![Page 51: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/51.jpg)
HANC Audio T/C
VANC DID tagged streams
Active Video
VANC Audio T/C
VANC DID tagged streams
Active Video SMPTE 436 ANC Essence
MXF File with 436M Essence
File Wrapper
Video Essence
Audio Essence (s)
Time Code
Original Source Video Playback Video
Ingest Playback
Add and Modify ANC Easily
Original ANC Data
Original ANC Data Augmented ANC Data
Original ANC Data Augmented ANC Data
SMPTE 436 Dramatically Improves ANC Carriage
![Page 52: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/52.jpg)
Ancillary Data Using SMPTE 436M
Standardized by SMPTE in 2006 Can carry any DID/SDID (i.e. future-proof) Carried as a separate essence payload in MXF
Can be embedded or referenced Easy to re-wrap Easy to Add / Modify
Supported in MXF and AS-N Application Specifications Now being added to SMPTE RDD9 for AS-10 / IMX/XD-CAM
SMPTE-436M Ancillary Data
Carriage in Files
It solves the biggest file interoperability problems we have experienced
The most important thing to happen to File Based since the folder was invented
![Page 53: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/53.jpg)
MPEG-2 TS
MOV / MP4 AVI
GXF &
LXF Generic
MXF
IMX / XDCAM
MXF P2
MXF
Avid MXF
(OP Atom) MXF
AS-02 Editing NLE Support Random Access Edit-while-ingest Playout Transcoder Support Native Server Support ANC carriage Additions/Changes without full remux Archiving Descriptive Metadata Carriage Future-proofness
Key Features of Popular Media Wrappers
ANC Carriage had been weakness of IMX/XDCAM MXF
Now with inclusion of SMPTE 436M ANC Carriage becomes supported
436M
![Page 54: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/54.jpg)
Contrasting the good ol’ days versus today
• File format standards that are interpreted in too many different ways (e.g. MXF)
WAN Files
• Multiple Codec formats??? • Multiple file wrapper formats • Missing / misplaced
meta data
SDI
• “Iron Clad” tape formats • “Cast in stone” device to
device interconnect (SMPTE SDI)
Then (the good ol’ days)
Today (the wild west)
Incompatible wrappers
Inconsistent, non-extendable ANC data carriage
Improved file Interoperability
SMPTE 436M
AS-XX Specifications AMWA
![Page 55: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/55.jpg)
What We Can Do Now
Wild West of Files Anatomy Lesson
Manage The Chaos
Wrap It Up The Poor Cousin
![Page 56: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/56.jpg)
In an Ideal World…..
SMPTE 436 ANC Essence
MXF File with 436M Essence
File Wrapper
Video Essence
Audio Essence (s)
Time Code
There would be one wrapper to wrap them all!
![Page 57: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/57.jpg)
And All Sources Would Be Wrapped The Same
Third party media server
INGEST
PLAYOUT
STORE
Networked VTRS
WAN File Delivery Service
Ethernet / IP Network
MXF
MXF
MXF
MXF
![Page 58: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/58.jpg)
And It Would Be Simple to Find Your Data – Especially Captions
SMPTE 436 ANC Essence
MXF File with 436M Essence
File Wrapper
Video Essence
Audio Essence (s)
Time Code
Here is Your Data – AND YOUR CAPTIONS!
![Page 59: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/59.jpg)
The Reality….
SDI
Third party media server
INGEST
PLAYOUT
STORE
Networked VTRS
WAN File Delivery Service
IMX
LXF
?XF Ethernet /
IP Network
MXF Flv A
![Page 60: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/60.jpg)
What Can You Do?
1.Have a Playout System that can handle ALL Types of File Formats
2.Normalize ALL Files at Ingest to One File Format
![Page 61: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/61.jpg)
Option 1: Playout System The SKILLED factory approach
IMX
LXF
?XF
MXF Flv A
MOV
AVI
GXF
GXF LXF IMX MOV MXF Flv A ?XF AVI
![Page 62: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/62.jpg)
Option 2: Normalize Files The UN-SKILLED factory approach
IMX
LXF
?XF
MXF Flv A
MOV
AVI
GXF
MXF MXF MXF MXF MXF MXF
![Page 63: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/63.jpg)
Anything That Can Be Done in SDI Needs to Happen in Files
SD Source HD Source 608
708
![Page 64: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/64.jpg)
Need to be able to Analyze More Than the Essence
File Processing Factory
Graphics Up/Down/X Convert
Video Decode
Video Encode
Loudness Measure / Adjust
Up/Down Mix
Audio Decode
Audio Encode
V-chip AFD CC, Subtitles
Dolby Metadata
Audio Mapping File
un- wrap
File wrap
Nielsen Watermark
MPEG Stitching / ReMuxing
![Page 65: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/65.jpg)
Need to be able to Preview and Manage Offline
• Metadata viewing / editing • Media preview
![Page 66: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/66.jpg)
Monitor The Results
FRE ITA ENG DVB Subtitles
PGM Les Expos sont de retour avec une avance de 9 a 1
Expo sono tornati con un vantaggio di 9-1
ITA FRE
Missing Captions / Subtitles
COM
![Page 67: Where are my Closed Captions? Managing and …bento.cdn.pbs.org/hostedbento-prod/filer_public/2013/04/...Looking at a simplified view of a typical playout workflow, we will find programs,](https://reader030.fdocuments.us/reader030/viewer/2022040823/5e6d5147241fb16f2e44fa23/html5/thumbnails/67.jpg)
What Can I Do? S436m
Get Involved!
Vendor Validation Ask for it!