High Definition in the Archive Domain

May 5, 2010High Definition in the Archive Domain

Joint Technical Symposium - 2010

Introduction – HDTV some key points

01

HD in the Archive Domain | May 5, 2010 3

A quick comparison HD/SD

Offer better and more attractive programmes to the viewer. It is done through:

A better picture resolution allowing a new viewing distance (3H versus 6H)

A better sound quality : 5.1 versus mono or stereo

A 16/9 aspect ratio wide screen versus 4/3

More scanning modes: Progressive or interleaved versus interleaved.

720 pixels per line576 Active lines( from 200 000

to 400 000 pixels)

1280 or 1920 pixels per line

720 or 1080 active lines

( from 900 000 to 2 000 000 pixels)

Image definition

Image definition

AudioAudio Mono or Stereo

Sound 5.1Digital Dolby

6 tracks

Scanning Scanning

Interleaved(i)

50 or 60 Hz

Interleaved ( i)

Progressive (p)

Progressive Segmented Frame (PSF)

50 , 60 ,24 Hz

SDSD

HDHD

Aspect ratioAspect ratio 4/3 or 16/9 16/9


HDTV formats

International formats and standards are well defined and adopted but they are numerous:

Number of active pixels

per line

Number of active lines

per frame

Frame rates

Formats are described by:

Picture aspect ratio

Scanning mode

1920

1440

1280

1080

720

60

59,94

30

29,97

25

24

23,98

16/9interleaved

progressive

psf


HDTV formats and standards

Most popular formats are:

1920x1080i1920x1080i 1280x720p1280x720p

50i,60i,25p,25 psf,30p,30 psf,50p and 60 p) and (24 p and 24 psf)50i,60i,25p,25 psf,30p,30 psf,50p and 60 p) and (24 p and 24 psf)

at

Going from one format to another requires cross conversion. Going from one format to another requires cross conversion.

Calculation ofpixels

and lines

Frame rate conversion

Interleave or de-interleave


But there are as many practices as televisions….

There is a great variety of formats and compressions used in production postproduction and broadcast.

The production standard for TV programs is not necessarily the same as the broadcast standard

Though “labelled HD”, The “real quality” may vary in a wide range.


A wide range of shooting solutions and quality

HD shootingHD shooting

Low end solutionsLow end solutionsBroadcast solutions Broadcast solutions

HDVMPEG2 25Mb/s

long GOP 6 or 12

HDVMPEG2 25Mb/s

long GOP 6 or 12

AVCHDH264 21Mb/s

long GOP

AVCHDH264 21Mb/s

long GOP

Sony’s HDXDCAMMPEG2 422 up to 50Mb/s

on 50GBoptical disk

Sony’s HDXDCAMMPEG2 422 up to 50Mb/s

on 50GBoptical disk

Panasonic’s DVCPRO HD AVC intra up to 100Mb/s

on 64 GB P2 cards

Panasonic’s DVCPRO HD AVC intra up to 100Mb/s

on 64 GB P2 cards

Sony’s’ XDCAM EX MPEG2 up to 35 Mb/s

on 32 GB SxS cards

Sony’s’ XDCAM EX MPEG2 up to 35 Mb/s

on 32 GB SxS cards

Grass Valley Infinity JPEG2000 up to 100 Mb/s

on Hard drive

Grass Valley Infinity JPEG2000 up to 100 Mb/s

on Hard drive

High quality capture High quality capture

HDCAM SRup to 880Mb/s in high speed mode

on tape

HDCAM SRup to 880Mb/s in high speed mode

on tape


Main used compression types

MPEG2 HD

MPEG2 HD

DV HD

DV HD

H264 HD

H264 HD MJPEGMJPEG

DNx(AVID)

DNx(AVID)

Pro res (Apple)

Pro res (Apple)

JPEG2000JPEG2000

DVC pro HD

DVC pro HD

HD compressionsHD compressions


Most used compression schemes

ShootingShooting Post Production Post Production Play outPlay out

MPEG2 HD long GOP

MPEG2 HD short GOP

DV HDAVC long GOP

AVC intra

MPEG2 HD long GOP

MPEG2 HD short GOP

DV HDAVC long GOP

AVC intra

Base band 1,5GB/sMPEG2 HD :up to 300Mb/s

DV HD up to 100Mb/sProprietary formats:

Pro Res (Apple)DNx (Avid)

Others...

Base band 1,5GB/sMPEG2 HD :up to 300Mb/s

DV HD up to 100Mb/sProprietary formats:

Pro Res (Apple)DNx (Avid)

Others...

MPEG2 HD20 to 80Mb/s


BroadcastBroadcast


H2648 to 16Mb/s


H2648 to 16Mb/s

ArchivingArchiving

? ?

JPEG2

000

DPX D10

AVC-Intra

The Challenges

02


The challenges

More and more televisions are producing and broadcasting HDTV.

The ratio of SD programmes versus HD programmes is decreasing rapidly

Archivists must face and manage 2 new challenges:

How to collect, store and make

accessible these new HD digital programmes?

How to collect, store and make

accessible these new HD digital programmes?

How could SD archives be re-used in

a HD environment?

How could SD archives be re-used in

a HD environment?

and


Archiving HD

Standard definition video(uncompressed)

720 pixels 576 lines

1- hour programme file size : 72 GB

High definition video(uncompressed)

1980 pixels 1080 lines

1- hour programme file size : from 374 GB to 673 GB*

according to frame rates

To archive HD, Compression “could” be required.

? ?

JPEG2

000

DPX D10

AVC-Intra

? ?

?

?


Using SD in HD programs

Sometimes, archivists have already digitised their original analogue archives in SD.

Questions …

How could these SD preservation masters be used and match the quality requirements of HDTV?

When will we need to reuse original media?

What kind of process do we need,to try to match HD quality requirements?


Using SD in HD programs : video and film archives...

SD video program

SD video program

Up conversion

Up conversion HD programHD program

Film programs16/S16/35 mm

Film programs16/S16/35 mm

Up conversion

Up conversion

SD telecine

SD telecine

HD telecine

HD telecine

HD programHD program

?


Using SD in HD programs : About up conversion...

The quality of the HD output depends very much on the quality of up conversion.

The main functions that an up converter must achieve, are:Calculation of missing pixels and linesFrame rate conversionResizing

Interleaving or de-interleaving

Frame rate conversion (cross conversion) could also degrade the picture.


Using SD in HD programs : About resizing...

4:3 16:9

Top/ Bottom Crop

4:3 16:9

Side Panel

There are several possibilities to show 4/3 pictures in 16/9 programs

4:3 16:9

Stretching

Zoom,and stretching

?

Current practices

03


The questionnaire

In 2009 a short questionnaire about HDTV current practices has been sent to FIAT/IFTA members.

This questionnaire has 4 chapters: 1-General information and current situation about HD of the company or television.2-Technical information about formats and standards used in the company for :>shooting>production and post production>Mastering >broadcasting

3-HD programs archiving >Volumes, media ,storage>expected evolutions or plans in the company about HD archiving?

4-Use of SD archives in HD programs.


The questionnaire

12 companies have answered to the questionnaire:> Sound and Vision National Dutch Broadcast archives for Public Broadcast> ORF Austrian Broadcasting Corporation> SBS Korea> TFO French educational channel Toronto (Canada)> Televisio de Catalunya TVC (Spain)> CBS News> TSR Télévision Suisse Romande > SVT> CBC radio Canada> NBC news /NBC universal> NHK> CCTV


Production: from shooting to broadcastingshooting Format1920x 1980 61280x 720p 21440x1080 1other 3

HDCAM/HDCAM SR 5HDXDCAM 3 DVCpro P2 3DNX HD 1D5 1ohter 1

ProductionHDCAM HDCAM SR 2HDXDCAM 3DnX HD 4Pro res 1DVCpro HD 2

MasteringHDCAM/HDCAM SR 5XDCAM HD 3D10? 1D5 1DVCpro HD 2

BroadcastingMPEG2 10H264 2

It seems that shooting full HD is predominant

Almost all televisions use all formats and shooting solutions :

Most used media are HDCAM HDXDCAM and DVCPro HD

For postproduction, most of the companies use

AVID DNx file format either 120 or 185.

For mastering HDCAM/HDCAM SR is preferred

MPEG2 broadcasting is still far ahead compared to H264.


Archiving

Most companies archive original format on the shelves, but most of them intend to go file

MPEG2 HD seems to be the file format in use (or most expected)

H264 HD seems too young to be considered as a file format for archives

JPEG2000 that is standardised for digital cinema, is not well known and considered in televisions.

Current archivingOn the shelves 8archiving as files 2

intend to archive as filesYes 7not yet chosen 3

files MPEG2 and XDCAM 4DVCPro HD 2JPEG2000 1 on film onlyDNx 1


4/3 use policy

Generally televisions perform up conversion indoor while independent archivists prefer to let end users to achieve the transformation.

The use of pillar box presentation has the preference of the televisions and archivists.

When the choice is made by the end user, any kind of transform may happen….

resizePilar box 6 no resizetop bottom crop 3stretch/zoom 0choice by end user 3

up conversionindoor 9end user 2

Our projects …..

04


From our archives (SD) …..

We have now 450 000 hours of digitalized videos, mainly on the MPEG2 (8 Mb/s) format.

Fortunatly we went through a phase of dubbing on numeric Betacam, and we store hundreds thousands of numeric tapes.

The goal is to transfert the tape on files :To enable an easy use of archivesTo enable an easy use of upscaling and restoration for video and

film(… with some new HD transfert for the 35 mm film)

But we want to forget the tape without regrets …


From our archives (SD) ….. A new format

We want a new formatWith complete specifications and documentation

Without impact of Patents (preferably) We store the national heritage!

With a very hight qualityIntraFrame, 4:2:2, 10 bits, 8 audio channels etcFrom 50 Mb/s to 100 Mb/s or more

This year we build a model to help us make the choice between : Several competitors AVC-Intra, D10, DPX and … JPEG2000

For our SD archives and for the new incoming HD programs.


Model ...

STORAGE

Tape Library Scalar 10K

LTO 5

HSM

STORAGE

Tape Library Scalar 10K

LTO 5

HSM

HDCAMHDCAM SR

HDCAMHDCAM SR

BetacamNumeric Beta

BetacamNumeric Beta

Encoding in « NewFormat » wrapping in MXF




Encoding orTranscoding

in « NewFormat » wrapping in MXF

Encoding orTranscoding

in « NewFormat » wrapping in MXF

ClippingClipping

TranscodingUpscaling


x N

DV, MPEG HD, H264, DNx On demand !

RestitutionSDI/HDSDI RestitutionSDI/HDSDI

ClippingClipping TranscodingUpscaling


RestitutionFTP

RestitutionFTP

Transcoding

H264Proxy

Transcoding

H264Proxy

Serveur NAS

x N

FilesPublic TV

FilesPublic TV

SDI

SDI

SAN


Thank you for your attention

[email protected]

High Definition in the Archive Domain

Documents

Transcript of High Definition in the Archive Domain