Application Production Process and tools

Commerce using MPEG-4 Commerce using MPEG-4 on Internet with QoS on Internet with QoS

Project Leader : Christian Bertin, CCETT

christian.bertin@cnet.francetelecom.fr

ApplicationsApplications

VIRTUGUIDE Application

Home shopping application for Turism

Products (extended city trips)

VIRTUCAT Application

Home shopping application for Commercial

Centre products (sport, video, etc.)

VIRTUGUIDE ApplicationVIRTUGUIDE Application

- Young overstyled blonde

- History student- Charismatic artist type- Techno D.J.ane- Jobless coffeedrinking

actor

360-degree prerecorded video sequence so you can see in any direction around you

A set of recommended choices (appearing and disappearing) for interaction A global map of Berlin with the guide position A local map (zoom on global Berlin map) with the guide position

As you follow your guide through Berlin, you can see in addition to the 3D Video:

You are following one of the 5 guides through Berlin :

VIRTUGUIDE ScreenVIRTUGUIDE Screen

HTML Page consisting in : Applets (global map, local map,

recommended choices) MPEG-4 3D Scene with a video displayed on

a hemisphere)Problem :

Text display quality is not acceptable in VRML/MPEG-4 => Java AWT.

VIRTUGUIDE ApplicationVIRTUGUIDE ApplicationCharacteristicsCharacteristics

360 degree shooting with a hemispheric mirror above the camera : 512x512 pixels

Future : Video divided in 8 planarvideo segments

Circular video to be mapped on a hemisphere

Future : Only 3 or 4 Video segments sent at a time to be mapped on a cylinder

VIRTUGUIDE VIRTUGUIDE ScenarioScenario

VIRTUGUIDE VIRTUGUIDE .VFF file (Virtuguide File .VFF file (Virtuguide File

Format)Format)SEQ I_1 # Videosequence numberFPS 25 # number of frames per secondsSHEET I_1_1 # sequence numberTITLE "XP1-Rose in" - "Extended Version I.1.1-4!"# <BEGIN> <NXT> <Camera Rotation>BEGIN 0 I_1_1 0PA #No PA$ PALINK IN OUT1 "excuse me ..." 0 370 7002 "hi, where are you up to ?" I_2_1 370 6603 "wow, wonderful dress you have" I_2_1 370 6604 "hey! is this the new berlin style?" I_2_2 370 660PAENDMAP # x y t -0.615 0.859 0-0.615 0.859 598-0.615 0.859 1181MAPENDEND##########SHEET I_1_2TITLE "XP1-Rose leaves" - "Extended Version I.1.1-4!"

VIRTUGUIDE Production VIRTUGUIDE Production processprocess

Audio-Video shooting (Filmakademie)Audio-Video MPEG-4 encoding (LEP)Scenario production (Filmakademie)Scenario textual coding (Filmakademie,

textual editor)Screen implementation (CCETT, html

pages, applets)Scenario MPEG-4 coding (CCETT, VFF

file parser => Textual BIFS update => MkScene BIFS encoder => Binary BIFS)

VIRTUCAT ApplicationVIRTUCAT ApplicationBike shop screenBike shop screen

Do it yourself!

Please select :- a frame,- a fork,- a wheeland you will see the result : a 3D model of your bike with all the selected elements together

You can go around the bike you are building yourself You can browse the sets of frames, forks and wheels for selection You can order your bike (BUY button) You can go back to the shop selection

VIRTUCAT ScreenVIRTUCAT ScreenCharacteristicsCharacteristics

MPEG-4 Scene with : 2D scene with 2D textures 3D Bike Model

HTML pages for order formServer ASP Script to handle the

contents of the customer trolley and corresponding order form

VIRTUCAT Production VIRTUCAT Production ProcessProcess

3D Commercial centre Tower Navigation production (Lightwave, 3D Studio Max, convertion to MPEG-4 with some limitations due to the Compositor

3D Bike model Production (Filmakademie, 3D S. Max)

2D Textures (Frames, Forks, Wheels) (Filmakademie, JPEG encoding)

Bike Shop Screen composition (CCETT, no 2D tool, text editor only)

VIRTUCAT Production VIRTUCAT Production Process (continued)Process (continued)

EAI (Enhanced Authoring Interface) Java Programs (to get the selected bike elements and to position the bike elements)

ASP Script behind BUY button to run on the server (Finsiel)

File formating for server useFile formating for server use

RTP

IETFGenericPayload

Video Pump

RTP

Flex Mux

Video Pump

AccessUnitFile

Video Encoder

Video

Raw DataFile

Access Unit Formater

Super AU Formater

Super Sync Layer - PDU

FormaterIndexFile

SuperAUFile

IndexFile

SuperSL-PDU File

ServerOperation

RTP

Flex Mux

Synch. Layer

Video Pump

Application Production IssueApplication Production Issue

BIFSTEXT Files

ODCross-ref.

File

BIU FilesBIA Files

MP-4 Video Files

MP-4 AudioFiles

JPG, GIF Files

Storyboard

App.Exec.CGIScripts

Server Code Files

HtmlFormCreat.

HtmlPagesFiles

JavaByteCode

EAIScriptProd.

JavaClassFiles

ObjectDescriptorCreation

OD-ESProd.

ODFiles

OD-ES Files

2D Graphics& animation& text creat.

Texture &Still pictureCreation

AudioVideoShooting

3D Graphics& animationCreation

VRML D1/YUV LosslessJPEG/GIF

MkSceneMkAnim

JPEG (photos)GIF (others)

Still picture Coding

Audio/Video Coding

BIFSSpecificAdd-on

JPEG/GIFES Prod.

Video ESProd.

Audio ESProd.

Audio ESFiles

Video ESFiles

JPEG/GIFES Files

BIA-ES Files

BIU-ES Files

File namereplacementby OD ID

BIA-ESProd.

BIU-ESProd.

Electronic Commerce Electronic Commerce Requirement on MPEG-4Requirement on MPEG-4

We will use MPEG-4 only when MPEG-4 Tools and Servers offer : User input to get Password, User ID, User

Address, User Comments, Order Forms, Database Product Search Criteria, etc.

Dynamics in scene using scene skeleton and dynamic elements updated with information coming from a database (price, product description, product pictures, product videos)

Possibility to jump at a Random Access Point in an MPEG-4 scene