OPENISE Terminal structure

Web-Browser

Network/Local Filesystem

VideoCaptureWindow

MPEG4 Conferencing

Window

MPEG-4Player

Decoders & Buffers

DMIFQoS

Data Conferencing

Chat

Shared App

Doc Transfer

Transfer

MPEG-4Conferencing

COM-Interfaces

Shared Apps

Windows

MPEG4 Player

Window

Browser Window

DMIFQoS

MPEG-4 player

Java based

playback of complete MPEG-4 scenes including 3D/Video material

MPEG-4 SL-1, Flex-Demux, DMIF modules (real-time)

optimized rendering for walkthrough applications involving complex 3D scenes

MPEG-4 conferencing module

C++ MPEG-4 conferencing module offers video and audio conferencing in a 3D virtual meeting space

RT MPEG‑4 video encoder of arbitrarily shaped video images and RT segmentation of the silhouette of person in front of a video camera

QoS support for the conferencing application

Integration of collaboration tools

Architecture of the OPENISE Terminal

2nd IST E3 Concertation MeetingBruxelles, 24-25 May 2000

Marco Di Concetto

Central Labs – Networks and Services

Siemens Information and Communication Networks SpA

Marco.Diconcetto@icn.siemens.it

DAI

SLSL-1-1 Layer Layer

BifsDecoderBifsDecoder OD DecoderOD Decoder

CompositorCompositorApplicationApplicationExecutiveExecutive

A DecoderA Decoder

IOD DecoderIOD Decoder

)

)

=

SL_PDUsSL_PDUs

ESI

AUs

Time stamps management

MpegJMpegJ V DecoderV Decoder

RendererRenderer

OPENISE MPEG-4 Player Architecture

Current Features

BIFS-Command and BIFS-Anim decoder

JPEG/GIF decoder

MPEG-4 Video decoder

AAC decoder (sound)

Script and MPEG-J interpretors

2D/3D renderer reading either textual format or mp4 files

DMIF FilterDMIF FilterDMIF FilterFlexDeMuxFlexDeMux

Signalling Plane Data PlaneDNI

TCP TCP UDP UDP

RTP RTP

IPIP

RTSP RTSP RTCPRTCP RTCPRTCP

VR-Conference Terminal Architecture

ConferenceControl

Call Signaling

IP Unicast & Multicast

VR-ConferenceExecutive

A/VReceiver

H.245 T.120

A/VSender

DataConferencing

Web-Browser

Events

GUI

A/V Receiver part of the VR-Conference Terminal

BIFS/OD & Texture Decoder

MP4-Video Decoder

MP4-Video Decoder

...G.723.1 Decoder

G.723.1 Decoder

...

HTTP RTP/RTCPRTP/RTCP ...RTPRTP ...

DS Buffer

DS Buffer

... TextureBuffer

TextureBuffer

...

Scene Graph

SoundNode

MovieTextureNode

DirectSoundPrimary Sound Buffer

VideoFrameBuffer

Graphics Rendering& Navigation Module

IP Unicast & Multicast

A/V Sender part of the VR-Conference Terminal

G.723.1Encoder

DatarateController

RTP/RTCP RTP/RTCPDeliveryStatistics

IP Multicast

VideoSegmentation

MP4-Video Encoder

AudioCapture

VideoCapture

GUI

Windows Sockets 2 API

RSVP SP

RSVP SP

ToS Marking