Multimedia: What next? Nicolas D. Georganas University of Ottawa- Canada.

Multimedia: What next?

Nicolas D. Georganas

University of Ottawa- Canada

MULTIMEDIA COMMUNICATIONS

THE FIELD REFFERING TO THE:

• REPRESENTATION ,• STORAGE / RETRIEVAL• DISSEMINATION

OF MACHINE-PROCESSABLE INFORMATION EXPRESSED IN MULTIPLE MEDIA, SUCH AS:

• TEXT• VOICE • GRAPHICS / 3D • IMAGES • ANIMATIONS • AUDIO• VIDEO

MM Research Issues

• User Interface Design and AI• Signal Processing and Coding• Database issues• Operating Systems• Networking• Protocols• Synchronization• Security and authentication• Collaborative applications

Problem now well understood: Media Synchronization

Media Buffers

Communication Controller

Voice Server Image Server Text & Graphics Server

Camera

Mic

Scenario

Audio/Video

Transfer

Time

Image

Text

videoAudio

Synchronizer

Display

Server

….let us forget about more

research on this!

New Media

• Virtual Reality

• Holography

• Haptics (Touch)

• eSmell

• eTaste

• eThought

• ……..

Media and sensors

MEDIA SENSORS ACTUATORS

Audio Microphone Speaker

Visual 3D scanner3D video camera

Head-Mounted DisplayLCD, CRTHolography

Touch Motion sensor Thermal sensorPressure sensor

Human body roboticsHaptic device

Smell Electronic nose Smell actuator

Taste Electronic tongue Taste actuator

Environment Synthesis from Sensor Data Fusion

WIRELESS COMMUNICATION NETWORK

Mobile Robotic IntelligentSensor Agent

Mobile Robotic Intelligent Sensor Agent


StationaryIntelligentSensor Agent



DISTRIBUTEDVIRTUALIZEDREALITYENVIRONMENT

Head Mounted Display

HapticFeedback

WIRELESS COMMUNICATION NETWORK















HapticFeedback



HapticFeedback


HapticFeedback

Future Multimedia Telecommunication System:

“Sensorium” (Ray Kurtzweil)

Telephone

Videophone

VRT phone

Super VRT phone

audio visual touch smell taste

(From a thesis at the MM Univ., Malaysia (Prof. Riyoshi Komiya))

Hapto-Audio-Visual Communications

(From a thesis at the Multimedia Univ., Malaysia (Prof. Riyoshi Komiya))

Stringent QoS Constraints: Network End-to-End-Delay

• Tele-haptics– 50-100 msec (dependent on refresh rates)

• Collaborative Virtual Environments– 100-200 msec.

• Good Predictors are needed here (“Dead Reckoning” not good enough)

….We still have a lot of problems still to solve here.

MM Sensor Networks Research

• Exciting field for MM research• Wireless, small OS footprint, limited

power, bring new constraints• Ad Hoc Networking• Source-to-sensor sink data download but

with possible sensor-to-sensor messaging• Redundant coverage and reliability

essential• New Protocols needed.

The future looks exciting but …scary!

Multimedia: What next? Nicolas D. Georganas University of Ottawa- Canada.

Documents

Transcript of Multimedia: What next? Nicolas D. Georganas University of Ottawa- Canada.