Overview of The Multimedia Networks -...

26
Overview of The Multimedia Networks Instructor: Hamid R. Rabiee Spring 2012

Transcript of Overview of The Multimedia Networks -...

Page 1: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Overview of The

Multimedia Networks

Instructor: Hamid R. Rabiee

Spring 2012

Page 2: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Multimedia Networking

Instructors: Hamid R. Rabiee, PhD ([email protected])

Office: CE department #804 or #803 (DML)

TAs:

Mostafa Salehi ([email protected])

Office: CE department #803 (DML lab)

Navid Bayat ([email protected])

Office: CE department #803 (DML lab)

Maryam Tahani([email protected])

Office: CE department #808

Nasim Nabavi ([email protected])

Office: CE department #803 (DML lab)

Elahe Ghalebi ([email protected])

Office: CE department #803 (DML lab

Hours:

Class hours: Saturdays & Mondays (15:00 to 16:30)

Exercise hours: Saturdays 12:00 to 13:15, Room 201

Course web page: http://ce.sharif.edu/courses/90-91/2/ce873-1/

Digital Media Lab - Sharif University of Technology2

Page 3: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Course Textbooks (References)

“Fundamental of Multimedia”, by ZeNian Li and Mark Drew, Prentice-

Hall, 2003.

“Computer Networking: A Top-Down Approach (4th edition)”, by J.

Kurose and K. Ross, Addison-Wesley, 2008.

“Quality of Service Control in High-speed Networks”, by H.J. Chao, X.

Guo, John Wiley and Sons, 2002.

“Multimedia over IP and Wireless Networks: Compression, Networking,

and Systems”, by M. Van Der Schaar, P. Chou, Academic Press, 2007.

Digital Media Lab - Sharif University of Technology3

Page 4: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Digital Media Lab - Sharif University of Technology4

Lecture Outlines

Course Introduction (Syllabus)

Course Outline

Why Multimedia Networking?

Page 5: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Course Introduction

The course goal:

This course is primarily concerned with the problems that arise when

carrying audio/video contents over the modern communication networks

The course will :

Present an overview of current/future multimedia applications and

architectures

Discuss deployment problems

Discuss Multimedia Network Design and study solutions

Examine emerging technologies and open research problems related to

multimedia networking

Digital Media Lab - Sharif University of Technology5

Page 6: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Course Introduction

Prerequisites:

Signal and Systems, Multimedia Systems, Computer Networks

Background in Computer Systems Performance Evaluation (e.g., Simulation,

Experimental, or Analytical approaches)

Experience with Matlab and GNU/Linux.

Simulation Tool: OpNet

Style:

Both slides and whiteboard

Reading List:

Recommended books and papers

Slides

Handouts

Digital Media Lab - Sharif University of Technology6

Page 7: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Course Introduction

Evaluation:

Homework $ Mini - Projects

About 5 series of homework

and mini - projects

40 (Points)

Quiz

About 12 number of quizzes

10 (Points)

Midterm written exam

25 (Points)

Final written exam

35 (Points)

Total :

110 (Points)

Digital Media Lab - Sharif University of Technology7

Page 8: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Course Outline

Introduction

Fundamentals of Multimedia

Background information similar to the ones covered in the Multimedia Systems

Fundamentals of Next Generation Networks

Quality of Service

Principles (e.g. Admission Control and Shaping/Policing)

QoS Architecture (Integrated services; Differentiated services)

Traffic engineering (Fair Scheduling)

Flow and congestion control (Buffer Management)

Error correction & concealment

Digital Media Lab - Sharif University of Technology8

Page 9: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Course Outline

Multimedia over IP (IP multicast)

Multimedia over Overlay networks

Multimedia Applications

Multimedia Protocols

Signaling Protocols (SIP, H.323), Streaming (Real-time) Protocols (RTP, RTCP)

IP Multimedia Subsystem (IMS)

Multimedia over Wireless/ sensor network

Multimedia Networking Applications

Digital TV, Voice Over IP, IPTV, Audio/video Conferencing, Interactive Multiplier

Games, Application-Level Framing, Video Servers

Digital Media Lab - Sharif University of Technology9

Page 10: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Course Outline

Multimedia Network Security

Encryption, digital signatures, authentication, IP security

Digital watermarking security features in multimedia compression standards,

secure media streaming

Content Networks

Convergence Networks

Hot Research Topics

Digital Media Lab - Sharif University of Technology10

Page 11: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Why Multimedia Networking?

The use of IP-based Internet is growing , both in business & home usage

Growth of networked multimedia applications on the Internet

A balance of digital broadcasting with multimedia streaming over IP networks

IP network, especially Internet, is becoming a very attractive channel for multimedia

communications.

Dedicated networks and ATM are not widely available to bulk of users

There are many applications for Internet multimedia:

Internet telephone, Internet TV, video conferencing, network games, remote

corroboration, media rich social networks, …

IP uses packet switching

Suitable for unexpected burst of data without establishing an explicit connection

Bandwidth is shared and so data can be sent at any time

Digital Media Lab - Sharif University of Technology11

Page 12: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Networked Multimedia Applications

Digital Media Lab - Sharif University of Technology12

Music

Streaming

Information

SearchMovies

StreamingFinance,

Brokerage

Digital Photos

The Internet cloud

E-mail

Video Clip

Attachment

Video

Conference

VoIP

Wireless Browsing

Page 13: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Networked Multimedia Applications

Multimedia Extended Email

World Wide Web

Video Distribution Services

Video Conferencing

Interactive Distributed Games

Virtual Reality

E-Learning

Instant Messaging

Sometimes there may be only one media, but similar requirements:

Image Distribution, Telephony, Radio, Jukebox Services, Document Archives

Digital Media Lab - Sharif University of Technology13

Page 14: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Classes of Internet Multimedia Apps

Streaming stored media

Stored on server

Examples: pre-recorded songs, famous lectures, video-on-demand

Streaming live media

“Captured” from live camera, radio, T.V.

1-way communication, maybe multicast

Examples: concerts, radio broadcasts, lectures

Real-time interactive media

2-way communication

Examples: Internet phone, video conference

Digital Media Lab - Sharif University of Technology14

Page 15: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

A Sample Framework of Media Delivery

Media

Encoding

Audio

Video

Animation

Web

Server

Send Request

to Media

Server

Media

Server

Proprietary

Format

•Multicast capable

•More Robust

•Access to Storage

•Relieves Web Server

Send Stream

To Clients

•Standalone player

•Java based player

•Browser plug-in player

•Appliance

•Decode

•Buffer

•Sync.

To hear or view a media file

without downloading it

Note: P2P applications and

Services increasing

Clients

Send Request

To Servers

Page 16: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Multimedia Expectations

Multimedia Expectations from a Communication Network

Traffic Requirements

limits on real-time parameters (delay, jitter)

bandwidth and reliability

synchronization

Functional Requirements

support for multimedia services such as multicasting, security,

mobility and session management

More about media & multimedia on next session

Digital Media Lab - Sharif University of Technology16

Page 17: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Main Problems in Multimedia Applications

Supporting multimedia applications over a computer network renders the

application distributed.

Multimedia Transmission over Wireless/Wired networks

Convergence on Wireless, Multimedia, and Internet

Digital Media Lab - Sharif University of Technology17

Multimedia Capability

Enhanced Mobility

Full ConnectivityMultimedia Internet

Wireless

Page 18: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Main Problems in Multimedia Applications

Multimedia data is huge

Audio, Images, graphics, and video

Wireless/Internet lacks performance guarantee

Best effort service, no QoS provision by itself

Packet loss, congestion, latency, delay jitters

Errors in wireless links

Internet is heterogeneous

Varying network conditions, user preferences, device capabilities

Question : How to Enable EFFICIENT, ROBUST, UBIQUITOUS Delivery?

Digital Media Lab - Sharif University of Technology18

Page 19: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Multimedia Networking Issues

Media Issues

Huge amount of data

Different formats of media (need for

Coders & Decoders, Different

Applications, transmission protocols, ...)

Issues for real-time transport of

streaming multimedia

Quality of media

Network Issues

Availability and Performance of

Network Bandwidth

Reliability of Transport and

Performance

Availability of “Media-aware”

Middleware

Availability and Performance of

Applications

Required standards for data exchange

in heterogeneous environments

Security and copyright Issues

Wireless networks issues

Integration of wired and wireless

heterogeneous networking systems

Digital Media Lab - Sharif University of Technology19

Page 20: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Solutions

Two basic Approaches

Network- Centric

End- system Based

Digital Media Lab - Sharif University of Technology20

Page 21: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Network - Centric Based Solutions

Network - Centric

Packet Classification

Packet is marked based on the Type of Service

Packet Scheduling

choose next packet to send on link

Integrated Services: flow based

architecture for providing QOS guarantees in IP networks for individual application

sessions

Differentiated Services: packet based

Mark IP packet to specify treatment

Multi Protocol Label Switching: flow+ packet based

A forwarding scheme that tags packets with labels

Digital Media Lab - Sharif University of Technology21

Page 22: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

End-System Based Solutions

End-System Based

Compression

Layered and scalable coding

Base layer, enhancement layers

MPEG: SNR, spatial, temporal scalability

MPEG-4 fine granularity scalability (FGS), and H.264

MPEG Scalable Video Coding (SVC)

Media distribution

Media synchronization

Multimedia network protocol

Digital Media Lab - Sharif University of Technology22

Page 23: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

End-System Based Solutions

End-system Based

QoS Control

Congestion Control

Source-based rate control, Receiver-based rate control, Hybrid

rate control

Rate-adaptive source encoding

Rate shaping

Error Control

FEC, retransmission (ARQ), error-resilient encoding, error concealment

Digital Media Lab - Sharif University of Technology23

Page 24: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Sharif University of Technology, Department of Computer Engineering, Multimedia Systems Course

Next Session

Multimedia Networking

24

Page 25: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

References

Shashank Khanvilkar, Faisal Bashir, Dan Schonfeld, and Ashfaq Khokhar,

“Multimedia Networks and Communication”, University of Illinois at

Chicago, 2004.

Jenq-Neng Hwang, “Introduction to multimedia networking”, Cambridge

University Press,

Digital Media Lab - Sharif University of Technology25

Page 26: Overview of The Multimedia Networks - Sharifce.sharif.edu/courses/90-91/2/ce873-1/resources/root/Class Notes... · Simulation Tool: OpNet Style: Both slides and whiteboard Reading

Acknowledgement

The following graduate students have helped to prepare the slides for this

course:

Mostafa Salehi

Fatemeh Dabiran

Hoda Ayatollahi

Digital Media Lab - Sharif University of Technology26