Lec01, Overview, v1.05.ppt -...

Multimedia SystemsMultimedia Systems

Overview of the CourseOverview of the Course

Course PresentationCourse Presentation

Mahdi Amiri

February 2014

Sharif University of Technology

Course SyllabusCourse Syllabus

http://ce.sharif.edu/courses/92-93/2/ce342-1/

WebsiteWebsite

Page 1 Multimedia Systems, Overview


Z-N. Li, M.S. Drew,

Fundamentals of Multimedia,

Pearson Prentice Hall Upper

Saddle River, NJ, 2004.*

TextbookTextbook


Saddle River, NJ, 2004.*

* We will mostly use class handouts

and lectures. Therefore, text books

could be used as a reference.


P. Havaldar, G. Medioni, Multimedia Systems:

Algorithms, Standards, and Industry Practices,

Cengage Learning, 2010.

R. Steinmetz and K. Nahrstedt, Multimedia

Other Reference BooksOther Reference Books

http://books.google.com/books/about/Multimedia_Systems.html?id=k83m5inkjXwC


R. Steinmetz and K. Nahrstedt, Multimedia

Fundamentals: Media Coding and Content

Processing, Prentice Hall, 2002.

K. R. Rao, Z. S. Bojkovic and D. A. Milanovic,

Multimedia Communication Systems, Prentice Hall,

2002.… and Wikipedia

Course SyllabusCourse SyllabusGrading PolicyGrading Policy


Quiz: Sunday, Lowest quiz will be dropped

HW: Tuesday, Due: 2 Weeks, Req. MATLAB or Octave


Examples:Traffic control using mobile phones,

Multimedia systems in schools,

Human computer interfacing,

Video chat over LAN network,

Critical ReadingCritical Reading


Video chat over LAN network,

Telemedicine, TeleCollaboration, etc.

* We will review the examples in a session

Report structureLiterature survey

Pros. and Cons. of the existing methods

Definition of new proposals


TA(s) and session time

See the course website.

Integral component of the course

Problem Solving ClassesProblem Solving Classes


Integral component of the course

Tools:

MATLAB

GNU Octavewww.gnu.org/software/octave/

www.mathworks.com/products/matlab/

Course OutlineCourse Outline

What is Multimedia?

Components of Multimedia

Multimedia Research Topics and Projects

Introduction to MultimediaIntroduction to Multimedia


Multimedia Research Topics and Projects

Processing: e.g. content-based retrievalGeneration, Representation, Storage, Search and retrieval.

Networking: e.g. QoSTransmission, Delivery.

End-Systems: e.g. User Interfaces

Interaction: e.g. “ubiquity“ devices


What is “signal”!?

Discrete-time signals and systems

Sampling theorem

Review of Signals and SystemsReview of Signals and Systems


Sampling theorem

Quantization (Scalar Q., Vector Q.)

Transform domain analysis

FFT, STFT, Wavelet


Audio representations

Formats and standards

Frequency Masking vs. Temporal Masking

AudioAudio


Frequency Masking vs. Temporal Masking

Speech processing

Synthesis, recognition, …

Audio Compression

DPCM, ADPCM, LPC, CELP


Data storage

Data redundancyLossy and lossless compression

Entropy encoder

Entropy CodingEntropy Coding


Entropy encoder

Predictive coding

Huffman Coding

Lempel-Ziv-Welch

Arithmatic Coding


Physics of Color

Human Eye

Additive and subtractive color mixing

Image, Color SpaceImage, Color Space


Additive and subtractive color mixing

Color space Models

YUV, RGB, HSV, …

Gamma correction


Color Depth

Palette, Halftone

Image Resolution

Image, Acquisition and RepresentationImage, Acquisition and Representation


Image Resolution

Histogram, Contrast

High-Dynamic-Range (HDR)

Bracketing


Image Noise

Gaussian Smoothing

Mean and Median Filter

Image, EnhancementImage, Enhancement


Mean and Median Filter

Sharpening

Edge Detection

Despeckle


JPEG

Encoder Diagram

Decoder Diagram

Color Space Transformation

Image, CompressionImage, Compression


Color Space Transformation

Subsampling in color space

Discrete Cosine Transform (DCT)

Quantization Matrix

Compression Ratio

Blocking Artifact


Video Display

Progressive, Interlaced

Analog Broadcast TV Systems

NTSC, PAL

Video, Analog and Digital VideoVideo, Analog and Digital Video


NTSC, PAL

Analog Color Video

Composite video, S-Video, Component video

Digital Video (HDTV)

DVI, HDMI, DisplayPort


Interframe and intraframe coding

Motion Estimation and Motion Compensation

(MEMC)

Picture Types

Video CodingVideo Coding


Picture Types

I-frames, B-frames, P-frames

Video Codecs

MPEG-1, MPEG-2, MPEG-4

, h.261, h.263, h.264, h.265, …


Standalone vs. Networked

Live vs. Orchestrated

Multimedia system building blocks

Multimedia (Networking) SystemsMultimedia (Networking) Systems


Multimedia system building blocks

Real-time multimedia system

architecture


Quality of Service (QoS)

Error concealment

Prioritized Encoding

Multimedia NetworkingMultimedia Networking


Overlay networks

Packet-loss, Congestion

Unicasting and Multicasting

Streaming protocols


DVB

Interactive TV, Internet-TV, IPTV

E-Learning

Multimedia ApplicationsMultimedia Applications


E-Learning

Human Computer Interface

Multimedia Home Platform (MHP)

Multimedia Information Retrieval System

3D Technologies

Thank You

Multimedia SystemsMultimedia Systems

Overview of the CourseOverview of the Course


1. http://ce.sharif.edu/~m_amiri/

2. http://www.dml.ir/

FIND OUT MORE AT...

Next Session: Introduction to Multimedia SystemsNext Session: Introduction to Multimedia Systems

Lec01, Overview, v1.05.ppt -...

Documents

Transcript of Lec01, Overview, v1.05.ppt -...