Page 1 Multimedia Systems, Overview
Course Syllabus
http://ce.sharif.edu/courses/93-94/2/ce342-1/ Website
Page 2 Multimedia Systems, Overview
Course Syllabus
Z-N. Li, M.S. Drew, Fundamentals of Multimedia, Pearson Prentice Hall Upper Saddle River, NJ, 2004.* * We will mostly use class handouts and lectures. Therefore, text books could be used as a reference.
Textbook
Page 3 Multimedia Systems, Overview
Course Syllabus
P. Havaldar, G. Medioni, Multimedia Systems: Algorithms, Standards, and Industry Practices, Cengage Learning, 2010.
R. Steinmetz and K. Nahrstedt, Multimedia Fundamentals: Media Coding and Content Processing, Prentice Hall, 2002.
K. R. Rao, Z. S. Bojkovic and D. A. Milanovic, Multimedia Communication Systems, Prentice Hall, 2002.
Other Reference Books
… and Wikipedia
http://books.google.com/books/about/Multimedia_Systems.html?id=k83m5inkjXwC
Page 4 Multimedia Systems, Overview
Course Syllabus
Quiz: Sunday, Lowest quiz will be dropped
HW: Tuesday, Due: 2 Weeks, Req. MATLAB or Octave
Grading Policy
Page 5 Multimedia Systems, Overview
Course Syllabus
Examples: Traffic control using mobile phones, Multimedia systems in schools, Human computer interfacing, Video chat over LAN network, Telemedicine, TeleCollaboration, etc.
* We will review the examples in a session
Report structure Literature survey Pros. and Cons. of the existing methods Definition of new proposals
Critical Reading
Page 6 Multimedia Systems, Overview
Course Syllabus
TA(s) and session time See the course website.
Integral component of the course Tools:
MATLAB
GNU Octave
Problem Solving Classes
www.gnu.org/software/octave/
www.mathworks.com/products/matlab/
Page 7 Multimedia Systems, Overview
Course Outline
What is Multimedia? Components of Multimedia Multimedia Research Topics and Projects
Processing: e.g. content-based retrieval Generation, Representation, Storage, Search and retrieval.
Networking: e.g. QoS Transmission, Delivery.
End-Systems: e.g. User Interfaces Interaction: e.g. “ubiquity“ devices
Introduction to Multimedia
Page 8 Multimedia Systems, Overview
Course Outline
What is “signal”!? Discrete-time signals and systems Sampling theorem Quantization (Scalar Q., Vector Q.) Transform domain analysis FFT, STFT, Wavelet
Review of Signals and Systems
Page 9 Multimedia Systems, Overview
Course Outline
Audio representations Formats and standards
Frequency Masking vs. Temporal Masking Speech processing
Synthesis, recognition, … Audio Compression
DPCM, ADPCM, LPC, CELP
Audio
Page 10 Multimedia Systems, Overview
Course Outline
Data storage Data redundancy
Lossy and lossless compression Entropy encoder Predictive coding
Huffman Coding Lempel-Ziv-Welch Arithmatic Coding
Entropy Coding
Page 11 Multimedia Systems, Overview
Course Outline
Physics of Color Human Eye Additive and subtractive color mixing Color space Models
YUV, RGB, HSV, … Gamma correction
Image, Color Space
Page 12 Multimedia Systems, Overview
Course Outline
Color Depth Palette, Halftone Image Resolution Histogram, Contrast High-Dynamic-Range (HDR) Bracketing
Image, Acquisition and Representation
Page 13 Multimedia Systems, Overview
Course Outline
Image Noise Gaussian Smoothing Mean and Median Filter Sharpening Edge Detection Despeckle
Image, Enhancement
Page 14 Multimedia Systems, Overview
Course Outline
JPEG Encoder Diagram Decoder Diagram Color Space Transformation Subsampling in color space Discrete Cosine Transform (DCT) Quantization Matrix Compression Ratio Blocking Artifact
Image, Compression
Page 15 Multimedia Systems, Overview
Course Outline
Video Display Progressive, Interlaced
Analog Broadcast TV Systems NTSC, PAL Analog Color Video
Composite video, S-Video, Component video
Digital Video (HDTV) DVI, HDMI, DisplayPort
Video, Analog and Digital Video
Page 16 Multimedia Systems, Overview
Course Outline
Interframe and intraframe coding Motion Estimation and Motion Compensation
(MEMC) Picture Types
I-frames, B-frames, P-frames Video Codecs
MPEG-1, MPEG-2, MPEG-4 , h.261, h.263, h.264, h.265, …
Video Coding
Page 17 Multimedia Systems, Overview
Course Outline
Standalone vs. Networked Live vs. Orchestrated Multimedia system building blocks Real-time multimedia system
architecture
Multimedia (Networking) Systems
Page 18 Multimedia Systems, Overview
Course Outline
Quality of Service (QoS) Error concealment Prioritized Encoding Overlay networks Packet-loss, Congestion Unicasting and Multicasting Streaming protocols
Multimedia Networking
Page 19 Multimedia Systems, Overview
Course Outline
DVB Interactive TV, Internet-TV, IPTV E-Learning Human Computer Interface Multimedia Home Platform (MHP) Multimedia Information Retrieval System 3D Technologies
Multimedia Applications
Page 20 Multimedia Systems, Overview
Thank You
1. http://sharif.edu/~rabiee/ 2. http://www.dml.ir/
FIND OUT MORE AT...
Multimedia Systems Overview of the Course
Next Session: Introduction to Multimedia Systems
Top Related