MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

12
MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems

Transcript of MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Page 1: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

MPEG-4 Structured Audio

Mihir Anandpara

EE 382C – Embedded Software Systems

Page 2: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Overview

Structured Audio Systems Audio Synthesis and Effects processing

in MPEG-4 AudioBIFS layer in MPEG-4 Software Implementation and Results Conclusions and Future Work

Page 3: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Structured Audio

Structured Coding v/s Traditional Coding Audio Synthesis through programs

Page 4: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Structured Audio in MPEG-4

Structured Audio Orchestra Language – SAOL• Run-time control of sound through score

• Audio rate and Control rate separation

• Custom effects processing on sound signal

Page 5: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

AudioBIFS

Audio Binary Information For Scene Description

Audio Composition, Effects Processing and Virtual Reality Modeling

Scene Graph setup

Page 6: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Example

Page 7: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

AudioFX node

Download of custom effects post-processing on the composited/decoded sound signal

Examples:• Simple echo

• Reverberation

• Chorus

Page 8: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Complexity of Effects processing algorithms

Critical issue in studying implementation of an execution engine for effects processing

Complexity Vector • Core Opcode calls

• Floating point divides, multiplies

• Memory accesses

Page 9: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Software Implementation

Scene Graph setup AudioMix, AudioSwitch, AudioDelay

nodes for sound composition Flexible and scalable signal processing

engine for AudioFX node to implement several effects

Page 10: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Results

Implementation of a subset of the AudioBIFS system

SAOL execution engine for AudioFX Complexity analysis of typical effects

processing algorithms Investigation of parallel execution of

effects processing algorithms

Page 11: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Future Work

Implementation of block-based signal processing at control rate

Page 12: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.

Questions?