MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.
-
Upload
bennett-watkins -
Category
Documents
-
view
212 -
download
0
Transcript of MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.
![Page 1: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/1.jpg)
MPEG-4 Structured Audio
Mihir Anandpara
EE 382C – Embedded Software Systems
![Page 2: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/2.jpg)
Overview
Structured Audio Systems Audio Synthesis and Effects processing
in MPEG-4 AudioBIFS layer in MPEG-4 Software Implementation and Results Conclusions and Future Work
![Page 3: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/3.jpg)
Structured Audio
Structured Coding v/s Traditional Coding Audio Synthesis through programs
![Page 4: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/4.jpg)
Structured Audio in MPEG-4
Structured Audio Orchestra Language – SAOL• Run-time control of sound through score
• Audio rate and Control rate separation
• Custom effects processing on sound signal
![Page 5: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/5.jpg)
AudioBIFS
Audio Binary Information For Scene Description
Audio Composition, Effects Processing and Virtual Reality Modeling
Scene Graph setup
![Page 6: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/6.jpg)
Example
![Page 7: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/7.jpg)
AudioFX node
Download of custom effects post-processing on the composited/decoded sound signal
Examples:• Simple echo
• Reverberation
• Chorus
![Page 8: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/8.jpg)
Complexity of Effects processing algorithms
Critical issue in studying implementation of an execution engine for effects processing
Complexity Vector • Core Opcode calls
• Floating point divides, multiplies
• Memory accesses
![Page 9: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/9.jpg)
Software Implementation
Scene Graph setup AudioMix, AudioSwitch, AudioDelay
nodes for sound composition Flexible and scalable signal processing
engine for AudioFX node to implement several effects
![Page 10: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/10.jpg)
Results
Implementation of a subset of the AudioBIFS system
SAOL execution engine for AudioFX Complexity analysis of typical effects
processing algorithms Investigation of parallel execution of
effects processing algorithms
![Page 11: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/11.jpg)
Future Work
Implementation of block-based signal processing at control rate
![Page 12: MPEG-4 Structured Audio Mihir Anandpara EE 382C – Embedded Software Systems.](https://reader036.fdocuments.us/reader036/viewer/2022083009/5697c0261a28abf838cd5c98/html5/thumbnails/12.jpg)
Questions?