MM-4095, Innovating with AMD Multimedia Technologies, by Amit Mookerjee and Carl Wakeland

INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES

AMIT MOOKERJEE SENIOR MANAGER, MEDIA SOFTWARE SOLUTIONS, AMD

CARL WAKELAND FELLOW DESIGN ENGINEER, AMD

AMD Media SDK Enabling Developers to Provide the Best Multimedia Experiences on the AMD platform

3 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

3

Video Conferencing

Multimedia Experiences on AMD

Remote Desktop Video Playback

Cloud Gaming Video Editing/Transcode Wireless Display


4

AMD MULTIMEDIA SOFTWARE STACK

AMD Media Framework (AMF)

Driver

MFT

Applications

AMD HW

DirectX OpenCL OpenGL

Media SDK

MFT MFT ISV ISV

ISV


5

MEDIA SDK1.0 SUMMARY

MFTs for leveraging Media HW accelerator blocks for video encoding/decoding

Video Quality MFT for video pre/post processing

AMF-DEM library for use in low latency applications

Support for Windows 7/8 Desktop as well as Windows 8 Store Application*

* AMF-DEM library only supports classic desktop applications


6

MEDIA SDK1.0 VALUE FOR DEVELOPERS

Leverage AMD’s industry leading multimedia IP

‒ Leverage well known video processing features like AMD Steady VideoTM

‒ Leverage the unique VCE-DEM feature on AMD APUs/dGPUs in low latency applications

like wireless display and remote desktop

Optimal use of Heterogeneous Compute in Multimedia Apps

‒ eg. Buffer sharing on GPU, DX to OpenCL inter-op

Reduce Time to Market for Multimedia ISVs

‒ Optimized sample code for targeted application use cases

‒ Developer collateral and support via forum


7

MEDIA SDK ROADMAP

Q4 Q1 Q2 Q3 Q4

2014 2013

APU13

MediaSDKv1.0: - Video quality MFT for

video processing - AMF-DEM library for low

latency apps - Windows 8 Store

Support

Media SDKv1.0

Beta

Nov

Media SDKv1.0

GA

Jan

MediaSDKv1.1: - AMF library for video

encode/decode/processing - Multi-GPU support - Cloud gaming support

Media SDKv1.1

Jun

Beta Announcement &

Demos


9

ADDITIONAL INFORMATION

Fast, easy mobile computing and gaming; Victor Chin @ Splashtop; 2:45-3:30pm, Nov 12

ScreenMirror – A Unified screen mirroring solution; Nao Yoshikawa @ ArcSoft;11:00-11:45am,Nov 12

Miracast with AMD Wireless Display Technology; Daryl Sartain @ AMD ; 5:00-5:45pm,Nov 12

RapidFire API; Dmitry Kozlov @ AMD ; 4:00-4:45pm, Nov 12

Bay Area Multimedia Meetup - http://www.meetup.com/Bay-Area-Multimedia-Meetup-Group/

http://www.meetup.com/Bay-Area-Multimedia-Meetup-Group/









AMD TRUEAUDIO PROCESSOR CARL WAKELAND

FELLOW DESIGN ENGINEER, AMD


11

BENEFITS OF AMD TRUEAUDIO ACCELERATION FOR GAMERS

Raising the bar for the audio gaming experience on PC ‒More audio objects and higher-resolution sound

environments, with minimal workload added to the CPU

‒ Eliminate the workload uncertainty factor sound designers have when relying completely on CPU-based offload

‒ TrueAudio provides a baseline of bonus audio processing throughput that sound designers can add to their typical 10% CPU utilization budget

Enhanced headset experience ‒ Implement enhanced environmental 3D object positioning

using position information from the game engine

‒ TrueAudio works inside the game application itself. OS audio stack is not involved

** All features above are dependent on 3rd Party ISVs such as game developers, audio middleware, etc..


12

OTHER POTENTIAL TRUEAUDIO USES

Content management ‒Audio search pre and post-processing

‒Quickly navigate through hundreds of sounds to find just the one you want

‒Pick distinct songs out of your library just by pointing the mouse and listening

Professional Audio Processing ‒Client digital audio workstation

applications ‒Use TrueAudio to accelerate :

‒Music creation with complete control over every aspect of the sound and add custom effects

‒Add dozens of layers of sound, music and dialogue to your movie masterpiece

** All features above are dependent on 3rd Party ISVs, audio middleware, etc..


13

AMD TRUEAUDIO HARDWARE ARCHITECTURE

Interrupt Routing

Clock/Reset/Pwr Control

Semaphore I/F

Client/Target MMIO

Debug

Streaming DMA Engine

Memory Bus Interface with scatter-

gather Translation Apertures

384 K Shared Instruction/Data RAM

Tensilica HiFi EP Subsystem



DSP0

I-Cache 32KB

D-Cache 32KB

8 KB Scratch

RAM

DSP1

I-Cache 32KB

D-Cache 32KB

8 KB Scratch

RAM

DSP2

I-Cache 32KB

D-Cache 32KB

8 KB Scratch

RAM

Bus Routing and Bridging

Address Translation

Address Translation

Address Translation

Routing and Arbitration

AMD TRUEAUDIO Registers

Bus Bridging

Sync

Memory

MMIO

JTAG

Memory

GPU Interrupt


14




DSP0

I-Cache 32KB

D-Cache 32KB

8 KB Scratch

RAM

DSP1

I-Cache 32KB

D-Cache 32KB

8 KB Scratch

RAM

DSP2

I-Cache 32KB

D-Cache 32KB

8 KB Scratch

RAM

AMD TRUEAUDIO DSP FEATURES

Three Audio Optimized DSP cores

Tensilica HiFi EP instruction set

Tensilica Xtensa SP float support, DP assistance (also supports some transcendentals)

32 KB instruction and data caches

8 KB of scratch RAM used for fast local operations

External power/clock management for clock freq/voltage (up to 900 MHz)


15

Interrupt Routing

Clock/Reset/Pwr Control

Semaphore I/F

Client/Target MMIO

Debug

Streaming DMA Engine

Memory Bus Interface with scatter-

gather Translation Apertures

384 K Shared Instruction/Data RAM

Bus Routing and Bridging

Address Translation

Address Translation

Address Translation

Routing and Arbitration

AMD TRUEAUDIO Registers

Bus Bridging

Sync

Memory

MMIO

JTAG

Memory

AMD TRUEAUDIO SPECIFIC HARDWARE FEATURES

Streaming DMA engine ‒ Multichannel with

programmable descriptors, IOC

‒ Scatter gather architecture

Internal Shared memory ‒ 384 KB of shared internal

memory, 8 KB banks

‒ Independently arbitrated for con concurrent access of DMA and each DSP

Bus interface to frame buffer/system memory ‒ High performance, low latency

access to frame buffer memory

‒ Up to 64 MB addressable space in frame buffer

‒ Windowed into internal AMD TRUEAUDIO system memory space

GPU Interrupt


16

AUDIO ALGORITHMS COMPLETED AND IN DEVELOPMENT

AMD is engaged with tools and plugin developers to accelerate the following with TrueAudio: ‒AudioKinetic

‒ Convolution reverb

‒ GenAudio AstoundSound RTI positional audio

‒FMOD ‒ FMOD Reverb

‒ ML1 Limiter from McDSP

‒ Others to be announced


17

ACCESSING AMD TRUEAUDIO FUNCTIONALITY FROM APPLICATIONS

Audio Middleware ‒Audio Middleware is responsible

for audio engine framework ‒Audio algorithms typically ship

with middleware - these can be accelerated with TrueAudio accessible through AMD Audio API

Game Engines ‒Game engines can integrate

sound engine, but most work with audio middleware vendors such as FMOD, AudioKinetic

TrueAudio User-mode Services Library

Audio Middleware

Optional API Abstraction

Layer(s)

AMD Audio

API

Higher-Level API

Apps & Game Engines

w/ Middleware

Support

Game Engines w/

Integrated Sound

Engine

AMD Audio

API

Middleware API


18

TRUEAUDIO ENABLEMENT FOR DEVELOPERS

3rd Party Middleware Integration ‒ Less integration

work required

‒ Use existing high level Middleware API to accelerate plugins w/ TrueAudio

Choose from native middleware plugins or 3rd party ‒ Middleware

licensing required

Game Engine

Middleware

AMD TrueAudio

Middleware Plugins

(ie. FMOD, AudioKinetic)

3rd Party Plugins (ie. McDSP)

AMD Audio API

Middleware API


19

AUDIO DATA FLOW & OUTPUT SUPPORT

Effects & Algorithms

AMD

TRUEAUDIO

Application / Game Audio

Assets

Audio Middleware

OS

Dri

ve

r S

tac

k

3.5mm Audio Jack

USB

HDMI/DP

Sound

Card

Driver

USB

Audio

Driver

HDMI/D

P Audio

Driver


20

SUMMARY

Programmable audio pipeline grants artistic freedom to game audio engineers for sound processing

Easy to access through popular audio libraries used by top game developers

Fundamentally redefines the nature of a modern PC graphics card

Spatialization, reverb, mastering limiters and simultaneous voice decode are only the beginning


21

DISCLAIMER & ATTRIBUTION

The information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions and typographical errors.

The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limited to product and roadmap changes, component and motherboard version changes, new model and/or product releases, product differences between differing manufacturers, software changes, BIOS flashes, firmware upgrades, or the like. AMD assumes no obligation to update or otherwise correct or revise this information. However, AMD reserves the right to revise this information and to make changes from time to time to the content hereof without obligation of AMD to notify any person of such revisions or changes.

AMD MAKES NO REPRESENTATIONS OR WARRANTIES WITH RESPECT TO THE CONTENTS HEREOF AND ASSUMES NO RESPONSIBILITY FOR ANY INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS INFORMATION.

AMD SPECIFICALLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE. IN NO EVENT WILL AMD BE LIABLE TO ANY PERSON FOR ANY DIRECT, INDIRECT, SPECIAL OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY INFORMATION CONTAINED HEREIN, EVEN IF AMD IS EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

ATTRIBUTION

© 2013 Advanced Micro Devices, Inc. All rights reserved. AMD, the AMD Arrow logo and combinations thereof are trademarks of Advanced Micro Devices, Inc. in the United States and/or other jurisdictions. Windows is a registered trademark of Microsoft Corporation. Other names are for informational purposes only and may be trademarks of their respective owners.


22

DISCLAIMER & ATTRIBUTION

Images used in this presentation are courtesy of CyberLink, Irrational Games and Square Enix ©2013 Take - Two Interactive Software, Inc. Developed by Irrational Games. BioShock, BioShock Infinite, Irrational Games, 2K Games, Take - Two Interactive Software and their respective logos are all trademarks of Take-Two Interactive Software, Inc. The ratings icon is a trademark of the Entertainment Software Association. All other trademarks are property of their respective owners. All rights reserved. ©2013 Tomb Raider © SQUARE ENIX, Ltd. SQUARE ENIX and the SQUARE ENIX logo are registered trademarks or trademarks of Square Enix Holdings Co., Ltd. Lara Croft, Tomb Raider, Crystal Dynamics, the Crystal Dynamics logo, Eidos, and the Eidos logo are trademarks of SQUARE ENIX, Ltd. All other trademarks are the property of their respective owners. All rights reserved.

MM-4095, Innovating with AMD Multimedia Technologies, by Amit Mookerjee and Carl Wakeland

Technology

Transcript of MM-4095, Innovating with AMD Multimedia Technologies, by Amit Mookerjee and Carl Wakeland