Track 1 session 2 - st dev con 2016 - dsp concepts - innovating iot+wearable with acoustic
-
Upload
stworld -
Category
Devices & Hardware
-
view
714 -
download
2
Transcript of Track 1 session 2 - st dev con 2016 - dsp concepts - innovating iot+wearable with acoustic
Almost every device that interacts with humans has an audio component
Innovating IoT and Wearable Devices with
Acoustic technology
October 4, 2016
Paul Beckmann, CEO – DSP Concepts
2
Introduction
• Dr. Paul Beckmann– 1984-1992: M.I.T., SB, SM and PhD in EE specializing in DSP
– 1992-2001: Bose Corp., developed algorithms for home theater,
pro audio, 3D audio
– 2001-2003: Enuvis Corp., VP Engineering, developed high-
sensitivity GPS algorithms
– 2003-present: DSP Concepts founder/CEO, developed Audio
Weaver and consulted for OEMs
• DSP Concepts– Licenses Audio Weaver: versatile, modular DSP software that requires no coding
– Develop audio processing IP
– Audio DSP consulting/engineering services
3
About DSP Concepts
DSP Concepts is a leading provider of Audio DSP technology, tools and design services
We have over 12 years of experience delivering premium audio solutions for OEMs, silicon vendors, and IP providers
1. Audio Solutions
– System Architecture
– System Customization & Tuning
– Processor profiling and
benchmarking
2. Audio Tools – Audio WeaverTM
– The only graphical cross-
platform audio design
framework
3. Audio Algorithms
– A wide variety of IP for
loudspeaker playback and
microphone input
4
Product Development is Changing
Our VisionDevelopment of products is optimized through global collaboration and integration of tools, technologies and people
5
Which Sense Would You Give up?
6
“Sound is a powerful force that, along with being
able to bring that sense of peace and well-being,
can make human beings love, cry, and in some
cases even kill.” – Deepak Chopra
7
Playback
Communication
Voice Input
Analytics
Where is Audio Heading?
• Speaker processing
• (CE, Pro-Audio)
• Microphone
• Speaker
• (Mobile, CE)
• Audio as UI
• (IoT, Mobile, CE)
• Contextual awareness
• Smart devices
• Big data
• (IoT, Mobile, Wearables, CE,
Medical)
8
Interfaces
First Wave Second Wave Third Wave
8
9
Processing By Senses
10
Smartphone drives microphone costs down
0.0
1000.0
2000.0
3000.0
4000.0
5000.0
6000.0
2013 2014 2015 2016 2017
MEMS Microphone Market (M units)
Market for Analog MEMS Market for Digital MEMS
11
Smartphone drives microphone costs down
Sources: IHS and Yole
© 2015 Property of UBM Canon; All Rights Reserved
2015 UBM Electronics Embedded Markets Study
12
57%
42%
41%
40%
22%
18%
17%
5%
Sensor driven
Cloud connected
Industrial
Smart buildings
Wearable
Medical
Connected vehicles
Other
2015 only (n = 220)
New in 2015If you are developing Internet of Things (IoT) applications,
please indicate the type of application.
Majority of IoT devices sensor driven – little data becoming big data
© 2015 Property of UBM Canon; All Rights Reserved
2015 UBM Electronics Embedded Markets Study
13
How many people are on your embedded project team?14 or so engineers..
What is your development team’s ratio of total resources (including time/dollars/manpower) spent on software vs. hardware for your embedded projects?
60/40
Thinking now about the last embedded project you completed (no longer in development), how many months did that project take to finish?
About 12.5 months
My current embedded project is programmed mostly in: C and C++ account for over 80%
Other interesting highlights about embedded market
14
Scarcity of Resources
Audio DSP
872
Embedded Software
97,975
Audio Engineer
30,915
59 261
129
11
• Expertise needed to develop audio processing software.
• Numbers taken from LinkedIn search
15
Audio Weaver® Design ToolsAudio Weaver Features
• Graphical interface
• Large library of optimized modules
• Real-time tuning
• MIPs and memory profiling
• Regression testing
• Multirate processing
• Frequency domain processing
• Advanced features using MATLAB
Audio Weaver Benefits
• Easy to evaluate IP
• Easy to integrate IP
• Easy to tune IP
• Easy to port IP
• Easy to pick processors
• Easy to ship products
• Easy to support customers
16
The Only Cross Platform Solution
Supported Cores
• ARM Cortex-M4 and M7
• ARM Cortex-A w/NEON
• Intel x86
• Analog devices SHARC, Griffin,
and Blackfin
• TI C6xxx. Jacinto.
• Tensilica Hifi 2 and 3
Feature Roadmap• Multicore support
• 64-bit run-time support
• Presets
• Sample rate converter
integration
Close partners with ARM and Tensilica
17
Demos
• Dialog Enhancement – think of post-
processing modes based on purpose
(music vs talking)
• Time of Arrival – think of robotics,
sound location, cameras
• Voice trigger
• Wind removal – pre-processing
noise cancellation
18
Trends: Microphone Applications
• Smartphone
– # of microphones / Smartphone now at 4pcs (Nokia)
– iPhone5/5s 3pcs. iPhone6 4pcs. iPhone7 TBD. Galaxy S5
switched to DMEMS
• Tablets
– Major OEMs using DMEMs (3pcs). Whitebox (ECM)
• Notebooks / Chromebooks / Ultrabooks
– Strong focus on voice quality. Poised to increase up to 3
/4 for UB
• Emerging Applications
– IoTs, Smart TV / Remote
– Wearable & Fitness
– Ultrasonic
19
Trends: Automotive Microphone Use Cases
• Telephony
– Microphone arrays
• Voice input (aka, “Alexa for your car”)
• Noise dependent equalization
• Active noise cancellation
• Autonomous vehicles
– EMS detection
– Honk detection
– Exterior or interior mics?
20
Trends: Microphone in Headphones
• 35% of headphones in NA shipped with microphones
in 2013..expected to rise to 65% in 2018
• Future source predicts that by 2018 all in-ear
headphones will be equipped with microphones!
• USBC will also increase the probability that localized
pre- and post- processing
• What can be done?
21
Use Case: DTV Video Conferencing
22
Use Case: Security
• Microphone use increasing in cameras
• Sophisticated features
– Direction of arrival estimation
– Automatic gain control
– Echo canceler
– Beamforming
– Acoustic event detection - Machine learning
based CNN algorithms
– Trigger word detection
– VR preprocessing
23
24
Where Microphone Innovation will Occur
Transducer
Combo MEMS Sensor
Vertical Integration -
SW Algorithms + CPU + Mic
25
We are at the heart of Acoustics –
“Unleashing the Power of Sound”
1. Post-processing
2. Pre-processing
New Markets examples:• Medical Wearables Quivium
Cough detection
• Amazon Echo
• Security, DIY
• Education
• VR both voice recognition &
virtual reality
Proliferation of premium acoustics.
Customers are seeking improved acoustic solutions
(pre & post)
Microphone market: ASP
Down and mobile growth stabilizing
Needs new market growth
stimulus
..intelligent audio is coming,
requires DSP knowledge to optimize the
audio signal path
Scarcity of DSP and Acoustic
Expertise requires Turn-Key Solutions
Audio next big input into Contextual Awareness
Acoustic EventDetection
Including ADAS!
Thank You!