爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy...
Transcript of 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy...
![Page 1: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/1.jpg)
Earphones: The Next Computing Platform
Romit Roy Choudhury
after Smartphones
![Page 2: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/2.jpg)
Nura
Bose
Nokia
Apple
Samsung
Dolby, Oculus
![Page 3: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/3.jpg)
Nura
Bose
Nokia
Apple
Samsung
Dolby, Oculus
… just the tip of the iceberg
![Page 4: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/4.jpg)
Mic IMUSpkr. BLE
Sensors, hardware
![Page 5: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/5.jpg)
Mic IMUSpkr. BLE Vibration Optical Neural ArraysIn-Ear
Sensors, hardware
![Page 6: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/6.jpg)
Mic IMUSpkr. BLE Vibration Optical Neural ArraysIn-Ear
Acoustics,Speech
Wireless(BLE, WiFi, 60GHz)
Multi-modal Sensing
Embedded Systems
Machine Learning
Sensors, hardware
Primitives, Algorithms
![Page 7: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/7.jpg)
Mic IMUSpkr. BLE
Sensors, hardware
Acoustic
Health Sense
Security
Navigate me
Acoustics,Speech
Wireless(BLE, WiFi, 60GHz)
Multi-modal Sensing
Embedded Systems
Machine Learning
Primitives, Algorithms
Vibration Optical Neural ArraysIn-Ear
Translate
![Page 8: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/8.jpg)
2005 2015 20232018
![Page 9: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/9.jpg)
But why Earables? Why now?
![Page 10: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/10.jpg)
Reading and typing, a cognitive re-focus
Voice + hearing seamless for humans
But why Earables? Why now?
1
![Page 11: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/11.jpg)
Reading and typing, a cognitive re-focus
Phone, watch, fitbit = quantified lower body
Voice + hearing seamless for humans
Earables gateway to upper body, head
But why Earables? Why now?
1
2
![Page 12: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/12.jpg)
Reading and typing, a cognitive re-focus
Socially well accepted (unlike, Google Glass)
Phone, watch, fitbit = quantified lower body
Voice + hearing seamless for humans
Earables gateway to upper body, head
Takes off one important risk factor
But why Earables? Why now?
1
2
3
![Page 13: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/13.jpg)
But what are hurdles … show-stoppers?
![Page 14: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/14.jpg)
Many Hurdles …
![Page 15: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/15.jpg)
Energy
Many Hurdles …
1
![Page 16: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/16.jpg)
Energy
Discomfort
Many Hurdles …
1
2
![Page 17: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/17.jpg)
Energy
Discomfort
Privacy / Shy
Many Hurdles …
1
2
3
![Page 18: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/18.jpg)
Energy
Discomfort
Privacy / Shy
Health, radiation
Many Hurdles …
1
2
3
4
![Page 19: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/19.jpg)
Energy
Discomfort
Privacy / Shy
Health, radiation
Many Hurdles …but not Insurmountable
1
2
3
4
Contact Mic.
Hollow
Whisper Zone
Low Frequency
![Page 20: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/20.jpg)
We are building a
software libraryfor Earable Computing
With particular interest in the more challenging problems …
![Page 21: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/21.jpg)
We are building a
software libraryfor Earable Computing
Voice assistants
Motion tracking
In-Ear Anatomy (health, security)
Face/Jaw Activity (eating, drinking)
Spatial acoustics
Noise Cancellation
Sensor and Hardware Layer
Beamforming to Speech
![Page 22: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/22.jpg)
Voice assistants
Motion tracking
In-Ear Anatomy (health, security)
Face/Jaw Activity (eating, drinking)
Spatial acoustics
Noise Cancellation
Sensor and Hardware Layer
Beamforming to Speech
We are building a
software libraryfor Earable Computing
![Page 23: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/23.jpg)
Voice assistants Low SNR Speech Recognition (whisper)
![Page 24: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/24.jpg)
Voice assistants Low SNR Speech Recognition (whisper)
WhisperDecoder ASR
![Page 25: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/25.jpg)
Voice assistants
Motion tracking
In-Ear Anatomy (health, security)
Face/Jaw Activity (eating, drinking)
Spatial acoustics
Noise Cancellation
Sensor and Hardware Layer
Beamforming to Speech
![Page 26: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/26.jpg)
Spatial Acoustics
Different propagation delays at two ears
![Page 27: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/27.jpg)
Spatial Acoustics
Different propagation delays at two ears
Inject artificial delays as if sounds coming from a specific direction
![Page 28: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/28.jpg)
Spatial Acoustics
Different propagation delays at two ears
But delays are not unique along hyperbola
Inject artificial delays as if sounds coming from a specific direction
![Page 29: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/29.jpg)
Spatial Acoustics
Different propagation delays at two ears
But delays are not unique along hyperbola
Inject artificial delays as if sounds coming from a specific direction
Personal Transfer Function
![Page 30: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/30.jpg)
3D Gazing Direction
Spatial Acoustics
Different propagation delays at two ears
But delays are not unique along hyperbola
Inject artificial delays as if sounds coming from a specific direction
Personal Transfer Function
![Page 31: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/31.jpg)
FollowMe
Starbuckshere
Acoustic Augmented Reality (AAR)
Spatial Acoustics
Voice Escort
![Page 32: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/32.jpg)
Voice assistants
Motion tracking
In-Ear Anatomy (health, security)
Face/Jaw Activity (eating, drinking)
Spatial acoustics
Noise Cancellation
Sensor and Hardware Layer
Beamforming to Speech
We are building a
software libraryfor Earable Computing
![Page 33: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/33.jpg)
Motion tracking Indoor localization
![Page 34: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/34.jpg)
Motion tracking Indoor localization
![Page 35: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/35.jpg)
Motion tracking Indoor localization
![Page 36: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/36.jpg)
Motion tracking Indoor localization
![Page 37: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/37.jpg)
Motion tracking Indoor localization
![Page 38: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/38.jpg)
Motion tracking Indoor localization
Body/skeleton is a natural low pass filter
![Page 39: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/39.jpg)
Motion tracking Indoor localization
LocationTracking
Lower body IMU (smartphone)
Head IMU (earphone)
Kinematic Motion models
Body/skeleton is a natural low pass filter
![Page 40: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/40.jpg)
Voice assistants
Motion tracking
In-Ear Anatomy (health, security)
Face/Jaw Activity (eating, drinking)
Spatial acoustics
Noise Cancellation
Sensor and Hardware Layer
Beamforming to Speech
We are building a
software libraryfor Earable Computing
![Page 41: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/41.jpg)
Beamforming to Speech Estimate Angle of Arrival (AoA)
![Page 42: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/42.jpg)
Beamforming to Speech Estimate Angle of Arrival (AoA)
AoA Estimate.
.
.
![Page 43: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/43.jpg)
Path #2(1st Echo)
Path #3(2nd Echo)
Path #1(Direct Path)
Estimate Angle of Arrival (AoA) Beamforming to Speech
![Page 44: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/44.jpg)
Path #2(1st Echo)
Path #3(2nd Echo)
Path #1(Direct Path)
A B C D E F G H I JA B C D E F G
……A B C …
A B C D E F G H I JA B C D E. …
…A B C …
![Page 45: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/45.jpg)
Iterative Align and Cancel (IAC)
Algorithm
![Page 46: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/46.jpg)
Voice assistants
Motion tracking
In-Ear Anatomy (health, security)
Face/Jaw Activity (eating, drinking)
Spatial acoustics
Noise Cancellation
Sensor and Hardware Layer
Beamforming to Speech
We are building a
software libraryfor Earable Computing
![Page 47: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/47.jpg)
Noise Cancellation
Ear Drum
Noise
Anti-Noise
Bone Conduction
Speaker
NoiseCancelation
Cancellation with Hollow earbuds
![Page 48: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/48.jpg)
Face/jaw activity
Different eating, drinking, tooth brushing activity
Activities = Eating, Drinking, Brushing
![Page 49: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/49.jpg)
In-ear health sensing Ear Impulse Response (EIR)
![Page 50: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/50.jpg)
Voice assistants
Motion tracking
In-Ear Anatomy (health, security)
Face/Jaw Activity (eating, drinking)
Spatial acoustics
Noise Cancellation
Sensor and Hardware Layer
Beamforming to Speech
We are building a
software libraryfor Earable Computing
![Page 51: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/51.jpg)
Questions thus far …
![Page 52: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/52.jpg)
Part II
Design a hollow earable
that can still cancel noise
![Page 53: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/53.jpg)
Existing Solutions
![Page 54: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/54.jpg)
This Project
Existing SolutionsBetter Noise Cancellation
9dB Better
![Page 55: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/55.jpg)
This Project
Existing Solutions
Better Form Factor(Hollow)
Better Noise Cancellation
Comparable Performance
9dB Better
![Page 56: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/56.jpg)
Wireless Networking +
Our System: MUTE
Noise Cancellation
![Page 57: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/57.jpg)
Alice
![Page 58: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/58.jpg)
1. Sound starts
Alice
![Page 59: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/59.jpg)
1. Sound starts
2. IoT relay forwards sound over wireless
Alice
![Page 60: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/60.jpg)
1. Sound starts
2. IoT relay forwards sound over wireless
Alice
Wireless radios travel a million times faster than sound
![Page 61: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/61.jpg)
1. Sound starts
2. IoT relay forwards sound over wireless 3. Wireless arrives at
ear-device earlier
Alice
![Page 62: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/62.jpg)
1. Sound starts
2. IoT relay forwards sound over wireless 3. Wireless arrives at
ear-device earlier
4. Actual sound arrives later
Alice
![Page 63: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/63.jpg)
1. Sound starts
2. IoT relay forwards sound over wireless 3. Wireless arrives at
ear-device earlier
Lookahead
4. Actual sound arrives later
Alice
![Page 64: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/64.jpg)
Lookahead allows us to cover ears in time
Analogy: Light travels much faster than sound
MUTE: Leverage lookahead for noise cancellation
![Page 65: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/65.jpg)
Talk Outline
How can MUTE leverage lookahead?
Wideband Cancellation
Non-Causal Filtering
Sound Source Profiling
Timing Gain
Signal Processing Gain
Application-Specific Gain
![Page 66: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/66.jpg)
Talk Outline
How can MUTE leverage lookahead?
Wideband Cancellation
Non-Causal Filtering
Sound Source Profiling
Timing Gain
Signal Processing Gain
Application-Specific Gain
![Page 67: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/67.jpg)
Noise Cancelling Headphones-- What is inside?
![Page 68: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/68.jpg)
Noise Cancellation Primer
Ref. Mic. DSP Anti-NoiseSpeaker
![Page 69: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/69.jpg)
Noise Cancellation Primer
Ref. Mic. DSP Anti-NoiseSpeaker
![Page 70: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/70.jpg)
Noise Cancellation Primer
Ref. Mic. DSP Anti-NoiseSpeaker
![Page 71: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/71.jpg)
Noise Cancellation Primer
Ref. Mic. DSP Anti-NoiseSpeaker
![Page 72: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/72.jpg)
Noise Cancellation Primer
Ref. Mic. DSP Anti-NoiseSpeaker
![Page 73: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/73.jpg)
Noise Cancellation Primer
Ref. Mic. DSP Anti-NoiseSpeaker
Feedback Mic.
(Error Feedback)
![Page 74: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/74.jpg)
How do they perform today?
![Page 75: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/75.jpg)
500 1000 1500 2000 2500 3000 3500
Frequency (Hz)
-30
-20
-10
0
Can
cella
tion
(dB)
Bose_Active
Active noise cancellation only at low frequencies
Bose QC35
Good
Bad
![Page 76: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/76.jpg)
500 1000 1500 2000 2500 3000 3500
Frequency (Hz)
-30
-20
-10
0
Can
cella
tion
(dB)
Bose_Active
Active noise cancellation only at low frequencies
Bose QC35
Good
Bad
![Page 77: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/77.jpg)
500 1000 1500 2000 2500 3000 3500
Frequency (Hz)
-30
-20
-10
0
Can
cella
tion
(dB)
Bose_Active
Active noise cancellation only at low frequencies
Bose QC35
Good
Bad
Sound absorbing material blocks high frequencies
![Page 78: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/78.jpg)
Active noise cancellation only at low frequencies
500 1000 1500 2000 2500 3000 3500
Frequency (Hz)
-30
-20
-10
0
Can
cella
tion
(dB)
Bose_Active
Bose_Overall
Sound absorbing material blocks high frequencies
Bose QC35
Good
Bad
![Page 79: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/79.jpg)
Why does noise cancellation not work at higher frequencies?
Let’s look into the headphone again.
![Page 80: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/80.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
Time
![Page 81: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/81.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
𝑡𝑡1
𝑡𝑡2
Time
![Page 82: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/82.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
𝑡𝑡1
𝑡𝑡2
Time
![Page 83: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/83.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
𝑡𝑡2
Time
𝑡𝑡1
![Page 84: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/84.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
𝑡𝑡1
𝑡𝑡2
Time budget (lookahead):𝑡𝑡2 − 𝑡𝑡1 ≈ 30 μs
1 cm
Time
![Page 85: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/85.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
𝑡𝑡1
𝑡𝑡2
𝑡𝑡3
Time budget (lookahead):𝑡𝑡2 − 𝑡𝑡1 ≈ 30 μs
Time
![Page 86: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/86.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
𝑡𝑡1
𝑡𝑡2
𝑡𝑡3
Time budget (lookahead):𝑡𝑡2 − 𝑡𝑡1 ≈ 30 μs
Time
Time lag: Δ𝑡𝑡 = 𝑡𝑡3 − 𝑡𝑡2
![Page 87: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/87.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
Time
High Frequency:
Anti-Noise
Noise
Residual Error
Low Frequency:
Anti-Noise
Noise
Residual Error
![Page 88: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/88.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
Time
500 1000 1500 2000 2500 3000 3500
Frequency (Hz)
-30
-20
-10
0
Can
cella
tion
(dB)
Bose_Active
![Page 89: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/89.jpg)
Let’s now look at noise cancellation in MUTE ...
![Page 90: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/90.jpg)
Ref. Mic. Fb. Mic.DSP Speaker
𝑡𝑡1
𝑡𝑡2
Time
![Page 91: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/91.jpg)
Fb. Mic.DSP Speaker
𝑡𝑡2
𝑡𝑡1
Ref. Mic.
Time
![Page 92: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/92.jpg)
Fb. Mic.DSP Speaker
𝑡𝑡1
𝑡𝑡2
Ref. Mic.
Time
![Page 93: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/93.jpg)
Fb. Mic.DSP Speaker
𝑡𝑡2
Ref. Mic.𝑡𝑡1
1 m
Time budget (lookahead):𝑡𝑡2 − 𝑡𝑡1 ≈ 3 ms(100X larger)
Time
![Page 94: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/94.jpg)
Fb. Mic.DSP Speaker
𝑡𝑡2
Ref. Mic.𝑡𝑡1
Time budget (lookahead):𝑡𝑡2 − 𝑡𝑡1 ≈ 3 ms(100X larger)
Time
![Page 95: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/95.jpg)
Fb. Mic.DSP SpeakerRef. Mic.𝑡𝑡1
Time budget (lookahead):𝑡𝑡2 − 𝑡𝑡1 ≈ 3 ms(100X larger)
Cancel high frequencies
Anti-Noise
Noise
Residual Error
Time
![Page 96: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/96.jpg)
Talk Outline
How can MUTE leverage lookahead?
Wideband Cancellation
Non-Causal Filtering
Sound Source Profiling
Timing Gain
Signal Processing Gain
Application-Specific Gain
![Page 97: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/97.jpg)
Talk Outline
How can MUTE leverage lookahead?
Wideband Cancellation
Non-Causal Filtering
Sound Source Profiling
Timing Gain
Signal Processing Gain
Application-Specific Gain
![Page 98: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/98.jpg)
Noise Cancellation Primer
Ref. Mic. Feedback Mic.
DSP
![Page 99: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/99.jpg)
Noise Cancellation Primer
Ref. Mic. Feedback Mic.
DSP
𝑓𝑓(•)
![Page 100: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/100.jpg)
Noise Cancellation Primer
Ref. Mic. Feedback Mic.
DSP
𝑔𝑔(•)
𝑓𝑓(•)
![Page 101: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/101.jpg)
Noise Cancellation Primer
Ref. Mic. Feedback Mic.
𝑓𝑓(•)
𝑔𝑔(•)
−𝑓𝑓−1 ∗ 𝑔𝑔
![Page 102: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/102.jpg)
−𝑓𝑓−1 ∗ 𝑔𝑔
Future PastCurrent
Channel Impulse Response
Ref. Mic. Feedback Mic.
![Page 103: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/103.jpg)
−𝑓𝑓−1 ∗ 𝑔𝑔
Future PastCurrent
Today’s Headphones (Causal)
MUTE (Non-Causal)
Channel Impulse Response
Lookahead
“Lookahead” Non-Causal Filtering Better Cancellation
Ref. Mic. Feedback Mic.
![Page 104: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/104.jpg)
Talk Outline
How can MUTE leverage lookahead?
Wideband Cancellation
Non-Causal Filtering
Sound Source Profiling
Timing Gain
Signal Processing Gain
Application-Specific Gain
![Page 105: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/105.jpg)
Talk Outline
How can MUTE leverage lookahead?
Wideband Cancellation
Non-Causal Filtering
Sound Source Profiling
Timing Gain
Signal Processing Gain
Application-Specific Gain
![Page 106: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/106.jpg)
![Page 107: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/107.jpg)
Alice Bob Alice
![Page 108: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/108.jpg)
Alice Bob Alice
![Page 109: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/109.jpg)
Alice Bob Alice
![Page 110: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/110.jpg)
With lookahead …
![Page 111: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/111.jpg)
Alice Bob Alice
![Page 112: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/112.jpg)
Alice Bob Alice
![Page 113: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/113.jpg)
Alice Bob Alice
![Page 114: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/114.jpg)
Talk Outline
How can MUTE leverage lookahead?
Wideband Cancellation
Non-Causal Filtering
Sound Source Profiling
Timing Gain
Signal Processing Gain
Application-Specific Gain
![Page 115: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/115.jpg)
Implementation & Evaluation
![Page 116: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/116.jpg)
MUTE Platform
Noise Source
![Page 117: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/117.jpg)
MUTE PlatformIoT Relay
Noise Source
![Page 118: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/118.jpg)
MUTE Platform
Wireless Receiver
Noise SourceIoT Relay
![Page 119: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/119.jpg)
MUTE Platform
DSP Processor
Wireless Receiver
Noise SourceIoT Relay
![Page 120: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/120.jpg)
MUTE Platform
Feedback Microphone
Wireless Receiver
Noise SourceIoT Relay
DSP Processor
![Page 121: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/121.jpg)
MUTE Platform
Anti-Noise SpeakerWireless Receiver
Noise SourceIoT Relay
DSP Processor
Feedback Microphone
![Page 122: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/122.jpg)
MUTE Platform
MUTE (Hollow)
![Page 123: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/123.jpg)
MUTE Platform
MUTE (Hollow)
![Page 124: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/124.jpg)
Evaluation
Goal: Comparable Performance
MUTE (Hollow) Ear Blocking Headphone
![Page 125: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/125.jpg)
500 1000 1500 2000 2500 3000 3500
Frequency (Hz)
-40
-30
-20
-10
0
Can
cella
tion
(dB)
Bose
MUTE (Hollow)
2. MUTE hollow design (comfort)1. Bose headphone
![Page 126: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/126.jpg)
Evaluation
Goal: Better Performance
MUTE (Non-Hollow) Ear Blocking Headphone
![Page 127: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/127.jpg)
500 1000 1500 2000 2500 3000 3500
Frequency (Hz)
-40
-30
-20
-10
0
Can
cella
tion
(dB)
Bose
MUTE (Hollow)
MUTE (Non-Hollow)
2. MUTE hollow design (comfort)3. MUTE non-hollow design (performance)
1. Bose headphone
+
![Page 128: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/128.jpg)
Zooming Out
![Page 129: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/129.jpg)
Wireless Signal
![Page 130: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/130.jpg)
MUTE Tabletop Relay
![Page 131: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/131.jpg)
DSP
MUTE Tabletop Relay
![Page 132: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/132.jpg)
DSP
MUTE Tabletop Relay
![Page 133: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/133.jpg)
Noise Cancellation as an Edge Service
DSP
![Page 134: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/134.jpg)
Noise Cancellation as an Edge Service
DSP
Anti-Noise for Alice
Feedback
![Page 135: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/135.jpg)
MUTE Enabled Noise Sources
![Page 136: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/136.jpg)
Conclusion
Acoustic Data Plane
Wireless Control Plane
MUTETabletop Relay
MUTEEdge Service
MUTENoise Source
AcousticNoise
Cancellation
![Page 137: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/137.jpg)
Conclusion
AcousticNoise
Cancellation
On-Ear Machine Learning
Acoustic Augmented
Reality…
MUTETabletop Relay
MUTEEdge Service
MUTENoise Source
Acoustic Data Plane
Wireless Control Plane
![Page 138: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/138.jpg)
Closing Thoughts …
![Page 139: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/139.jpg)
The Wearable Market Projections
WiFore: https://www.nickhunn.com/wp-content/uploads/downloads/2014/08/The-Market-for-Smart-Wearables.pdfhttps://www.nickhunn.com/wp-content/uploads/downloads/2014/08/The-Market-for-Smart-Wearables.pdf
![Page 140: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/140.jpg)
Voice assistants
Motion tracking
In-Ear Anatomy (health, security)
Face/Jaw Activity (eating, drinking)
Spatial acoustics
Noise Cancellation
Sensor and Hardware Layer
Beamforming to Speech
We are building a
software libraryfor Earable Computing
![Page 141: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/141.jpg)
![Page 142: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/142.jpg)
Thanks to my excellent
students and collaborators …
Thanks to all of youJay PrakashVisiting Student
![Page 143: 爀吀愀氀欀 椀猀 搀攀猀椀最渀攀搀 琀漀 戀攀 昀漀爀 琀栀攀 … Roy Choudhury.pdfEarphones: The Next Computing Platform . Romit Roy Choudhury. after Smartphones.](https://reader036.fdocuments.us/reader036/viewer/2022062415/6099e95d9a84316d9f2b7f77/html5/thumbnails/143.jpg)