Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays...
Transcript of Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays...
![Page 1: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/1.jpg)
Using arrays of loudspeakers
for focusing or diffusing sound
February meeting of Pacific
Northwest section of Audio
Engineering Society (AES)
![Page 2: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/2.jpg)
Agenda
Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research
Focusing sound principle and generic beamforming Jasha Droppo, Microsoft Research
Robust beamformer design for loudspeaker arrays Ivan Tashev, Microsoft Research
Generating diffuse sound with loudspeaker arrays James (jj) Johnston, Microsoft Corporation
Demos of loudspeaker arrays: Focusing sound
Multiple beams
Diffusing sound
Home entertainment
![Page 3: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/3.jpg)
Loudspeaker arrays applications
in home and in the office
Mike Seltzer, Microsoft Research
![Page 4: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/4.jpg)
Loudspeaker Arrays
Chain multiple speakers to create a more uniform sound field in a performance space Undo the directivity of the individual speakers
Every seat is a good seat
Requires healthy dose of art and science Commodity parts
Performance space is not well behaved
Size and cost constraints
On-site installation
![Page 5: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/5.jpg)
I should put this in my home?
![Page 6: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/6.jpg)
Well, sort of…
Question of the night:
What (other) experiences can be enabled with loudspeaker arrays in the home and office?
Can these experiences be realized? Commodity parts
Performance space is not well behaved
Size and cost constraints
On-site installation
Mass production scale quantities
![Page 7: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/7.jpg)
Scenarios: Office
Listening to private
phone call …
… instead of holding
a handset
![Page 8: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/8.jpg)
Scenarios: Office
Listen to favorite music
not wearing headset …
… instead of wearing headset
and not able to hear anything else.
![Page 9: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/9.jpg)
Scenarios: Home
Create personal audio space
and listen to music/TV while the baby
is sleeping, …
… or wear a headset all time, …
… or deal with the crying baby!
![Page 10: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/10.jpg)
Scenarios: Home
Different strokes for different folks: multiple
sound beams!
…picture-in-picture TV watching,
DVDs in different languages, split screen gaming, etc
![Page 11: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/11.jpg)
Scenarios: Retail/Museum
… the latest
dresses from
Valentino …
… the
handbags
from Gucci
![Page 12: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/12.jpg)
Anyone doing this?
Sound Projector line of
products
Licensed technology from 1Limited (UK)
6 different models
![Page 13: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/13.jpg)
Under the hood:
40 drivers (2W)
2 woofers (20W)
They make a compact model with 21 drivers
![Page 14: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/14.jpg)
What can it do?
![Page 15: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/15.jpg)
Focusing sound principle and
generic beamforming
Jasha Droppo, Microsoft Research
![Page 16: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/16.jpg)
A Single Point Source
Speaker in the
center of room.
Radiates sound in all
directions equally.
Red and blue are
high and low
pressure waves.
![Page 17: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/17.jpg)
Two Point Sources
• The waves from two speakers overlap.
• Too close together, they appear like a single point source.
• As they separate, the pattern becomes more complex.
![Page 18: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/18.jpg)
A Jumble of Point Sources
• Four speakers placed at random within the room, fed with the same source.
• Neighboring pairs of speakers broadcast audio depending on their relative positions.
• This would sound pretty awful.
![Page 19: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/19.jpg)
Beamforming
Take the input signal
Filter it with different
for each loudspeaker
filter
Send the output to
the loudspeaker
Listen
Filter 1
Filter l
Filter L
…
…
X(f)
Y1(f)
Yl(f)
YL(f)
![Page 20: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/20.jpg)
An array of Point Sources
• A linear array makes a nicer pattern by default compared to the jumble.
• (Top) nine speakers fed with the same source.
• (Bottom) slightly different signal sent to each speaker produces a more coherent pattern.
![Page 21: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/21.jpg)
Steering the Array
• (Left) speakers fed with “no delay”
• (Center) speakers fed “linear delay”
• (Right) Because the process is linear, different sounds can be sent in different directions.
![Page 22: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/22.jpg)
When Theory meets Reality
The amplifier channels aren‟t identical.
Each speaker‟s response isn‟t ideal.
Varies over frequency, angle, and distance.
No two speakers are the same.
Manufacturing tolerances, baffling box
effect.
Which effects are important? What can
we do to mitigate them?
![Page 23: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/23.jpg)
Practical Solutions (Easy)
Ignore the problem
You can still get some steering of the
sound, even though the components are
non-ideal.
Do simple calibration
Measuring or adjusting the relative gain of
your channels can improve the system.
![Page 24: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/24.jpg)
Practical Solutions (Moderate)
Characterize the system (simple) Measure or equalize signal gain through each
channel.
(complex) For each speaker in the array, for 36 angles, at two different distances, measure the end-to-end impulse response.
Freq [kHz]
Incid
ent
Angle
[degre
es]
2 4 6 8 10 12 14 16 18 20
0
50
100
150
![Page 25: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/25.jpg)
Practical Solutions (Fun)
Develop new math!
![Page 26: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/26.jpg)
Robust beamformer design
for loudspeaker arrays
Ivan Tashev, Microsoft Research
![Page 27: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/27.jpg)
What we know so far?
Loudspeakers have directivity pattern ( , , )U f
Martin-W8LM Monarc MLA6
horizontal
horizontal
vertical -150 -100 -50 0 50 100 150-40
-35
-30
-25
-20
-15
-10
-5
0
5Sound field intensity - single speaker, 1000.0 Hz
Direction, degrees
Inte
nsity, d
B
MSR Experimental
![Page 28: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/28.jpg)
What we might want to do with an
array of loudspeakers?
To cover a large area with same sound
level – sound reinforcement
To focus the sound in a small area, or
towards given direction
To send multiple sound beams towards
different directions
To generate a diffuse sound field with no
detectable sound source direction
![Page 29: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/29.jpg)
How to cover a large area?
Project sound beams, covering the area
relatively evenly
First floor Balcony
J-array of speakers
![Page 30: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/30.jpg)
How to cover a large area?
Project sound beams, covering the area
relatively evenly
First floor Balcony
J-array of speakers
![Page 31: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/31.jpg)
How to cover a large area?
Project sound beams, covering the area
relatively evenly
First floor Balcony
J-array of speakers
![Page 32: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/32.jpg)
How to cover a large area?
Project sound beams, covering the area
relatively evenly
First floor Balcony
J-array of speakersJoin the AES meeting
in Port Townsend
to learn more!
![Page 33: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/33.jpg)
Focusing the sound?
Generalized beamforming:
How to design the filters?
given listening area SL
given silent area SS
find Wl(f) such as to
maximize
( ) ( ). ( ) 1l lY f W f X f l L
1
( ) ( )
1
( , ) ( ) ( )
( ) arg max arg max
( , ) ( ) ( )
L
L
L
l
lS
Lf f
l
lS
D f s W f X f ds
f
D f s W f X f ds
W W
W
listening area
silent area
![Page 34: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/34.jpg)
Cool! The theory works!
-150 -100 -50 0 50 100 150-40
-35
-30
-25
-20
-15
-10
-5
0
5Sound field intensity - single speaker, 1000.0 Hz
Direction, degrees
Inte
nsity, d
B
-150 -100 -50 0 50 100 150-40
-35
-30
-25
-20
-15
-10
-5
0
5Sound field intensity - speaker array, 1000.0 Hz
Direction, degrees
Inte
nsity, d
B
![Page 35: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/35.jpg)
Works? Really?
What if the loudspeakers are not exactly
the same?
-150 -100 -50 0 50 100 150-40
-35
-30
-25
-20
-15
-10
-5
0
5MaxDir: Speaker Array Gain for 1000.0 Hz
Direction, degrees
Gai
n,
dB
-150 -100 -50 0 50 100 150-40
-35
-30
-25
-20
-15
-10
-5
0
5Sound field intensity - speaker array, 1000.0 Hz
Direction, degrees
Inte
nsity, d
B
2, , , , 0, ( )l lU f U f f exact matching
![Page 36: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/36.jpg)
Robust beamformer design
After some derivations we find that we
have to maximize:
2
min 2 2
2.5
21
2.5 2.51 1
2 2
tot
A
tot tot
S S
PR
P PR R
-150 -100 -50 0 50 100 150-40
-35
-30
-25
-20
-15
-10
-5
0
5MaxDir: Speaker Array Gain for 1000.0 Hz
Direction, degrees
Gai
n,
dB
-150 -100 -50 0 50 100 150-40
-35
-30
-25
-20
-15
-10
-5
0
5MaxDirRobust: Speaker Array Gain for 1000.0 Hz
Direction, degrees
Gai
n,
dB
![Page 37: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/37.jpg)
Not bad!
=
![Page 38: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/38.jpg)
0.2
0.4
0.6
0.8
1
30
210
60
240
90
270
120
300
150
330
180 0
Directivity of the speaker array for 1000.0 Hz
Not bad! Not bad at all!
![Page 39: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/39.jpg)
Is it real?
Two demos for focusing the sound after the talk: Focusing one beam
towards the front of the array (the example so far)
Two beams simultaneously playing different sound tracks
16 element linear loudspeaker array
![Page 40: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/40.jpg)
Generating diffuse sound with
loudspeaker arrays
James (jj) Johnston, Microsoft
![Page 41: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/41.jpg)
So far, what have we seen?
Being able to synthesize a plane/circularly convergent wave has great advantages.
You can synthesize such a wave without too much trouble with a loudspeaker array.
What about the “diffuse” soundfield that one hears in a good acoustic venue? It‟s more or less the opposite of a direct wave.
Perceptually, it‟s decorrelated at the two ears.
Acoustically, it doesn‟t actually have to be decorrelated.
![Page 42: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/42.jpg)
Why would we do this?
Simply put, when we issue a one-point
recording of a diffuse waveform from a
single loudspeaker, we turn it into a
single-point-source version of a diffuse
waveform.
It is, therefore, heavily correlated at the
ears, both perceptually and mathematically.
![Page 43: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/43.jpg)
So?
What we do, then, is create a pattern that is
diffuse in terms of the hearing apparatus.
This means that in each critical band, onsets for the
signal envelope are scrambled somehow.
This onset is different for adjacent critical bands.
It helps if the frequency response is also
“scrambled”.
You can “overlay” a listening room‟s acoustics
via first arrival from an array speaker.
![Page 44: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/44.jpg)
An example:
![Page 45: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/45.jpg)
Diffuse sound demo
Since a beam can be steered, etc, as you‟ve seen
from the other talks, we are going to demonstrate a
fixed direct beam (2 meters directly in front of the
center of the array) along with a diffuse radiation
superimposed on the direct beam.
In order to experience the different effects, all that is
necessary is to walk up on axis between the two
arrays and listen as you approach the „X‟ on the
floor.
In a real application, it would be, of course, possible
to provide different direct and indirect signals.
![Page 46: Using arrays of loudspeakers for focusing or diffusing sound · Agenda Loudspeaker arrays applications in home entertainment and in the office Mike Seltzer, Microsoft Research Focusing](https://reader030.fdocuments.us/reader030/viewer/2022040607/5eba65d47b1de53106169352/html5/thumbnails/46.jpg)
Demos
Focusing sound
Beam focused towards the array broadside
Multiple beams
Two beams, one broadside, one under 45 degrees
Diffuse sound
Stereo sound track, with both direct and diffuse
radiation
Home entertainment
Yamaha 1100 speaker array for surround sound