Graduate Thesis Seminar Week 1: Latex and HTML Jonas Braasch.
Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.
-
Upload
norma-banks -
Category
Documents
-
view
222 -
download
4
Transcript of Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.
![Page 1: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/1.jpg)
Applied PsychoacousticsLecture: Binaural Hearing
Jonas Braasch Jens Blauert
![Page 2: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/2.jpg)
left ear3D acoustic
sceneright ear
Coding
Decoding
3D auditoryscene
Eardrum
signal s(t):distanceazimuthelevation
sl(t)
sr(t)
4D 2x 1D 4D ?
![Page 3: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/3.jpg)
Types of Binaural Models
• Localization Models• Detection Models• Sound-Source Separation Models
• Pink Models• Black-Box Models
![Page 4: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/4.jpg)
Types of Binaural Models
• Localization Models• Detection Models• Sound-Source Separation Models
• Pink Models• Black-Box Models
![Page 5: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/5.jpg)
Tasks to solve
1 What cues are available to localize a sound source?
2 How can we extract those cues in a Binaural Computational Model?
3 How can we calculate the position of the sound source from the extracted binaural cues ?
![Page 6: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/6.jpg)
Models regarding one sound source1. What cues are available to localize a sound source?
![Page 7: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/7.jpg)
Models regarding one sound source1. What cues are available to localize a sound source?
Head-Related Coordinate System
![Page 8: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/8.jpg)
Those cues are available:
• Interaural cues– Interaural Time Differences (ITD‘s)– Interaural Level Differences (ILD‘s)
• Monaural cues– Spectral Cues
![Page 9: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/9.jpg)
Those cues are available:
• Interaural cues– Interaural Time Differences (ITD‘s)– Interaural Level Differences (ILD‘s)
• Monaural cues– Spectral Cues Rayleigh‘s
Duplex Theorie
![Page 10: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/10.jpg)
HRIR
![Page 11: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/11.jpg)
HRIR
HRTFRHRTFL
![Page 12: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/12.jpg)
![Page 13: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/13.jpg)
![Page 14: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/14.jpg)
Lateralization=intra cranialLocalization =extra cranial
Lateralization
figure from Jens Blauert
Interaural axis
Sideward deviation=1-D task
![Page 15: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/15.jpg)
delay lines
figure from Jens Blauert
attenuators
How to generate ITDs and ILDs
ITDsILDs
![Page 16: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/16.jpg)
figure from Jens Blauert
Frequency
Late
raliz
ati
on
blu
r
Gaussian tones
sinusoids
Lateralization Blur for ILDs
Lateralization blur=Lateralization experimentsMinimal audible angle=Localization experiments
![Page 17: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/17.jpg)
figure from Jens Blauert
ILD induced Lateralization
inter aural level differences
perc
eiv
ed
sid
ew
ays
devia
tion
left stronger
right stronger
left
ri
ght
broadband noise
600-Hz sinusoid(Sayers, 1964)
![Page 18: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/18.jpg)
fcarrier
en
velo
pe o
r ca
rrie
r carrierenvelopetotal signalpure tones
frequency band wideGaussian tones
figure from Jens Blauert
Lateralization Blur for ITDs
Gaussian tones:Gaussian enveloped sinusoidsof critical band width
![Page 19: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/19.jpg)
Envelope vs. Carrier Signals
![Page 20: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/20.jpg)
inter aural phase differences
perc
eiv
ed
sid
ew
ays
devia
tion
left earlier right earlier
left
ri
ght
figure from Jens Blauert
ITD induced Lateralization
![Page 21: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/21.jpg)
Localization Curves
level difference
(left louder)
time difference
(left earlier)
dir
ect
ion o
f au
dit
ory
event
φ→
dir
ect
ion o
f au
dit
ory
event
φ→
figure from Jens Blauert
![Page 22: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/22.jpg)
Tasks to solve
1 What cues are available to localize a sound source?
2 How can we extract those cues in a Binaural Computational Model?
3 How can we calculate the position of the sound source from the extracted binaural cues ?
![Page 23: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/23.jpg)
How can we extract those cues in a Binaural Computational Model?
• Extracting ITD‘S– Jeffress Model– Cross-Correlation Models
• Extracting ILD‘s– Excitation-Inhibition cells
![Page 24: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/24.jpg)
The Jeffress Model (1948)
![Page 25: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/25.jpg)
R
L Jeffress
model (1948)
Estimation of ITDs
![Page 26: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/26.jpg)
R
L
Estimation of ITDs
Jeffressmodel (1948)
![Page 27: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/27.jpg)
R
L
Estimation of ITDs
Jeffressmodel (1948)
![Page 28: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/28.jpg)
R
L
Estimation of ITDs
Jeffressmodel (1948)
![Page 29: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/29.jpg)
R
L
Estimation of ITDs
Jeffressmodel (1948)
![Page 30: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/30.jpg)
R
L
Estimation of ITDs
Jeffressmodel (1948)
![Page 31: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/31.jpg)
R
L
Interaural cross correlation
Estimation of ITDs
Jeffressmodel (1948)
![Page 32: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/32.jpg)
Model Structure
xR M
x
x
R M
R M
Band
pass
filte
r ban
k
Decis ion device
HRTF l
HRTF l
HRTF r
HRTF r
Band
pass
filte
r ban
k
Hairc
ell
Beha
vior
Cros
s-co
rrela
tion
Rem
appi
ng
Hairc
ell
Beha
vior
to: H
RT
Fr
from
: sou
nd s
ourc
es
Out
er e
ar
Out
er e
ar
Soun
d so
urce
s
+
1st
2n d
ith
n th
frequencyband:
+
y 1 y 2 y n
H
H
H
H
H
H HR LP
Halfwaverectification
Lowpassfilter
![Page 33: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/33.jpg)
Cross-Correlation Models
Y ()= 1/(t1-t0) Yl(t)Yr(t+)t=t0
t1
Cherry (1959)
![Page 34: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/34.jpg)
Cross-Correlation Models
Y ()= 1/(t1-t0) Yl(t)Yr(t+)t=t0
t1
Similarity to Jeffress‘ Coincidence Model:
k k+1 k+2 k+3 k+4 k+5 k+6 k+7 k+8
![Page 35: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/35.jpg)
102
103
104
-60
-50
-40
-30
-20
-10
0
10
Frequency [Hz]
Filt
er R
espo
nse
[dB
]
Bandpass Filterbank Fletcher (1940)Patterson et al. (1995)
![Page 36: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/36.jpg)
Model Structure
xR M
x
x
R M
R M
Band
pass
filte
r ban
k
Decis ion device
HRTF l
HRTF l
HRTF r
HRTF r
Band
pass
filte
r ban
k
Hairc
ell
Beha
vior
Cros
s-co
rrela
tion
Rem
appi
ng
Hairc
ell
Beha
vior
to: H
RT
Fr
from
: sou
nd s
ourc
es
Out
er e
ar
Out
er e
ar
Soun
d so
urce
s
+
1st
2n d
ith
n th
frequencyband:
+
y 1 y 2 y n
H
H
H
H
H
H
Blauert und Cobben (1978)
![Page 37: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/37.jpg)
0.0 2.5 5.0 7.5 10.0 12.5 -100
-50
0
dB
Frequency [kHz]
0 0.02 0.04 0.06 0.08 0.1
-1.0
-0.5
0.0
0.5
1.0
time [s]
rel.
ampl
itude
Testsound 1ff=500 Hz
Time
Frequency
![Page 38: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/38.jpg)
Cross-correlationBand 7 (527 Hz)
![Page 39: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/39.jpg)
Cross-correlationBand 11 (3809 Hz)
![Page 40: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/40.jpg)
0 0.5 1 1.5 2
x 10-3time [ms]
rel.
ampl
itude
L
R
Uncertainty in High Frequencies
![Page 41: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/41.jpg)
0 0.5 1 1.5 2
x 10-3time [ms]
rel.
ampl
itude
L
R
? ? ?
Uncertainty in High Frequencies
![Page 42: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/42.jpg)
0 0.02 0.04 0.06 0.08 0.1
-1.0
-0.5
0.0
0.5
1.0
time [s]
rel.
ampl
itude
Testsound 1ff=500 Hzmodulated
![Page 43: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/43.jpg)
xR M
x
x
R M
R M
Band
pass
filte
r ban
k
Decis ion device
HRTF l
HRTF l
HRTF r
HRTF r
Band
pass
filte
r ban
k
Hairc
ell
Beha
vior
Cros
s-co
rrela
tion
Rem
appi
ng
Hairc
ell
Beha
vior
to: H
RT
Fr
from
: sou
nd s
ourc
es
Out
er e
ar
Out
er e
ar
Soun
d so
urce
s
+
1st
2n d
ith
n th
frequencyband:
+
y 1 y 2 y n
H
H
H
H
H
H
Model Structure
![Page 44: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/44.jpg)
Model Structure
xR M
x
x
R M
R M
Band
pass
filte
r ban
k
Decis ion device
HRTF l
HRTF l
HRTF r
HRTF r
Band
pass
filte
r ban
k
Hairc
ell
Beha
vior
Cros
s-co
rrela
tion
Rem
appi
ng
Hairc
ell
Beha
vior
to: H
RT
Fr
from
: sou
nd s
ourc
es
Out
er e
ar
Out
er e
ar
Soun
d so
urce
s
+
1st
2n d
ith
n th
frequencyband:
+
y 1 y 2 y n
H
H
H
H
H
H HR LP
Halfwaverectification
Lowpassfilter
![Page 45: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/45.jpg)
Cross-correlationBand 21 (3809 Hz)
![Page 46: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/46.jpg)
Estimating ILDs using EI-cells
Reed and Blum (1990)Breebaart et al. (2001)
E()=exp((10/40 Pl-10-/40 Pr)2)
ILD
![Page 47: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/47.jpg)
Estimating ILDs using EI-cells
Reed and Blum (1990)Breebaart et al. (2001)
E()=exp((10/40 Pl-10-/40 Pr)2)
ILD
R
L
![Page 48: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/48.jpg)
EI modelBand 25 (6281 Hz)
![Page 49: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/49.jpg)
Tasks to solve
1 What cues are available to localize a sound source?
2 How can we extract those cues in a Binaural Computational Model?
3 How can we calculate the position of the sound source from the extracted binaural cues ?
![Page 50: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/50.jpg)
3. How can we calculate the position of the sound source from the extracted binaural cues ?
![Page 51: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/51.jpg)
xR M
x
x
R M
R M
Band
pass
filte
r ban
k
Decis ion device
HRTF l
HRTF l
HRTF r
HRTF r
Band
pass
filte
r ban
k
Hairc
ell
Beha
vior
Cros
s-co
rrela
tion
Rem
appi
ng
Hairc
ell
Beha
vior
to: H
RT
Fr
from
: sou
nd s
ourc
es
Out
er e
ar
Out
er e
ar
Soun
d so
urce
s
+
1st
2n d
ith
n th
frequencyband:
+
y 1 y 2 y n
H
H
H
H
H
H
3. How can we calculate the position of the sound source from the extracted binaural cues ?
![Page 52: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/52.jpg)
3. How can we calculate the position of the sound source from the extracted binaural cues ?
xR M
x
x
R M
R M
Band
pass
filte
r ban
k
Decis ion device
HRTF l
HRTF l
HRTF r
HRTF r
Band
pass
filte
r ban
k
Hairc
ell
Beha
vior
Cros
s-co
rrela
tion
Rem
appi
ng
Hairc
ell
Beha
vior
to: H
RT
Fr
from
: sou
nd s
ourc
es
Out
er e
ar
Out
er e
ar
Soun
d so
urce
s
+
1st
2n d
ith
n th
frequencyband:
+
y 1 y 2 y n
H
H
H
H
H
H
![Page 53: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/53.jpg)
Remapping
![Page 54: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/54.jpg)
![Page 55: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/55.jpg)
30°0°
90°
Model based on EI-cells
![Page 56: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/56.jpg)
left ear3D acoustic
sceneright ear
Coding
Decoding
3D auditoryscene
Eardrum
signal s(t):distanceazimuthelevation
sl(t)
sr(t)
4D 2x 1D 4D
ITDsILDs
monaural cues
![Page 57: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/57.jpg)
Head-related Coordinate System
frontal plane
median plane
horizontal plane
backwardφ=180°=0°
forwardφ=0°=0°
figure from Jens Blauert
![Page 58: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/58.jpg)
Head-related transfer functions
Frequency [Hz]
![Page 59: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/59.jpg)
Frequency [Hz]
Head-related transfer functions
leftright
![Page 60: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/60.jpg)
Frequency [Hz]
Head-related transfer functions
Inte
rau
ral ti
me d
iffere
nce
s [m
s]
![Page 61: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/61.jpg)
Frequency [Hz]
Head-related transfer functions
Inte
rau
ral le
vel diff
ere
nce
s [d
B]
![Page 62: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/62.jpg)
Localization in the Median Plane
Blauert 1969/70Monaural Cues
directional bands
boosted bands
Signal: 1/3 oct. Band noise
level
diff
ere
nce
s
rel.
judgem
ent
![Page 63: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/63.jpg)
Localization of a single sound source
![Page 64: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/64.jpg)
Types of accompaning sound sources
• Non-coherent sound sources– independent sound sources (e.g.
street noise, concurrent speakers, accompaning musical instruments)
• Coherent sound sources– wall reflections– electronically processed sound
sources (e.g., loudspeaker arrays)
![Page 65: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/65.jpg)
Part ILocalization of a single sound source
Part IILocalization in the presence of a
non- coherent sound source
Part IIILocalization in the presence of
coherent sound sources
![Page 66: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/66.jpg)
target
distracter200ms 200ms 100ms
Time Course
![Page 67: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/67.jpg)
Methods
• Virtual auditory sound sources• Individual HRTF• 11 listeners, 10 repetitions• Test sound and distracter:
– noise (200 - 14 kHz) – T/D-ratio 0 ... - 15 dB
• GELP
![Page 68: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/68.jpg)
-90 -60 -30 0 30 60 90
-90
-60
-30
0
30
60
90
presented left/right[° ]
perc
eive
d le
ft/r
ight
[°]
Single sourceSNR: 0dB
Localization Results
![Page 69: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/69.jpg)
Listener 6:anechoiccondition
Localization Results
![Page 70: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/70.jpg)
Localization model
xR M
x
x
R M
R M
Band
pass
filte
r ban
k
Decis ion device
HRTF l
HRTF l
HRTF r
HRTF r
Band
pass
filte
r ban
k
Halfw
ave
rect
ificat
ion
Cros
s-co
rrela
tion
Rem
appi
ng
Halfw
ave
rect
ificat
ion
to: H
RT
Fr
from
: sou
nd s
ourc
es
Out
er e
ar
Out
er e
ar
Soun
d so
urce
s
+
1st
2n d
ith
n th
frequencyband:
+
y 1 y 2 y n
![Page 71: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/71.jpg)
Lateralization shifts at 0 dB T/D-ratio
-90 -60 -30 0 30 60 90
-90
-60
-30
0
30
60
90
presented left/right[° ]
perc
eive
d le
ft/r
ight
[°]
Single sourceSNR: 0dB
listeners
distracter distracter
![Page 72: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/72.jpg)
0 dB -10 dB
60 dBRunning interauralcross-correlation
frequency band: 5
![Page 73: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/73.jpg)
Localization
Experiment
target
distracter
target
distracter
![Page 74: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/74.jpg)
Arguments for the cross-correlation difference
hypothesis
• two noise bursts are perceived as one auditory event, if their envelope is identical and they overlap in spectrum. This can be observed, even if the noise burst have different spatial positions and if they are uncorrelated.
• the auditory event of the target depends strongly on the exposure time of the masker before the target onset.
• existing models fail at very low SNRs.
![Page 75: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/75.jpg)
The interaural cross-correlation difference function
T
D‘ D
200ms 200ms 100ms
T = A- D
D‘ D
T‘ A- D‘
step 1:
step 2:
T
T
T
T
T‘D‘
D
A
A
time time
![Page 76: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/76.jpg)
sig: 30°dis: 0°
Distracter
Total signal
Total signal - Distracter
Target
![Page 77: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/77.jpg)
Lateralisation shifts
Simulation usingsubtraction factor g:
T = A-g(t)D‘
with a) g(0)=0; b) g(x0)=1;
Meunier et al. (1996)
![Page 78: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/78.jpg)
Including a detection algorithm
SNR=-15 dB
![Page 79: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/79.jpg)
Conclusion
• The model is able to simulate localization and detection of broadband noise in broadband noise
• It allows localization at very low T/D-ratios• The model explains a number of
psychoacoustical phenomena (e.g. shifts of auditory events, clustering of responses)
• It can be extended to more than two sound sources
![Page 80: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/80.jpg)
Part ILocalization of a single sound
source
Part IILocalization in the presence of a
non- coherent sound source
Part IIILocalization in the presence of
coherent sound sources
![Page 81: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/81.jpg)
The precedence effect
(Blauert, 1983)
![Page 82: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/82.jpg)
Time course
IT D 1 IT D 2IS I
tim e
rig h tc h a n n e l
le f tc h a n n e l
le a d
la g
![Page 83: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/83.jpg)
Methods
• Stimulus presentation via headphones • Lead and lag pair:
– Bandpass filtered noise (500 Hz cf)– 100 Hz, 400 Hz or 800 Hz frequency
range– Lead: 300 ms ITD, lag: —300 ms and vice
versa– ISI 0, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, 4.5 ms
• 6 listeners• Acoustic pointer
![Page 84: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/84.jpg)
Psychoacoustial results
![Page 85: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/85.jpg)
delay Δt of the lag speaker
lead
lag
Revised precedence effect curve for narrow-band
signals
Blauert & Braasch 2004
![Page 86: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/86.jpg)
ILD analysis
ISI [ms]
![Page 87: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/87.jpg)
Specialized Models• Combining Several Cues
– Centrality and Straightness (Stern et al., 1988)– HRTF-adjustment (Gaik-Lindemann, 1990)– Neuronal Networks (z.B. Janko et al. 1996)
• Localizing more than one sound source– Contralateral Inhibition (Lindemann, 1986)– Bayes Classification (Nix, Hohmann, 1999)– Cross-Correlation Difference (Braasch, 2001)
![Page 88: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/88.jpg)
Importance of Head movements
Jonghees and van der Veer 1958
![Page 89: Applied Psychoacoustics Lecture: Binaural Hearing Jonas Braasch Jens Blauert.](https://reader035.fdocuments.us/reader035/viewer/2022062301/56649ec45503460f94bcee77/html5/thumbnails/89.jpg)
level differences between both loudspeaker signals
Median values and variations between listeners
azi
muth
angle
φ o
f audit
ory
event
figure from Jens Blauert