AUDL 4007 Auditory Perception Week 1
Transcript of AUDL 4007 Auditory Perception Week 1
![Page 1: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/1.jpg)
AUDL 4007Auditory Perception
Week 1
The cochlea & auditory nerve:Obligatory stages of auditory
processing1
![Page 2: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/2.jpg)
Think of the ear as a collection of ‘systems’, transforming
sounds to be sent to the brain
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
2
![Page 3: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/3.jpg)
Imagine the cochlea unrolled
Neural firing depends upon basilar membrane vibration
3
![Page 4: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/4.jpg)
Basilar membrane motion to two sinusoids of different frequency
4
![Page 5: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/5.jpg)
Defining the envelope of the travelling wave
allkhalf.mov5
![Page 6: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/6.jpg)
A crucial distinctionexcitation pattern vs. frequency response
• Excitation pattern — the amount of vibration across the basilar membrane to a single sound.– Input = 1 sound.
– Measure at many places along the BM.
• Essentially the envelope of the travelling wave
• Related to a spectrum (amplitude by frequency).
6
![Page 7: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/7.jpg)
A crucial distinctionexcitation pattern vs. frequency response
• Frequency response — the amount of vibration shown by a particular place on the BM to sinusoids of varying frequency.– Input = many sinusoids.– Measure at a single place on the BM.– Band-pass filters at each position along the basilar
membrane.
7
![Page 8: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/8.jpg)
Two sides of the same coin:Deriving excitation patterns for a 1 kHz
sinusoid from frequency responses
Note shallower slope to lower frequencies (left) for frequency responses
300 Hz frequency 1900 Hz
8
![Page 9: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/9.jpg)
Frequency responses with centre frequenciesrunning from 1400 – 600 Hz
1400 Hz
9
![Page 10: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/10.jpg)
Deriving excitation pattern from auditory filters
Note shallower slope to right
Note shallower slope to left
10
![Page 11: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/11.jpg)
Note shallower slope to right
apex base
low frequencies high
Now the other way around:filter shapes from excitation patterns
Flip the orientation of the axis and schematise
11
![Page 12: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/12.jpg)
The other side of the coin:Deriving a frequency response at 1 kHz
from excitation patterns
Note shallower slope to higher frequencies (right) for excitation patterns
300 Hz frequency 1900 Hz
12
![Page 13: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/13.jpg)
Excitation patterns with centre frequenciesrunning from 1200 – 400 Hz
1200 Hz
13
![Page 14: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/14.jpg)
Deriving frequency responses from excitation patterns
Note shallower slope to left
Note shallower slope to right
14
![Page 15: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/15.jpg)
Laser Doppler Velocimetry
http://www.wadalab.mech.tohoku.ac.jp/bmldv-e.html15
![Page 16: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/16.jpg)
Modern measure-
ments of the frequency
response of the basilar membrane
Consider the frequency
response of a single placeon the BM
16
![Page 17: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/17.jpg)
input/ output
functions on the basilar
membrane
17
![Page 18: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/18.jpg)
Innervation of the cochlea
90-95% of afferents are myelinated, synapsing with a single inner hair cell (IHC). 18
![Page 19: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/19.jpg)
Four aspects of firing patterns on the auditory nerve
• The coding of intensity.
• The representation of the place code.
• The representation of temporal fine structure (for intervals ranging up to 20 ms).
• The representation of gross temporal structure.
19
![Page 20: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/20.jpg)
Intensity
Rate-level functions for
auditory nerve fibres
Observe!
• Threshold
• Saturation
• Limited dynamic range20
![Page 21: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/21.jpg)
However, firing rates depend not only on sinusoidal sound
intensity but also on sound ...
21
![Page 22: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/22.jpg)
Firing rate for a single ANF across frequency and a level of 50 dB SPL
Note: CF ~ 1.2 kHz
Rose, Brugge, Anderson & Hind (1967) J Neurophysiology 30, 769-793.
![Page 23: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/23.jpg)
Firing rate across frequency and level for different ANFs
Rose, Hind, Anderson & Brugge (1971) J Neurophysiology 34, 685-699.
![Page 24: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/24.jpg)
‘Audiograms’ of single auditory nerve fibres reflect BM tuning
24
![Page 25: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/25.jpg)
The ‘best’ frequency of a particular tuning curve depends upon the BM position of the IHC to
which the afferent neuron is synapsing
25
![Page 26: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/26.jpg)
BM and neural tuning compared
‘filtered’ is high-pass filter at 3.8 dB/octave. From Ruggero et al. 2000
26
![Page 27: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/27.jpg)
Information about stimulus frequency is not only coded by which nerve fibres are active (the place code) but also by
when the fibres fire (the time code).
Temporal coding (up to 5 kHz)
27
![Page 28: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/28.jpg)
The firing of auditory nerve fibres is synchronized to movements of the hair cell cilia (at low enough frequencies)
Play transdct.mov 28
![Page 29: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/29.jpg)
This image cannot cur rently be displayed.
Auditory nerves tend to fire to low-frequency sounds at particular waveform times (phase locking).
Evans (1975)
Not the same as firing rate!
29
![Page 30: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/30.jpg)
But phase-locking is limited to lower frequencies ...
• Synchrony of neural firing is strong up to about 1-2 kHz.
• No evidence of synchrony above 5 kHz.
• The degree of synchrony decreases steadily over the mid-frequency range.
30
![Page 31: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/31.jpg)
… as readily seen in a period histogram
31
![Page 32: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/32.jpg)
Period histograms across frequency
Note half-wave rectification and synchrony index32
![Page 33: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/33.jpg)
This image cannot cur rently be displayed.
Constructing an interval histogram
t1 t7t5t3t8t6t4t2
33
![Page 34: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/34.jpg)
Interval histograms for a single AN fibre at
two different
frequencies
Num
ber o
f inte
rvals
per b
in
0 5 10 15 20time (ms)
34
![Page 35: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/35.jpg)
Interval histograms for a single
AN fibre across
frequency
35
![Page 36: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/36.jpg)
Neural stimulation to a low frequency tone
Sound energy propagates to the characteristic place of the tone where it causes deflection of the cochlear partition. Neural spikes, when they occur, are synchronized to the peaks of the local deflections. The sum of these neural spikes tends to mimic the wave shape of the local deflections. 36
![Page 37: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/37.jpg)
Gross temporal structureEnhanced response to sound onsets:
The value of novelty
PST (Peri-Stimulus Time) histogram
37
![Page 38: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/38.jpg)
Where we’ve got to …
• Outer ear channels sound to the middle ear, and can be characterized as a bandpass filter.
• Middle ear effects an efficient transfer of sound energy into the inner ear, again with the characteristics of a bandpass filter.
• Inner ear– Transduces basilar membrane movements into nerve
firings …
– which are synchronised to peaks in the stimulating waveform at low enough frequencies
– Performs a mechanical frequency analysis, which can be envisioned as the result of analysis by a filter bank.
38
![Page 39: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/39.jpg)
Auditory Nerve Structure and Function
Cochlear
Frequency
Map
Liberman (1982)
Single-unit
Recording
Electrode
Auditory
Nerve
Cochlea
Tuning curves
Tracer
Apex
Base
39
![Page 40: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/40.jpg)
A systems model of the auditory periphery
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
40
![Page 41: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/41.jpg)
What properties should the filter bank have?
• Filter spacing
–Corresponding to tonotopic map
• Filter bandwidth
–vary with frequency as on the basilar membrane
• Filter nonlinearity
–vary gain and bandwidth with level as on the basilar membrane
41
![Page 42: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/42.jpg)
period histograms
Modelling the hair cell/auditory nerve synapse
• Neuro-transmitter is released when cilia are pushed in one direction only, tied to polarity of basilar membrane motion– half-wave
rectification
42
![Page 43: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/43.jpg)
Modelling the hair cell/auditory nerve synapse
Phase-locking is limited to low frequencies
– low-pass filtering
period histograms across frequency
43
![Page 44: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/44.jpg)
Simulating hair cell transduction at 500 Hz
input wave
½–wave rectification
smoothing with a 1.5 kHz lowpass filter
think of this last wave as driving the auditory nerve(e.g., as the amount of neurotransmitter in the synaptic cleft)
time (ms) →
good synchrony!
44
![Page 45: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/45.jpg)
Simulating hair cell transduction at 1000 Hz
input wave
½–wave rectification
smoothing with a 1.5 kHz lowpass filter
time (ms) →
good synchrony!
45
![Page 46: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/46.jpg)
Simulating hair cell transduction at 2000 Hz
input wave
½–wave rectification
smoothing with a 1.5 kHz lowpass filter
pretty good synchrony!
46
![Page 47: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/47.jpg)
Simulating hair cell transduction at 4000 Hz
input wave
½–wave rectification
smoothing with a 1.5 kHz lowpass filter
pretty bad synchrony!
47
![Page 48: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/48.jpg)
Simulating hair cell transduction at 8000 Hz
input wave
½–wave rectification
smoothing with a 1.5 kHz lowpass filter
no synchrony!
48
![Page 49: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/49.jpg)
Modelling the hair cell/auditory nerve synapse
• Rapid adaptation
–need some kind of automatic gain control (agc)
49
![Page 50: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/50.jpg)
Neural stimulation to a low frequency tone
50
![Page 51: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/51.jpg)
We’re done!(but need agc here)
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
51
![Page 52: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/52.jpg)
A spectrogram with ‘ear-like’ processing (Giguere & Woodland, 1993)
(typical spectrogram properties in italics)
• A first-stage broad band-pass linear filter to mimic outer and middle ear effects (pre-emphasis filter).
• A filterbank whose centre frequencies are arranged in the same way as the human tonotopic (frequency to place) map ... (equal spacing of filters in Hz).
• with non-linear filters whose bandwidths increase as level increases (linear filters with a fixed bandwidth).
• Smearing of temporal information so as to mimic the frequency limitation of phase locking in the auditory nerve (smearing by choice of temporal window/filter bandwidth —no extra processing ). 52
![Page 53: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/53.jpg)
An auditory spectrogram
53
![Page 54: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/54.jpg)
Types of Spectrogram
Wide-band Narrow-band Auditory
An auditory spectrogram looks like a wide-band spectrogram at high frequencies and a narrow-band spectrogram at low frequencies (but with more temporal structure). 54
![Page 55: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/55.jpg)
Laboratory session: A computer implementation of essentially
this model
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
55
![Page 56: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/56.jpg)
A cochlear simulation
56
![Page 57: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/57.jpg)
Flip it around
????
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
57
![Page 58: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/58.jpg)
A cochlear simulation
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
How should we look at the output of the model?
58
![Page 59: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/59.jpg)
Could look at the output waveforms
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
input signal
output signal
59
![Page 60: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/60.jpg)
But hard to see what is going on (especially for complex waves)
60
![Page 61: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/61.jpg)
Solution: encode wave amplitude in a different way
waveform at 200 Hz
rectified & smoothed
spectrographic
waveform amplitude is recoded as the darkness of the trace
61
![Page 62: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/62.jpg)
Encode wave amplitude as trace darkness
waveform at 1 kHz
rectified & smoothed
spectrographic
62
![Page 63: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/63.jpg)
Encode wave amplitude as trace darkness
waveform at 4 kHz
rectified & smoothed
spectrographic
63
![Page 64: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/64.jpg)
Construct the output display one strip at a time
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
input signal at 200 Hz
output display
64
![Page 65: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/65.jpg)
Construct the output display one strip at a time
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
input signal at 4 kHz
output display
65
![Page 66: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/66.jpg)
4 kHz + 200 Hz
-5
0
5
10
15
20
25
100 1000 10000-5
0
5
10
15
20
25
100 1000 10000
input signal
output display
66
![Page 67: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/67.jpg)
4 kHz + 200 Hz
67
![Page 68: AUDL 4007 Auditory Perception Week 1](https://reader031.fdocuments.us/reader031/viewer/2022030122/621d57f5c313e9247d03e6b7/html5/thumbnails/68.jpg)
Auditory and ordinary spectrograms
68