Hearing Things
description
Transcript of Hearing Things
![Page 2: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/2.jpg)
Sound Signals
• Many physical objects emit sounds when they are “excited” (e.g. hit or rubbed).
• Sounds are just pressure waves rippling through the air, but they carry a lot of information about the objects that emitted them.(Example: what are these two objects? Which one is heavier, object A or object B ?)
• The sound (or signal) emitted by an object (or system) when hit is known as the impulse response.
• Impulse responses of everyday objects can be quite complex, but the sine wave is a fundamental ingredient of these (or any) complex sounds (or signals).
![Page 3: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/3.jpg)
Vibrations of a Spring-Mass System
Undamped
1. F = -k·y (Hooke’s Law)
2. F = m · a (Newton’s 2nd)
3. a = dv/dt = d2y/dt2
-k · y = m · d2y/dt2
y(t) = yo · cos(t · k/m)
Damped
4. –k·y –r dy/dt = d2y/dt2
y(t) = yo·e(-r·t/2m)cos(t·k/m-(r/2m)2)
Don’t worry about the formulae! Just remember that mass-spring systems like to vibrate at a rate proportional to the square-root of their “stiffness” and inversely proportional to their weight.
Don’t worry about the formulae! Just remember that mass-spring systems like to vibrate at a rate proportional to the square-root of their “stiffness” and inversely proportional to their weight.
https://mustelid.physiol.ox.ac.uk/drupal/?q=acoustics/simple_harmonic_motion
![Page 4: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/4.jpg)
Sound wave propagation
![Page 5: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/5.jpg)
Resonant Cavities
• In resonant cavities, “lumps of air” at the entrance/exit of the cavity oscillate under the elastic forces exercised by the air inside the cavity.
• The preferred resonance frequency is inversely proportional to the square root of the volume. (Large resonators => deeper sounds).
![Page 6: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/6.jpg)
The Ear
Organ of Corti
Cochela “unrolled” and sectioned
![Page 7: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/7.jpg)
Basilar membrane mechanics:a trade-off between stiffness and
inertia
![Page 8: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/8.jpg)
Basilar Membrane Tuning Animation
See auditoryneuroscience.com | The Ear
![Page 9: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/9.jpg)
Sound Transduction
Cochlea
Organ of Corti
Sensory “Hairs”(Stereocilia)
![Page 10: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/10.jpg)
Afferent Innervation of the Hair Cells
type 1
type 2
Tonotopy
![Page 11: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/11.jpg)
The Outer Hair Cell’s Special Trick
https://mustelid.physiol.ox.ac.uk/drupal/?q=ear/dancing_hair_cell
![Page 12: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/12.jpg)
Many Real-World
Objects Vibrate at Multiple
Frequencies
https://mustelid.physiol.ox.ac.uk/drupal/?q=acoustics/modes_of_vibration https://mustelid.physiol.ox.ac.uk/drupal/?q=acoustics/modes_of_vibration
![Page 13: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/13.jpg)
The Impulse (or “Click”)
• The “ideal click”, or impulse, is an infinitesimally short signal.
The Fourier Transform encourages us to think of this click as an infinite series of sine waves, which have started at the beginning of time, continue until the end of time, and all just happen to pile up at the one moment when the click occurs.
The Fourier Transform encourages us to think of this click as an infinite series of sine waves, which have started at the beginning of time, continue until the end of time, and all just happen to pile up at the one moment when the click occurs.
![Page 14: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/14.jpg)
Basilar Membrane Response to Clicks
![Page 15: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/15.jpg)
The Spectrogram
![Page 16: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/16.jpg)
Click Trains & the “30 Hz Transition”
• At frequencies up to ca 30 Hz, each click in a click train is perceived as an isolated event.
• At frequencies above ca 30 Hz, individual clicks fuse, and one perceives a continuous hum with a strong pitch.
time
sound p
ress
ure
https://mustelid.physiol.ox.ac.uk/drupal/?q=pitch/click_train
![Page 17: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/17.jpg)
Harmonic Structure of Click Trains
• If we represent each click in a train by its Fourier Transform, then it becomes clear that certain sine components will add (top) while others will cancel (bottom). This results in a strong harmonic structure.
![Page 18: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/18.jpg)
Basilar Membrane Response to Click Trains
auditoryneuroscience.com | The Ear
![Page 19: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/19.jpg)
Vocal Folds in Action
auditoryneuroscience.com | Vocalizations
![Page 20: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/20.jpg)
Articulation
• Articulators (lips, tongue, jaw, soft palate) move to change resonance properties of the vocal tract.
auditoryneuroscience.com | Vocalizations Launch Spectrogram
![Page 21: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/21.jpg)
Harmonics & Formants of a Vowel
HarmonicsFormants
![Page 22: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/22.jpg)
The “Neurogram”As a crude approximation, one might say that it is the job of the ear to produce a spectrogram of the incoming sounds, and that the brain interprets the spectrogram to identify sounds. This figure shows histograms of auditory nerve fibre discharges in response to a speech stimulus. Discharge rates depend on the amount of sound energy near the neuron’s characteristic frequency.
![Page 23: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/23.jpg)
The discharges of cochlear nerve fibres to low-The discharges of cochlear nerve fibres to low-frequency sounds are not random; frequency sounds are not random;
they occur at particular times (they occur at particular times (phase lockingphase locking).).
Evans (1975)Evans (1975)
Phase Locking
https://mustelid.physiol.ox.ac.uk/drupal/?q=ear/phase_locking
![Page 24: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/24.jpg)
• Cariani & Delgutte AN recordings
Phase locking to Modulator(Envelope)
Phase locking to Modulator(Envelope)
Phase locking to CarrierPhase locking to Carrier
AN Phase Locking to Artificial “Single Formant” Vowel Sounds
https://mustelid.physiol.ox.ac.uk/drupal/?q=ear/bm_motion_3
![Page 25: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/25.jpg)
Tonotopicity in the
Cochlear Nucleus
The base of the BM projects to medial CN, the apex to lateral CNThe base of the BM projects to medial CN, the apex to lateral CN
Anteroventral CN
Posteroventral CN
Posteroventral CN
Anteroventral CN
Dorsal CN
Cochlea
CochlearNerve
![Page 26: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/26.jpg)
Neurons of the Cochlear Nucleus
Figure 2-16 of Schnupp, Nelken, King “Auditory Neuroscience”
![Page 27: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/27.jpg)
Simplified schematic of the
ascending auditory pathway
![Page 28: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/28.jpg)
Periodicity Maps in the Midbrain?
Neurons in the midbrain or above show much less phase locking to AM than neurons in the brainstem.Transition from a timing to a rate code. Some neurons have bandpass MTFs and exhibit “best modulation frequencies” (BMFs).Topographic maps of BMF may exist within isofrequency laminae of the ICc, (“periodotopy”).
![Page 29: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/29.jpg)
Periodotopic maps via fMRI• Baumann et al Nat Neurosci
2011 described periodotopic maps in monkey IC obtained with fMRI.
• They used stimuli from 0.5 Hz (infra-pitch) to 512 Hz (mid-range pitch).
• Their sample size is quite small (3 animals – false positive?)
• The observed orientation of their periodotopic map (medio-dorsal to latero-ventral for high to low) appears to differ from that described by Schreiner & Langner (1988) in the cat (predimonantly caudal to rostral)
![Page 30: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/30.jpg)
Auditory cortex of Ferret (A), Cat (B) and Macaque Monkey (C)
Figure 2-18 of Schnupp, Nelken, King “Auditory Neuroscience”
![Page 31: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/31.jpg)
A pitch area in
primates?
• In marmoset, Pitch sensitive neurons are most commonly found on the boundary between fields A1 and R.
• Fig 2 of Bendor & Wang, Nature 2005
![Page 32: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/32.jpg)
A pitch sensitive neuron in marmoset A1?
• Apparently pitch sensitive neurons in marmoset A1.• Fig 1 of Bendor & Wang, Nature 2005
![Page 33: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/33.jpg)
Break
![Page 34: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/34.jpg)
Earning One’s Supper
![Page 35: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/35.jpg)
Interaural Time Difference (ITD) Cues
ITD
ITDs are powerful cues to sound source direction, but they are ambiguous (“cones of confusion”)
ITDs are powerful cues to sound source direction, but they are ambiguous (“cones of confusion”)
![Page 36: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/36.jpg)
Interaural Level Cues (ILDs)
Unlike ITDs, ILDs are highly frequency dependent. At higher sound frequencies ILDs tend to become larger, more complex, and hence potentially more informative.
ILD at 700 Hz ILD at 11000 Hz
![Page 37: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/37.jpg)
Spectral (Monaural) Cues
![Page 38: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/38.jpg)
“Type IV” neurons in the dorsal cochlear nucleus often have inhibitory frequency response areas with excitatory sidebands. This makes them sensitive to “spectral notches” like those seen in spectral localisation cues.
Bushy Multipolar (Stellate) PyramidalOctopus
Spectral Cues and the Dorsal Cochlear Nucleus
![Page 39: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/39.jpg)
![Page 40: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/40.jpg)
![Page 41: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/41.jpg)
The Jeffress Model
![Page 42: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/42.jpg)
Guinea Pig ITD Tuning Curves
-2000 -1500 -1000 -500 0 500 1000 1500 2000ITD (microseconds)
no
rma
lize
d fi
rin
g r
ate
150 Hz200 Hz260 Hz340 Hz650 Hz1000 Hz
![Page 43: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/43.jpg)
The “Auditory Space Map” in the Superior Colliculus
• The SC is involved in directing orienting reflexes and gaze shifts.
• Acoustically responsive neurons in rostral SC tend to be tuned to frontal sound source directions, while caudal SC neurons prefer contralateral directions.
• Similarly, lateral SC neurons prefer low, medial neurons prefer high sound source elevations.
![Page 44: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/44.jpg)
Where and What Streams in Auditory Cortex?
After Romanski et al
![Page 45: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/45.jpg)
The Rauschecker & Tian 2001 “What vs. Where experiment”
![Page 46: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/46.jpg)
Are there “What” and “Where” Streams in Auditory Cortex?
• Some reports suggest that anterior cortical belt areas may more selective for sound identity and less for sound source location, while caudal belt areas are more location specific.
• It has been hypothesized that these may be the starting positions for a ventral “what” stream heading for inferotemporal cortex and a dorsal “where” stream which heads for postero-parietal cortex.
• Figure 2 from Tian & Rauschecker, Science 2001
AnterolateralBeltAnterolateralBelt
CaudolateralBeltCaudolateralBelt
![Page 47: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/47.jpg)
-100
-50
0
50
dB/a/ /e/ /u/ /i/
200 Hz
-100
-50
0
50
dB
336 Hz
-100
-50
0
50
dB
565 Hz
0 5000 10000-100
-50
0
50
dB
Hz0 5000 10000
Hz0 5000 10000
Hz0 5000 10000
Hz
951 Hz
-100
-50
0
50
dB/a/ /e/ /u/ /i/
200 Hz
-100
-50
0
50
dB
336 Hz
-100
-50
0
50
dB
565 Hz
0 5000 10000-100
-50
0
50
dB
Hz0 5000 10000
Hz0 5000 10000
Hz0 5000 10000
Hz
951 Hz
Artificial Vowel Sounds
![Page 48: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/48.jpg)
Responses to Artificial Vowels
Bizley, Walker, Silverman, King & Schnupp - J Neurosci 2009Bizley, Walker, Silverman, King & Schnupp - J Neurosci 2009
![Page 49: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/49.jpg)
Pit
ch
(H
z)
Vowel type (timbre)
Joint Sensitivity to Formants and Pitch
Bizley, Walker, Silverman, King & Schnupp - J Neurosci 2009Bizley, Walker, Silverman, King & Schnupp - J Neurosci 2009
![Page 50: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/50.jpg)
Azimuth, Pitch and Timbre Sensitivity in Ferret Auditory Cortex
JK Bizley, KMM Walker, BW Silverman, AJ King and JWH Schnupp, (2009) Interdependent encoding of pitch, timbre and spatial location in auditory cortex. J Neurosci 29(7):2064-75.
![Page 51: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/51.jpg)
Cortical Deactivation
• Deactivating some cortical areas (A1, PAF) by cooling impairs sound localization, but impairing others (AAF) does not.
• Lomber & Malhorta J. Neurophys (2003)
![Page 52: Hearing Things](https://reader035.fdocuments.us/reader035/viewer/2022062423/5681472c550346895db46a05/html5/thumbnails/52.jpg)
Common Features of Sensory Systems
• Highly sensitive receptors “transduce” physical features of the outside world into neural excitation patterns
• Afferent pathways pre-process the information using synaptic computations such as “lateral inhibition” to enhance contrast or similar
• Parallel (but nevertheless interconnected!) pathways may deal with particular aspects of a sensory stimulus (colour, shape, pitch, spatial position)
• Sensory information is fed in parallel into several different “response systems”, such as reflex pathways for rapid response, “limbic” structures for evaluation of emotional significance, parietal cortex for guiding deliberate actions, prefrontal cortex for short term memory purposes, inferotemporal cortex for abstract cognitive evaluation and gating to long term memory