Auditory Neuroscience - Lecture 3 Periodicity and Pitch [email protected]
description
Transcript of Auditory Neuroscience - Lecture 3 Periodicity and Pitch [email protected]
![Page 1: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/1.jpg)
Auditory Neuroscience - Lecture 3
Periodicity and Pitch
auditoryneuroscience.com/lectures
![Page 2: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/2.jpg)
PitchThe American National Standards Institute
(ANSI, 1994) defines pitch as “that auditory attribute of sound according to which sounds can be ordered on a scale from low to high.”
… But which way is up?
![Page 3: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/3.jpg)
How pitch perception does NOT work.
http://auditoryneuroscience.com/topics/basilar-membrane-motion-0-frequency-modulated-tone
![Page 4: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/4.jpg)
Missing Fundamental Sounds
http://auditoryneuroscience.com/topics/missing-fundamental
![Page 5: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/5.jpg)
Counter-intuitive Missing Fundamental
http://auditoryneuroscience.com/topics/why-missing-fundamental-stimuli-are-counterintuitive
![Page 6: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/6.jpg)
Measuring Pitch: a Perceptual Quality
http://auditoryneuroscience.com/topics/pitch-matching
![Page 7: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/7.jpg)
Periodicity and Harmonic Structure
![Page 8: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/8.jpg)
Time
Freq
uenc
y
pure tone
1 2 3 40
500
1000
1500
2000
2500
3000
3500
Time
Freq
uenc
y
am tones
1 2 30
500
1000
1500
2000
2500
3000
3500
Time
Freq
uenc
y
iterated rippled (comb filtered) noise
1 2 30
500
1000
1500
2000
2500
3000
3500
Time
Freq
uenc
y
click trains
1 2 30
500
1000
1500
2000
2500
3000
3500
The Pitch of “Complex” Sounds (Examples)
![Page 9: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/9.jpg)
The Periodicity of a Signal is a Major Determinant of its Pitch
Iterated rippled noise can be made more or less periodic by increasing or decreasing the number of iterations. The less periodic the signal, the weaker the pitch.
![Page 10: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/10.jpg)
AN Figure 3.2Four periods of the vowel /a/ from natural speech. The periods are
similar but not identical
![Page 11: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/11.jpg)
AN Figure 3.3Three examples of nonperiodic (quasi-periodic) sounds that evoke a strong pitch
perception.
![Page 12: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/12.jpg)
periodic soundfundamental2nd harmonicnot a harmonic
Periodic Sounds Always Have “Harmonic Structure”
![Page 13: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/13.jpg)
Autocorrelation50 100 150 200 250 300 350 400 450 500 550
-2
0
2
50 100 150 200 250 300 350 400 450 500 550-2
0
2
50 100 150 200 250 300 350 400 450 500 550-2
0
2
50 100 150 200 250 300 350 400 450 500 550-2
0
2
50 100 150 200 250 300 350 400 450 500 550-2
0
2
50 100 150 200
-0.5
0
0.5
1
![Page 14: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/14.jpg)
Stimulus Autocorrelation
• Autocorrelations measure how similar a sound is to a delayed copy of itself.
• Periodic sounds have high autocorrelation values when the delay equals the period.
• Peaks in the autocorrelation are therefore predictive of perceived pitch, even for missing fundamental stimuli and “quasi-periodic” sounds.
![Page 15: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/15.jpg)
Musical Pitch Scales, Consonance and Dissonance
![Page 16: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/16.jpg)
Pitch Scales in Western Music
• One octave: double fundamental frequency• 12 “semitones” in one octave.• A1 = 55 Hz, A2 = 110 Hz, A3 = 220 Hz, A4 = 440 Hz, …• One semitone increases frequency by 2(1/12) = 1.0595, or ca 6%
![Page 17: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/17.jpg)
Consonant and
Dissonant Intervals
AN Fig 3.4Fifth = 7 semi tones = F0 interval of 2(1/7) =
1.4983, i.e almost exactly 50% above the fundamental
“Perfect Fifth” = F0 interval of exactly 1.5
![Page 18: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/18.jpg)
Cochlea and Auditory Nerve
Place vs Timing Codes
![Page 19: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/19.jpg)
Resolved and Unresolved Harmonics
Spectrogram of, and basilar membrane response to, the spoken word “head”
http://auditoryneuroscience.com/ear/bm_motion_3
![Page 20: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/20.jpg)
Cariani & Delgutte AN recordings
Phase locking to Modulator(Envelope)
Phase locking to Carrier
AN Phase Locking to Artificial “Single Formant” Vowel Sounds
![Page 21: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/21.jpg)
Periodicity and Pitch Coding in the CNS
![Page 22: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/22.jpg)
Encoding of Envelope Modulations in the Midbrain
Neurons in the midbrain or above show much less phase locking to AM than neurons in the brainstem.Transition from a timing to a rate code. Some neurons have bandpass MTFs and exhibit “best modulation frequencies” (BMFs).Topographic maps of BMF may exist within isofrequency laminae of the ICc, (“periodotopy”).
Schreiner & Langner J Neurohys 1988
![Page 23: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/23.jpg)
Periodotopic maps via fMRIBaumann, Petkov, Griffiths, Rees
Nat Neurosci 2011described periodotopic maps in
monkey IC obtained with fMRI.They used stimuli from 0.5 Hz
(infra-pitch) to 512 Hz (mid-range pitch).
Their sample size is quite small (3 animals – 20-30 voxels/IC)
The observed orientation of their periodotopic map (medio-dorsal to latero-ventral for high to low) appears to differ from that described by Schreiner & Langner (1988) in the cat (predimonantly caudal to rostral)
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3068195
![Page 24: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/24.jpg)
Schnupp, Garcia-Lazaro & Lesica, SfN abstracts 2013
![Page 25: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/25.jpg)
Rate modulation tuning curves for clicks, SAMn and IRN
Schnupp, Garcia-Lazaro & Lesica, SfN abstracts 2013
Periodotopy?
![Page 26: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/26.jpg)
Schulze, Hess, Ohl, Scheich, 2002 EJN 15:6
Proposed Periodotopy in
Gerbil A1
![Page 27: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/27.jpg)
Periodotopy inconsistent in ferret cortex
Nelken, Bizley, Nodal, Ahmed, Schnupp, King (2008) J. Neurophysiol 99(4)
SAM tones hp Clicks hp IRN
animal 1
animal 2
![Page 28: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/28.jpg)
Topographic Sensory Maps in the Superior Colliculus
Cajal speculated that the optic chiasm might have evolved to ensure a continuous, isomorphic representation of visual space in the optic tectum...
... Like many excellent ideas in science, this one was later proven wrong.This example illustrates how dangerously seductive to the idea of topographic
maps in the brain can be.
![Page 29: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/29.jpg)
A pitch area in primate
cortex?
Fig 2 of Bendor & Wang, Nature 2005
![Page 30: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/30.jpg)
A pitch sensitive neuron in marmoset A1?
Apparently pitch sensitive neurons in marmoset A1.Fig 1 of Bendor & Wang, Nature 2005
![Page 31: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/31.jpg)
Mapping cortical sensitivity to sound features
Pitc
h (H
z)
Bizley, Walker, Silverman, King, Schnupp, J Neurosci, 2009
200
336
565
951
Timbre/ɑ/ /ɛ/ /u/ /i/
Location
-45°-15°
15° 45°
![Page 32: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/32.jpg)
Bizley, Walker, Silverman, King, Schnupp, J Neurosci 2009
Responses to Artificial Vowels
![Page 33: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/33.jpg)
Pitc
h (H
z)
Vowel type (timbre)
Joint Sensitivity to Formants and Pitch
Bizley, Walker, Silverman, King & Schnupp - J Neurosci 2009
![Page 34: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/34.jpg)
Mapping cortical sensitivity to sound features
Neuralsensitivity
Timbre
Pitc
h
Location
Nelken et al., J Neurophys, 2004
Bizley, Walker, Silverman, King & Schnupp - J Neurosci 2009
![Page 35: Auditory Neuroscience - Lecture 3 Periodicity and Pitch jan.schnupp@dpag.ox.ac.uk](https://reader036.fdocuments.us/reader036/viewer/2022062315/56816587550346895dd83dd7/html5/thumbnails/35.jpg)
Further Reading
• Auditory Neuroscience – Chapter 3• Schnupp JW, Bizley JK. (2010) On Pitch,
the Ear and the Brain of the Beholder. J Neurophysiol.