Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech...
Transcript of Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech...
![Page 1: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/1.jpg)
Why speech perception is a challenge
• Something we do without effort• Something machines do very poorly• Characteristics:
– Extremely rapid– No “white space”– “Lack of invariance”
• Within a speaker• Across speakers
![Page 2: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/2.jpg)
“Speech is special” hypothesis
• Specialized neural hardware
• Innate categories
![Page 3: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/3.jpg)
-130 msec. VOT 0 msec. VOT +100 msec. VOT
English: ba ba paSpanish: ba pa -
![Page 4: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/4.jpg)
Categorical Perception
-100 -90 -80 -70 -60 -50 -40 -30 -20 -10 0 +10 +20 +30 +40 +50 +60
Voice Onset Time continuum
“ba” “pa”
% “
ba”
iden
tific
atio
n
100
50
0
phonemeboundary
![Page 5: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/5.jpg)
Synthetic /pa-ba/ continuum
1 2 3 4 5 6 7 8 9
![Page 6: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/6.jpg)
AX discrimination task
• Hear 2 adjacent (i.e., very similar) stimuli
• Task: Are they the Same? Different?
![Page 7: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/7.jpg)
Categorical Perception
-100 -90 -80 -70 -60 -50 -40 -30 -20 -10 0 +10 +20 +30 +40 +50 +60
Voice Onset Time continuum
“ba” “pa”
% c
orre
ct d
iscr
imin
atio
n
100
50
0
phonemeboundary
XX X X
XX X X X X
X
X
X X
XX
![Page 8: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/8.jpg)
Synthetic /pa-ba/ continuum
1 2 3 4 5 6 7 8 9
Phoneme boundary
![Page 9: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/9.jpg)
Continuous Perception
-100 -90 -80 -70 -60 -50 -40 -30 -20 -10 0 +10 +20 +30 +40 +50 +60
Voice Onset Time continuum
“ah” “ee”
% “
ba”
iden
tific
atio
n
100
50
0
phonemeboundary
![Page 10: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/10.jpg)
Pdetector
Bdetector
1 2 3 4 5 6 7 8 9
Phoneme boundary
P P P P P P P P .
. . . . . . B B B
Feature detectors?
![Page 11: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/11.jpg)
If there are feature detectors, can we tire one of them out?
![Page 12: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/12.jpg)
Selective adaptation
1. Do phoneme identification test (e.g., “ba-pa” continuum)
2. Play a stimulus from one of the end-points many times (e.g., 100 times)
3. Repeat phoneme identification test
![Page 13: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/13.jpg)
Selective adaptation
-100 -90 -80 -70 -60 -50 -40 -30 -20 -10 0 +10 +20 +30 +40 +50 +60
Voice Onset Time continuum
“ba” “pa”
% “
ba”
iden
tific
atio
n
100
50
0
Pre-adpatationphonemeboundary
Post-adpatationphonemeboundary
REPEAT -100 “ba”100 times for one minute
![Page 14: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/14.jpg)
But are there really feature detectors?
• Chinchillas exhibit categorical perception as well
![Page 15: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/15.jpg)
Chinchilla experiment(Kuhl & Miller experiment)
“ba…ba…ba…ba…”“pa…pa…pa…pa…”
![Page 16: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/16.jpg)
• Train on end-point “ba” (good), “pa” (bad)
• Test on intermediate stimuli
• Results:– Chinchillas switched over from staying to running
at about the same location as the English b/pphoneme boundary
![Page 17: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/17.jpg)
Categorical perception, Take 2
• Natural discontinuities in many sensory systems; many of these are common across mammalian species
• Some stimulus differences are hard; others are easy
• Language takes advantage of “natural boundaries”
![Page 18: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/18.jpg)
But other ways in which speech perception seems different
![Page 19: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/19.jpg)
Sine-wave analogs of speech
Sine wave:
Original speech:
![Page 20: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/20.jpg)
I read a book today
![Page 21: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/21.jpg)
Other interesting effects. . .
• Speaker normalization
• Lack of invariance
• “top-down” effects – Phoneme Restoration
![Page 22: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/22.jpg)
Tentative conclusions• The human articulatory system and auditory system is
different from non-human primates in non-trivial ways that make speech possible
• There is a tight integration between perception & production… “our ears compensate for what our mouths do”
• There is a tight integration between the perception of speech and higher level cognition
![Page 23: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/23.jpg)
Phonetics & Phonology
• Phones– Sounds produced by human articulatory system
• Phonology– How sounds distinguish one word from another
• Phoneme– Smallest unit of sound that makes a difference
for meaning; set of phones equivalent in determination of meaning
![Page 24: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/24.jpg)
Speech Sounds & Distinctive Features
• Trubetsky & Jakobson– Speech sounds are encoded in the brain in terms
of more primitive specifications called distinctive features
• Phonological structure relates to movements of the vocal tract
![Page 25: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/25.jpg)
![Page 26: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/26.jpg)
![Page 27: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/27.jpg)
![Page 28: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/28.jpg)
![Page 29: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/29.jpg)
![Page 30: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/30.jpg)
![Page 31: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/31.jpg)
![Page 32: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/32.jpg)
![Page 33: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/33.jpg)
![Page 34: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/34.jpg)
![Page 35: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/35.jpg)
![Page 36: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/36.jpg)
![Page 37: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/37.jpg)
![Page 38: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/38.jpg)
![Page 39: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/39.jpg)
![Page 40: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/40.jpg)
![Page 41: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/41.jpg)
![Page 42: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/42.jpg)
![Page 43: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/43.jpg)
![Page 44: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/44.jpg)
![Page 45: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/45.jpg)
![Page 46: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/46.jpg)
![Page 47: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/47.jpg)
Mechanics of Speaking
• Vibration is a function of the vibration of the lips and the resonant frequencies of the trumpet’s tube
![Page 48: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/48.jpg)
Imaginary Trumpet
• Made of rubber• Has 2 tubes• Stretching changes
resonant frequencies• Choice of tube offers
possibility of different tone qualities
![Page 49: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/49.jpg)
Analogy
• Trumpet Player’s Lips• Trumpet Tube
– Tube 1– Tube 2
• Vocal Cords in Larynx• Throat & its Branches
– Nasal Cavity– Oral Cavity
![Page 50: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/50.jpg)
![Page 51: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/51.jpg)
![Page 52: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/52.jpg)
Sound Source
![Page 53: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/53.jpg)
Resonant Filter
![Page 54: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/54.jpg)
Speech production
KNS_X-ray_Film.mov
![Page 55: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/55.jpg)
![Page 56: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/56.jpg)
Spectrum(s)
![Page 57: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/57.jpg)
Spectogram(s)
![Page 58: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/58.jpg)
![Page 59: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/59.jpg)
Directing the Flow
• To disconnect nasal cavity– Raise velum (soft palate)
• To cut off air from oral cavity– Close lips– Raise tongue
![Page 60: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/60.jpg)
AEMS.mov
![Page 61: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/61.jpg)
Vowels
• Tongue Height• Tongue Position• Defined by first two
Formants(peaks in spectra)(dark bands in spectro-gram)
• Synthesized by first3 formants
![Page 62: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/62.jpg)
Vowels
![Page 63: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/63.jpg)
Studying Speech Perception w/ERPs
• Is there an ERP component that could serve as an objective record of perceptual discriminations people make when comprehending speech?
![Page 64: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/64.jpg)
Mismatch Negativity (MMN)
• Frontocentral negative ERP component• Peaks 100-250 ms post-stimulus onset• Change in repetitive aspect of on-going
auditory stimulation
![Page 65: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/65.jpg)
Mismatch Negativity
![Page 66: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/66.jpg)
Reflects Automatic Processing
• Occurs with or without attention to auditory stimuli
• Sleep– Stage 2– REM
• Coma• MMN signal more “pure” without attention
– Without: subtraction yields only MMN– With: subtraction yields MMN, N2, P3
![Page 67: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/67.jpg)
MMN & Echoic Memory• Seems to reflect unified sound
percepts (not acoustic features)– Simple tones– Complex stimuli (phonemes)– “complex spectrotemporal
pattern”• Does not arise unless
“standard” is repeated a few times
• Does not arise if 5-10 s intervenes between stimuli– Matches estimated length of
echoic memory
![Page 68: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/68.jpg)
How different is different?
![Page 69: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/69.jpg)
![Page 70: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/70.jpg)
How different is different?
• How does discrimination ability change as a function of experience?
![Page 71: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/71.jpg)
MMN and Experience• Subjects read a book while
tones played in background
• Tested periodically in their ability to discriminate between tones– Increased over course of
study• MMN increases in
amplitude as function of experience
![Page 72: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/72.jpg)
Language Experience: Infants
![Page 73: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/73.jpg)
Language Experience: Adults
• /a/ embedded in /e/– Relevant in Finnish– Not relevant in
Hungarian
• /y/ embedded in /e/– Relevant in Finnish– Relevant in Hungarian
![Page 74: Why speech perception is a challenge - UCSD Cognitive …coulson/cogs179/speech1.pdf · Why speech perception is a challenge ... Sine wave: Original speech: I ... • Phoneme –](https://reader034.fdocuments.us/reader034/viewer/2022051803/5b00444e7f8b9ad85d8c63be/html5/thumbnails/74.jpg)
Speech Stimuli(Left Temporal)
Musical Stimuli(Right Temporal)