From Sound to Sense and back again: The integration of lexical and speech processes From Sound to...
-
Upload
jasmin-franklin -
Category
Documents
-
view
229 -
download
0
Transcript of From Sound to Sense and back again: The integration of lexical and speech processes From Sound to...
![Page 1: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/1.jpg)
From Sound to Sense and From Sound to Sense and back again:back again:
The integration of lexical and The integration of lexical and speech processesspeech processes
From Sound to Sense and From Sound to Sense and back again:back again:
The integration of lexical and The integration of lexical and speech processesspeech processesDavid Gow
Massachusetts General HospitalDavid Gow
Massachusetts General HospitalBob McMurray
Dept. of Brain and Cognitive SciencesUniversity of Rochester
Bob McMurrayDept. of Brain and Cognitive Sciences
University of Rochester
![Page 2: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/2.jpg)
Complex computations from sound to sense must be broken up for study.
The Speech Chain
Sound
Sense
Assume intermediate representations:
Phonemes…Words…Syntactic
Phrases…
![Page 3: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/3.jpg)
The Standard Paradigm
The Standard Paradigm
Sense
Ph
on
olo
gy
Words
Phonemes
Sound
![Page 4: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/4.jpg)
The Standard Paradigm
The Standard Paradigm
Ph
on
olo
gy
Words
Phonemes
Delimited fields of study.
Sound
•Speech Perception
•Spoken Word Recognition
•Phonology
Phonemes* essential
* or other sublexical category
Sense
![Page 5: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/5.jpg)
Why? Categorical Perception (CP)
•Sharp identification of tokens on a continuum.
VOT
0
100
PB
% /
p/
ID (%/pa/)0
100Discrim
inatio
n
Discrimination
•Discrimination poor within a phonetic category.
Continuous Acoustic Detail => Discrete Categories
Does CAD affect speech categorization?
![Page 6: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/6.jpg)
Categorical Perception (CP)
Defined fundamental computational problems.
CP is output of •Speech perception
Input to •Phonology•Word recognition.
Ph
on
olo
gy
Words
Phonemes
Sense
Sound
![Page 7: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/7.jpg)
But… • Not all speech contrasts are categorical.
• Lots of tasks show non-categorical perception.
Fry, Abramson, Eimas & Liberman (1962) Pisoni & Tash (1974) Pisoni & Lazarus (1974) Carney, Widden & Viemeister (1977) Hary & Massaro (1982) Pisoni, Aslin, Perey & Hennessy (1982) Healy & Repp (1982) Massaro & Cohen (1983) Miller (1997) Samuel (1997)…
CP
![Page 8: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/8.jpg)
Categorical Perception is about phonetic classification.
Why has the Standard Paradigm persisted?
Sound
SenseThe minimal computational problem: compute meaning from sound.
CP tasks don’t necessarily tap a stage of this problem.
?CPWords
Lexical activation… seems a good bet.
![Page 9: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/9.jpg)
Even when continuous acoustic detail affects word recognition, it is seen as outside of core word recognition.
Why has the Standard Paradigm persisted?
![Page 10: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/10.jpg)
Example: Word Segmentation
• Vowel Length• Stress/Meter• Coarticulation
Words
Phonemes
CAD
Segm
enta
tion
Cue extra-segmental process.W
ord
Reco
gn
itio
n
Even when continuous acoustic detail affects word recognition, it is seen as outside of core word recognition.
Why has the Standard Paradigm persisted?
![Page 11: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/11.jpg)
No. Standard Paradigm is fine…
Yes. Hmm…
Does continuous acoustic detail affect interpretation via core word-recognition processes?
Need to use stimuli with:•Precise control over CAD
Need to use tasks that:•reflect only minimal computational problem:
meaning.•are sensitive to acoustic detail.
Sublexical Filter(phonemes)
![Page 12: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/12.jpg)
Visual World Paradigm
Visual World Paradigm
•Subjects hear spoken language and manipulate objects in a visual world.
•Visual world includes set of objects with interesting linguistic properties (names)
•Eye-movements to each object are monitored throughout the task.
Tanenhaus, Spivey-Knowlton, Eberhart & Sedivy (1995)Allopenna, Magnuson & Tanenhaus (1998)
![Page 13: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/13.jpg)
•Meaning based, natural task: Subjects must interpret speech to perform task.
•Eye-movements fast and time-locked to speech.
•Fixation probability maps onto dynamics of lexical activation.
•Context is controlled: meaning lexical
activation.
![Page 14: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/14.jpg)
?Does continuous
acoustic detail affect interpretation?
Is lexical activation sensitive to continuous
acoustic detail?
![Page 15: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/15.jpg)
Combine tools of
• speech perception:
9-step VOT continuum.
• spoken word recognition:
visual world paradigm
McMurray, Tanenhaus & Aslin (2003)
![Page 16: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/16.jpg)
A moment to view the items
Methods
![Page 17: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/17.jpg)
500 ms later
![Page 18: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/18.jpg)
Bear
Repeat 1080 times…
![Page 19: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/19.jpg)
Target = Bear
Competitor = Pear
Unrelated = Lamp, Ship
Time
200 ms
1
2
3
4
5
Trials
![Page 20: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/20.jpg)
Time (ms)
VOT=0 Response=
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
0 400 800 1200 1600
Fix
ati
on
p
rop
ort
ion
![Page 21: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/21.jpg)
Systematic effect on competitor dynamics.Fixations to the competitor.
Predictions
Categorical Results Gradient Effect
target
competitor
time
Fix
ati
on
pro
port
ion
target
competitor competitorcompetitor
time
Fix
ati
on
pro
port
ion
target
What would lexical sensitivity to CAD look like?
![Page 22: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/22.jpg)
Results
0 400 800 1200 16000
0.02
0.04
0.06
0.08
0.1
0.12
0.14
0.16
0 ms5 ms10 ms15 ms
VOT
0 400 800 1200 1600 2000
20 ms25 ms30 ms35 ms40 ms
VOT
Com
peti
tor
Fix
ati
on
s
Time since word onset (ms)
Response= Response=
![Page 23: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/23.jpg)
Task?
P
B Sh
LPhoneme ID
Not part of minimal computational
problem.
Same stimuli in metalinguistic task…
…more categorical pattern of fixations
Continuous acoustic detail is not helpful in metalinguistic tasks…
![Page 24: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/24.jpg)
Summary
Word recognition shows gradient sensitivity to continuous acoustic detail.
Not extra-segmental: VOT
CAD affects higher-level processes.
Consistent with other studies:
Andruski, Blumstein & Burton (1994)Marslen-Wilson & Warren (1994)Utman, Blumstein & Burton (2000)Dahan, Magnuson, Tanenhaus & Hogan (2001)McMurray, Clayards, Aslin & Tanenhaus (2004)McMurray, Aslin, Tanenhaus, Spivey & Subik (in prep)
![Page 25: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/25.jpg)
The Standard Paradigm?
Sense
Ph
on
olo
gy
Words
Phonemes
Continuous Acoustic Detail
CAD affects higher-level processes.
From other work:
Lexical activation influences sublexical representations.
Samuel & Pitt (2003)Magnuson, McMurray, Tanehaus & Aslin (2003)Samuel (1997)Elman & McClelland (1988)
![Page 26: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/26.jpg)
The Standard Paradigm?
Sense
Ph
on
olo
gy
Words
Phonemes
Continuous Acoustic Detail
CAD affects higher-level processes.
From other work:
Lexical activation influences sublexical representations.
Phonological regularity affectssignal interpretation.
Massaro & Cohen (1983)Halle, Segui, Frauenfelder & Meunier (1998)Pitt (1998)Dupoux,Kakehi, Hirose, Pallier & Mehler, (1999)
![Page 27: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/27.jpg)
?Sense
Ph
on
olo
gy
Words
Phonemes
Continuous Acoustic Detail
Perhaps interaction and integration make sense.
Do they help solve sticky problems?
YES
![Page 28: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/28.jpg)
The Emerging Paradigm
Integration of work in:• spoken word recognition • speech perception• phonology
New computations simplify old problems and solve new ones.
•Cognitive processes: Lexical activation & competition.
•Perceptual processes: sensitivity to CAD & perceptual grouping.
![Page 29: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/29.jpg)
CAD is helpful in language comprehension.
• Word segmentation
• Coping with lawful variability due to assimilation
Combination of approaches helps solve both problems.
![Page 30: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/30.jpg)
Some lexical processes can’t work
in the Standard Paradigm
Lexical Segmentation
![Page 31: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/31.jpg)
[ ]
The SWR Solution
![Page 32: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/32.jpg)
active
[ ]
![Page 33: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/33.jpg)
active department
[ ]
![Page 34: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/34.jpg)
active departmentact of dip art mint
a partdepart in
arepar
Standard Paradigm: Template matching overgenerates
[ ]
![Page 35: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/35.jpg)
•Overgeneration resolved through competition in TRACE (McClelland & Elman 1986)
Problem: What if the speaker is trying to say “suck seeds”?
‘ k s I d -
succeed
suck
seed
activ
atio
n
Cycle
Frauenfelder & Peeters (1990)
![Page 36: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/36.jpg)
Cues shown to affect segmentation:
•Initial strong syllable•Initial lengthening•Increased aspiration•Increased glottalization
Lehiste, 1960; Garding,1967; Lehiste, 1972; Umeda, 1975; Nakatani & Dukes, 1977; Nakatani & Schaffer,1978; Cutler & Norris, 1988…..
Implied processing model requires separate segmentation process
Words
Segm
enta
tion
Phonemes
CAD
Recog
nitio
n
The Speech Solution
![Page 37: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/37.jpg)
Problem: cues are subtle and varied, extra-segmental processes are inelegant
?Is there a better mechanism?
Words
Segm
enta
tion
Phonemes
CAD
Recog
nitio
n
![Page 38: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/38.jpg)
The proposal had a strange syntax that nobody liked. ^
The proposal had a strange sin tax that nobody liked. ^
• CAD affects interpretation.• does not trigger segmentation.
Gow & Gordon (1995)
GRAMMAR primedSyntax
Tax INCOME inhibited
GRAMMAR primedSyntax
Tax INCOME primed
![Page 39: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/39.jpg)
•Observation: All segmentation cues happen to enhance word-initial features
• Strengthened cues facilitate activation, making intended words stronger competitors
Incorporating CAD:
• Solves overgeneration problem.
•No extra-segmental segmentation process.
Good Start Model
Gow & Gordon (1995)
![Page 40: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/40.jpg)
When continuous acoustic detail affects lexical
activation, speech and SWR models can
be integrated and simplified
Summary
![Page 41: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/41.jpg)
The emerging paradigm reframes
computational problems
Assimilation
![Page 42: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/42.jpg)
English coronal place assimilation
/coronal # labial/ [labial # labial]
/coronal #velar/ [velar # velar]Standard Paradigm: Change is • discrete• phonemically neutralizing
Redefining Computational Problems
[ ]# berries nonword?
right berries?
ripe berries?
[ ]# berries
![Page 43: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/43.jpg)
Standard Paradigm solution: Phonological inference (Gaskell & Marslen-Wilson, 1996; 1998; 2001)
Knowledge driven inference:
If [labial # labial] infer /coronal # labial/
greem beans green (Gaskell & Marslen-Wilson, 1996; Gow, 2001)
ripe berries right (Gaskell & Marslen-Wilson, 2001; Gow, 2002)
Moreover: Assimilation effects dissociated from linguistic knowledge (Gow & Im, in press)
ripe
![Page 44: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/44.jpg)
Assimilatory modification is acoustically continuous
This is not discrete feature change!
Assimilation Produces CAD
F2 Transitions in /æC/ Contexts
1550
1600
1650
1700
1750
1800
1850
Pitch Period
Fre
qu
en
cy (
Hz)
coronalassimilatedlabial
F3 Transitions in /æC/ Contexts
2550
2600
2650
2700
2750
2800
Pitch Period
Fre
qu
en
cy (
Hz)
coronalassimilated
labial
![Page 45: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/45.jpg)
SmaSelect thecat
p box
Regressive Context Effects
![Page 46: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/46.jpg)
Subject Hears: Assim_Non-Coronal (cat/p box)
0
0.1
0.2
0.3
0.4
0.5
0.6
0 400 800 1200 1600Time (ms)
Fix
ati
on
Pro
port
ion
Coronal (cat)
Non-Coronal (cap)
![Page 47: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/47.jpg)
Subject Hears: Assim Non-Coronal (cat/p drawing)
0
0.1
0.2
0.3
0.4
0.5
0.6
0 400 800 1200 1600Time (ms)
Fix
ati
on
Pro
port
ion
Coronal (cat)Non-Coronal (cap)
![Page 48: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/48.jpg)
Looks to Final Non-coronal (box)
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0 400 800 1200 1600
Time (ms)
Fixa
tio
n P
rop
ort
ion
Assim Non-Coronal
Coronal Non-Coronal
Progressive Context Effects
Progressive effect in the same experiment
![Page 49: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/49.jpg)
Assimilation is resolved through phonological context.
Fully assimilated items show neither* (Gaskell & Marslen-Wilson, 2001; Gow, 2002;2003)
Assimilation: Use of CAD
Partially-assimilated items show
regressive context effects (Gow, 2002; 2003)
progressive context effects (Gow, 2001; 2003)
![Page 50: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/50.jpg)
assimilation # context
Infinite regress (eternal ambiguity)…. or something more interesting?
![Page 51: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/51.jpg)
Continuous acoustic detail is subject to basic perceptual
processes
![Page 52: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/52.jpg)
Feature cue parsing (Gow, 2003)
Time (s)0 0.760454
0
3000
[
A Perceptual Account
![Page 53: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/53.jpg)
Feature cue parsing (Gow, 2003)
Time (s)0 0.760454
0
3000
Features encoded by multiple cues that are integrated
![Page 54: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/54.jpg)
Feature cue parsing (Gow, 2003)
Time (s)0 0.760454
0
3000
![Page 55: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/55.jpg)
Feature cue parsing (Gow, 2003)
Time (s)0 0.760454
0
3000
Assimilation creates cues consistent with multiple places
![Page 56: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/56.jpg)
Feature cue parsing (Gow, 2003)
Extract feature cues
![Page 57: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/57.jpg)
Feature cue parsing (Gow, 2003)
Group feature cues by similarity and resolve ambiguity
![Page 58: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/58.jpg)
Feature cue parsing (Gow, 2003)
example: eight….
catp # box cat
p # drawing catp
# | | | |
[cor] [cor] [COR] [cor] [lab] [LAB] [lab] [lab]
![Page 59: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/59.jpg)
example: eight….
catp # Box cat
p # Drawing catp
# | | [cor] [cor] [COR] [cor] [lab] [LAB] [lab] [lab]
Feature cue parsing (Gow, 2003)
Progressive and regressive effects fall out of grouping
![Page 60: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/60.jpg)
SWR problem (eternal ambiguity) replaced by simpler perceptual problem
CAD important in solution: processing obstacle facilitates perception.
Integration of continuous perceptual features facilitates higher-level processes.
Facilitation via core-word recognition mechanisms—no extra-segmental routines required.
Summary
![Page 61: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/61.jpg)
Standard paradigm
•Created artificial boundaries that misframed issues.
•Continous acoustic detail is variability to be conquered..
The Standard Paradigm
The basis of the standard paradigm is undercut.
•Meaning-based processes are affected by CAD.
•CAD is an essential component of word recognition.
![Page 62: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/62.jpg)
The emerging paradigm
•Emphasis on methodologies that tap the minimal computational problem: meaning.
•Stresses integration of speech and spoken word recognition, questions methods and theory.
•Continuous acoustic detail is useful signal, not noise.
The Emerging Paradigm
![Page 63: From Sound to Sense and back again: The integration of lexical and speech processes From Sound to Sense and back again: The integration of lexical and.](https://reader036.fdocuments.us/reader036/viewer/2022062423/56649f115503460f94c234ee/html5/thumbnails/63.jpg)
From Sound to Sense and From Sound to Sense and back again:back again:
The integration of lexical and The integration of lexical and speech processesspeech processes
From Sound to Sense and From Sound to Sense and back again:back again:
The integration of lexical and The integration of lexical and speech processesspeech processesDavid Gow
Massachusetts General HospitalDavid Gow
Massachusetts General HospitalBob McMurray
Dept. of Brain and Cognitive SciencesUniversity of Rochester
Bob McMurrayDept. of Brain and Cognitive Sciences
University of Rochester