Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring...
Transcript of Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring...
![Page 1: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/1.jpg)
Implicit measures of automatic evaluation
Exploring new methods to measure attitudes towards
language varieties
Laura Rosseel, Dirk Geeraerts, Dirk Speelman
RU Quantitative Lexicology and Variational Linguistics
![Page 2: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/2.jpg)
Introduction
• since 1960s/1980s little methodological innovation in
language attitudes research (until recently)
• traditional methods:
– surveys (direct)
– speaker evaluation paradigm (indirect)
– societal treatment
• problems: self-presentation, limited introspection,
artificiality, lack of semantic & syntactic control
SLE 2014, Poznań 11.09.2014
![Page 3: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/3.jpg)
Introduction
➔ innovation: inspired by attitude research in social psychology
SLE 2014, Poznań 11.09.2014
![Page 4: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/4.jpg)
Outline
1. implicit measures
2. overview of techniques
3. AAP & IAT: success stories?
4. AMP & ST-IAT: new possibilities?
5. conclusion
SLE 2014, Poznań 11.09.2014
![Page 5: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/5.jpg)
Outline
1. implicit measures
2. overview of techniques
3. AAP & IAT: success stories?
4. AMP & ST-IAT: new possibilities?
5. conclusion
SLE 2014, Poznań 11.09.2014
![Page 6: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/6.jpg)
Implicit measures
implicit techniques measure automatic associations
– association object & evaluation in memory = attitude (Fazio 2007)
– automaticity?
four horsemen of automaticity (Bargh 1994)
• unconscious
• unintentional
• efficient
• uncontrollable
SLE 2014, Poznań 11.09.2014
![Page 7: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/7.jpg)
Implicit measures
implicit techniques measure automatic associations
– association object & evaluation in memory = attitude (Fazio 2007)
– automaticity?
four horsemen of automaticity (Bargh 1994)
• unconscious
• unintentional
• efficient
• uncontrollable
SLE 2014, Poznań 11.09.2014
![Page 8: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/8.jpg)
Implicit measures
implicit techniques measure automatic associations
– association object & evaluation in memory = attitude (Fazio 2007)
– automaticity?
four horsemen of automaticity (Bargh 1994)
• unconscious
• unintentional
• efficient
• uncontrollable
SLE 2014, Poznań 11.09.2014
![Page 9: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/9.jpg)
Implicit measures
what have they been used for so far?
• various fields:
marketing, psychiatry, (social) psychology,…
• wide variety of topics:
advertising, sexual preference, alcoholism, self-
mutilation, self-esteem, racism, gender stereotypes,...
SLE 2014, Poznań 11.09.2014
![Page 10: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/10.jpg)
Implicit measures
what have they been used for so far?
• various fields:
marketing, psychiatry, (social) psychology,…
• wide variety of topics:
advertising, sexual preference, alcoholism, self-
mutilation, self-esteem, racism, gender stereotypes,...
SLE 2014, Poznań 11.09.2014
![Page 11: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/11.jpg)
Implicit measures
what have they been used for so far?
• various fields:
marketing, psychiatry, (social) psychology,…
• wide variety of topics:
advertising, sexual preference, alcoholism, self-
mutilation, self-esteem, racism, gender stereotypes,...
SLE 2014, Poznań 11.09.2014
![Page 12: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/12.jpg)
Outline
1. implicit measures
2. overview of techniques
3. AAP & IAT: success stories?
4. AMP & ST-IAT: new possibilities?
5. conclusion
SLE 2014, Poznań 11.09.2014
![Page 13: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/13.jpg)
Overview of techniques
two paradigms:
1. response interference paradigm
2. sequential priming paradigm
= measure implicit attitudes
= two congruent stimuli faster response
≠ presentation of stimuli: simultaneous vs. sequential
≠ underlying mechanisms
SLE 2014, Poznań 11.09.2014
![Page 14: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/14.jpg)
Overview of techniques
two paradigms:
1. response interference paradigm
2. sequential priming paradigm
= measure implicit attitudes
= two congruent stimuli faster response
≠ presentation of stimuli: simultaneous vs. sequential
≠ underlying mechanisms
SLE 2014, Poznań 11.09.2014
![Page 15: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/15.jpg)
Overview of techniques
two paradigms:
1. response interference paradigm
2. sequential priming paradigm
= measure implicit attitudes
= two congruent stimuli faster response
≠ presentation of stimuli: simultaneous vs. sequential
≠ underlying mechanisms
SLE 2014, Poznań 11.09.2014
![Page 16: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/16.jpg)
Overview of techniques
SLE 2014, Poznań 11.09.2014
response interference sequential priming
previously
introduced
to
linguistics
implicit association test
(IAT)
auditory affective priming
(AAP)
new to
linguistics
single target implicit
association test
(ST-IAT)
affect misattribution
procedure
(AMP)
![Page 17: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/17.jpg)
Outline
1. implicit measures
2. overview of techniques
3. AAP & IAT: success stories?
4. AMP & ST-IAT: new possibilities?
5. conclusion
SLE 2014, Poznań 11.09.2014
![Page 18: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/18.jpg)
Overview of techniques
SLE 2014, Poznań 11.09.2014
response interference sequential priming
previously
introduced
to
linguistics
implicit association test
(IAT)
auditory affective priming
(AAP)
new to
linguistics
single target implicit
association test
(ST-IAT)
affect misattribution
procedure
(AMP)
![Page 19: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/19.jpg)
Implicit Association Test
how it works
SLE 2014, Poznań 11.09.2014
![Page 20: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/20.jpg)
Implicit Association Test
how it works
SLE 2014, Poznań 11.09.2014
TARGET CONCEPT ATTRIBUTE
category
names black/white good/bad
stimuli
lovely, terrific, horrible, disgusting
![Page 21: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/21.jpg)
Implicit Association Test
how it works
SLE 2014, Poznań 11.09.2014
TARGET CONCEPT ATTRIBUTE
category
names black/white good/bad
stimuli
lovely, terrific, horrible, disgusting
![Page 22: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/22.jpg)
Implicit Association Test
how it works
SLE 2014, Poznań 11.09.2014
TARGET CONCEPT ATTRIBUTE
category
names black/white good/bad
stimuli
lovely, terrific, horrible, disgusting
![Page 23: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/23.jpg)
Implicit Association Test
SLE 2014, Poznań 11.09.2014
black white
block 1 – target discrimination
![Page 24: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/24.jpg)
Implicit Association Test
SLE 2014, Poznań 11.09.2014
good bad
block 2 – attribute discrimination
horrible
![Page 25: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/25.jpg)
Implicit Association Test
SLE 2014, Poznań 11.09.2014
black
good
white
bad
block 3 – critical block: combined task
horrible
![Page 26: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/26.jpg)
Implicit Association Test
SLE 2014, Poznań 11.09.2014
white black
block 4 – target concept discrimination reversed
![Page 27: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/27.jpg)
Implicit Association Test
SLE 2014, Poznań 11.09.2014
white
good
black
bad
block 5 – critical block: combined task reversed
horrible
![Page 28: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/28.jpg)
Implicit Association Test
in linguistics:
Redinger (2010)
Pantos (2010, 2012)
Campbell-Kibler (2012, 2013)
SLE 2014, Poznań 11.09.2014
![Page 29: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/29.jpg)
Implicit Association Test
in linguistics:
Redinger (2010)
Pantos (2010, 2012)
Campbell-Kibler (2012, 2013)
SLE 2014, Poznań 11.09.2014
![Page 30: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/30.jpg)
Implicit Association Test
Pantos (2010, 2012)
• attitudes towards foreign accented vs. US English
• auditory stimuli + written pos/neg adjectives
• clear preference for US English <-> explicit attitudes
SLE 2014, Poznań 11.09.2014
![Page 31: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/31.jpg)
Implicit Association Test
Pantos (2010, 2012)
• attitudes towards foreign accented vs. US English
• auditory stimuli + written pos/neg adjectives
• clear preference for US English <-> explicit attitudes
SLE 2014, Poznań 11.09.2014
![Page 32: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/32.jpg)
Implicit Association Test
Pantos (2010, 2012)
• attitudes towards foreign accented vs. US English
• auditory stimuli + written pos/neg adjectives
• clear preference for US English <-> explicit attitudes
SLE 2014, Poznań 11.09.2014
US
bad
foreign
good
![Page 33: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/33.jpg)
Implicit Association Test
Pantos (2010, 2012)
• attitudes towards foreign accented vs. US English
• auditory stimuli + written pos/neg adjectives
• clear preference for US English <-> explicit attitudes
SLE 2014, Poznań 11.09.2014
![Page 34: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/34.jpg)
Implicit Association Test
evaluation
SLE 2014, Poznań 11.09.2014
practical complexity - participant
- researcher (reaction times)
linguistic / auditory stimuli + OK (labels & auditory stimuli)
+ length: rather flexible
psychometric qualities + good reliability & validity
relation attribute – target + valence & semantic
other
- binary structure / comparative structure
- practice effect: max. 1 test
- extra-personal associations P-IAT
- naming of categories
+ inspiration development model of
cognitive processes underlying attitudes
![Page 35: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/35.jpg)
Overview of techniques
SLE 2014, Poznań 11.09.2014
response interference sequential priming
previously
introduced
to
linguistics
implicit association test
(IAT)
auditory affective priming
(AAP)
new to
linguistics
single target implicit
association test
(ST-IAT)
affect misattribution
procedure
(AMP)
![Page 36: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/36.jpg)
Affective Priming
SLE 2014, Poznań 11.09.2014
how it works
![Page 37: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/37.jpg)
Affective Priming
SLE 2014, Poznań 11.09.2014
prime
![Page 38: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/38.jpg)
Affective Priming
SLE 2014, Poznań 11.09.2014
prime
![Page 39: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/39.jpg)
Affective Priming
SLE 2014, Poznań 11.09.2014
+ -
target
![Page 40: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/40.jpg)
prime
target
congruence
response speed
+ + congruent faster
+ - incongruent slower
- + incongruent slower
- - congruent faster
Affective Priming
SLE 2014, Poznań 11.09.2014
![Page 41: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/41.jpg)
Auditory Affective Priming
in linguistics? Speelman et al. (2013)
• attitudes towards 3 varieties of Dutch in Belgium
• auditory primes, pictures as targets
• for periphery: standard > own (peripheral) > central variety
For centre: own (central) > standard > peripheral variety
SLE 2014, Poznań 11.09.2014
![Page 42: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/42.jpg)
Auditory Affective Priming
in linguistics? Speelman et al. (2013)
• attitudes towards 3 varieties of Dutch in Belgium
• auditory primes, pictures as targets
• for periphery: standard > own (peripheral) > central variety
For centre: own (central) > standard > peripheral variety
SLE 2014, Poznań 11.09.2014
![Page 43: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/43.jpg)
Auditory Affective Priming
in linguistics? Speelman et al. (2013)
• attitudes towards 3 varieties of Dutch in Belgium
• auditory primes, pictures as targets
• for periphery: standard > own (peripheral) > central variety
For centre: own (central) > standard > peripheral variety
SLE 2014, Poznań 11.09.2014
+ -
![Page 44: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/44.jpg)
Auditory Affective Priming
in linguistics? Speelman et al. (2013)
• attitudes towards 3 varieties of Dutch in Belgium
• auditory primes, pictures as targets
• for periphery: standard > own (peripheral) > central variety
for centre: own (central) > standard > peripheral variety
SLE 2014, Poznań 11.09.2014
![Page 45: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/45.jpg)
Affective Priming
evaluation
SLE 2014, Poznań 11.09.2014
practical complexity
+ simple for participant
- difficult to programme (reaction times)
- neutral primes necessary
linguistic / auditory
stimuli
+ OK
- length: very limited
psychometric qualities - not satisfactory, low reliability
relation prime – target + valence (& semantic)
other
- few prime categories per experiment
limited number of attitude objects can be
compared
- very sensitive procedure
+ publications: many
+ no naming of categories
![Page 46: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/46.jpg)
Outline
1. implicit measures
2. overview of techniques
3. AAP & IAT: success stories?
4. AMP & ST-IAT: new possibilities?
5. conclusion
SLE 2014, Poznań 11.09.2014
![Page 47: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/47.jpg)
Overview of techniques
SLE 2014, Poznań 11.09.2014
response interference sequential priming
previously
introduced
to
linguistics
implicit association test
(IAT)
auditory affective priming
(AAP)
new to
linguistics
single target implicit
association test
(ST-IAT)
affect misattribution
procedure
(AMP)
![Page 48: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/48.jpg)
Single target IAT
how it works
SLE 2014, Poznań 11.09.2014
![Page 49: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/49.jpg)
Single target IAT
how it works
(Bluemke & Friese 2008)
SLE 2014, Poznań 11.09.2014
TARGET CONCEPT ATTRIBUTE
category
names CDU good/bad
stimuli
Schäuble, Koch love, vacation,
health, disease, death, pain
![Page 50: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/50.jpg)
Single target IAT
how it works
(Bluemke & Friese 2008)
SLE 2014, Poznań 11.09.2014
TARGET CONCEPT ATTRIBUTE
category
names CDU good/bad
stimuli
Schäuble, Koch love, vacation,
health, disease, death, pain
![Page 51: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/51.jpg)
Single target IAT
how it works
(Bluemke & Friese 2008)
SLE 2014, Poznań 11.09.2014
TARGET CONCEPT ATTRIBUTE
category
names CDU good/bad
stimuli
Schäuble, Koch love, vacation,
health, disease, death, pain
![Page 52: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/52.jpg)
Single target IAT
SLE 2014, Poznań 11.09.2014
good
bad
block 1 – attribute discrimination
vacation
![Page 53: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/53.jpg)
Single target IAT
SLE 2014, Poznań 11.09.2014
CDU
good
bad
block 2 – critical block: combined task
![Page 54: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/54.jpg)
Single target IAT
SLE 2014, Poznań 11.09.2014
CDU
bad
good
block 3 – critical block: combined task reversed
![Page 55: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/55.jpg)
Single target IAT
evaluation
SLE 2014, Poznań 11.09.2014
practical complexity + rather simple for the participant
- difficult to programme (reaction times)
linguistic / auditory stimuli + (OK)
+ length: rather flexible
psychometric qualities + good reliability & validity
relation attribute – target + valence & semantic
other
+/- publications: moderate
+ not binary / comparative
+ multiple subsequent tests possible
![Page 56: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/56.jpg)
Overview of techniques
SLE 2014, Poznań 11.09.2014
response interference sequential priming
previously
introduced
to
linguistics
implicit association test
(IAT)
auditory affective priming
(AAP)
new to
linguistics
single target implicit
association test
(ST-IAT)
affect misattribution
procedure
(AMP)
![Page 57: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/57.jpg)
Affect misattribution procedure
how it works
SLE 2014, Poznań 11.09.2014
![Page 58: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/58.jpg)
Affect misattribution procedure
how it works
SLE 2014, Poznań 11.09.2014
prime
![Page 59: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/59.jpg)
Affect misattribution procedure
how it works
SLE 2014, Poznań 11.09.2014
prime target
![Page 60: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/60.jpg)
Affect misattribution procedure
how it works
SLE 2014, Poznań 11.09.2014
prime target backward mask
![Page 61: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/61.jpg)
Affect misattribution procedure
how it works
SLE 2014, Poznań 11.09.2014
prime target backward mask
- +
?
![Page 62: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/62.jpg)
Affect misattribution procedure
SLE 2014, Poznań 11.09.2014
prime
![Page 63: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/63.jpg)
Affect misattribution procedure
SLE 2014, Poznań 11.09.2014
target
![Page 64: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/64.jpg)
Affect misattribution procedure
SLE 2014, Poznań 11.09.2014
+ -
backward
mask
![Page 65: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/65.jpg)
Affect misattribution procedure
evaluation
SLE 2014, Poznań 11.09.2014
practical complexity
+ rather simple for the participant
+ simple to programme / measure
(no reaction times)
linguistic/auditory stimuli - ?
- length: limited
psychometric qualities + good reliability & validity
relation prime – target + valence & semantic
other
- implicitness questioned
+ publications: moderate – many
+ no neutral primes
+ multiple prime categories (attitudes
objects) in one experiment
![Page 66: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/66.jpg)
measure practical
complexity
linguistic/
auditory
stimuli
psychometric
qualities
relation
prime -
target
other
IAT - participant
- researcher
+OK
+ length:
rather
flexible
+ good Valence &
semantic
- binary / comparative structure
- practice effect: max. 1 test
- extra-personal associations+
publications: many
AAP + participant
- researcher
+OK
- length :
very
limited
- not very
good
Valence &
(semantic)
- few prime categories /
experiment
- very sensitive procedure
- neutral primes
+ publications (AP): many
ST-IAT + participant
- researcher
+(OK)
+ length :
rather
flexible
+ good Valence &
semantic
- extra-personal associations
P-IAT
+ not binary/comparative
-/+ publications: moderate
+ several subsequent tests
AMP + participant
+ researcher
-?
- length :
limited
+ good Valence &
semantic
- implicitness questioned
+ multiple prime categories
+ no neutral primes
+ publications: moderate-many
![Page 67: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/67.jpg)
Outline
1. implicit measures
2. overview of techniques
3. AAP & IAT: success stories?
4. AMP & ST-IAT: new possibilities?
5. conclusion
SLE 2014, Poznań 11.09.2014
![Page 68: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/68.jpg)
Conclusion
limitations implicit measures
- sensitive to many procedural details
- no gold standard
- lack of context in prime stimuli
advantages
- extensive literature from psychology ample evidence for
validity & reliability
- limit the influence of social desirability & lack of introspection
- fairly short and easy to administer
- inspiration in implicit measures paradigms to help
sociolinguistics to develop a cognitive model of language
attitudes
- method to test hypotheses, not an exploratory technique
SLE 2014, Poznań 11.09.2014
![Page 69: Exploring new methods to measure attitudes …...Implicit measures of automatic evaluation Exploring new methods to measure attitudes towards language varieties Laura Rosseel, Dirk](https://reader034.fdocuments.us/reader034/viewer/2022042409/5f24eac5a1bbb84368142c64/html5/thumbnails/69.jpg)
Conclusion
• early for any definitive conclusions, but promising if:
more research to develop a gold standard so techniques
become easier to implement
• no technique is perfect
choose technique in function of research question
methods can complement each other
➔ implicit measures as a valuable addition to be used in
addition to other (traditional) methods to make up for
each other’s limitations
SLE 2014, Poznań 11.09.2014