Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown ...
-
Upload
guillermo-marske -
Category
Documents
-
view
214 -
download
0
Transcript of Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown ...
![Page 1: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/1.jpg)
Understanding the Subjective:
Eliciting Hidden Meaning
David Roberts
• RobertsBrown
www.robertsbrown.com
© RobertsBrown Pty Ltd 2012
![Page 2: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/2.jpg)
IntroductionTalk about some research into how projective techniques work
![Page 3: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/3.jpg)
Projective techniques
In 1949 Haire borrowed projective techniques from psychology
What people were SAYing in response to questions was different from what they DID
Wide range of techniques Vignettes Drawing pictures Association Photo-elicitation
Used for 25 years because they work
![Page 4: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/4.jpg)
Why is it so?
Why do projective techniques work?
How can we assess the value of data provided by research interviews?
Cognitive science and phenomenology provide some clues
![Page 5: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/5.jpg)
Behaviour is automatic
Behaviour and thinking is predominantly automatic –
Very little of our thinking is explicit
Rely on mental shortcuts Variety of names: “System 1”, “Scripts” ‘Schema’ because it has the longest history and
broadest application
![Page 6: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/6.jpg)
Test if schema present
Test the idea that schemata operate in interviews
Preliminary Research
Used a projective technique that requires schema
If not there - nowhere
![Page 7: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/7.jpg)
Methods
![Page 8: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/8.jpg)
Methods
Eight cognitive interviews with experienced evaluators
Two parts: ‘Originating’ interviewCognitive debrief
![Page 9: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/9.jpg)
Originating Interview
Photo-Elicitation (aka TAT)
Shown array of photo portraits
![Page 10: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/10.jpg)
![Page 11: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/11.jpg)
Choose & Describe
Asked to choose “best” commissioner “worst”
Describe Person Behaviour when receive report
![Page 12: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/12.jpg)
Cognitive debrief
Short break
Video reviewed together
Participant asked to explain what they were thinking
![Page 13: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/13.jpg)
Results
![Page 14: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/14.jpg)
Selection of photographs
Selections made very quicklySometimes took a while to pick up photo but choices
made early
Some variance across participants including one photo being chosen as both ‘best’ and
‘worst’
![Page 15: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/15.jpg)
Explanation of Selections
Explained in terms of specific attributes of the photographMan behind the desk = ‘computer a barrier’, ‘busy’,
‘not paying attention to the report’Woman in the park = ‘informal’ ‘away from
distractions’, ‘I felt a connection’ ‘Very attractive’
Selections based on salient experiences frequent strong emotional impact recent
![Page 16: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/16.jpg)
Descriptions
Resistance to ‘stereotyping’ but still described the ‘person’ represented
Picked up photograph
Referred back to fine details in the photograph
![Page 17: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/17.jpg)
Discussion
![Page 18: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/18.jpg)
Implicit Knowledge
First instant of selection responded to an array of 16 photos enormous detailCould not be consciously aware of all details Different and sometimes opposing selections
Judgements were
intuitive
based on personal knowledge
implicit knowledge
NOT some shared understanding
![Page 19: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/19.jpg)
Subjective Expression
In the selection phase no explicit information
Asking them to express a subjective understanding
![Page 20: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/20.jpg)
Typification
Not a specific person but their understanding of a type
‘type’ of person ‘They’ (Schutz 1970) or ‘generalised other
Used a typification so they could respond
![Page 21: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/21.jpg)
‘Doing’ is ‘Now’
Responding is before explicit thinking Mead’s ‘pre-suppositional’ Schutz’s ‘pre-phenomenal’ knowledge Kahnemann ‘System1’
Responding is
‘Doing’
NOW
HERE
What we DO may be different in other situations
![Page 22: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/22.jpg)
Schema
Has all the characteristics of schema thinking
Identified a ‘type’ very quickly (seconds)
Identification based on very little information and sometimes vey subtle cues (posture, situation, etc.)
Used implicit knowledge (subjective perceptions) to select photos of a ‘type’ of person
Implicit knowledge based on generalised experience
![Page 23: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/23.jpg)
Descriptions
Looked at the photos to find details that support their descriptions
Constructed explicit description in the interview (Brockmeier 2010 ; Knoblauch & Schnettler 2012)
Explicit knowledge varies with context
![Page 24: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/24.jpg)
Subjective v Objectified
Two different ways of thinking within these interviews
‘expressing’ = subjective responses
‘talking about’ = conscious reflection on ‘They’
Talking about => objects for reflection
Can ‘Talk about’ self (Mead’s ‘Me’) ‘We’ (Jenkins et al 2010; Schutz 1944) ‘Thou’
![Page 25: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/25.jpg)
Nature of data?
What is the nature & value of such data
Participants asked to ‘talk about’ ‘They’
Tells us nothing about those people
Tells us how participants perceive ‘They’ in the interview
![Page 26: Understanding the Subjective: Eliciting Hidden Meaning David Roberts RobertsBrown david@robertsbrown.com © RobertsBrown Pty Ltd 2012.](https://reader036.fdocuments.us/reader036/viewer/2022062619/551677a9550346a2698b5a44/html5/thumbnails/26.jpg)
Conclusion
Selections made in photo-elicitation uses implicit knowledge – specifically a schema
Elaboration – explicit knowledge - occurs after the selection and starts from that implicit knowledge
Different systems of thinking at different parts of the interview
Need to understand how the answers generated before can understand how to analyse the data.