Power Point StimulatedRecall

download Power Point StimulatedRecall

of 30

Transcript of Power Point StimulatedRecall

  • 8/12/2019 Power Point StimulatedRecall

    1/30

    STIMULATED

    RECALLJonathon Ryan

  • 8/12/2019 Power Point StimulatedRecall

    2/30

    OUTLINE

    Researching miscommunication: The case for Stimulated Recall (SR)

    Characteristics of SR

    Outline of the present study

    Discussion of methodological issues

    Implications of key findings

  • 8/12/2019 Power Point StimulatedRecall

    3/30

    IDENTIFYING MISCOMMUNICATION

    Each method has substantial limitations:

    Self-reporting (e.g. miscommunication diaries) (e.g. Milroy, 1986)

    Close analysis of recordings and transcripts (e.g. Schegloff, 1987)

    Task completion (e.g. Brown, 1995)

    Mixed methods are often used (e.g. Tzanne, 2000)

  • 8/12/2019 Power Point StimulatedRecall

    4/30

    STIMULATED RECALL

  • 8/12/2019 Power Point StimulatedRecall

    5/30

    DEFINING SR

    SR is a type of retrospective report

    Involving the retrospective verbalization of cognition

    Contrasts with Think Aloud: concurrent verbal reporting

    Contrasts with other types of retrospective report

    Through the use of a recall stimulus

    Focuses on cognition at the time of the event (not

    informed by subsequent events)

  • 8/12/2019 Power Point StimulatedRecall

    6/30

    STIMULATED RECALL: BASIC PROCEDURES

    An event is observed and recorded

    Participants are interviewed

    A stimulus is used to prompt recall of the event

    Participants verbalize the thoughts they had during the event (not

    reflections on the event)

  • 8/12/2019 Power Point StimulatedRecall

    7/30

    DOES IT PRODUCE USEFUL DATA?

    At its best, SR enables participants to relive an original situation with

    vividness and accuracy (Bloom, 1953, p. 161)

    However, for much of the 20

    th

    century, researchers treated verbalreports with suspicion

    Undoubtedly, SR data is easily compromised and a great deal of caution

    is required when collecting and interpreting it

  • 8/12/2019 Power Point StimulatedRecall

    8/30

    THEORETICAL JUSTIFICATION

    Ericsson & Simon (1984) provided a theoretical justification foraccepting certain types of verbal report as hard data:

    In completing a task, a durable (if partial) memory trace is laiddown of the information that informed the behaviour

    This trace can be accessed from [short-term memory], at least inpart, or retrieved from [long-term memory] and verbalized.

    Both are direct verbalisations of specific cognitive processes.

    However, the latter will require an additional process of retrievaland may display errors and incompleteness. (p. 16)

  • 8/12/2019 Power Point StimulatedRecall

    9/30

    AREAS OF PREVIOUS ENQUIRYMost often used to explore the cognition behind participants actions, e.g.

    teacher cognition (Polio, et al., 2006)

    learner cognition (Lam, 2008)

    language processing in translation (Dechert, 1987)

    learner reflection and self-evaluation (Murray, 2010)

    Less frequently used to explore hearer responses to discourse:

    Tylers (1995): the perceptions of conversational interactants

    Blooms (1953): students thoughts during lectures and tutorials

    The great majority of such studies treat the procedures involved asunproblematic and few studies report the SR protocol in critical detail(Lyle, 2003, p. 861)

  • 8/12/2019 Power Point StimulatedRecall

    10/30

    THE STUDY

  • 8/12/2019 Power Point StimulatedRecall

    11/30

    THE PRESENT STUDY

    Acts of reference: where speakers identify for the hearer a

    specific individual (e.g. by saying that manor Charlieor he)

    Referential miscommunication: when the hearer misidentifies

    who the speaker means

    Research Question: What linguistic factors are implicated in

    referential miscommunication in L1-L1 and L2-L1 narrative

    discourse?

  • 8/12/2019 Power Point StimulatedRecall

    12/30

    PARTICIPANTS

    60 participants in 30 dyads

    10 L2 speakers + L1 hearers

    10 L2 speakers + ESL teachers

    10 L1 speakers + L1 hearers

  • 8/12/2019 Power Point StimulatedRecall

    13/30

    PROCEDURES

  • 8/12/2019 Power Point StimulatedRecall

    14/30

    EXAMPLES FROM THE STUDY

    Narrative retelling SR interview

    A Charlie falls on the fat

    woman, like two times and shes

    all like like this (GESTURE)

    B [LAUGHS]

    A and then um she like gets

    up and looks real mad?, like her

    face?, and then suddenly like she

    pushes the policeman orsomething,

    Part 1

    Res who got up and lookedmad?

    B the fat woman

    Part 2

    B ah, it WAS her [[the banana

    girl]], [LAUGHS] I thought the fatangry woman got angry

  • 8/12/2019 Power Point StimulatedRecall

    15/30

    EXAMPLES FROM THE STUDY

    Narrative retelling SR interview

    S so, you know at the last

    part, we see together, when

    they bringed the machine?

    A when she said the machine,

    I thought of two machines

    obviously . . . . there was the

    conveyor belt,

    Res ah, and that other one

    A and the other big machine

    where the guy talked to him

    and he changed the speeds

  • 8/12/2019 Power Point StimulatedRecall

    16/30

    S I noticed he was um, . like . his English definitely wasnt perfect, but . .

    like . he he did make quite a few mistakes, I noticed one that I can sort

    of just remember off the top of my head [okay] he said him instead of

    her . um, a couple of times I think

    R Oh, okay, . and was that confusing? S Well it wasnt confusing because I knew what he was talking about,

    and thats the other thing I was going to get to, I mean, even though he

    made quite a few mistakes, . I still figured out what he was on about,

    [some comments omitted] yeah, I mean . . I picked up on it straight away,

    pretty much [yep, okay] and knew exactly who he was talking about

  • 8/12/2019 Power Point StimulatedRecall

    17/30

    MISPLACED CONFIDENCE

    However, the SR interview revealed that the hearer had a radically

    different interpretation of the narrative (see Ryan & Barnard, 2009)

    The miscommunications largely hinged on a small number of

    mispronounced words: Shake choke

    Spilled spit

    Lunch machine (feeding machine) (cleaning up machine)

    Corn comb

  • 8/12/2019 Power Point StimulatedRecall

    18/30

    USING STIMULATED RECALL

  • 8/12/2019 Power Point StimulatedRecall

    19/30

    PITFALLS

    There are multiple pitfalls in implementing SR procedures (see Gass &

    Mackey, 2000:84-99), and so it is of some concern to Lyle that few

    studies treat the procedures involved as unproblematic and few studies

    report the SR protocol in critical detail (2003:861).

    Lyle (2003) warns that care is required to minimize the risk of SR data

    not accurately representing cognitive processes from the time of the

    original event, particularly in relation to processes such as re-ordering,

    reasoning, and sanitization.

  • 8/12/2019 Power Point StimulatedRecall

    20/30

    BEST PRACTICE PROCEDURES

    Lyle (2003, pp. 865-866)

    It is necessary to reduce anxiety;

    limit the perception of judgemental probing;

    reduce the intrusion into the action;

    stimulate rather than present a novel perspective/insight;

    make the retrospection as immediate as possible;

    allow the subject a relatively unstructured response;

    and employ an 'indirect' route to the focus of the research.

  • 8/12/2019 Power Point StimulatedRecall

    21/30

    VIDEO

    Video is generally regarded as providing the strongest recall stimulus

    It is the most widely used stimulus in current research

    However, it is possible that using videotapes for stimulated recallproduce a much more foreign stimulus than audiotapes (Yinger,1986:271)

    Most people are not accustomed to seeing themselves on video

    The participants often appeared distracted by their own image

    My response: train cameras on the speakers

  • 8/12/2019 Power Point StimulatedRecall

    22/30

  • 8/12/2019 Power Point StimulatedRecall

    23/30

    TIME ELAPSE

    The delay between the event and the interview is critical

    Time elapse leads to memory decay

    But analysis of recordings is useful for identifying

    troublespots

    The dilemma:

    Analyze the recordings first?

    Or commence the SR immediately?

  • 8/12/2019 Power Point StimulatedRecall

    24/30

    TIMING OF THE RECALL PROMPT

    Where do you pause the recording?

    they all stopped and had lunch and he . . .

    they all stopped and had lunch and he still had twitches

    Suggestion: pause recordings only at natural discourse

    boundaries

  • 8/12/2019 Power Point StimulatedRecall

    25/30

    THE FOCUS OF RECALL QUESTIONS

    When she said that big guy, who did you think she meant?

    Who stole the bread?

    What was your understanding of the film at this point?

    What was your mental picture of what was happening here?

  • 8/12/2019 Power Point StimulatedRecall

    26/30

    DECLARATIVE AND PROCEDURAL

    KNOWLEDGE

  • 8/12/2019 Power Point StimulatedRecall

    27/30

    LEADING QUESTIONS?

    M so . um the girl runs out of the car, Charlie Chapman follows, thecop follows, and they all fall down, . . . the cops somehow . still on theground?, unconscious or something?,

    R okay

    M he must have donked his head, but I I'm just filling in a gap,

    R yeah, okay

    M and then she explains something about Charlie Chapman hits himon the head again,

    R hits the policeman?

    M hits the policeman with a stick, and then they managed to get away R okay

  • 8/12/2019 Power Point StimulatedRecall

    28/30

    M he must have donked his head, but I I'm just filling in a gap,

    R yeah, okay

    M and then she explains something about Charlie Chapman hits himon the head again,

    R hits who?

    There is a need to ask confirming questions

    There is sometimes a tension between not leading the participant and

    needing to present yourself as a cooperative listener

    Suggestion: Use leading questions to confirm an interpretation you are

    fairly confident of (see also Kvale, 1996, p. 158)

  • 8/12/2019 Power Point StimulatedRecall

    29/30

    FACE THREATS

    Miscommunication is face threatening (Tzanne, 2000)

    Speakers wish to be viewed as competent communicators

    Hearers may wish to protect the speakers face

    Hearers wish to appear intelligent and cooperative but are

    at risk of appearing slow-witted (Smith et al., 2005, p. 1871)

    Highlights need to minimize participant anxiety (cf. Bloom, 1953)

  • 8/12/2019 Power Point StimulatedRecall

    30/30

    REFERENCES

    Bloom, B. (1953). Thought processes in lectures and discussions. Journal of General Education, 7, 160-169.

    Dechert, H. W. (1987). Analysing language processing through verbal protocols. In C. Frch & G. Kasper (Eds.), Introspection insecond language research (pp. 96-112). Clevedon, England: Multilingual Matters.

    Ericsson, K. A., & Simon, H. A. (1984). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.

    Gass, S. M., & Mackey, A. (2000). Stimulated recall methodology in second language research. Mahwah, NJ: Lawrence Erlbaum.

    Kehler, A. (2002). Coherence, reference, and the theory of grammar. Stanford, CA: CSLI Publications.

    Kvale, S. (1996). InterViews: An introduction to qualitative research interviewing. Thousand Oaks, CA: Sage.

    Lam, W. Y. K. (2008). Metacognitive strategy use: Accessing ESL learner's inner voices via stimulated recall. Innovation in LanguageLearning and Teaching, 2(3), 207-217.

    Lyle, J. (2003). Stimulated recall: A report on its use in naturalistic research. British Educational Research Journal, 29(6), 861-878.

    Murray, J. (2010). Politeness and face in professional speaking tests. Paper presented at the 18th international conference onpragmatics & language learning.

    Polio, C., Gass, S., & Chapin, L. (2006). Using stimulated recall to investigate native speaker perceptions in native-nonnativespeaker interactions. Studies in Second Language Acquisition, 28(2), 237-267.

    Tyler, A. (1995). The coconstruction of cross-cultural miscommunication: Conflicts in perception, negotiation, and enactment ofparticipant role and status. Studies in Second Language Acquisition, 17(2), 129-152.

    Tzanne, A. (2000). Talking at cross-purposes: The dynamics of miscommunication. Amsterdam, The Netherlands: John Benjamins. Yinger, R. J. (1986). Examining thought in action: A theoretical and methodological critique of research on interactive teaching.

    Teaching & Teacher Education, 3(2), 263-282.