In-Depth Interviews: Techniques and Best Practices

51
In-Depth Interviews: Techniques and Best Practices A workshop in conjunction with the ACEHP Annual Conference Friday, January 17, 2014 4:15pm-6:15pm Wendy Turell, DrPH, CCMEP President Contextive Research LLC wendy@contextiveresearch. com Alexandra Howson MA, PhD, CCMEP Owner Thistle Editorial, LLC [email protected] m

description

Slides from a 2-hour facilitated workshop presented at the Alliance for Continuing Education in the Health Professions

Transcript of In-Depth Interviews: Techniques and Best Practices

Page 1: In-Depth Interviews: Techniques and Best Practices

In-Depth Interviews: Techniques and Best Practices

A workshop in conjunction with the ACEHP Annual Conference

Friday, January 17, 20144:15pm-6:15pm

Wendy Turell, DrPH, CCMEPPresidentContextive Research [email protected]

Alexandra Howson MA, PhD, CCMEPOwnerThistle Editorial, [email protected]

Page 2: In-Depth Interviews: Techniques and Best Practices

OverviewLearning Objectives: After participating, learners will be able to:

• Develop, pilot, and administer an interview guide for an IDI series

• Demonstrate optimal interviewer skills and techniques to encourage full feedback from interviewees

Page 3: In-Depth Interviews: Techniques and Best Practices

The qualitative approach

Page 4: In-Depth Interviews: Techniques and Best Practices

Search for objective, universal truths using standardized data gathering techniques

Page 5: In-Depth Interviews: Techniques and Best Practices

Naturalistic/interpret-ative approach

Focus on how people perceive their worlds and interpret experience

Page 6: In-Depth Interviews: Techniques and Best Practices

Data: What vs WhyQuantitative Data:A 37% drop-off was observed in adherence to post surgery medication regimens

Qualitative Data“After their bypass surgery, when they have seen God and all that, they listen, but after they are out of the hospital and they are going through rehab and they are fine, that period of after the bypass, they are invincible.”

Page 7: In-Depth Interviews: Techniques and Best Practices

Relevance to CEHP

Needs assessment

Formative evaluation

Outcomes evaluation

Page 8: In-Depth Interviews: Techniques and Best Practices

Why Interview?• It’s good to talk

o Provides depth + context to other data

• Lopsided conversation• Relies on interaction 

Page 9: In-Depth Interviews: Techniques and Best Practices

What Defines an Interview?

A tool to direct or guide a conversation between 2 or more people towards a particular outcome.

Frey and Oishi (1995:01) define Interview as “a purposeful conversation in which one person asks prepared questions (interviewer) and another answers them (respondent).” 

Examples: • Journalistic• Clinical• Research• Occupational

Page 10: In-Depth Interviews: Techniques and Best Practices

Activity 1: Core Components of Interviews

• What went well in this interview?

• What did not work?

Alexandra Howson
moving from rationale and relevance to what an interview is to set up discussion of its core components/elements in next section of the workshop - leads into activity 1 = interview critique
Page 11: In-Depth Interviews: Techniques and Best Practices

Debrief

Page 12: In-Depth Interviews: Techniques and Best Practices

Interview Planning

Page 13: In-Depth Interviews: Techniques and Best Practices

Components of an Interview

• Opening/building rapport

• Language (word choices) and tone

• Body language

• Empathy

• Questions that will elicit deep response

Page 14: In-Depth Interviews: Techniques and Best Practices

The Interview Guide

• Keeps you on track

• Ensures material/research question coverage

• Establishes sequence

Page 15: In-Depth Interviews: Techniques and Best Practices

Question Order

sensitive

more serious

Small chat/ice-breaker

conversation

Page 16: In-Depth Interviews: Techniques and Best Practices

Types of Questions

Page 17: In-Depth Interviews: Techniques and Best Practices

Question Types• Open ended, neutral, sensitive, clear to

respondent

Patton, MQ. How to use qualitative methods in evaluation. London: Sage, 1987.

1. Main questions2. Probes3. Various follow up questions

Wendy Turell
AH has a q type grid
Page 18: In-Depth Interviews: Techniques and Best Practices

Main/Introducing

• “Tell me about….?”

• “Do you remember an occasion when…?”

• “What happened when you...?”

Page 19: In-Depth Interviews: Techniques and Best Practices

Prompts + Probes• Extensions of main question

• Aimed to encourage respondents to share more information and touch on areas they did not initially address

• May reflect statements or use vocabulary of respondent

“You mention patients come into visits with opinions from these ads. How does that impact the interaction?”

“Could you say something more about that?”

“Can you give a more detailed description of what happened?”

“Do you have further examples of this?”

Page 20: In-Depth Interviews: Techniques and Best Practices

Specifying

• “What did you think at that point?”

• “What did you actually do when you realized he had this side effect?”

• “How did your colleagues react when you started the new program?”

Page 21: In-Depth Interviews: Techniques and Best Practices

Direct/Indirect

Direct Indirect“In what ways do you

implement these guidelines post

diagnosis? “

“How do you believe other physicians view

these guidelines?”

“Describe ways in which you support your

patients’ adherence efforts”

“What do you think are the reasons behind your

patients’ lack of adherence?”

AH: I made the examples more CME specific. Do these still fit as good examples of direct/indirect questions in your opinion?

Page 22: In-Depth Interviews: Techniques and Best Practices

Interpreting “When you use the term ‘uncontrolled’ disease, are you referring mainly to A1Cs?”

“So do you mean that the patients have literacy challenges?”

“Is it correct to say that you are typically unable to chose your ideal treatment due to these barriers?”

“Does the expression ‘trying to keep up’ describe what you have just expressed?”

Page 23: In-Depth Interviews: Techniques and Best Practices

More about Questions• Use vocabulary of respondent• Appropriate tone• (make sure order/sequence is in deck

somewhere)• What open ended q looks like• Language that may invoke defensiveness• Leading questions

Page 24: In-Depth Interviews: Techniques and Best Practices

Time to Craft Some Questions

Page 25: In-Depth Interviews: Techniques and Best Practices

Activity 2: Your Mission…• As CME Director of Main Street Community Hospital,

you and your team have been asked to interview 20 recently discharged patients who received joint replacement surgery. The hospital administration would like to learn about patient satisfaction during their stay as part of an education program designed to reduce readmission rates.

• Develop 5-7 questions that will help hospital leadership better understand more about “patient satisfaction”.

Page 26: In-Depth Interviews: Techniques and Best Practices

Activity Debrief

Page 27: In-Depth Interviews: Techniques and Best Practices

Interview Presence

Page 28: In-Depth Interviews: Techniques and Best Practices

Face-to-face ‘live’

Page 29: In-Depth Interviews: Techniques and Best Practices

WHAT ARE YOU REALLY SAYING?

Page 30: In-Depth Interviews: Techniques and Best Practices

Telephone

Pros + cons

Page 31: In-Depth Interviews: Techniques and Best Practices

Optional Webcam-

enabled images

Text based chat &

audio capable

Online: Virtual Interview Room

Page 32: In-Depth Interviews: Techniques and Best Practices

Skype video call

Page 33: In-Depth Interviews: Techniques and Best Practices

Activity 3: Revisit Your Questions

• As CME Director of Main Street Community Hospital, you and your team have been asked to interview 20 recently discharged patients who received joint replacement surgery. The hospital administration would like to learn about patient satisfaction during their stay as part of an education program designed to reduce readmission rates.

• Develop 5-7 questions that will help hospital leadership better understand more about “patient satisfaction”.

Page 34: In-Depth Interviews: Techniques and Best Practices

Administering an interview

Page 35: In-Depth Interviews: Techniques and Best Practices

Interviewer Behavior• Active Listening – Be ‘in the moment’

o Patience, okay with silence

• Encourage respondento Give appropriate verbal and non-verbal feedback

• Stay neutralo Avoid presenting your perspective (bias interview)o Avoid counseling, teaching

• Reflectingo Paraphrase/reflect back

Page 36: In-Depth Interviews: Techniques and Best Practices

Capturing Informationo Audio Recording

• Digital RecorderoConference linesoPhone apps (e.g., italk)

• Video recording• Pen and paper notetaking

Page 37: In-Depth Interviews: Techniques and Best Practices

Activity 4: Interviewing with partners

• 1:1 pairing• Practice using revised questions• Chose one partner to share information on

experience

REMEMBER:Active ListeningReflect back to respondentStay neutral

Page 38: In-Depth Interviews: Techniques and Best Practices

Interview Disadvantages

• Time intensive

• Bias (researcher + interviewee)

• Skill requires practice!

• Lack of generalization

Page 39: In-Depth Interviews: Techniques and Best Practices

Subjects

• Recruitment• Screening

o participants/inclusion criterion

• Subject preparationoWhat to expecto Institutional Review Boards (IRBs)o Informed Consent

Page 40: In-Depth Interviews: Techniques and Best Practices

Questions?

Page 41: In-Depth Interviews: Techniques and Best Practices

Follow-up Questions?Contact Us

Wendy Turell, DrPH, CCMEPPresidentContextive Research [email protected]

Alexandra Howson MA, PhD, CCMEPOwnerThistle Editorial, [email protected]

Page 42: In-Depth Interviews: Techniques and Best Practices

Resources

Page 43: In-Depth Interviews: Techniques and Best Practices

Software Resources: Coding & Organization

• Free (QDA Miner Lite)o http://provalisresearch.com/products/qualitative-data-analysis-software

/freeware/

• Low Cost: dedoose ($10 per month)o http://www.dedoose.com/

• Bells and Whistles software: Nvivo or Atlas Tio http://www.qsrinternational.com/products_nvivo.aspxo http://www.atlasti.com/index.html

Page 44: In-Depth Interviews: Techniques and Best Practices

Resources Cont.• Hopkins Open Coursework: http://ocw.jhsph.edu/• Qualitative course materials:

o http://ocw.jhsph.edu/index.cfm/go/viewCourse/course/qualitativedataanalysis/coursePage/index/

• Online Qual. Textbook: http://onlineqda.hud.ac.uk/Introduction/index.php

Page 45: In-Depth Interviews: Techniques and Best Practices

Resources Cont.• Cater JK. SKYPE: a cost-effective method for

qualitative research. Rehab, Counselors + Educators Journal. 20011;4:

• Cohen DJ, Crabtree BF. Evaluative criteria for qualitative research in health care: controversies and recommendations. Ann Fam Med. 2008;6:331-339.

 • Curry L, Nembhard IM, Bradley EH. Qualitative and

mixed methods provide unique contributions to outcomes research. Circulation. 2009. 119:1442-1452.

Page 46: In-Depth Interviews: Techniques and Best Practices

Appendix

Page 47: In-Depth Interviews: Techniques and Best Practices

Conversation vs. InterviewConversation Interview

Respondent Friend/Acquaintance

Recruited respondent

Who provides Questions/Answers

Generally equal questions/answers among participants

Lopsided

Tone Share true feelings, reactions to what you hear

Maintain objective tone, non judgmental, non reactionary

Focus Typical focus on immediate outcome (e.g.: how was the game?)

Process, cause/consequences, context, search for patterns

Depth Most often a range of issues, not always deep

Narrow range of issues, greater depth

Page 48: In-Depth Interviews: Techniques and Best Practices

 Qualitative Research

Quantitative Research

Type of Questions

Probing “below the surface”; immediate follow up & adjustment

Limited probing; pre-determined questions NOT adjusted

Sample Size Small Any size including large

Information per respondent

Much Varies; Limited to answer choices

AdministrationRequires skilled researcher

Fewer specialist skills required

Type of Analysis

Follows structured steps; subjective and interpretative

Statistical; objective

Type of ResearchExploratory, descriptive Descriptive or Causal

Wendy Turell
appendix
Page 49: In-Depth Interviews: Techniques and Best Practices
Wendy Turell
add later, at end; maybe focus on Q&A style for first part of deck
Page 50: In-Depth Interviews: Techniques and Best Practices

White Board Exercise example

Which drug class do you prefer to use in patients who fail on oral monotherapy?

DPP4 Inhibitors

SGLT2 inhibitors

Page 51: In-Depth Interviews: Techniques and Best Practices