Baobab spring 2015 analyzing

Harry HochheiserDepartment of Biomedical InformaticsUniversity of [email protected]

Harry Hochheiser, [email protected] Baobab Health, February 2015Attribution-ShareAlikeCC BY-SA

Analyzing Qualitative Inquiry/Interview Data

mailto:[email protected]



Harry Hochheiser, [email protected] Baobab Health, February 2015

Analytic Challenge

● Having collected lots of data● Many hours of interviews● Lots of notes● Recordings● Artifacts, etc.

● How do we turn this into something useful?



Interpretation Goals

● Goal: Separating the wheat from the chaff

● Tell a story - inform design

● Summarize, organize, and communicate findings

● Without losing potentially important insights.

● Many approaches

● Be prepared to iterate: interpretation and analysis may reveal holes in earlier understanding that defined data collection.



Complementary approaches

• Coding: assign concepts to ideas, utterances, observances

• extract themes

• hierarchical organization of ideas

• Modeling: develop graphical depiction of key concepts, relationships, etc.

• Scenario development



Recording• Interpretation Notes (Beyer & Holtzblatt 2014)

• capture as soon as possible after the interview (immediately after whenever possible)

• Divide into manageable chunks



Coding

• Assign concepts/ideas to items from inquiry:

• utterances

• activities

• difficulties

• Interpretation notes

• Label and name any aspect of interest, including emotional response

• Goal: index the studies…



Qualitative Coding Preece, Rogers, Sharp, Interaction Design, 3/e

Open Coding Identify categories, properties, dimensions

Axial CodingSystematically elaborateOn categories and link to subcategories

Selective CodingRefine and integrateTo develop a theoretical scheme

Coding Manual:How are you doing it?



Grounded theory

● Starting point – no underlying theory about what's going on

● “Let the data speak”

● Identify, categorize, and organize themes and comments.



Other Types of Coding?

● J. Saldaña. The Coding Manual for Qualitative Research

● Not necessarily grounded -looking for something specific.

● First cycle

● Attribute, Magnitude, Simultaneous, Structural, Descriptive, In Vivo, Process, Initial, Emotion, Values

● Second Cycle

● Pattern, Focused, Axial, Theoretical, Elaborative, etc...



A grounded theory guided approach to palliative care systems designKuziemsky, Downing, Black, and Lau, IJMI 2007 http://dx.doi.org/10.1016/j.ijmedinf.2006.05.034


http://dx.doi.org/10.1016/j.ijmedinf.2006.05.034


Quantitative Coding - NVIVO



Chains of Evidence

● Create a classification scheme

● Tie summarizations back to “raw data”

● Sanity check – avoids drift

● Do this throughout interpretation and analysis.



Checklist: Coding Observations

1. Segment observations into individual chunks

2. Assign codes capturing key content in each observations

3. Group related codes hierarchically

4. Write a codebook describing how each code is used

5. Check agreement with other raters

6. Iterate and refine as needed to improve agreement



Interpretation sessionsBeyer & Holtzblatt 2014

• Interviewer + team members

• tell story from notes and memory

• develop notes

• consolidate data



Affinity Diagram(Anind Dey)

• Consolidate data hierarchically

• similar to axial coding

• add photos, etc.



Affinity Diagram - tell storiesBeyer & Holtzblatt 2014



Modeling: Tell Stories• Use coded results to develop graphical work models (Beyer & Holtzblatt)

● Flow

● Day-in-the-life

● Sequence

● Artifacts

● Physical Environment

● Cultural context

●



Allegheny County Health DepartmentAnind Dey, CMU Human-Computer Interaction InstituteMike Wagner, DBMI, et al.

● Goal: “Understand work flow in dealing with infectious diseases in public health departments”

● Thanks to Anind Dey for content on the following slides.



Allegheny County Health DepartmentAnind Dey, CMU Human-Computer Interaction InstituteMike Wagner, DBMI, et al.



Flow Model● Describe communication and coordination of tasks and information flow across roles

● Which roles are participants playing?

● How is work divided among people?

● Which people/groups are involved in getting work done?

● Which communication paths and tools are used to coordinate?

● Where do people go to coordinate?

● Where are the problems?



Flow Model



Sequence Model● Steps taken to complete tasks

● What are the steps?

● What is the intent?

● What are the triggers?

● Is there an order?

● Conditions?

● Problems?



Sequence ModelBeyer & Holtzblatt 2014



Physical Model

● Constraints of where work is done

● Components of environment that support work?

● Components that hinder?

● Tools that people use in these spaces?



Physical ModelBeyer & Holtzblatt, 1998



Cultural ModelBeyer & Holtzblatt, 1998

● What is the overall political, organizational, social context?


Baobab spring 2015 analyzing

Education

Transcript of Baobab spring 2015 analyzing