Qualitative Methods in Operations Research...Ensure results are used: - how to influence...
Transcript of Qualitative Methods in Operations Research...Ensure results are used: - how to influence...
![Page 1: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/1.jpg)
Qualitative Methods in Qualitative Methods in Operations ResearchOperations Research
James Pfeiffer PhD, MPHJames Pfeiffer PhD, MPHOperations Research MiniOperations Research Mini--CourseCourse
July 28, 2006July 28, 2006
![Page 2: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/2.jpg)
The question is not The question is not whetherwhether to use qualitative to use qualitative methods in OR, since they are, in fact, always methods in OR, since they are, in fact, always used. The questions are used. The questions are how muchhow much they should they should be used and be used and how systematichow systematic should their should their application be. application be.
![Page 3: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/3.jpg)
Qualitative ResearchQualitative Research
What are qualitative data?What are qualitative data?
Where do we get them and how? How do we Where do we get them and how? How do we analyze them?analyze them?
Why should they be used in OR and how?Why should they be used in OR and how?
QualQual OR design issues. OR design issues.
![Page 4: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/4.jpg)
What are qualitative data?What are qualitative data?
![Page 5: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/5.jpg)
![Page 6: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/6.jpg)
![Page 7: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/7.jpg)
Where do we get them and how? Where do we get them and how? How do we analyze them?How do we analyze them?
![Page 8: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/8.jpg)
![Page 9: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/9.jpg)
Basic MethodsBasic Methods
Individual InterviewsIndividual Interviews
Focus groupsFocus groups
Direct ObservationDirect Observation
ParticipantParticipant--ObservationObservation
![Page 10: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/10.jpg)
![Page 11: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/11.jpg)
Why should we useWhy should we usequalitative methods in OR qualitative methods in OR and how?and how?
![Page 12: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/12.jpg)
1.1. Identify and diagnose the problemIdentify and diagnose the problem2.2. Generate a programmatic solution to solve Generate a programmatic solution to solve
problemproblem3.3. Design and test intervention to solve the Design and test intervention to solve the
problemproblem4.4. Ensure results are used Ensure results are used 5.5. Disseminate resultsDisseminate results
Steps in the OR ProcessSteps in the OR Process
![Page 13: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/13.jpg)
Health program as systemHealth program as system
OutputsOutputs
Raw Materials:
•Finances
•Costs
•Staff
•Facilities
Activities:
•Trainings
•Supervision
•Logistics
•Reporting
•Record keeping
•Patient flow strategies
Products of program activities:
•# condoms distributed
•# people tested for HIV
•# enrolling for HIV care
Effect on knowledge or behavior:
•# youth using condoms
•# women using pMTCT services
•# starting ARVs
•% adhering to ARVs
Outcomes Impact
Change in health/well-being
•HIV/STD incidence
•# deaths
•Reduction in viral load
Health ProgramUnder managers’ control
Inputs Process
Effects of Health Program
![Page 14: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/14.jpg)
Mixing Methods/Mixing Methods/QualQual--quantquant
Three purposes (Three purposes (SandelowskiSandelowski):):
Triangulation Triangulation –– convergent validationconvergent validation
ComplementarityComplementarity –– clarify, explain, elaborateclarify, explain, elaborate
Development Development –– guide additional data collectionguide additional data collection
![Page 15: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/15.jpg)
MorganMorgan
Priority Decision Priority Decision
QuantitativeQuantitative QualitativeQualitative
Qualitative PreliminaryQual QUANT
Quantitative PreliminaryQuant QUAL
Qualitative follow-upQUANT Qual
Quantitative follow-upQUAL Quant
CompPrelim
CompFollow-up
SequenceDecision
![Page 16: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/16.jpg)
1.1. Identify and diagnose the problemIdentify and diagnose the problem
•• Example: Late utilization of prenatal care in Mozambique Example: Late utilization of prenatal care in Mozambique (Chapman).(Chapman).
-- Problem discovered through quantitative Problem discovered through quantitative routine data.routine data.
-- Potential causes: Lack of knowledge in pop, poorPotential causes: Lack of knowledge in pop, poortreatment in system etc.treatment in system etc.
-- Unclear whether system problem or communityUnclear whether system problem or community--based problembased problem
-- QualQual methods: Inmethods: In--depth, opendepth, open--ended interviews, ended interviews, participantparticipant--observationobservation
•• Example: Example: ActivistaActivista/adherence problem/adherence problem
![Page 17: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/17.jpg)
Example of difficulties in translating Example of difficulties in translating proven treatment into practiceproven treatment into practice
HAART reduces mortality among patients with HIVHAART reduces mortality among patients with HIV–– BUTBUT many eligible HIVmany eligible HIV--positive people donpositive people don’’t start HAARTt start HAART
Flow through the HIV care system in Beira and Chimoio, Mozambique, Jun 04 - Sept 05
HIV+
Undergo CD4 testing (78%)
Enroll at HIV clinic (59%)
Eligible for HAART (48%)
Start HAART (46%)
0
100
200
300
400
500
600
700
Aver
age
patie
nts
per m
onth
![Page 18: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/18.jpg)
Good OR views health programs as Good OR views health programs as interdependent interdependent ““systemssystems”” (2)(2)
Local level HIV care system in MozambiqueLocal level HIV care system in Mozambique
–– How can we change the system to improve the flow?How can we change the system to improve the flow?–– Will improving one step affect other steps?Will improving one step affect other steps?
Testing center HIV clinic
Adhere to HAART
HIV testing
Enroll at HIV clinic
Undergo CD4 testing
Start HAART, if
eligible
![Page 19: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/19.jpg)
Health programs are complex systemsHealth programs are complex systems
Adhere to HAART
HIV testing
Enroll at HIV clinic
Undergo CD4 testing
Start HAART, if
eligible
Arrives at HIV clinic,
sees receptionist
Schedules doctor
appointment
Doctor orders CD4
Blood drawn for CD4
(sometimes next-day)
Time & drop-off
Time & drop-off
Potential solutionsPotential solutionsCD4 ordered by nonCD4 ordered by non--doctors, at enrollment?doctors, at enrollment?All blood draws sameAll blood draws same--day?day?CD4 ordered in HIV testing site?CD4 ordered in HIV testing site?Move CD4s to another site?Move CD4s to another site?
Problems & solutions depend on system•Staffing
•Lab location, capacity, policies
![Page 20: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/20.jpg)
2. 2. Generate a programmatic solution to solve Generate a programmatic solution to solve problemproblem
-- Focus group discussions Focus group discussions -- Participatory Action Research Participatory Action Research -- Individual interviews with health workers/target Individual interviews with health workers/target
pop.pop.
Example: High maternal mortality in rural areas, Example: High maternal mortality in rural areas, transport plans transport plans
![Page 21: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/21.jpg)
3. 3. Design and test intervention to solve the problemDesign and test intervention to solve the problem-- Individual interviewing and direct observation for Individual interviewing and direct observation for
regular process monitoring and evaluation, and for regular process monitoring and evaluation, and for identification of unintended consequences of identification of unintended consequences of intervention.intervention.
-- Interviews, focus groups, observation combined with Interviews, focus groups, observation combined with quant measures to test intervention quant measures to test intervention effectiveness.effectiveness.
Example: Example: BednetBednet distribution through community groupsdistribution through community groups
![Page 22: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/22.jpg)
4. 4. Ensure results are used:Ensure results are used:-- how to influence policymakers or program how to influence policymakers or program
managersmanagers
5. 5. Disseminate results:Disseminate results:-- Identify best venues for dissemination to Identify best venues for dissemination to
influence policy and generate discussioninfluence policy and generate discussion..
Example: Syphilis testing in MozambiqueExample: Syphilis testing in Mozambique
![Page 23: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/23.jpg)
Qualitative OR Design IssuesQualitative OR Design Issues
Need to scale design and plan to rapid turnaroundNeed to scale design and plan to rapid turnaround
What mix of What mix of qualqual and quant data will you need?and quant data will you need?
What is your unit of analysis?What is your unit of analysis?
What should your sample strategy and size be to answer the questWhat should your sample strategy and size be to answer the question? ion?
Do you need unstructured free flowing responses or structured reDo you need unstructured free flowing responses or structured responses, sponses, or both?or both?
What contextual data will you need? What contextual data will you need?
![Page 24: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/24.jpg)
Defining the CaseDefining the CaseThe Unit of Analysis: ExamplesThe Unit of Analysis: Examples
IndividualsIndividualsHouseholdsHouseholdsGroupsGroupsCommunitiesCommunitiesIllness episodesIllness episodesOrganizationsOrganizationsHealth postsHealth postsEventsEvents
![Page 25: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/25.jpg)
SamplingSampling(and what it means for analysis)(and what it means for analysis)
ConvenienceConvenienceSnowballSnowballQuotaQuotaTheoretical samplingTheoretical samplingSpecial cases: typical, deviant, critical, Special cases: typical, deviant, critical, politically importantpolitically important
PurposivePurposive-- Criterion samplingCriterion sampling-- Maximum variationMaximum variation-- Random purposeful samplingRandom purposeful sampling-- Stratified purposeful samplingStratified purposeful sampling
![Page 26: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/26.jpg)
Sample SizeSample SizeRules of Thumb in Qualitative ResearchRules of Thumb in Qualitative Research
____________________________________________________________________________________________Theoretical saturationTheoretical saturationInformational redundancyInformational redundancy
But how manyBut how many??
Phenomenology = 6 respondentsPhenomenology = 6 respondentsEthnography and grounded theory = 30Ethnography and grounded theory = 30--5050Ethological studies = 100Ethological studies = 100--200 observations200 observations
ButBut…………………………………………………………………………………………it dependsit depends………………..
![Page 27: Qualitative Methods in Operations Research...Ensure results are used: - how to influence policymakers or program managers 5. Disseminate results: - Identify best venues for dissemination](https://reader034.fdocuments.us/reader034/viewer/2022052102/603c7df81de947506f3f3c95/html5/thumbnails/27.jpg)
CONTEXT IS EVERYTHING!!!CONTEXT IS EVERYTHING!!!And what it means for your analysis!!!And what it means for your analysis!!!
____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
LanguageLanguage
Cultural knowledgeCultural knowledge
RapporeRappore/ trust/ power dynamics/ trust/ power dynamics
Location of the interviewLocation of the interview
TopicsTopics
Paralinguistic phenomena Paralinguistic phenomena –– ““qualities of voice, breath qualities of voice, breath resonance, pitchresonance, pitch””