Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How...
Transcript of Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How...
![Page 1: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/1.jpg)
Measuring Outcomes in Behavioral Health: What, When & How
June 2013
Andrew Bertagnolli, PhD
![Page 2: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/2.jpg)
Agenda
Why Measure Outcomes
Types of Outcomes
Specifying & Refining Measures
Challenges in Behavioral Health Outcomes Measurement
Kaiser Permanente’s Journey in Depression Outcomes Monitoring
2
![Page 3: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/3.jpg)
Kaiser Permanente Membership by Region Colorado: 540,442
Georgia: 233,880
Hawaii: 224,591
Mid-Atlantic States (VA, MD, DC): 481,755
Northern California: 3,403,871
Northwest (Oregon/Washington): 484,349
Ohio: 86,338
Southern California: 3,594,848
3
![Page 4: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/4.jpg)
Why Measure Outcomes?
Demonstrates Quality
Ensures Effectiveness and Efficiency • Adherence to evidence supported treatments
• Use resources most efficiently
• Right person, right care, right time
• Develop appropriate levels of care
Builds Trust in the System • Public
• Patients
• Providers
• Payors
Allows for a Systematic Approach to Improvement
4
![Page 5: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/5.jpg)
What is Quality?
A measure of whether services increase the likelihood of desired mental health
outcomes and are consistent with evidence-based practice.
5
World Health Organization, 2003
![Page 6: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/6.jpg)
6
“Quality” Has Many Dimensions To Measure
Safe
Effective
Patient-Centered
Timely
Efficient
Equitable
Source: Institute of Medicine (2001). Crossing the Quality Chasm: A New Health System for the 21st Century.
![Page 7: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/7.jpg)
How Can Stakeholders Use Outcome Measures?
7
Patients
Service
Planners
Public Clinicians
Payors
Families
Researchers Policy Makers
Professional
Organization
![Page 8: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/8.jpg)
Types of Measures
8
QUALITY
Outcome
Process
Structure
![Page 9: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/9.jpg)
Structure Process Outcome
Strength • Easy to Gather • Capture Care
Elements Under
Greatest Control
• Assess if Patient Status
Improves
Limitation • Subject to
Response Bias
• Vagueness in
Terminology
• Dependent on Patient
Care-Seeking
Behaviors
• Sensitive to Differences
in Illness Severity and/or
Comorbidities
9
![Page 10: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/10.jpg)
Selecting & Refining Quality Measures
Clinical Importance • Does this measure represent a substantial deficit in care?
• Can this measure result in actionable improvement efforts?
Scientific Foundation • Is there evidence supporting the relationship between the measure and clinical outcome?
Validity • Is the measure scientifically sound?
• Is it sensitive to change?
• Is it easily understood?
• Is it susceptible to being ‘gamed’?
• Does it allow for differences in patient beliefs and preferences for care?
Feasibility • How easy is it to collect across an episode of care?
• How reliable/complete is the collection method and resulting data?
• How easy is it to retrieve from charts (EHR or paper)?
• How affordable is it to collect?
10
![Page 11: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/11.jpg)
11
Expect Measurement Sets To Evolve Over Time
Time
Num
ber
of M
easu
res
A Possible Profile
![Page 12: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/12.jpg)
Why Does BH Lag Behind?
Lack of Sufficient Evidence
• Poorly Defined Parameters
• Unable to Develop Specific, Valid & Clearly Defined Measures
• Lack of Agreement on ‘Quality Care’ in Behavioral Health
Inadequate Infrastructure to Develop & Implement Measures
Provider Concerns (privacy, ‘cook-book care’, etc)
Care Often Contained within Silos (eg; BHS, PC, PEDS, etc)
Lack of Electronic Health Information
• Incomplete or Missing Data Elements
• Having Data in Searchable Fields
12
![Page 13: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/13.jpg)
Kaiser Permanente’s Journey
![Page 14: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/14.jpg)
Vision
Mission
Values
Emotional Health is Part of Total Health:
All KP members at-risk will be routinely screened
and provided EST for emotional health needs until
their symptoms remit.
Improve clinical outcomes for members with emotional
health diagnoses by designing and implementing a
standardized, reliable process for identification and
treatment of members’ emotional health needs no matter
where the member presents for care.
•Evidence Supported
•Member Centered
•Flexible
•Cost-Effective
•Scaleable
•Leverages KP Integrated Delivery
System
![Page 15: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/15.jpg)
Clinical Opportunity Areas – Where To Start?
ADHD; Autism Spectrum Disorders;
Behavioral Disorders
Depression/Suicide Prevention;
Substance Use Disorders; Eating Disorders
Major Depressive Disorder; Substance Use Disorders;
Anxiety Disorders; ADHD; Eating Disorders
Major Depressive Disorder;
Substance Use Disorders; Anxiety Disorders
Children
Teens
Adults
Older Adults
![Page 16: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/16.jpg)
Agreeing on the PHQ9
Able to build job aides and decision support tools
Able to develop Depression Outcomes Report for internal benchmarking
Able to apply population care strategies
Able to develop stepped care models
16
![Page 17: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/17.jpg)
PHQ9 – The New Standard of Depression Care at Kaiser Permanente
17
![Page 18: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/18.jpg)
Taking it to the Street
18
Routine Use
Medical Care Providers
Psychotherapists
Care Managers
Psychiatrists
![Page 19: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/19.jpg)
What Can the PHQ9 Do For Me?
19
Help with Diagnosis
Aid in Treatment Planning
Track Outcomes
Manage Time Effectively
Improve Care Coordination
Structure the Conversation
![Page 20: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/20.jpg)
20
Diagnosis
![Page 21: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/21.jpg)
21
![Page 22: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/22.jpg)
Talking with Patients About Depression
22
![Page 23: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/23.jpg)
23
Talking with Patients About
Depression – Making the Right
Thing Easier To Do
![Page 24: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/24.jpg)
Treatment Decisions
24
![Page 25: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/25.jpg)
25
![Page 26: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/26.jpg)
Monitoring Progress
26
![Page 27: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/27.jpg)
27
![Page 28: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/28.jpg)
28
![Page 29: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/29.jpg)
Depression Dashboard Metrics
PHQ-9 Usage • New episodes: initial PHQ-9 at index date
• New episodes: follow-up PHQ-9 2-4 after index date
• Existing episodes: annual PHQ-9
29
0%
10%
20%
30%
40%
50%
60%
70%
Q1 Q2 Q3 Q4
Baseline PHQ-9 Completion
Region A
Region B
Region C
Region D
Region E
0%
10%
20%
30%
40%
50%
60%
6 month 12 month 18 month 24 month
Depression Outcomes: Remission and Improvement
5 PointImprovement
5 Point Worsening
Remission
PHQ-9 Score Change Over Time • Episodes which improve by a severity
class
• Episodes which improve to remission
class
• Episodes which stay the same or severity
class worsens
![Page 30: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/30.jpg)
Care Coordination
30
![Page 31: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/31.jpg)
Straw Model: Psychological Therapies for Adult Depression Stepped Care Model Adapted for Kaiser Permanente
Identification, Assessment &
Education
Low-Intensity Interventions
High-Intensity Interventions
Specialized-Interventions
Active Monitoring and Referral for Further Assessment & Intervention
PHQ9 < 9
PHQ9 = 10-14
PHQ9 = 15-19
PHQ9 > 20
![Page 32: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/32.jpg)
But Will Patients Like It……?
32
![Page 33: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/33.jpg)
33
![Page 34: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/34.jpg)
34
![Page 35: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/35.jpg)
Acknowledging it Takes Time
35
![Page 36: Measuring Outcomes in Behavioral Health: What, When & Ho What_When_How... · • How reliable/complete is the collection method and resulting data? • How easy is it to retrieve](https://reader033.fdocuments.us/reader033/viewer/2022042201/5ea0cf719ae119760755937c/html5/thumbnails/36.jpg)
Questions - - Comments
36