Measurement of Resource Use and Efficiency L. Gregory Pawlson MD, MPH, Executive Vice President NCQA...
-
Upload
kyle-maldonado -
Category
Documents
-
view
217 -
download
1
Transcript of Measurement of Resource Use and Efficiency L. Gregory Pawlson MD, MPH, Executive Vice President NCQA...
Measurement of Resource Use and Efficiency
L. Gregory Pawlson MD, MPH, Executive Vice President NCQAJoachim Roski PhD Vice President, Quality Measurement
Sally Turbyville MPH, Associate Director, Quality Measurement
Academy Health
2Academy Health June 2007
Why HEDIS® Plan Level Measures of Efficiency (cost-quality)?
• Affordability of health care is a major concern; crowding out focus on quality at purchaser level
• Understanding and influencing BOTH quality and utilization/cost is key to providing broader access to affordable health care
• Health plans attempt to add value by favorably impacting quality as well as mitigating avoidable utilization/cost
• NCQA health plan accreditation, which includes performance evaluation, is a lever to encourage performance assessment related to both quality and cost
3Academy Health June 2007
Potential Health Plans Impact on CostsPotential Health Plans Impact on Costs
Disease ManagementWellness Programs
Benefit DesignNetwork Design
Provider Payment
Disease ManagementWellness Programs
Benefit DesignNetwork Design
Provider Payment
UtilizationUtilization
Provider ContractingProvider Contracting Unit Price/DiscountUnit Price/Discount
Health Plan Functions Impact
Premium
Admin. costs, Strategic considerations, etcAdmin. costs, Strategic considerations, etc
Focus of RRU
4Academy Health June 2007
Principles of Measuring EfficiencyPrinciples of Measuring Efficiency
• Link measures of cost and quality in construction and reporting of measures
• Build on existing quality measures (e.g., HEDIS®)
• Add measures of cost-resource use• Methods must be transparent and fair• Standardized measures and data
collection• Begin with what can be measured now
5Academy Health June 2007
Health Plan Efficiency: HEDIS Measures
Quality Measures coupled with new Relative Resource Use (RRU) Measures for People with…
• Diabetes• Asthma• Acute Low Back Pain• Uncomplicated Hypertension• Cardiac Conditions• COPD
First year RRU collection in HEDIS 2007
First year RRU collection in HEDIS 2008
6Academy Health June 2007
The RRU Measures• Reports the relative resource use for a
health plan members with a particular condition when compared to their risk adjusted peers– Standard price table provided by NCQA to
appropriately weight units of services rendered to members.
– DOES NOT use episode groupers
• When coupled with the related HEDIS quality measures, the RRU ratios provide a better understanding of the efficiency or value of services rendered by the plan
7Academy Health June 2007
Key Features of HEDIS RRU MeasuresKey Features of HEDIS RRU Measures
• Costs are risk adjusted for: – Age– Gender– Presence of co-morbidities
• Exclusions of other dominant conditions– Active cancer– HIV/AIDS– ESRD, etc.
• Member cost capped if exceeds specified amount • Adjusted for enrollment and pharmacy benefit status
(medical and pharmacy member months)
8Academy Health June 2007
Objective of Objective of Early AdopterEarly Adopter Pilot Pilot• Pilot test analytic approach for full HEDIS data set
(300+ plans) submission that is in progress (June 2007)• Do preliminary analysis of variation of quality and cost
for adults with diabetes– Comprehensive Diabetes Care (CDC) and Relative Resource
Use for People with Diabetes (RDI) HEDIS measures • Initial opportunity to examine performance between
HMOs and PPOs• Gain further implementation experience prior to 2007
HEDIS data submission• Voluntary convenience sample of 20 HMO’s and 11
PPO plans (larger than initial pilot test of measures)
9Academy Health June 2007
Comprehensive Diabetes Care Comprehensive Diabetes Care Quality MeasuresQuality Measures
• Quality measure results based on 2006 HEDIS (measurement year 2005) using specifications for administrative only data collection
• Quality measures included four process of care measures:
– Annual Cholesterol Testing
– Annual HbA1c Testing
– Eye Exam
– Monitoring for Kidney Disease
• Calculated plan level diabetes measures composite rate
– Unweighted average of measures
• Created diabetes quality plan index
– Individual plan composite rate divided by all-plan composite average
10Academy Health June 2007
RRU Measure in DiabetesRRU Measure in Diabetes• RRU ratio based on 2007 HEDIS Diabetes RRU
specifications;
– Measurement year 2005 (same as quality measures)
• RRU results assess relative cost (i.e., standardized price weighted resource use) by service category:
– Inpatient facility services (IP)
– Surgery & procedure services (Surg)
– Evaluation and Management (office visits) services (E&M)
– Pharmacy, ambulatory use (Rx)
11Academy Health June 2007
Relative Resource Use Index for Diabetic Relative Resource Use Index for Diabetic Patients (RDI) Patients (RDI)
• RDI calculated as ratio of observed-to- expected (risk adjusted average) standardized costs for patients with diabetes
• RDI index calculated – RDI ratio divided by all-plan RDI ratio average
• Measurement of weighted resource use - not unit price– NCQA standardized price tables– Cost is defined as the summarized weighted
resource use
12Academy Health June 2007
Observed Resource Use (PMPM)Observed Resource Use (PMPM)Observed Resource Use (PMPM)Observed Resource Use (PMPM)HMO & PPO
N=31
13Academy Health June 2007
Diabetes Care: Quality and Cost
0.3
0.5
0.7
0.9
1.1
1.3
1.5
1.7
0.30.50.70.91.11.31.51.7
RDI Index: Total Medical Services
CD
C In
de
x: C
om
po
site
Total RDI & CDCTotal RDI & CDCTotal RDI & CDCTotal RDI & CDCDiabetes Care: Quality and Cost
0.3
0.5
0.7
0.9
1.1
1.3
1.5
1.7
0.30.50.70.91.11.31.51.7
RDI Index: Total Medical Services
CD
C In
de
x: C
om
po
site
N=31
▲▲=HMO
●● =PPO
14Academy Health June 2007
Variation in Pharmacy RDI & CDCVariation in Pharmacy RDI & CDCVariation in Pharmacy RDI & CDCVariation in Pharmacy RDI & CDCDiabetes Care: Quality and Cost
0.3
0.5
0.7
0.9
1.1
1.3
1.5
1.7
0.30.50.70.91.11.31.51.71.9
RDI Index: Pharmacy Services
CD
C In
dex:
Com
posi
te
▲▲=HMO
●● =PPO
N=31
r = .513,sig: .003
15Academy Health June 2007
Diabetes Care: Quality and Cost
0.3
0.5
0.7
0.9
1.1
1.3
1.5
1.7
0.30.50.70.91.11.31.51.7
RDI Index: Total Medical Services
CD
C In
de
x: C
om
po
site
Variation in IP Facility RDI & CDCVariation in IP Facility RDI & CDC
HMO Only N=23
r = -.466, sig: .025
16Academy Health June 2007
Diabetes Care: Quality and Cost
0.3
0.5
0.7
0.9
1.1
1.3
1.5
1.7
0.30.50.70.91.11.31.51.71.9
RDI Index: Pharmacy Services
CD
C In
de
x: C
om
po
site
Variation in Pharmacy RDI & CDCVariation in Pharmacy RDI & CDC
HMO Only N=23
r = .512,sig: .013
17Academy Health June 2007
Summary of FindingsSummary of Findings• PPO performance for both CDC and RDI
appeared to vary to a greater extent than HMO performance.
• For most categories, no correlation between cost and quality.
• Positive correlation (r= -.52) between pharmacy costs and quality
• Negative correlation (r= +.45) between inpatient facility costs and quality
• Results seem plausible
18Academy Health June 2007
Limitations Limitations • Small overall sample size (n=31)• Data limited to commercially insured members• HMOs were all subsidiaries of one national health
plan.• PPOs were all regional health plans.• While HMOs and some PPOs submitted audited
quality measures, RRU results were not audited.• Limitations in understanding variation within market
and between geographic regions
HEDIS 2007 data collection will
address many of these
limitationsHEDIS 2007 data collection will
address many of these
limitations
19Academy Health June 2007
RRU Measures—Moving ForwardRRU Measures—Moving ForwardNext Steps:• Collect HEDIS 2007 (final late July)
– First Year Analysis of new RRU measures with related quality measures (in collaboration with others)
• Continue research/development– Finalize ADA Research Pilot Project – New study of “Replicable Factors and Practices in
High Performing Plans (with Urban Institute)– Refinement of measures based on first year
results– Collection and analysis of additional set of
three measures in 2008
20Academy Health June 2007
Final thoughts on HEDIS RRU’sFinal thoughts on HEDIS RRU’s• Quality and resource use/cost may represent two
relatively independent dimensions of health plan performance
• HEDIS RRU measures may be applicable to integrated delivery systems (real or virtual ) with responsibility for total care:
– Medical groups, tiered networks, Physician-Hospital Organizations
• Unclear how this will be related to individual physician (versus network/group) measurement of quality and resource use/cost
21Academy Health June 2007
Related Work on Physician Level Efficiency Measurement
• Small sample size and heterogeneity of office practices likely to require extensive and complex risk adjustment of RRU/cost measures = high cost of development
• Multiple competing commercial products– Pros
• In fairly widespread use • Development/maintenance supported by market
– Cons• Limited access to understanding/testing reliability
and validity• Multiple products used in non standard manner
precludes pooling data or comparison across practices
22Academy Health June 2007
Physician Level Efficiency Measurement
Physician Level Efficiency Measurement
• Adaptation (and NQF endorsement) of HEDIS measures for physician office practice
• NCQA implementation standards for existing market leading RRU/cost software
• Two very different approaches used– Person Approach—patient is the primary
unit of analysis (HealthDialog)– Episode Approach—episodes of care are
the primary unit of analysis (Symmetry, Medstat, others)
23Academy Health June 2007
Principles for Developing NCQA Standards for Physician Level
Efficiency Measures
Principles for Developing NCQA Standards for Physician Level
Efficiency Measures• Reduce unnecessary complexity of program
or implement on a large-scale basis;• Would work in diverse types of organizational
structures from preferred provider organizations to staff model health maintenance organizations to other population-based measurement organizations;
• Would maximize the number of physicians and patients who could be evaluated while reducing error and bias; and
• Similar implementation standards for measuring physicians’ quality and cost of care.
24Academy Health June 2007
Issues addressed by Physician Cost of Care Implementation Standards
• Input data– Can data be consistently and reliably captured by most
health plans? – Which data are necessary, optional, or not useful for the
evaluation? – What is the required level of detail for various types of
data?– How can common data errors and biases be avoided?
• Methods used to estimate a patient’s risk score and expected cost– Does the treatment of outliers produce robust results that
are also sensitive to meaningful differences in performance?
– What is the minimum number of patient or episode observations acceptable for determining a physician’s cost of care?
– Is the reference population sufficiently similar to the application population for key characteristics?
25Academy Health June 2007
Physician Level Measurement Implementation Standards
• Physician attribution– Are approaches to attribute responsibility for
costs to physicians commensurate with the degree of actual or desired influence of the physician?
– Are the current attribution rules in use valid and fair?
• After revision/public comment “final” NCQA standards for physician level measurement available as “electronic publication” on NCQA website
26Academy Health June 2007
Discussion/QuestionsDiscussion/Questions