The Predictive Bull’s-eye: Predictive Analytic...

17
GA HIMSS The Predictive Bull’s-eye: Defining and Measuring Predictive Analytic ROI September 7, 2016 Leigh Williams Ritesh Sharma

Transcript of The Predictive Bull’s-eye: Predictive Analytic...

Page 1: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

GA HIMSSThe Predictive Bull’s-eye: Defining and Measuring Predictive Analytic ROI

September 7, 2016

Leigh WilliamsRitesh Sharma

Page 2: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Learning Objectives

Describe the role that

predictive analytics play

in the emerging

value-based landscape

Define the “predictive

analytic paradox”

Apply a framework for understanding

and determining predictive

analytic ROI

Page 3: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Why all the hype around predictive analytics?

The way we define value is changing

Payment is linked to

performance

Prevention is key to

meeting goals

The “Prevention

Gap”

Page 4: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Predictive Analytics:

Technology that uses machine learning ⎯also called artificial intelligence ⎯ to account for thousands of variables and make more precise and actionable predictions

Why all the hype around predictive analytics?

Page 5: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

What makes predictive analytics better than what we have today?

Accuracy Applicability Optimization

Efficiency Usability

Page 6: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

The Predictive Analytic Paradox

The process of applying an intervention obscures the

value of the prediction.

Page 7: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

The Predictive Analytic Paradox

By intervening based on predicted risk, you fundamentally change the outcome

and what you are able to observe.

High-Risk Individual

Interventions Applied

Individual Stays Well

Individual was never exposed

Intervention worked

Page 8: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

How To Determine Predictive Analytic ROI

Under-standing Accuracy

Translating Accuracy

Setting Goals

Aligning to the

Triple Aim

Page 9: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Understanding Accuracy

What is the accuracy of the predictive engine when applied to your own data?

Understanding Accuracy

Translating Accuracy

Setting Goals Aligning to the

Triple Aim

If 100 people are predicted

to be readmitted

and 35 are readmitted

then the model has a 35% accuracy

rate

Page 10: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Translating AccuracyUnderstanding

Accuracy Translating Accuracy

Setting Goals Aligning to the

Triple Aim

Pure potential

represents the accuracy

of the solution

20% 40% 60%

Pure Potential (100%)

Intervention Effectiveness

In our example, if you were able to stop all 35 readmissions,

we would achieve the “pure potential” of the solution.

Page 11: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Translating Accuracy

Current capacity to perform the intervention

Ability to drive adoption of the predictive solution

Effective-ness of the interven-tion for a specific patient

Patient’s willingness to engage with the intervention

Understanding Accuracy

Translating Accuracy

Setting Goals Aligning to the

Triple Aim

Driving effective interventions

Page 12: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Setting GoalsUnderstanding

Accuracy Translating Accuracy

Setting Goals Aligning to the

Triple Aim

• What if you did not have predictive analytics?

• How your organization is doing with applying an intervention

• Potential intervention effectiveness

Where you could have been

Where you are today

Where you could be

Page 13: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Aligning to the Triple AimUnderstanding

Accuracy Translating Accuracy

Setting Goals Aligning to the

Triple Aim

Page 14: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

What Predictive Analytic ROI Looks Like

Results for one provider:

• Achieved a 32% drop in readmissions

• Avoided $4,894,400 in cost

• Saved 2,331 LOS days

Page 15: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Driving Predictive Analytic Success

• Engage the right stakeholders

Leadership

• Select a key member who can drive the project

Project Owner

• Get users excited and committed

End users

Page 16: The Predictive Bull’s-eye: Predictive Analytic ROIga.himsschapter.org/sites/himsschapter/files... · Ritesh Sharma ritesh.sharma@jvion.com Leigh Williams ltwilliams@virginia.edu.

Next Steps

Determine risk areas

Prioritize for predictive analytics

Define your ROI metrics