Innovation Building the evidence base: in Evidence A ... · Conference Regina, SK Nov 15, 2018...
Transcript of Innovation Building the evidence base: in Evidence A ... · Conference Regina, SK Nov 15, 2018...
Innovation in Evidence Conference
Regina, SK Nov 15, 2018
Building the evidence base: A perspective from Washington State
WASHINGTON STATE INSTITUTE FOR PUBLIC POLICY
Stephanie Lee Director
Washington State Institute for Public Policy
! Explicitly nonpartisan ! Mission to produce practical research for the legislature
Nov 15, 2018 www.wsipp.wa.gov Slide 2 of 7
Capitol → ← WSIPP
Created by the 1982 Washington State Legislature
Assignments to produce evidence
Nov 15, 2018 www.wsipp.wa.gov Slide 3 of 7
What works? (and what does not?) a) Produce new evidence
! Evaluate outcomes for participants in state programs
b) Synthesize existing evidence ! Meta-analyze research on specific programs
! What is the potential return on investment?
2018 ESSB 6032 Sec. 606 (22) $57,000 of the general fund—state appropriation for fiscal year 2019 is provided solely for the Washington institute for public policy to conduct a review of the available research literature on step therapy protocol usage, including any rigorous evidence concerning positive or negative health outcomes resulting from step therapy protocol usage.
What is the evidence in Washington?
Nov 15, 2018 www.wsipp.wa.gov Slide 4 of 7
Outcome evaluations of real-world programs implemented in the state
! Administrative data
! Use rigorous research methods (establish causality)
! Identify comparison groups not receiving the program
! Apply statistical controls for potential confounds • Special attention to selection bias
What does the existing research tell us?
Nov 15, 2018 www.wsipp.wa.gov Slide 5 of 7
Meta analysis of research on specific programs ! Standardized approach
! Consider all published evidence we can find
! Apply consistent standards of rigor (causal evidence)
! Combine evidence statistically
! Estimate how much change we would expect
What is the potential return on investment?
Nov 15, 2018 www.wsipp.wa.gov Slide 6 of 7
WSIPP’s benefit-cost analysis ! Standardized approach ! Use results from a meta-analysis (or outcome evaluation)
• How much change can we expect? ! Apply consistent valuation of outcomes ! Estimate cost of program per-participant ! Consider risk of each investment
• How likely to “break even”?
Value of crime includes: ! Police ! Courts, prosecutors ! Prison or jail ! Probation or parole ! Victim property ! Victim physical and mental health, quality of life
Nov 15, 2018 www.wsipp.wa.gov Slide 7 of 7
Publishing our findings