1

Today’s Presenters

Suzanne Barnard, Annie E. Casey

Foundation

Kevin Haggerty,

Social Development

Research Group

Margaret Flynn-Khan, Mainspring Consulting

Rebecca Boxx,

Providence Children and

Youth Cabinet

2

I. Evidence2Success and how it works

II. What we’re looking for in new Evidence2Success communities

III. The role of prevention science and proven programs

IV. How Evidence2Success helps communities invest in what works

V. Evidence2Success progress in Providence

VI. Your questions via the Q&A window

Webinar Overview

3

Communicate with us using the Q&A window at the right of the presentation window.

• Type questions for the panel at any time during the webinar.

• Use the box to let us know if you are having technical difficulties.

Communicating During the Webinar

4

Introducing Evidence2SuccessSuzanne Barnard

5

The Annie E. Casey Foundation develops solutions to build a brighter future for children, families and communities.

6

Lessons from Research:What is Required for Young People to Be Successful?

Com

mun

ity School

Individual and Peer

Family

Child Well-being

Positive Relationships Behavior

EducationPhysical Health

Emotional Well-being

7

The Evidence2Success Framework

Governance structure

including public systems and community

Strategic use of data

Comprehensive financing strategies

Implementation of evidence-

based programs (EBPs)

Performance measures

8

Evidence2Success: Shared responsibility and shared accountability

Priority Outcome

AreasChild Welfare

Service Providers

Public Health

Community Representatives

Education System

Juvenile Justice System

Mental Health

Elected LeadersRisk and protective factors

9

Evidence2Success Communities

Designated site coordinator and implementation

oversight of evidence-based practices

Commitment to provide and shift public funding

and to share funding data

Commitment of school system to administer surveys

and provide data

Partnership of government systems, elected officials and

residents

• Locality with at least 100,000 residents

• Focus neighborhoods where significant financial resources are spent on children

Ability or willingness to use and share data

across systems

10

Governance Structure: Evidence2Success is Community-Owned

Evidence2Success Governance Structure

• Local site coordinator• Fiscal agent• Lasting local home

Ongoing local capacity

• Dedicated staff liaison to communities

• Tools and technical assistance

Community leaders ● System leaders ● Residents

11

Governance Structure

Their Charge:

• Select local site coordinator

• Review and understand data

• Set priorities

• Select programs

• Develop and review RFPs

• Monitor implementation progress and

outcomes

• Develop finance plan and scale plan12

The local site coordinator (100% FTE) is a senior-level executive in the Evidence2Success community who will ensure successful implementation of the Evidence2Success framework and build necessary capacities. May serve as finance lead.

Ongoing Local Capacity:Local Site Coordinator

13

Ongoing Local Capacity: System Partner Commitments

• Commit resources to support the work and commit to redirecting an increasing amount of public resources toward evidence-based programs over time

– Commit $150,000 cash at the outset for evidence-based programs, to be matched by the Foundation

• Designate a finance lead, along with finance experts from participating public departments

• Complete a fund map – an analysis of how key funding streams are invested

• Develop a collaborative strategic financing plan

• Pool a portion of resources dedicated to this effort that the partnership will determine how best to spend based on local needs

14

Annie E. Casey Foundation Support Structure

Evidence2Success Site ManagerWorks with local site coordinator

Tools and Technical AssistanceSurvey * Online tools * In-person

consulting * Financing toolkit * Program database * Evaluation dashboard

15

Evidence2Success Phases

Phase 1:

Build Partnership

Capacity

Phase 2:Select

Priorities and Proven

Programs

Phase 3;

Prepare to Install

Programs

Phase 4: Install Programs, Align

Practice, Evaluate, Adapt

• Fund and implement evidence-based programs city or state–wide

• Ongoing monitoring, tracking and adapting using survey data and dashboard

• Re-administer youth survey and continue to use fund-mapping tools

16

Prevention Science and Proven Programs

Kevin Haggerty

17

1. Use local data to prioritize underlying factors that contribute to well-being

2. Make decisions about which proven programs to use

3. Discuss decisions with confidence, knowing that they are grounded in solid research

The Role of Prevention Science in Evidence2Success

18

Why Proven (Evidence-Based) Programs?

• More consistent positive outcomes

• Strong ethical argument

• Cost savings to taxpayers

• Ability to address multiple risk, protective factors and outcomes

• Higher certainty of achieving the intended impact when implemented with fidelity

19

Essential Characteristics of Proven Programs

Impact Evaluation Quality

System Readiness

Intervention Specificity

Positive impact on child well-being outcomes

Absence of any negative effects

One randomized controlled trial OR two quasi-experimental trials without design flaws

Population of focus is clearly defined

Risk and protective factors that a program seeks to change are identifiable

Training materials are available

Information provided on the financial and human resources required

Cost-benefit analysis

Investing Smarter for Greater Returns

Margaret Flynn-Khan

21

• Achieving better outcomes from your investments

• Coordinating investments in shared priorities

• Reducing remedial spending by investing on front end

• Leveraging new public and private dollars to scale and

sustain programs and infrastructure

Investing Smarter for Greater Returns

22

How Do You Invest Smarter for Greater Returns?

$54,890,000 annual spending for children and families in one

community

Program Total Investment(per year)

Incredible Years BASIC

$127,386

Promoting Alternative Thinking Strategies

$50,773(for 3 years)

Life Skills Training $14,280

Functional Family Therapy (FFT)

$287,100

Nurse Family Partnership (NFP)

$103,631(for 2 years)

Total shift in spending $583,170

Redirect 1 percent to proven programs

23

Developing a Strategic Financing Plan

What are your financing goals?

What resources do you have?

What financial resources do you

need?

What financing strategies will you

implement?

What financing structures will you

implement?

Support for Strategic Financing in Evidence2Success

• Connection with national technical assistance consultants – Act as coach to the finance lead – Support the development of the fund map and strategic

financing plan• Access to online strategic financing toolkit • Participation in a peer technical assistance network

– In-person training– Ongoing information sharing and opportunities to connect

with peers

25

Evidence2Success in ProvidenceRebecca Boxx

26

• Providence Children and Youth Cabinet serves as the convener of cross-sector and cross-system efforts in the city

• Early exploration of the Evidence2Success framework identified clear synergy with existing city priorities:

– Use strong data on well-being of children and youth

– Deploy resources more effectively for children and youth

– Implement the highest quality programs

– Collaborate across sectors and systems

• Public system executives provide ongoing leadership: education, child welfare, public health

Evidence2Success and Providence

27

Priority Outcomes for Providence Youth

28

• Outcomes chosen through community-driven process

• Six proven programs selected

Providence Progress to Date

• Finance plan: Public system dollars and Health Equity Zone grant

• Implementation underway, serving more than 2,000 children 29

How does a program earn the distinction of being proven?

Develop a strong

program design

Attain strong evidence of

positive program outcomes

• Carry out evaluation with a comparison group

• Conduct regression analysis (quasi-experimental design )

• Perform multiple pre-and post -evaluations

• Meta-analysis

Produce indicators

of positive

outcomes

• Conduct evaluation with random assignment (experimental design)

• Carry out multiple evaluations with strong comparison group (quasi-experimental design)

• Conduct pre- and post-intervention evaluation

• Evaluate program quality and process

• Establish continuous improvement system

Ensure fidelity of

Implement-ation

Obtain evidence of

positive program

outcomes

• Create logic model and replication materials

30

Projected Program Targets:First Year of Implementation in One Site

Program How Much? How Well? What difference will it make?

Incredible Years 503children

$107,572 Redirected 15% increase in social competence

Cognitive Behavioral Intervention for Trauma in Schools (CBITS)

40 children $ 32,825Redirected

10% decrease in depression

Positive Action 2,141 children $ 96,044Redirected

15% decrease in problem behavior

31

Please use the Q&A function on your screen tosubmit questions.

For additional information after the webinar: Mildred Johnson, mjohnson@aecf.org

Proposal due date: May 28, 2015

For supplemental materials and more information about Evidence2Success: www.aecf.org

Questions?

32