NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale...

86
NCIC‐TP Project (2018, March) 1

Transcript of NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale...

Page 1: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 1

Page 2: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 2

Page 3: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 3

Page 4: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 4

Page 5: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 5

Page 6: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Aldridge, W. A., II, Boothroyd, R. I., Veazey, C. A., Powell, B. J., Murray, D. W., & Prinz, R. J. (2016, December). Ensuring Active Implementation Support for North Carolina Counties Scaling the Triple P System of Interventions. Chapel Hill, NC: Frank Porter Graham Child Development Institute, University of North Carolina at Chapel Hill. 

NCIC‐TP Project  (2018, March) 6

Page 7: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Aldridge, W. A., II, Boothroyd, R. I., Veazey, C. A., Powell, B. J., Murray, D. W., & Prinz, R. J. (2016, December). Ensuring Active Implementation Support for North Carolina Counties Scaling the Triple P System of Interventions. Chapel Hill, NC: Frank Porter Graham Child Development Institute, University of North Carolina at Chapel Hill.

Chinman M, Acosta J, Ebener P, Malone PS, Slaughter ME. Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of Getting To Outcomes®. Implementation Science. 2016;11(1):78.

Co-CreationMetz & Albers (2014) What does it take? How federal initiatives can support the implementation of evidence-based programs to improve outcomes for adolescents. Journal of Adolescent Health, 54, 592-596.

Metz A. Implementation brief: The potential of co-creation in implementation science. Chapel Hill, NC: National Implementation Research Network, Frank Porter Graham Child Development Institute, University of North Carolina at Chapel Hill;2015.

Local Implementation Capacity & PerformanceChinman M, Acosta J, Ebener P, Malone PS, Slaughter ME. Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of Getting To Outcomes®. Implementation Science. 2016;11(1):78.

Aldridge, W. A., II, Boothroyd, R. I., Fleming, W. O., Lofts Jarboe, K., Morrow, J., Ritchie, G. F., & Sebian, J. (2016). Transforming community prevention systems for sustained impact: Embedding active implementation and scaling functions. Translational Behavioral Medicine, 6, 135-144. doi:10.1007/s13142-015-0351-y

NCIC‐TP Project  (2018, March) 7

Page 8: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Metz, A., & Bartley, L. (2012). Active Implementation Frameworks for Program Success. Zero to Three, 32, 11-18.

Hawkins, J. D., Catalano, R. F., & Arthur, M. W. (2002). Promoting science-based prevention in communities. Addictive Behaviors, 27, 951-976.

Spoth, R., Greenberg, M., Bierman, K., & Redmond, C. (2004). PROSPER community–university partnership model for public education systems: Capacity-building for evidence-based, competence-building prevention. Prevention Science, 5(1), 31-39.

Triple P System OptimizationProctor E, Silmere H, Raghavan R, et al. Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda. Administration and Policy in Mental Health and Mental Health Services Research. 2011;38(2):65-76.

Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review. 1998;18(1):23-45.

Mihalic S. The importance of implementation fidelity. Emotional and Behavioral Disorders in Youth. 2004;4:83 - 105.

Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implementation Science : IS, 8, 1-11, doi:10.1186/1748-5908-8-117.

NCIC‐TP Project  (2018, March) 7

Page 9: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 8

Page 10: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 9

Page 11: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 10

Page 12: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 11

Page 13: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 12

Page 14: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC‐TP Project  (2018, March) 13

Page 15: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Developing Capacity to Successfully Scale Triple P:

The NCIC-TP Project

NCIC-TP Support for

Wake County Triple P CoalitionRenée Boothroyd, LaTanya Moore, Robin Jenkins, & William Aldridge,

The Impact Center at FPG Child Development Institute, UNC - Chapel Hill

Ashley Lindsay & Dr. Audrey Bunch, Wake County Triple P, Project Enlightenment,

Wake County Public School System, Office of Early Learning

Mary Haskett, Wake County Triple P, North Carolina State University

Page 16: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Session Overview

Framed by the implementation capacity theory of change,

• Anchor implementation support activities in core capacity and performance goals

• Introduce a set of stage-based core components that describe implementation support roles

• Illustrate concrete implementation support processes and activities with the Wake County Triple P Project

• Demonstrate early progress in implementation capacities being developed with the Wake County Triple P Project

2

Page 17: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

NCIC-TP’s Integrated Theory of Change for the supporting

the implementation and scale-up of the Triple P system of

interventions

(Aldridge, Boothroyd, Veazey, Powell, Murray, & Prinz, 2016)

Triple P System

Optimization

Population-level

Child & Family

Outcomes

Co-Creation

Partner Support

Sustainment

Primary Goals of Direct Implementation Support

Page 18: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Integrated Theory of Change for Successful, Sustainable Implementation & Scale UpIntegrated Theory of Change for Successful, Sustainable Implementation & Scale UpIntegrated Theory of Change for Successful, Sustainable Implementation & Scale UpIntegrated Theory of Change for Successful, Sustainable Implementation & Scale Up

Page 19: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

External

Implementation

Support

(Aldridge, Brown, Bumbarger, & Boothroyd, under review)

1.

2.

3.

4.

5.

6.

8.

7.

9.

10.

Page 20: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Wake County Triple P Project

6

Project Enlightenment, part of the Wake County Public School System (WCPSS), serves as the lead agency for the coalition, consisting of approximately 25 community service agencies delivering variants of the Triple P system to community parents and families.

Page 21: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

External

Implementation

Support

(Aldridge, Brown, Bumbarger, & Boothroyd, under review)

1.

2.

3.

Page 22: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

IIIIMPLEMENTATIONMPLEMENTATIONMPLEMENTATIONMPLEMENTATION SSSSUPPORTUPPORTUPPORTUPPORT CCCCOREOREOREORE CCCCOMPONENTSOMPONENTSOMPONENTSOMPONENTS

• Build collaborative relationships

• Assess community wellbeing

goals & current implementation

processes

• Facilitate collaborative

agreements about

implementation improvement

goals, strategies, & early wins

8

(Aldridge, Brown, Bumbarger, & Boothroyd, under review)

Readiness & Exploration(Exploration Stage)

IIIIMPLEMENTATIONMPLEMENTATIONMPLEMENTATIONMPLEMENTATION SSSSUPPORTUPPORTUPPORTUPPORT PPPPROCESSESROCESSESROCESSESROCESSES & A& A& A& ACTIVITIESCTIVITIESCTIVITIESCTIVITIES (E(E(E(EXXXX.).).).)

• Food, conversation, personal check-ins (clarify roles, relationships, group agreements, hopes,

concerns)

• Share/review local, relevant materials

• Semi-structured interviews

• Community & Agency-level Capacity

Assessments

• Collaborative Strategic Planning

1.

2.

3.

Page 23: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

9

Page 24: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Implementation

Capacity: Core

Area

PRIORITY GOALS (illustrative) STRATEGIES (examples)

Co-Creation

Partners

Greater agencies’ ownership of collaborative

process

Redesign coalition & committee structure to

ensure community ownership

Quality & Outcome

Monitoring System

Infuse monitoring and evaluation, grounded

in a theory of change, throughout coalition

and agencies to ensure shared accountability

Anchor local evaluation questions across

funders in NCIC-TP Logic Model. Roll out using

improvement cycles (e.g., PDSAs)

Leadership &

Implementation

Teams

Formalize a Community/Coalition

Implementation Team with

dedicated time, effort, resources

AND Re-establish a set of engaged

and effective community service

agencies with identified leadership

and implementation team structures

Move to a formal Community Coalition

structure that integrates implementation

best practices and collective impact

AND

Move to quarterly coalition meetings with

the new design and leadership team structure

10

Collective, Shared Learning:

GOALS, STRATEGIES, EARLY WINS3.

Page 25: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

External

Implementation

Support

(Aldridge, Brown, Bumbarger, & Boothroyd, under review)

4.

5.

Page 26: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

12

Raleigh/Wake Triple P Coalition Leadership TeamService Agency Executive Leaders & Implementation CoordinatorsService Agency Executive Leaders & Implementation CoordinatorsService Agency Executive Leaders & Implementation CoordinatorsService Agency Executive Leaders & Implementation Coordinators

Coalition Implementation TeamCoordinator, Evaluator, Triple P Parent Educators (2)Coordinator, Evaluator, Triple P Parent Educators (2)Coordinator, Evaluator, Triple P Parent Educators (2)Coordinator, Evaluator, Triple P Parent Educators (2)

Community Connections CommitteeKey Parents/Families, Community Leaders, Funders, & PolicymakersKey Parents/Families, Community Leaders, Funders, & PolicymakersKey Parents/Families, Community Leaders, Funders, & PolicymakersKey Parents/Families, Community Leaders, Funders, & Policymakers

Learning Committee Including Including Including Including

Parents/FamiliesParents/FamiliesParents/FamiliesParents/Families

Media & Networking Committee including. including. including. including.

Parents/FamiliesParents/FamiliesParents/FamiliesParents/Families

Fe

ed

ba

ck

As Needed As Needed

Su

pp

ort

Focus of

Implementation

Support

Page 27: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Capacity Development(Installation Stage)

IIIIMPLEMENTATIONMPLEMENTATIONMPLEMENTATIONMPLEMENTATION SSSSUPPORTUPPORTUPPORTUPPORT CCCCOREOREOREORE CCCCOMPONENTSOMPONENTSOMPONENTSOMPONENTS

• Provide adult learning for local

leaders and teams (implementation

science and best practices)

• Facilitate local implementation

capacity development (using PDSA

techniques as appropriate)

13

(Aldridge, Brown, Bumbarger, & Boothroyd, under review)

IIIIMPLEMENTATIONMPLEMENTATIONMPLEMENTATIONMPLEMENTATION SSSSUPPORTUPPORTUPPORTUPPORT PPPPROCESSESROCESSESROCESSESROCESSES & A& A& A& ACTIVITIESCTIVITIESCTIVITIESCTIVITIES (E(E(E(EXXXX.).).).)

• Professional development (i.e., orientation of

community and agency teams to leadership and

management functions for implementation and multi-level

structures for activating them)

• Utilized tools to operationalize coalition- and

agency-level data about leadership and

implementation teams

• Supported Local Coalition Coordinator to

PDSA agency team development process

4.

5.

Page 28: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Developing Implementation Capacities: Early Progress

14

Jan., 2017, Aug 2017, Feb 2018

Page 29: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Ongoing Learning

• Join subject-matter and contextual expertise to co-design and address priorities in core areas of implementation infrastructure and best practices to support use of Triple P

• Implementation support activities get traction when they are clearly integrated with local change agents and activities.

• The utility and ongoing improvement of implementation support will depend on tracking and using data to understand and optimize it (e.g., dosage, reach, engagement, relevance, quality, feasibility)

15

Page 30: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Members of The Impact Center at

FPG

Thank You & DisclosureThank You & DisclosureThank You & DisclosureThank You & Disclosure

Special Thanks to:

16

Will Aldridge

LaTanya Moore

Rebecca Roppolo

Wendy Morgan

Jenna Barnes

Kimberly Ruck

Jennifer Robinette

Renée Boothroyd

Robin Jenkins

Jessica Reed

Simon Pipkin

Julie Chin

Ximena Franco

16

DisclosureDisclosureDisclosureDisclosure: Will Aldridge’s costs to participate in the Helping Families Change Conference were supported, in part, by

the University of Queensland. This support has been disclosed to UNC-Chapel Hill.

Page 31: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Measuring External Implementation Support

Development of a System for Quality and Outcome Monitoring

Rebecca H. Roppolo

William A. Aldridge II

Renée I. Boothroyd

The Impact Center, FPG Child Development Institute, University of North Carolina at Chapel Hill

Page 32: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Outline

• What does NCIC-TP do?• Re-Orient to Core Components

• Schematic connecting Core Components to Outcomes

• How do you measure that?• Indicators

• Data Collection

• Data Visualization for NCIC-TP QI Practices

2

Page 33: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

(Aldridge, Boothroyd, Veazey, Powell, Murray, & Prinz, 2016)

Integrated Theory of Change for Successful, Sustainable Implementation & Scale Up

3

External Implementation

Support

Page 34: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Core ComponentsHow do we operationalize external implementation support?

…what’s in that grey arrow?

4

Page 35: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

External Implementation

Support

(Aldridge, Brown, Bumbarger, & Boothroyd, under review)

5

Sustainment

Page 36: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Support SchematicHow does this lead to improved local implementation capacity and performance?

…why do you think that will work?

6

Page 37: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

7

Build collaborative relationships

Facilitate experiential and inhibitory learning opportunities

Facilitate collaborative agreements about implementation improvement goals, strategies, & early wins

Provide adult learning for local leaders and teams

Greater knowledge and skills among local leaders and teams

Facilitate local implementation capacity development

Greater self-regulation by leaders and teams

Sustained, independentimplementation performance

Greater implementation capacity of system

Facilitate collective learning and adaptive problem solving

Provide supportive behavioral coaching for leaders and teams

Reinforce local-regulation of implementation processes

Transition the implementation support role

Assess community wellbeing goals & current implementation processes

Stronger working alliance between local leaders and teams with external support

Readiness & Exploration

Capacity Development

Supported Performance

Local System Regulation

Page 38: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Quality and Outcome Monitoring System

Now that we’re clear about what we’re trying to accomplish…

…how does that help you get better?

8

Page 39: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

How does this work?

9

Page 40: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

1. Exploration Discussion Guide

2. Goals, Strategies, Early Wins document

3. Transition Strategy

1. Brief Alliance Inventory

2. Implementation Support Collaboration

3. Contact with External Providers of Support

4. Knowledge [to be developed]

5. Skills [to be developed]

6. Confidence and competence across implementation capacity domains

7. Community Capacity Assessment

8. Implementation Drivers Assessments

Process Output MeasuresSupport Outcome Measures

What are we measuring?

10

Page 41: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Characterized by Proctor et al. (2011) “Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda”

Provide a diversity of indicators to measure external implementation support performance and inform quality improvement efforts.

Implementation/Process Outcomes

1. Reach2. Engagement3. Dose4. Adherence5. Quality6. Accessibility7. Acceptability8. Appropriateness9. Feasibility10. Adoption11. Sustainability

Theoretical Rationale

What else are we measuring?

Fidelity

11

Page 42: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Technical Assistance EvaluationsAfter each scheduled or responsive call, meeting, or email

Site-Visit EvaluationsAfter every in-person visit to site

Quarterly EvaluationsAfter every three months

• Format of Support• Invited Participants

• Reach• Engagement

• Dose• By Core Components• By Site Goals

• Core Component Adherence

• Collaborative Relationship• Self-Regulation of Implementation

Processes• Contextual Factors

• Implementation Outcomes• Acceptability• Appropriateness• Quality• Likelihood of Use

• Collaborative Relationship• Self-Regulation of Implementation

Processes• Contextual Factors• Implementation Outcomes

• Institutionalization• Accessibility• Actual Use

Where does the data come from?

12

Page 43: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Improving NCIC-TP Implementation Support

Quarterly Action Planning Data Dashboards

…so what?

13

Page 44: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Technical Assistance

Events

Reach & Engagement

Frequency of Contact

Cumulative dose of Core

Components by month

Dose by Core Component each month

Visual of quarter’s

support by Core Component

14

Page 45: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Dose of Capacity Development

and Supported Performance per

Goal

Breakdown by Goals, this

quarter vs. YTD

Cumulative dose by Goal each

month

15

Page 46: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

TA Tracker2-3 per month

Site Survey1 in November

Quarterly2 total

Reach

Engagement

Quality

Feasibility

Appropriateness

Acceptability

Use: Likelihood

Use: Reported

Accessibility

Sustainability

16

Page 47: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Local Regulation of Implementation – confidence and

competenceImplementation

Support Collaboration

Co-creation partners,

leadership & teams, quality &

outcome monitoring

Brief Alliance Inventory

Workforce development, and

media & networking

17

Page 48: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

18

Build collaborative relationships

Facilitate experiential and inhibitory learning opportunities

Facilitate collaborative agreements about implementation improvement goals, strategies, & early wins

Provide adult learning for local leaders and teams

Greater knowledge and skills among local leaders and teams

Facilitate local implementation capacity development

Greater self-regulation by leaders and teams

Sustained, independent implementation performance

Greater implementation capacity of system

Facilitate collective learning and adaptive problem solving

Provide supportive behavioral coaching for leaders and teams

Reinforce local-regulation of implementation processes

Transition the implementation support role

Assess community wellbeing goals & current implementation processes

Stronger working alliance between local leaders and teams with external support

Page 49: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Thank you!

[email protected] Child Development Institute

University of North Carolina – Chapel Hill

Helping Families Change Conference 2018

Santa Rosa, California

Page 50: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Members of The Impact Center at

FPG

Thank You & Disclosure

Special Thanks to:

20

Will AldridgeLaTanya Moore

Rebecca RoppoloWendy MorganJenna BarnesKimberly Ruck

Jennifer Robinette

Renée BoothroydRobin JenkinsJessica ReedSimon Pipkin

Julie ChinXimena Franco

20

Disclosure: Will Aldridge’s costs to participate in the Helping Families Change Conference were supported, in part, by the University of Queensland. This support has been disclosed to UNC-Chapel Hill.

Page 51: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

The Impact Center at FPG Child Development Institute,

University of North Carolina at Chapel Hill

Julie ChinWendy Morgan

William A. Aldridge IIRenée I. Boothroyd

Robin JenkensLaTanya Moore

Rebecca H. Roppolo

NCIC Online Products to Increase Learner Knowledge and Skills Toward

Building Capacity for Triple P Implementation

Page 52: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

2

Learning Approaches

Online Products & Tools

Build Knowledge, Skills,

Performance

Page 53: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

3

Page 54: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Learning & Development Team

Julie ChinEducation Technology Specialist

Wendy Morgan, PhDLearning and Development Strategist

Page 55: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

5

Page 56: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Universal Design for Learning

Targeted Learning

Blended Learning Approaches

Learning Approaches

Learner Data Collection

Page 57: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Image From National Center on Universal Design for Learning

Learning Approaches

Page 58: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

8

Targeted Learning ApproachLearning Approaches

Page 59: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

9

Blended Learning Approach

BLENDEDLEARNING

Online Learning

In person

ON SITE

Learning Approaches

Page 60: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Learner Engagement

10

65% Of people are visual learners

90% Of the information transmitted to the brain is visual

We learn and remember best through pictures.

From “Brain Rules” by Molecular Biologist John Medina

Vision is our most dominant sense.

Learning Approaches

Page 61: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

11

Page 62: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Check out more examples!

http://ncic.fpg.unc.edu

/lessons-learned

12

Online Products & Tools

Page 63: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Online Products & ToolsModule One Community Readiness for Scaling Up Triple P

13

Identify necessary co-creation partners

Sequence tasks toward building a coalition

Identify level of fit with Triple P

Build Knowledge, Skills, Performance

Page 64: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

14

Construct a summary speech

Online Products & ToolsModule One Community Readiness for Scaling Up Triple P

Build Knowledge, Skills, Performance

Page 65: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

15

Gain buy-in from partners during a simulated group discussion

Online Products & ToolsModule One Community Readiness for Scaling Up Triple P

Page 66: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Learner Data Collection

16

Who’s taking the course?

Personalized Feedback & Reports

Build Knowledge, Skills, Performance

Performance Data Outcomes

Page 67: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

17

Identify most “ready” agencies, evaluators, funders, and community members to partner in scale-up efforts, based on the following criteria:

Learning ObjectivesAgency: willingness, ability, fit

Evaluators: affordability, alignment

Funders: ability, stability, fit

Community members: demonstrated commitment, collaborative nature, connections

Online Products & ToolsModule Two Recruiting and Selecting Initial Coalition Members

Page 68: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

18

Page 69: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Learner Data Collection

19

Who’s taking the course?

Personalized Feedback & Reports

Build Knowledge, Skills, Performance

Performance Data Outcomes

Page 70: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Future Modules

20

Module 3 Leadership & Implementation Teams

Module 4Implementation Drivers Assessment

Module 5Quality & Outcome Monitoring

Future Needs:CoachingFidelity AssessmentPolicy

Page 71: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Next Steps

21

Provide larger, integrated strategies

Identify goals of all products and processes

Identify ways of evaluating products and processes that will direct new versions, indicate successes & ROI

Fold new counties, EBPS, into the overall strategy

Learning Approaches and Strategies

Online Products and Tools

Build Knowledge, Skills, Performance

Page 72: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Welcome Feedback

22

http://ncic.fpg.unc.

edu/node/22

Page 73: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Robin JenkinsThe Impact Center at FPG Child Development Institute, UNC-Chapel Hill

Sharon Hirsch, President/CEOPrevent Child Abuse NC

Karla Buitrago, Prevention DirectorPrevent Child Abuse NC

William A. Aldridge IIThe Impact Center at FPG Child Development Institute, UNC-Chapel Hill

Helping Families Change Conference, March 1st, 2018

Increasing Intermediary Supports for Triple P in NC

Page 74: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Workforce Development

Proactive & Responsive

Implementation Support

Partnership Engagement &

Communication

Policy & Finance Support

Research, Evaluation, & Data-Linking

Capacity

2

An intermediary organization is defined as a statewide center or partnership that supports

state and local child‐ and family‐serving agencies in designing, implementing, and sustaining evidence‐based programs like

Triple P (Mettrick et al., 2015).

Page 75: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

3

Workforce Development

Proactive & Responsive

Implementation Support

Partnership Engagement &

Communication

Policy & Finance Support

Research, Evaluation, & Data-Linking

Capacity

Proactive & Responsive Implementation

Support

Helping to ensure multi-level capacity and performance to scale Triple P with success and

sustainability.

Often involves helping to ensure:• Leadership and team structures for implementation• Workforce development infrastructure• Quality and outcome monitoring systems for

improvement• Media and networking capacity to expand beyond

direct services

Proactive & Responsive Implementation Support focuses on building organization and leadership

capacity in support of additional functions

Page 76: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

4

Workforce Development

Proactive & Responsive

Implementation Support

Partnership Engagement &

Communication

Policy & Finance Support

Research, Evaluation, & Data-Linking

Capacity

Partnership Engagement &

Communication

Helping to ensure that the right co-creation partners are at the table to support a

hospitable context to achieve Triple P goals.

Helping to ensure widespread and consistent messaging about positive parenting and

collaborative accomplishments.

Often involves helping to ensure:• Cross-agency involvement and statewide support

partners• Co-creation process at community levels• Consistent messaging for shared values, principles,

and strategies• Tailored communications for state and local contexts

Page 77: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

5

Workforce Development

Proactive & Responsive

Implementation Support

Partnership Engagement &

Communication

Policy & Finance Support

Research, Evaluation, & Data-Linking

Capacity

Policy & Finance Support

Helping to ensure hospitable policy and financial environments for Triple P and supporting partners to navigate them

with confidence.

Often involves helping to ensure:• Clear state and local policies that are

aligned with:• Triple P programming• Community implementation and

scaling needs• Local and statewide partners are confident

navigating policy and finance to optimize Triple P sustainability

Page 78: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

6

Workforce Development

Proactive & Responsive

Implementation Support

Partnership Engagement &

Communication

Policy & Finance Support

Research, Evaluation, & Data-Linking

Research, Evaluation, & Data

Linking

Helping to ensure the improvement of state and local Triple P efforts

through data monitoring, benchmark evaluation, and connecting research

to practice.

Often involves helping to ensure:• Comprehensive evaluation design• Systematic data collection, analysis, and

reporting• The use of research and data for

continuous quality improvement at all levels

Page 79: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

7

Workforce Development

Proactive & Responsive

Implementation Support

Partnership Engagement &

Communication

Policy & Finance Support

Research, Evaluation, & Data-Linking

Capacity

Workforce Development

Helping to ensure that practitioners can competently and confidently deliver Triple

P as intended and in ways that are responsive to parent needs and

preferences.

Often involves helping to ensure:• Triple P is usable within practitioners’

local contexts• The right practitioners are selected to

deliver Triple P• Triple P training is accessible• Consistent, high quality coaching support

after Triple P accreditation

Page 80: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Multi-Level Model of Implementation

Support in NC’s Triple P System

Practitioners' Responsive & Effective

Delivery of Triple P

NC Triple P State Learning Collaborative

Parent and Family Wellbeing &

Self-Regulation

Sup

po

rt

Feed

back

Feed

back

Feed

back

Sup

po

rt

Sup

po

rt

Triple P America

PCANC

FPG NCIC-TP

Page 81: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Why PCANC?

9

Knowledge about EBPs

and underlying theoriesStatewide presence Fit with mission and vision

Credible and connected

organization

Experience and effective in:

▪ Implementation

strategies

▪ Facilitation

▪ Data

▪ Partner engagement

and communication

Neutral and honest

convener and broker

Page 82: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Moving from Readiness & Exploration to Capacity Building

10

Readiness

Spring 2016-April 2017

Exploration

(Jun–Sept 2017)

Capacity

Development

(Oct 2017-TBD)

Service Delivery

(TBD-ongoing)

Spring 2016: Project partners

considered possible IOs

Summer 2016:FPG & PCANC

conducted three calls and onsite meeting

Fall 2016:Partners assessed readiness of PCANC

March 2017:Roles and

expectations Memorandum of Agreement between FPG and PCANC

signedJune 2017:

Initial exploration meetings between FPG and PCANC

held

July/August 2017:

Continued exploration meetings

between FPG and PCANC

held

Sept 2017:Collaborative

Strategic Planning Retreat

between FPG and PCANC

held Oct 2017 -present:

Internal org change processes based

on PCANC leadership, action plans aligned with

IO functionality and IOCA results

Aug/Sept 2017:

Internal org design

meetings for PCANC

leadership team held

Stage-based approach with PCANC as intermediary support partner

Page 83: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

11

Triple P

Intermediary Org Function

IOCA Score

(baseline)

Level of

Accountability

Current/Recommended Future

Primary Accountability

Proactive and Responsive

Implementation Support8% FPG

Research, Evaluation,

and Data Linking7% DPH and/or TBD

Partnership Engagement

and Communication38%

Triple P Cross-Agency State Leadership Team and PCANC

Workforce Development 31% PCANC

Policy and Finance 42% PCANC

Primary Accountability Support/Alignment AccountabilityShared Accountability

Page 84: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

12

One excerpt of PCANC’s Action Plan

Page 85: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Looking Ahead• FPG to provide ongoing capacity building to PCANC using the core practice components for NCIC-

TP support, with focus on Policy and Finance; Workforce Development; Partnerships, Engagement and Communication functions

• PCANC to scale-up WFD in March 2018; have TPA training in March 2018; P & F, and PEC activities scaled over the next 2+ years (capacity growth measured with IOCA and other process evaluation tools)

• FPG’s NCIC-TP team will provide Proactive & Responsive Implementation Support to PCANC and selected sites (collaboratively chosen with PCANC, funding partners, SLT). One goal is to embed implementation science and best practices across the entire PCANC organization

• FPG and PCANC will continue multi-level implementation support for:

• statewide Triple P policy, leadership and design activities as required

• statewide Triple P learning collaborative

• local Triple P coalition capacity building

• other partnerships as identified & appropriate for Triple P scale-up and community-wide population impacts

13

Page 86: NCIC‐TP Project (2018, March) 1 · 2018-05-17 · Developing Capacity to Successfully Scale Triple P: The NCIC-TP Project NCIC-TP Support for Wake County Triple P Coalition Renée

Members of The Impact Center at

FPG

Thank You & Disclosure

Special Thanks to:

19

Will AldridgeLaTanya Moore

Rebecca RoppoloWendy MorganJenna BarnesKimberly Ruck

Jennifer Robinette

Renée BoothroydRobin JenkinsJessica ReedSimon Pipkin

Julie ChinXimena Franco

19

Disclosure: Will Aldridge’s costs to participate in the Helping Families Change Conference were supported, in part, by the University of Queensland. This support has been disclosed to UNC-Chapel Hill.