Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation...
-
Upload
dwight-jensen -
Category
Documents
-
view
213 -
download
0
Transcript of Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation...
![Page 1: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/1.jpg)
Barbara SimsDean FixsenKaren BlaseCaryn Ward
National SISEP CenterNational Implementation Research Network
FPG Child Development CenterUniversity of North Carolina at Chapel Hill
Lake Geneva WI
October 2014
Building Implementation Capacity Innovation and
Implementation Conference II
![Page 2: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/2.jpg)
EBPs
Students cannot benefit from interventions they do not receive.
![Page 3: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/3.jpg)
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
![Page 4: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/4.jpg)
WHYEducationally
Significant Outcomes
WHATEffective
Innovations
WHEREEnabling Contexts
Formula for Success
Students cannot benefit from
instruction they do not
experience
![Page 5: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/5.jpg)
Active Implementation Frameworks
WHO
Teams
WHEN
Stages
HOW
Drivers
HOW
Cycles
WHAT
UsableInterventions
![Page 6: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/6.jpg)
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
![Page 7: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/7.jpg)
USABLE INTERVENTIONS
An intervention needs to be teachable, learnable, doable, and be readily assessed in practice.
UsableInterventions
![Page 8: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/8.jpg)
Usable Interventions
Operational Definitions
ClearDescription
FidelityAssessment
EssentialFunctions
![Page 9: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/9.jpg)
Implications for Sustainability and Scalability
We tend to over-estimate how well defined “it” is We find out when we start to Install
“it”
Help Schools and Districts choose wisely based on: Needs of students Best evidence Fit and Resources Required Readiness and resources for
replication
Usable Interventions
![Page 10: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/10.jpg)
Implications for Sustainability and Scalability
Help Schools and Districts “operationalize” the WHAT Practice Profiles
Help Schools and Districts “make space” for the new work Supportive policies and practices
Usable Interventions
![Page 11: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/11.jpg)
Usable InterventionsTools You Can UseHexagon Tool Practice Profiles
UsableInterventions
![Page 12: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/12.jpg)
![Page 13: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/13.jpg)
Try It Now! Usable Interventions
Select 3-5 Indicators
Consider the following factors:What will it look like if this indicator is being implemented with fidelity?What is an acceptable variation of this in early stages of implementation?Identify any red flags that indicate unacceptable variations
SupportingNew Ways of Work
![Page 14: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/14.jpg)
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
![Page 15: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/15.jpg)
IMPLEMENTATION TEAMS
Organized, expert assistance to develop and sustain an accountable and effective structure
![Page 16: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/16.jpg)
Implementation TeamNo Implementation Team
80%3 Years
14%17
Years
To “Making it Happen”From “Letting it Happen”
Sources: Fixsen, Blase, Timbers, & Wolf, 2001Balas & Boren, 2000 Green & Seifert, 2005Saldana & Chamberlain, 2012
Improvement inIntervention Outcomes
![Page 17: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/17.jpg)
Implications for Sustainability and Scalability
Teaming Structure Accountable Implementation Science informed Lasting – Key to Sustainability Linked – Key to Scalability
Why Individual champions come and go Structures host functions Intentional use of data,
improvement cycles
Implementation Teams
![Page 18: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/18.jpg)
WHY: Socially
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
![Page 19: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/19.jpg)
IMPLEMENTATION STAGES
Purposeful matching of critical implementation activities to the stage of the process
![Page 20: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/20.jpg)
Implementation Stages
Exploration Installation Initial Implementation
FullImplementation
2-4 Years
• Assess needs• Examine
intervention components
• Consider Implementation Drivers
• Assess Fit• Build
sustainability
• Acquire Resources
• Prepare Organization
• Prepare Implementation Drivers
• Prepare Staff• Build
sustainability
• AdjustImplementation Drivers
• Manage Change• Deploy Data
Systems• Initiate
Improvement Cycles
• Build sustainability
• Monitor & Manage Implementation Drivers
• Achieve Fidelity & Outcome Benchmarks
• Further Improve Fidelity & Outcomes
• Sustainability
![Page 21: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/21.jpg)
Implementation StagesTools You Can UseDistrict Initiative Inventory Stages of Implementation AnalysisImplementation Action Plan
![Page 22: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/22.jpg)
District Initiative Inventory
![Page 23: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/23.jpg)
The HexagonAn EBP Exploration Tool
NEED
FIT
RESOURCES
EVIDENCE
CAPACITY
READINESS
Fit with current Initiatives• School, district , state priorities• Organizational structures
Community values
Need in school, district, state• Academic & socially significant Issues• Parent & community perceptions of need• Data indicating need
Resources and supports for:• Curricula & Classroom• Technology supports (IT dept.)• Staffing• Training• Data Systems• Coaching & Supervision• Administration & system
Evidence• Outcomes – Is it worth it?• Fidelity data• Cost – effectiveness data• Number of studies• Population similarities• Diverse cultural groups• Efficacy or Effectiveness
Capacity to Implement• Staff meet minimum qualifications• Able to sustain Imp Drivers
• Financially • Structurally
• Buy-in process operationalized• Practitioners • Families
Readiness for Replication• Qualified purveyor• Expert or TA available• Mature sites to observe• Several replications• How well is it operationalized?• Are Imp Drivers operationalized?
The “Hexagon” can be used as a planning tool to evaluate evidence-based programs and practices during the Exploration Stage of Implementation.
Download available at:www.scalingup.org/tools-and-resources
EBP:
5 Point Rating Scale:High = 5; Medium = 3; Low = 1.Midpoints can be used and scored as a 2 or 4.
High Med Low
Need
Fit
Resource Availability
Evidence
Readiness for Replication
Capacity to Implement
Total Score
© 2009 Karen Blase, Laurel Kiser, & Melissa Van Dyke Adapted from work by Laurel J. Kiser, Michelle Zabel, Albert A. Zachik, and Joan Smith at the University of Maryland
![Page 24: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/24.jpg)
![Page 25: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/25.jpg)
Try It Now! Implementation Stages
Early Implementers: use the Hexagon Tool to assess potential program under consideration
Ongoing Implementation: Use the Stages of Implementation Analysis tool to identify gaps and next steps in your implementation
SupportingNew Ways of Work
![Page 26: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/26.jpg)
IMPROVEMENT CYCLES
Changing on purpose to support the new way of work
![Page 27: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/27.jpg)
Rapid Cycle Problem Solving
Improvement Cycles
Plan
DoStudy
Act
![Page 28: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/28.jpg)
Usability TestingImprovement Cycles
Plan
DoStudy
Act Plan
DoStudy
Act Plan
DoStudy
Act
![Page 29: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/29.jpg)
Implementation Team
DistrictManagement
Team
TeachersInnovations
Students
Su
stai
nab
ilit
y
Pra
ctic
e In
form
s P
olic
yP
olic
y E
na
ble
s
Pra
ctice
Practice-Policy Communication Cycle
![Page 30: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/30.jpg)
IMPLEMENTATION DRIVERS
Common features of successful supports to help make full and effective use of a wide
variety of innovations
![Page 31: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/31.jpg)
Fidelity Assessment
Coaching
Training
Technical
Systems Intervention
Facilitative Administration
Decision Support Data System
Com
pete
ncy
Driv
ers
Com
pete
ncy
Driv
ers
Organization D
rivers
Organization D
rivers
Implementation Drivers
© Fixsen & Blase, 2008Leadership
Selection
Adaptive
![Page 32: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/32.jpg)
Competency Drivers
Develop, improve and sustain competent
and confident use of the innovation through
Careful selection of new and lead staff
Design and employ effective training
plans
Design and support coaching system
Routine use of fidelity assessment to
inform the process
Implementation Drivers
Com
pete
ncy
Driv
ers
![Page 33: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/33.jpg)
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
![Page 34: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/34.jpg)
Organization Drivers
Change Organizations and Systems
Create and sustain hospitable organizational and system environments for effective services
Develop functional data systems that can be used to inform decision-making
Implementation Drivers
Organization D
rivers
![Page 35: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/35.jpg)
Decision Support Data SystemsPurposes Monitor and improve student outcomes through
data-based decisions
Provide information to assess effectiveness of intervention and prevention practices
Analyze the relationship of fidelity to outcomes
Guide further program development Detect discrete issues as well as systemic issues
Engage in continuous quality improvement Of the Intervention and the Drivers
Celebrate success
Be accountable to parents, Board of Education taxpayers, and other funders
Implementation Drivers
Organization D
rivers
![Page 36: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/36.jpg)
Facilitative AdministrationPurposes
Driving change within your direct sphere of influence
Creates an internally hospitable environment for the new way of work – at the level of the “agency” (e.g. school, District)
Facilitates the installation, implementation, and improvement of the Drivers for each innovation
Looks for ways to make the direct work of practitioners (e.g. teachers, school staff) and administrators more effective and less “burdensome”!!
Implementation Drivers
Organization D
rivers
![Page 37: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/37.jpg)
Facilitative Administration Strategies
Schedule changes
Policy revision
Practice revision
Communication protocols
Change responsibilities
Revise priorities
Implementation Drivers
Organization D
rivers
![Page 38: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/38.jpg)
Systems InterventionPurposes Driving change outside your direct sphere of
influence
Identify and “lift up” systemic barriers and facilitators to the next level to improve support for the new way of work
Create an externally “hospitable” environment for the new way of work
Embed facilitators and strengths
Contribute to cumulative learning in multi-site projects
Implementation Drivers
Organization D
rivers
![Page 39: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/39.jpg)
Systems InterventionStrategies Communication protocols
Stakeholder groups
Community involvement
Public communication
Implementation Drivers
Organization D
rivers
![Page 40: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/40.jpg)
Performance Assessment(Fidelity)
Coaching
Training
Technical
Systems Intervention
Facilitative Administration
Decision Support Data System
Com
pete
ncy
Driv
ers
Com
pete
ncy
Driv
ers
Organization D
rivers
Organization D
rivers
Facilitative Administration
Enabling Context
© Fixsen & Blase, 2008Leadership
Selection
Adaptive
Integrated & Compensatory
![Page 41: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/41.jpg)
Implementation DriversTools You Can UseStrategic Analysis of Drivers Drivers Action PlanImplementation Drivers: Implementation Drivers:
Team Review & Planning Best Practices
![Page 42: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/42.jpg)
Implementation Drivers: Team Review & Planning
![Page 43: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/43.jpg)
Create a hospitable system with linked communication and problem-solving protocols to support the effective WHAT
Ensure that practice informs policy, and policy enables better practice
Operationalize success
Prevent the institutionalization of errors
Enabling Context Implications for Sustainability and Scalability
![Page 44: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/44.jpg)
Try It Now! Implementation Drivers
Competency Drivers Consider how the district is
attending to these indicators Consider how your vendors attend
to these indicators
Organization Drivers Identify strategies you will use to
support building staff in implementation of your program
SupportingNew Ways of Work
![Page 45: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/45.jpg)
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
![Page 47: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/47.jpg)
Get Connected!
www.scalingup.org
SISEP @SISEPcenter
For more on Implementation Sciencehttp://nirn.fpg.unc.edu
www.implementationconference.org
![Page 48: Barbara Sims Dean Fixsen Karen Blase Caryn Ward National SISEP Center National Implementation Research Network FPG Child Development Center University.](https://reader038.fdocuments.us/reader038/viewer/2022110205/56649c875503460f9493ecfc/html5/thumbnails/48.jpg)
©Copyright Dean Fixsen and Karen Blase
This content is licensed under Creative Commons license CC BY-NC-ND, Attribution-NonCommercial-NoDerivs. You are free to share, copy, distribute and transmit the work under the following conditions: Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work); Noncommercial — You may not use this work for commercial purposes; No Derivative Works — You may not alter or transform this work. Any of the above conditions can be waived if you get permission from the copyright holder.
http://creativecommons.org/licenses/by-nc-nd/3.0