The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 ›...
Transcript of The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 ›...
![Page 1: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/1.jpg)
Dean L. Fixsen, Karen A. Blase,
Michelle A. Duda, Sandra F. Naoom,
Melissa Van DykeNational Implementation Research Network
Frank Porter Graham Child Development Institute
University of North Carolina – Chapel Hill
NECTAC 2008
The Science and Practice of using Science in Practice
![Page 2: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/2.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
We want to:Reliably produce…
predictable outcomes for children, families, and communities…
that improve every year…
for the next 50 years.
![Page 3: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/3.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
A Big ProblemChildren and families cannot benefit from interventions they do not experience
![Page 4: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/4.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Lessons From:Direct experience with program development and national implementation
Review and synthesis of the implementation evaluation literature
Review of successful implementation practices
Evaluation of implementation efforts
![Page 5: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/5.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation ScienceExcellent experimental evidence for
what does not work
Diffusion/dissemination of information by itself does not lead to successful implementation (research literature, mailings, promulgation of practice guidelines)
Training alone, no matter how well done, does not lead to successful implementation
![Page 6: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/6.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation ScienceExcellent experimental evidence for
what does not work
Diffusion/dissemination of information by itself does not lead to successful implementation (research literature, mailings, promulgation of practice guidelines)
Training alone, no matter how well done, does not lead to successful implementation
These two “implementation
practices” have been in
common use for the past 5
decades.
![Page 7: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/7.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation ScienceExcellent evidence for what does
not work
Implementation by laws/ compliance by itself does not work
Implementation by “following themoney” by itself does not work
Implementation without changingsupporting roles and functions does not work Paul Nutt (2002). Why Decisions Fail
![Page 8: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/8.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation Science
Effective NOT Effective
Effective
NOT Effective
IMPLEMENTATION
INTE
RVE
NTI
ON Child & Family Benefits
Highly variable, often ineffective, sometimes harmful to children, families, and adults
(Institute of Medicine, 2000; 2001; New Freedom Commission on Mental Health, 2003; National Commission on Excellence in Education,1983; Department of Health and Human Services, 1999)
Poor Outcomes
![Page 9: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/9.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation ScienceLetting it happen
Recipients are accountable
Helping it happenRecipients are accountable
Making it happenImplementation teams are accountable
Based on Greenhalgh, Robert, MacFarlane, Bate, & Kyriakidou, 2004
![Page 10: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/10.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation Frameworks
Multi-dimensional, Fully integrated
Implementation Drivers
Implementation Stages
Implementation Teams
System Transformation
![Page 11: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/11.jpg)
© Fixsen & Blase, 2008
Consumer Benefits
Performance Assessment (Fidelity)
Coaching
Training
Selection
Competency
Implementation Lens
![Page 12: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/12.jpg)
© Fixsen & Blase, 2008
Child & Family Benefits
Performance Assessment (Fidelity)
Coaching
Training
Selection
Systems Intervention
Facilitative Administration
Decision Support Data System
Competency Organization
![Page 13: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/13.jpg)
© Fixsen & Blase, 2008
Child & Family Benefits
Technical
Performance Assessment (Fidelity)
Coaching
Training
Selection
Systems Intervention
Facilitative Administration
Decision Support Data System
Competency Organization
Leadership
Adaptive
![Page 14: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/14.jpg)
© Fixsen & Blase, 2008
Child & Family Benefits
Technical
Integrated & Compensatory
Performance Assessment (Fidelity)
Coaching
Training
Selection
Systems Intervention
Facilitative Administration
Decision Support Data System
Competency Organization
Leadership
Adaptive
![Page 15: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/15.jpg)
OUTCOMES(% of Participants who Demonstrate Knowledge, Demonstrate
new Skills in a Training Setting, and Use new Skills in the Classroom)
TRAININGCOMPONENTS
Knowledge SkillDemonstration
Use in the Classroom
Theory and Discussion 10% 5% 0%
..+Demonstration in Training
30% 20% 0%
…+ Practice & Feedback in Training
60% 60% 5%
…+ Coaching in Classroom
95% 95% 95%
Joyce and Showers, 2002
![Page 16: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/16.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation Frameworks
Multi-dimensional, Fully integrated
Implementation Drivers
Implementation Stages
Implementation Teams
System Transformation
![Page 17: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/17.jpg)
Child & Family Benefits
Technical
Integrated & Compensatory
Performance Assessment (Fidelity)
Coaching
Training
Selection
Systems Intervention
Facilitative Administration
Decision Support Data System
Innovation Organization
Leadership
Adaptive
Stages of Implementation
•Exploration
•Installation
•Initial Implementation
•Full Implementation
•Innovation
•Sustainability
Fixsen, Naoom, Blase, Friedman, & Wallace, 2005
2 – 4 Years
![Page 18: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/18.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation Frameworks
Multi-dimensional, Fully integrated
Implementation Drivers
Implementation Stages
Implementation Teams
System Transformation
![Page 19: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/19.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation ScienceMaking it Happen: Implementation teams are accountable
EBPs currently are used where they are most wanted (boutique uses)
Social impact will come from going where they are most needed (ALL children and families who need help – common usage)
![Page 20: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/20.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation TeamA group that knows the innovation
very well (formal and practice knowledge)
A group that knows implementationvery well (formal and practice knowledge)
A group that knows improvement cycles to make intervention and implementation methods more effective and efficient over time
![Page 21: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/21.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation Team
OrganizationManagement (leadership, policy)
Administration (HR, structure)
Supervision (nature, content)
Practitioner
State, County and Local ContextSystem of care
Impl
emen
tatio
n Te
amSimultaneous, Multi-Level Interventions
![Page 22: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/22.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation Team
Implementation Team
Prepare Communities
Prepare agencies and staff
Work with Researchers
Assure Implementation
Prepare Regions Assure Consumer Benefits
Create Readiness
Parents and Stakeholders
![Page 23: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/23.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation Science
Effective NOT Effective
Effective
NOT Effective
IMPLEMENTATION
INTE
RVE
NTI
ON 80%, 3.6 Yrs 14%, 17.0 Yrs
![Page 24: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/24.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation Frameworks
Multi-dimensional, Fully integrated
Implementation Drivers
Implementation Stages
Implementation Teams
System Transformation
![Page 25: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/25.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Problem"All organizations [and systems] are designed, intentionally or unwittingly, to achieve precisely the results they get." R. Spencer Darling
Business Expert
“The tyranny of the status quo.”Fritz OserEducator
![Page 26: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/26.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
ProblemInnovative practices do not fare well in existing organizational structures and systems
Organizational and system changes are essential to successful use of innovations
Expect it
Plan for it
![Page 27: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/27.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation ScienceDevelop an infrastructure for implementation in each State (Implementation Teams)
To support the effective use of evidence-based programs and other innovations in education and human service systems
So practitioners can achieve better results each year for the next 50 years
![Page 28: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/28.jpg)
Intensive Development
Saturation
State Capacity Development
0
2
4
6
8
10
12
14
16
1 2 3 4 5 6 7 8 9 10 11 12
Years
Reg
iona
l Im
pl. T
eam
s
RITs
Intensive Development
Reap the Benefits
![Page 29: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/29.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation SciencePre-contemplation (Say what?)
Contemplation (Let me think about it.)
Preparation (I think I will do that.)
Action (I am trying it now.)
Implementation (I am working out the bugs as I try to do it.)
Maintenance (Say what?)Hall & George, 1978
Prochaska & DiClemente, 1982
![Page 30: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/30.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Implementation ScienceShewhart (1924); Deming (1948); Six-
Sigma (1990)
Plan – Develop specific things to do
Do – Do them (make sure)
Study – See what happens
Act – Make adjustments
Cycle – Do over and over again until the goal is reached (again)
![Page 31: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/31.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Improvement Cycle Uses
Rapid Cycle TeamsProblem-solving
Practice Improvement
Transformation Zones
PEP – PIP Cycles
![Page 32: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/32.jpg)
Management Group
Implementation Team
Innovation
Policy Enabled Practice (PEP)
Prac
tice
Info
rmed
Po
licy
(PIP
)
Syst
em
Cha
nge
“External”System
Change Support
![Page 33: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/33.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Transformation Zone
A place to work out a functional version of an innovationSuspend/ bend the usual rules to find and solve usability problems
Expose facilitators and barriers within the organization (strengthen/ change)Reveal facilitators and barriers in the system (strengthen/ change)Identify/ develop implementation supports for the innovation
![Page 34: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/34.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
System Transformation
State Department
Districts
Agencies
Teachers/ Staff
Effective Practices
ALI
GN
MEN
TFederal
Departments
Impl
emen
tatio
n Te
ams
FORM SUPPORTS FUNCTION
![Page 35: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/35.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Functional Systems
Bureaucracy
Staff
Policies
Agencies
![Page 36: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/36.jpg)
Coming Soon from2009 Science and Service Award Program
Do you know an organization/coalition currently implementing an evidence based practice in their local community?
Is the implementation of this program/innovation producing beneficial outcomes to the community?
Are they a national role-model for moving the evidence based practice from science to service?
If you answered “YES” to all of the above, check out:
http://www.samhsa.gov/scienceandservice/
![Page 37: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/37.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
For More InformationFor More InformationDean L. Fixsen, Ph.D.
919-966-3892
Karen A. Blase, Ph.D.919-966-9050
Frank Porter Graham Child Development Institute
University of North Carolina
Chapel Hill, NC
http://nirn.fpg.unc.edu/www.scalingup.org
http://www.fpg.unc.edu/~nirn/resources/publications/Monograph/
![Page 38: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/38.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
For More Information
Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M. & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).
Download all or part of the monograph at:http://www.fpg.unc.edu/~nirn/resources/publications/Monograph
Implementation Research: A Synthesis of the Literature
![Page 39: The Science and Practice of using Science in Practice › ~pdfs › Meetings › national2008 › ... · implementation (research literature, mailings, promulgation of practice guidelines)](https://reader034.fdocuments.us/reader034/viewer/2022042309/5ed59160f22a1c42f97e271b/html5/thumbnails/39.jpg)
Copyright © Dean L. Fixsen and Karen A. Blase, 2008
Thank YouWe thank the following for their support
Annie E. Casey Foundation (EBPs and cultural competence)William T. Grant Foundation (implementation literature review)Substance Abuse and Mental Health Services Administration (implementation strategies grants; NREPP reviews; SOC analyses of implementation; national implementation awards)Centers for Disease Control & Prevention (implementation research contract)National Institute of Mental Health (research and training grants)Juvenile Justice and Delinquency Prevention (program development and evaluation grantsAgency for Children and Families (child welfare leadership development contract)Office of Special Education Programs (implementation capacity development center contract)