Understanding No Child Left Behind (NCLB) NCLB Committee of Practitioners August, 2007.
EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and...
-
Upload
devin-barrett -
Category
Documents
-
view
217 -
download
1
Transcript of EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and...
![Page 1: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/1.jpg)
EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING
IN LONG-TERM STUDENT ACHIEVEMENT
Theories of Change and Logic Modeling:
Matching Means and Ends
NCLB/ITQ SymposiumOctober 10, 2008
![Page 2: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/2.jpg)
IBHE Model for Evaluation
![Page 3: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/3.jpg)
Theory of Action
Universal Theory of Action: Collaborative partnerships are the mechanism for action
Project Theories of Action: how each intervention is delivered train-the-trainers model on-line learning model direct instruction model cooperative learning model workshop series model mentor/mentee model
The Theory of Action describes HOW a project is delivered, usually based on the professional development literature
![Page 4: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/4.jpg)
Limitations of Theories of Action
They describe HOW a project is delivered, not WHY it will work or what EFFECTS it will have.
They are therefore evaluated by outputs, not by outcomes/effects.
Output evaluation is necessary, but not
sufficient, to show value for the project.
![Page 5: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/5.jpg)
Theory of Change: Three Elements
![Page 6: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/6.jpg)
Element One: The Change Framework
A backward mapping process that begins with Outcomes to plan, implement, and continuously develop and improve programs
![Page 7: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/7.jpg)
Element Two: Program Interventions
Designing interventions or activities intended to create desired results, and linking them systematically
![Page 8: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/8.jpg)
Element Three: Program Assumptions
Carefully articulating assumptions about how change will occur and testing the assumptions systematically through evaluation
![Page 9: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/9.jpg)
Theory of Change: Background
Evaluation is challenging because program assumptions are not well-articulated.
The more complex the problem, the more difficult it is to be clear about how things will change as a result of the program.
By designing a Pathway of Change, program developers/ implementers/ evaluators, can strengthen the case that an intervention caused a result.
![Page 10: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/10.jpg)
Theory of Change: Process
Backward mapping from long, short, and mid-range goals or outcomes laid out in sequence
Link outcomes to program elementsPlan evaluation from the outset to track
achievement of the intended outcomesUse evaluation results for improvement and
accountability
![Page 11: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/11.jpg)
Broad Benefits of Theories of Change
“Stakeholders value theories of change as part of program planning and evaluation because they create a commonly understood vision of the long-term goals, how they will be reached, and what will be used to measure progress along the way.”
ActKnowledge/The Aspen Roundtable www.theoryofchange.org
![Page 12: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/12.jpg)
Theory of Change:Project Benefits
Makes explicit the basis for the project intervention
Consolidates the research that undergirds the project
Provides an overarching framework for project planning, implementation and evaluation
![Page 13: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/13.jpg)
Theory of Change and Logic Modeling
A Logic Model is a graphic form of a Theory of Change
Takes the theory, which is selected on the basis of empirical evidence that it will work, and translates it into an operational plan.
Created by backward mapping.
![Page 14: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/14.jpg)
The “IfThen” Connections
IF certain inputs are available…THEN certain activities/interventions can take
place;IF these interventions occur…THEN certain outputs will be seen; andIF the interventions are effective…THEN certain outcomes will be attained.
Finally, what we learn from the outputs and outcomes can be used to improve the intervention.
![Page 15: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/15.jpg)
Building the Logic Model
Start with the Theory of Change:
“Companies do better when their employees are healthy.”
Cite empirical evidence for this theory.
![Page 16: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/16.jpg)
Building the Logic Model
Do the backward mapping
Ask and answer the “How?” questions
Centers for Disease Control Healthier Worksite Initiative
http://www.cdc.gov/nccdphp/dnpa/hwi/program_design/logic_model.htm
![Page 17: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/17.jpg)
Building The Logic Model
Lay out the steps in order from inputs to outcomes
Answer the “Why?” questions.
Centers for Disease Control Healthier Worksite Initiative
http://www.cdc.gov/nccdphp/dnpa/hwi/program_design/logic_model.htm
![Page 18: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/18.jpg)
Building The Logic Model
Create the model with appropriate connections
•Funding• Staff
• Scientific Evidence
INPUTS
![Page 19: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/19.jpg)
Building The Logic Model
Create the model with appropriate connections
•Funding• Staff
• Scientific Evidence
Workplace Walkability Program
INPUTS INTERVENTION
![Page 20: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/20.jpg)
Building The Logic Model
Create the model with appropriate connections
•Funding• Staff
• Scientific Evidence
Workplace Walkability Program
Employees walk to
meetings more often
INPUTS INTERVENTION OUTPUT
![Page 21: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/21.jpg)
Building The Logic Model
Create the model with appropriate connections
•Funding• Staff
• Scientific Evidence
Workplace Walkability Program
Employees walk to
meetings more often
Employee level of physical
activity and fitness
increases
Productivity Increases
INPUTS INTERVENTION OUTPUT OUTCOMES
![Page 22: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/22.jpg)
Building The Logic Model
Create the model with appropriate connections
Identify your evaluation measures for outputs and outcomes
•Funding• Staff
• Scientific Evidence
Workplace Walkability Program
Employees walk to
meetings more often
Employee level of physical
activity and fitness
increases
Productivity Increases
INPUTS INTERVENTION OUTPUT OUTCOMES
Employee Logs
Employee Fitness Screenings
Company Data
![Page 23: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/23.jpg)
Project Benefits of Logic Models
They make a stronger case for project investment – funders understand more clearly what you intend to do
They reflect group process and understanding among project staff and project participants
They indicate where and how to evaluate program effects
![Page 24: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/24.jpg)
We Now Find These Everywhere
U.S. Department of Health & Human Services
Idaho State Board of Education
![Page 25: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/25.jpg)
We Now Find These Everywhere
National Institute of Standards and Technology
processoutcome.org
Research Utilization Support & Help (RUSH) Canadian Department of Justice
![Page 26: EFFECTIVE PROFESSIONAL DEVELOPMENT RESULTING IN LONG-TERM STUDENT ACHIEVEMENT Theories of Change and Logic Modeling: Matching Means and Ends NCLB/ITQ Symposium.](https://reader035.fdocuments.us/reader035/viewer/2022062404/5515621d55034674578b4a59/html5/thumbnails/26.jpg)
NOT Recommended!O
hio
Dep
artm
ent
of
Ed
uca
tio
n (
OD
E)