Increasing Impact
description
Transcript of Increasing Impact
![Page 1: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/1.jpg)
INCREASING IMPACTUnderstanding Measurements of Impact in Evaluation
June 2013Jennifer Farley
![Page 2: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/2.jpg)
Overview• Why evaluate?• Evaluation:
• Types, Continuous Improvement and Neglect• Outputs vs. Impact• Measures of Impact• Is impact good enough?• When it’s not good enough• Maximizing Evaluation• Questions
![Page 3: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/3.jpg)
Why Evaluate?• Ensures Quality• Increases Knowledge• Prioritize Resources• Accountability• Demonstrate need and effectiveness• Marketable
(Russ-Eft & Preskill)
![Page 4: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/4.jpg)
Types of Evaluation• Developmental• Formative• Summative• Monitoring and Auditing• Outcome Evaluation• Impact Evaluation• Performance Measurement
(Russ-Eft & Preskill)
![Page 5: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/5.jpg)
Continuous Improvement
Evaluation
![Page 6: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/6.jpg)
Top 10 Reasons Evaluation is Neglected
1. Misunderstanding the purpose and role of evaluation2. Fear3. Lack of Skills (Real or Perceived)4. No one has asked for it5. It is not used6. Time-consuming7. Perceived costs vs. Perceived benefit8. Leaders already know what works9. Prior experience 10. Lack of Value(Russ-Eft & Preskill)
![Page 7: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/7.jpg)
Outputs and Impact
![Page 8: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/8.jpg)
Measures of Impact• Measures of Change
• Attitude, Knowledge and Behavior• Comparison
• Pre- and Post-program• Calibration
• Is the primary impact what is measured?• Is the program driving the measure, or is the measure driving the
program?
![Page 9: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/9.jpg)
Is the Impact Good Enough?• Goals
• Program established goals• Funder established goals
• Comparison• Population level data
• Are the target and general population the same?• The continuum of evaluation and research
![Page 10: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/10.jpg)
When Impact isn’t “Good Enough”• Re-calibrate Measures
• What is impact?• Participant focus groups
• What best measures impact?• Refine measurement tools
• Staff Training• Re-Pilot surveys
• Incorporate Measures of Program Quality• Look at HOW programs and services are offered• Explore field-specific measures of quality
• Youth Program Quality Assessment• Quality Rating System
![Page 11: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/11.jpg)
Results: Maximizing Evaluation• What is the purpose of the evaluation?
• Funder Required?• Is there a requirement to “Act” on the results?
• How are the results communicated to all stakeholders?
• How are results used in planning?
![Page 12: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/12.jpg)
Questions?
![Page 14: Increasing Impact](https://reader036.fdocuments.us/reader036/viewer/2022062520/568162be550346895dd349d6/html5/thumbnails/14.jpg)
Works CitedRuss-Eft, D., & Preskill, H. (2009). Evaluation In Organizations: A systematic approach to enhancing learning, performance, and change. New York: Basic Books.