Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation –...
Transcript of Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation –...
![Page 1: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/1.jpg)
Evaluation –Optimising Evidence for Accountability andLearning in NRM Programmes
Prof Eureta Rosenberg (Rhodes
University), Nosiseko Mtati (NLEIP
and Rhodes) and Vhutshilo Mudau
(AWARD and Rhodes)
Biodiversity Research and Evidence Indaba 17 August 2017
![Page 2: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/2.jpg)
2
Resilience in the Olifants(RESILIM-O) – Limpopo Province, AWARD & USAID
Ntabalanga-Laleni Ecological Infrastructure program (NLEIP) -Eastern Cape, DEA & Rhodes
Two NRM Programmes with Innovative MEAR:
Photo Credits: NLEIP and AWARD
![Page 3: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/3.jpg)
3
If we want Monitoring, Evaluation & Reporting to optimise accountability and learning, we need:
1. Complementarity of multi-methods
2. Reporting with built-in reflection
3. Social & educational protocols forcitizen monitoring
![Page 4: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/4.jpg)
1. Complementarity of Multi-Methods
• On its own an indicator is just suggestive.
• On its own, a story is just anecdotal.
• Indicators plus narratives can add up to
robust evidence.
![Page 5: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/5.jpg)
Complementarity of Multi-Methods
Indicator based monitoring (e.g. # of wetlands restored, # of training days) +
Open-ended narrative
monitoring +
Focussed evaluation
case studies +
Meta-evaluation = generalizable
insights
![Page 6: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/6.jpg)
2. Reporting with Built In Reflection:
• Action-reflection cycles
• In complex,
stochastic systems =
• Strategic adaptive
management
Plan
Take action
Get feedback
Reflect
![Page 7: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/7.jpg)
2. Reporting with Built In Reflection:
• B2O Back to Office reports
• Teams compile monthly reports
• Evaluation Champs & Coordination
• Reflection may require training
• Need not be more onerous!Research: Mudau, Thulare, Kotschy, Burt, Rosenberg
![Page 8: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/8.jpg)
3. Citizen Monitoring can be valuable
• For NRMPs• For citizens
Research: Bannatyne, Nyamela, Rowntree, Van der Waal, Mtati, Rosenberg
![Page 9: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/9.jpg)
3. Citizen Monitoring protocols:
• Scientific• Social• Educational
Research: Bannatyne, Nyamela, Rowntree, Van der Waal, Mtati, Rosenberg
![Page 10: Evaluation Optimising Evidence for Accountability and Learning … · 2018-06-12 · Evaluation – Optimising Evidence for Accountability and Learning in NRM Programmes Prof Eureta](https://reader034.fdocuments.us/reader034/viewer/2022042322/5f0c39107e708231d4345781/html5/thumbnails/10.jpg)
Conclusion: Some NRM programmes are collecting evidence through new MEAR
frameworks which have potential to increase learning and accountability.
Research investigating such claims is underway. How do we make this work into the national system?
Plan
Act
Evaluate