Routes to resilience: Lessons learnt from monitoring BRACED project
-
Upload
ukcip -
Category
Environment
-
view
644 -
download
0
Transcript of Routes to resilience: Lessons learnt from monitoring BRACED project
Routes to Resilience: Lessons Learnt from Monitoring BRACED
PaulaSilvaVillanuevaCatherineGouldPLACARDWebinar30.01.2017
3
Ethiopia
Uganda
South Sudan
Sudan Chad Niger
Mali
Mauritania
Senegal Burkina Faso
Kenya
Africa: 13 projects in 11 countries
Myanmar (Burma)
Nepal
Asia: 2 projects in 2 countries
BuildingResilienceAndAdaptaDonToClimateExtremesandDisasters(BRACED)2015-2018
DFIDFunded:£110mwww.braced.org
ImplemenDngPartners
KnowledgeManager(KM)&FundManager(FM)
3
Research
TheKMcomprises6organisaDonswithcomplementaryexperDseindifferentdisciplinesandgeographiesworkingtogethertogenerateandshareevidencebasedknowledge…
Learning&Uptake
Monitoring&Evalua9on
AsiaRegionalPartner
Communica9ons&Dissemina9on
AfricaRegionalPartner
TheFMisresponsibleforoverseeingthedeliveryoftheBRACEDprojects.Itcomprises2organisaDonswhichtogetherformanintegratedteam:
BRACEDM&E‘Infrastructure’BRACED
Fund Manager FM Results
Team
Quarterly & Monthly
Reporting
Quarterly Performance
ReportingDirect
engagement with IPs
Monitoring visit reports
BRACED Knowledge Manager
Monitoring & Results
Reporting (MRR)
Consistent project results
reporting (Outcome
level)
3As (Absorptive, Anticipatory,
Adaptive)Areas of Change
(Outcome Mapping)
Evaluative Monitoring
Project to programme evidence &
learning
Annual Reporting Synthesis
Evaluation
EA 1: BRACED
Programme ToC
Contribution Analysis (Country
Case Studies)
EA 2: BRACED
InterventionsRealist Evaluation
EA 3: BRACED Projects
Quasi-Experimental
Impact EvaluationEA 4: Adaptive
Social Protection
(System level)
Contribution Analysis
EA 5: PHASE Case based analysis
HowisBRACEDperforming?HoweffecDvelyareacDviDesbeingdelivered?WhatresultshasBRACEDdelivered?DoestheBRACEDmodelwork?Forwhom?Whatdoesthismeanforfutureresilienceprogramming?Whatdoesthismeanforresiliencestrengtheningmorebroadly?Whathavewelearnedaboutmonitoringandmeasurementofresilienceprogramming?
AcDvity Method
KM Monitoring & Results Reporting (MRR) How are BRACED projects building resilience and what can we learn from MRR efforts?
5
BuildingtheevidencebaseviarobustmonitoringandresultsreporDng
4
Co-developmentoftheBRACEDfoundaDonaldocumentsfromtheboBom-up:theoryofchangeandlogframe
Developmentof3qualita9veframeworksformonitoringandmeasuringresilience
LighttouchM&Esupportthroughguidancenotes&M&E1:1clinics,webinars&workshops
Aggregation & synthesis: from projects to programme
KM BRACED MRR Framework Enabling data collection and evidence generation to track and understand the processes of change that lead to climate and disaster resilience
Theo
ry o
f cha
nge
What is the long term change and development impact the project is seeking
to support?
‘3A’s (Anticipatory, Absorptive & Adaptive)
Transformation
How will change happen? Who are the key actors?
Areas of Change(knowledge, capacity, decision-
making, partnerships)
What are the contextual drivers that may enable or constrain change?
Evaluative Monitoring (climatic and non-climatic context)
What are the underlying assumptions about how this change would happen and
did they hold?Reflection and learning- Testing
theory of change
Key questions How we monitor & assess change?
2Mandatoryprogramme-wideindicators:§ KPI4(outcome):ThenumberofpeoplewhoseresiliencehasimprovedasaresultofBRACEDsupport§ KPI1(output):ThenumberofpeoplesupportedbyBRACEDtocopewiththeeffectsofclimatechange
9
• Quantitative indicators of resilience need to be complemented with qualitative and explanatory frameworks
• There is a need to shifts mindsets from logframe-driven data collection exercises to learning-oriented M&E
• There are different options for rolling out, but each comes with its own trade-offs
• Aggregation and synthesis at scale takes time and resources, challenging real time learning and course correction
INDICATORS
PURPOSEOFM&E
ROLLINGOUTPROGRAMMELEVELFRAMEWORKS
SYNTHESIS&AGGREGATIONATSCALE
Implications for Practice When designing, implementing and reporting against resilience M&E frameworks:
1. Be clear about what counts and why from the beginning
2. Go beyond business as usual, but know your limits (or improve them!)
3. Pick your framework but be aware of its implications (and resource for them)
4. Resource for reporting at scale (and be cautious of time)
Question for further reflection Ø In this context, how complex does M&E need to be?