8/13/2019 1_5_rims

1/13

Results and Impact Management

System (RIMS)

Implementation WorkshopBamako

8-11 March 2005

8/13/2019 1_5_rims

2/13

Focus on results and impact of

development interventions

General context

IFAD is committed towards achieving Millennium Development

Goals (MDGs) and recognizes the need to better document the

impact of its operations on the MDGs

General consensus on the need to improve accountability of

donors funds, including IFADs

Managing for results and impact: articulation to the programmes

and country performance evaluation system (PR and PBAS)

Development and approval of a Framework forResults and Impact Management System for IFAD-

Supported Country Programmes (RIMS) in

December 2003

8/13/2019 1_5_rims

3/13

What is RIMS ?

A systematic methodology and set of commonindicators across programmes and regions tomeasure and inform on the performance andimpact of projects

It is based on a comprehensive system ofconcepts , definitions and indicators for results andimpact

It provides flexibility in the monitoring of resultsand simplicity in the evaluation of impact

It allows to share information among variousstakeholders

8/13/2019 1_5_rims

4/13

RIMS in the context of a

Project/Programme

MIS

Management

Information System

M&EMonitoring &

Evaluation RIMS

Results & Impact

Management System

IMPACT

Impact

Measurement

N.B. the performance of RIMS will depend largely on that of the Monitoring and

Evaluation Systems

8/13/2019 1_5_rims

5/13

Logical progression from results to impact

1stLEVELRESULTS

[OUTPUTS]

2NDLEVELRESULTS

[OUTCOMES]

IMPACT

8/13/2019 1_5_rims

6/13

Looking at RIMS indicators in light of Logical

Framework matrix

Narrative

Summary

Objectively Verifiable

Indicators*

Means of

Verifications

Assumptions

Goal (impact) (incl. RIMS 3rdlevel

results indicators)

Purpose

(Outcomes)

(incl. RIMS 2ndlevel

results indicators)

Outputs (incl. RIMS 1st level

results indicators)

Activities

*OVIs are likely to include other indicators that are not specified under RIMS

8/13/2019 1_5_rims

7/13

RIMS implies a significant shift in focus from level 1

(physical and financial progress) to level 2 (changes inbehaviour) and level 3 (impact) ..

Practically what it involves :

The selection of common RIMS indicators is done jointly -

IFAD and project- those (from the RIMS list of about 50, bytype of project and component) that are relevant to a particular

project (in LF)

Data/information on selected indicators to be conveyed to

IFAD, by project, annuallyto be aggregated and reported to

April Executive Board each year

The selection and reporting on a set of indicators including four

mandatoryindicators for all projects:

# of households with improvement in HH assets

Prevalence of child malnutrition

# of Hs that have improved food security

Reporting in the context of RIMS:

What does it mean for project stakeholders?

8/13/2019 1_5_rims

8/13

On results indicators, information required: annual

(AWPB targets and achievements); cumulative

(project targets and achievements with referenceto Appraisal )

Information on impact indicators to be captured

through surveys three times during the project life:at start-up, mid-term and completion (methodology

piloted in the framework of PRODAM II - Senegal

in December 2004)

Reporting in the context of RIMS:

What does it mean for project stakeholders?

8/13/2019 1_5_rims

9/13

Which projects are concerned by RIMS?

All projects approved since January 2004 have tofully incorporate RIMS (RIMS indicators are part ofthe LF and the 3 impact surveys are programmed)

Projects with the MTR taking place after January2004 have to select RIMS indicators, includingthose of impact, and programme the impact surveys(midterm and completion)

Project which have already carried out the baselinesurvey will incorporate RIMS impact indicators atMTR

Project which were past midterm as of January2004 will do there best to report on results andimpact based on their LF indicators.

8/13/2019 1_5_rims

10/13

Where do we stand today in PA ?

18 out of the 20 concerned projects have agreed on list of

indicators and reported on 1st level results in 2004

Country Project Acronym

Benin PDRT and PADPPA

Burkina Faso PAMER

Cameroon PPMF and PADC

Cape Verde PLPR

Ghana REP and RFSP

Chad PSANG

Guinea PPDR-HG

Mauritania PASK and PADCM

Niger PDSFR

Nigeria RTEP and CBARDP

Mali FODESA

Sao Tome & Principe PAPAFPA

Senegal PADV, POGV II and PRODAM II

Twenty projects have reported this year on 1st level indicators

8/13/2019 1_5_rims

11/13

Preliminary lessons learned

CPMs and project management teams of the targeted 20 first projects (out of

some 50) were able to agree on a set of RIMS indicators (on average 14 outof the list of 50) to report in 2004

Projects did not appear to have particular difficulties with reporting on 1st-level results because enough RIMS indicators were among the indicatorsthey already monitored

To a large extent, annual programme of work and budget targets wereidentified and, where possible, cumulative appraisal targets were estimated

However:

Appraisal targets MAY NOT be the best measure of project performance

This year sample confirmed that AWPB targets tend to be overestimated inthe early stages of implementation

Aggregation might not be so easy as there always remains rooms forinterpretation of the indicators and possible double counting (e.g groups,

training)

8/13/2019 1_5_rims

12/13

The way forward: work in progress

Mainstreaming of RIMS as an integral part of project M&E systems forall new projects

Finalization of methodology for impact assessment surveys, includingthe completion of pilot impact surveys (standard survey questionnaireand softwareJune 2005) and of 2ndlevel indicators. Reporting onthese starting in 2006

Clarify the role of CIs in the process (RIMS is an instrument for

supervision or an object of supervision?)Continued exchange of information with, and feedback from, projects

and development of adapted training material

Stock taking exercise in 2006, includingreviewing the list of indicators to betterrepresent todays projects/programmes, weedout inconsistencies, eliminate duplication, etc.and refine reporting methodology that betterlinks project results to outcomes, objectives andgoals

8/13/2019 1_5_rims

13/13

The way forward: next steps in PA

The success of IFAD RIMS depends entirely upon theappropriateness and strength of project M&E, able toprovide support for a results and impact orientedproject management.

There is still plenty of room for improvement there andthat is where PA wants to concentrate in the nearfuture.

Regional TAG in preparation for 2005 to strengthenmanagement for results and ME as management tool withproject teams

Specific country initiatives (e.g. Senegal)