1

MfDR CAP-Scan

www.MfDR.org/capscan - capscan@mfdr.org

Ingwell Kuil - World Bank Abdel Aziz Ould Dahi - MauritaniaCivil Service College, Singapore 2009

Guiding Principles

South-South knowledge sharingOngoing improvements to methodology

Theoretical: How it worksPractice: How to get it done Realistic: Continuous effort in country

Managing for Development Results

Development of a results cultureShift from focusing on inputs to performanceEvidence-based decision makingClear goals, monitoring and evaluationAccountability to deliver results

A global urgency to focus on Results

Improve development outcomes and results on the ground Improve country systems to Manage for Development ResultsImplement Results Based approaches

MDGs, Paris Declaration, Accra Agenda for ActionKorea 2011 4th High Level Forum

Development of CAP-Scan

Roundtable on MfDR in Hanoi (2007)OECD/DAC Joint Venture on MfDRWorking group of AsDB, AfDB, CIDA, EC, IADB, MSI, MCC, UNDP, USAID, World Bank, partner countriesMethodological sources:UNDP: Capacity Assessment Tool; CIDA: Capacity self-assessment tool; EC: Institutional Assessment and Capacity Development; WB: PEFA; Etc. Experiences in Mauritania, Niger, Senegal

CAP-Scan instrument

Broad-based, high-level, short-term, low-cost self-assessment by governments to identify strengths and capacity needs, develop actions to address resource needs, and target donor support:

A framework on development performanceEvidence-based decision-making toolSimple and practical tool for strategic planning, risk management, and monitoring and evaluation of results

Scope

Focus on the five MfDR pillars:

1 Leadership, 2 Evaluation & Monitoring, 3 Accountability & Partnerships, 4 Planning & Budgeting, 5 Statistics

MfDR PillarsComponents Awareness Exploration Transition Full Implementation

Commitment

Top management asserts importance of MfDR. But no concrete initiatives have

been initiated.

A small number of managers investigate

MfDR tools, and apply them sporadically. But,

initiative is not consistent, nor mandated.

Full commitment within government to MfDR. New

MfDR practices are systematically adopted. Most, but not all, staff,

support initiative and most, but not all units practice MfDR.

All units practice comprehensive and systematic MfDR systems. Staff report benefits outweigh costs of

MfDR. Organization is learning how to use, and continuously adapt MfDR.

MfDR informs policy

Although leaders claim that evidence should be

integrated into policy processes – reliable data are

not collected or used.

At least a few decisions are taken based on hard data.

However, these are the exceptions in an

environment where data are seldom available or used.

A thorough array of results-based data-grounded decision- and

policy-making support systems are installed in some units.

Leadership emphasizes the importance of such systems and

indicates that they should be harmonized and used universally.

Results-based management systems are utilized in virtually all relevant

areas. These systems are adequately funded, staff at all levels appreciate their utility, they use data to revise policy and procedures, and systems are in place to continuously improve

them.

National planning

National Development Plan exists. However, outcomes and targets – even for such areas as poverty reduction or health – are not clearly

articulated.

National Development Plan articulates outcomes, and maybe even some specific

targets. However, that discipline is not

consistently applied throughout the Plan.

National Development Plan clearly articulates outcomes, results, and measurable targets against which

programs can be measured. However, data are not

systematically collected and used by decision makers. “Ownership”

of the Plan and its data are not widespread.

Outcomes, results and targets area consistently and appropriately applied throughout the National Development Plan. Relevant data are collected and used to adapt implementation of the

plan. Decision-makers recognize the utility of the data and ensure it is

integrated into the decision-making process.

Criteria For Each Progressive Stage

Leadership

Matrix

1. Scope tasks

10.Implement improvement

3. Craft process

7. Identify emerging & advanced aspects of MfDR

2. Identify participants

4. Adapt tools

6. Analyze / present results

8. Prioritize improvement

5. Collect data

9. Plan improvement

Process

11

Products

Benefits for the client

Raise government consciousness of MfDR, in the local contextHelp government chart its own path to MfDRFacilitate cross-organizational cooperationPromote participation and consensusMap a prioritized plan for improvement with focused follow-upMeasure progress against the planLink with other toolsIntroduction to a broad intervention post CAP-Scan

Niger

Senegal

Mauritania

Lessons learnt

Quality Assurance TeamBenchmark with non-governmental actorsAction PlanningLink to implementationLink to other initiativesIncreasing cooperation with Regional CoPs on MfDREstablishment of Advisory Committee

Inter-sectoral character of capacities adds complexity to the search for solutionsCapacity Building was identified as a long-term goalThe CAP-Scan is an opportunity to develop an improvement plan• Self-assessment by senior government officials• Cross-cutting groups• Setting capacity building priorities• Concrete action plan that integrates existing efforts

Rationale

Team

Sector Meetings • Self-

Assessment• Group

Discussion

Preparation for Working Sessions

• Consolidation and synthesis

Working Sessions

• Self-Assessment

• Priorities• Action Plan • Monitoring

Launch

June 30 - July 8 July 6 – 11 July 12 & 15

Process planning

Results per MfDR pillar

Leade

rship

Evalua

tion a

nd Mon

itorin

g

Accou

ntabil

ity an

d Part

nershi

ps

Plann

ing an

d Budg

eting

Statis

tics

0

0.5

1

1.5

2

2.5

3

3.5

4

Mauritania

Mauritania

Results per dimension

0,00 1,00 2,00 3,00 4,00

Survey capabilityData quality assessment

Data Disaggregatio

n

Statistics strategy

Inter-sectoral CoordinationInternal Coordination

Performance based budgetingBudget reflects national

priorities

Public access to results

Independent media

Legislative Oversight

Judicial IndependenceReporting harmonization

Data management capability

Government performance is oriented toward results

Data management capabilityMonitoring and Evaluation

Capacity

National Development Plan evaluation systems

Human Resource Management

Change Management

Linking the field and the capital

Donor coordination and alignment with national priorities

Accountability and Delegation

Involvement of Non governmental stakeholders

MfDR informs policy

Commitment

Statistiques

Processus budgétaire

Redevabilité et contrôle

Suivi et Evaluation

Leadership

4321

4

3

2

1

Score of self-assessmentPrio

rity

= co

mbi

naiso

n Im

porta

nce,

Feas

ibilit

y, U

rgen

ce

Budget reflects National priorities

Management of change

Public access to information

Data quality assessment

Commitment

MfDR informs policy

« Quick win » ?

Action requested

No urgent action needed

Efforts without

significant returns

Identification of priorities

Action Plan

Dimension

Programmed actions Indicator/Monitor-ing

Referencesituation

Target situation Schedule

Financing Resp. Exec.

Prep-

aration

Exe-cution

Prior-ity

Comment/Connec-tion with existing

actionObtain-ed

Obtain-

able

Source

Leadership

Commitment CAP-Scan

3.0 1

1.1.1 Promulgate law organizing the monitoring and evaluation system of the CSLP

Law adopted

TO + 6 month

s

MEF

1.1.2 Extend the sector CDMST: MFPMA, MPEFP, MC

No. depts. CDMT

7 10 toTO + 1

yr

MEF/other

depart-ments

1.1.3 Study of capacity-strengthening needs of the coordination structure for governmental action (DG of Interministerial Coordination) to ensure performance of the coordination, facilitation and support roles at the interministerial level.

MEF for

submiss-ion to

PM

1.1.4 General introduction of a specialized body or unit responsible for strategic programming in the MPM and MC.

% direct/Dept

60% 100% by TO

+ 6 month

s

Ministry

submits to PM

Adjustment of organization charts

Clarity and articulation of vision CAP-Scan

3.0 1

1.2.1 Make the different programming tools consistent: analysis to harmonize terminology, structure and actions.

TO + 6 month

s

MEF/

DGCI

MEF/DGCIM

Human Resource Management CAP-Scan

1.25 2

1.8.1 Establishment of performance-evaluation tools for civil servants and government employees: pilot perimeter on the staff of the M&E units in the DEPs.

3-Year Plan indicator: % of officials evaluated

100% on the perimeter

by TO + 1 yr

Six priority areas were identifiedActions were developed in a full group discussion, including all key ministriesActions focused on new action areas and refining existing projectsThe Director General of the Development and Economic Cooperation of the MOF agreed to take the lead on follow-up actionsThe Action Plan was disseminated to donors in-country to support the actions

Action Plan and dissemination

MfDR CAP-Scan

Workshop Civil Service College, Singapore 2009

Ingwell Kuil & Abdel Aziz Ould Dahi

26

Workshop process

1. Use the ‘matrix’ to discuss the stage of development regarding the MfDR system in your country

2. Describe the main arguments of your discussion in the ‘journal’ and quantify the results

3. Graph the quantitative results in the ‘profile’4. Prioritize the results you’ve identified in the

‘prioritization matrix’5. Use the prioritization matrix to make an ‘action

plan’

xxx

MfDR Self-Assessment Matrix MfDR Pillars CRITERIA FOR EACH PROGRESSIVE STAGE

Components Awareness Exploration Transition Full Implementation

LEADERSHIP

Commitment to Results Management

Deputy and assistant Deputy assert importance of MfDR. But no concrete initiatives have been initiated.

Some managers investigate MfDR tools, and apply some in ad hoc manner. But, initiative is not consistent, nor mandated.

Full commitment within organization to MfDR. New practices systematically adopted to MfDR. Most, but not all, staff, support initiative and most, but not all units practice MfDR.

All units practice comprehensive and systematic MfDR systems. Staff report benefits outway costs of MfDR. Organization is learning how to use, and continuously adapt MfDR.

Evidenced-based policy processes

National Development Plan

Public consultation in planning and policy making

Self-Assessment Development Calculation Sheet (IDCS)

Organization: Ghana Ministry of Planning: Aug-08

Jun-07 Aug-08Pillar

Components Score Score Comments

Leadership Commitment 2.00 3.00

Four of five units have instituted Results Frameworks and Program Monitoring Plans. Data are produced regularly for those units and some decisions are made on data. The remaining unit is expected to adopt systems next year.

Evidence 1.00 1.00 No ChangeNational Development Plan Results Mgt. 2.00 4.00

National Development Plan now has full sets of results measures and ministries are reporting on progress against those indicators. Twice annual meetings of cabinet to review progress against indicators.

1.67 2.67 PillarsLeadership

Results Commitment

Evidenced-Based Mgt.

Public Consultation

Evaluation and Monitoring

M & E Capacity

Client Satisfaction Survey

Accountability & Feedback

Financial Resources

External Resources

Network Resources

Service Delivery

Active Membership

Legend:

Baseline: as of 2007

Mid-Course: as of 2008

End of period: 2009

Ghana Ministry of Planning

Awareness Exploration Transition Full Implementation

Self Assessment Profile: 2007-2008

1. CAP-Scan matrix

2. CAP-Scan journal

3. CAP-Scan profile

Capacity Improvement Result 1: {enter priority capacity result improvement desired}

Performance Indicator(s):

Activities Resources needed

Sources Completion date

Person

Responsible

1.

2.

3.

4.

5.

4321

4

3

2

1

Matrix Progress Scoring

Quadrant indicatingareas needing most

urgent attention M&ECapacity

(3)Public

Consultation(3)

Results Related toBudget (1)

InformsPolicy (3)

PillarsLeadership

Results Commitment

Evidenced-Based Mgt.

Public Consultation

Evaluation and Monitoring

M & E Capacity

Client Satisfaction Survey

Accountability & Feedback

Financial Resources

External Resources

Network Resources

Service Delivery

Active Membership

Legend:

Baseline: as of 2007

Mid-Course: as of 2008

End of period: 2009

Ghana Ministry of Planning

Awareness Exploration Transition Full Implementation

Self Assessment Profile: 2007-2008

3. CAP-Scan profile

4. CAP-Scan prioritization

5. CAP-Scan action plan

Matrix Progress Scoring 2 3 4

MfD

R Pr

iorit

y Ra

nkin

g

3

4