Post on 16-Jan-2016
description
Evaluation Cooperation GroupEvaluation Cooperation Group
Presentation to the DAC Network on Development Evaluation Presentation to the DAC Network on Development Evaluation 9/10 November 20049/10 November 2004
Role and functioning of the Role and functioning of the Evaluation Cooperation GroupEvaluation Cooperation Group
Fredrik KorfkerCorporate Director for Evaluation, EBRD
Chair ECG
Establishment of the Evaluation Establishment of the Evaluation Cooperation Group (ECG)Cooperation Group (ECG)
Development Committee, Report of the Task Force on Multilateral Development Banks, March 15, 1996, DC/96-01, p. 18 referred to the importance of evaluation
But earlier, anticipating a request by the Development Committee, the heads of the independent evaluation departments in the MDBs created the Evaluation Cooperation Group (ECG) in October 1995
The first meeting of the ECG was in February 1996.
Objectives of the ECGObjectives of the ECG
Strengthen cooperation among evaluators
Seeks to harmonize evaluation methodology in its member institutions
– to enable improved comparability of evaluation results while
– taking into account the differing circumstances of each institution.
HarmonisationHarmonisation
Harmonisation in the ECG includes increased information sharing and improved understanding of commonalities and differences in evaluation policies, procedures, methods and practices
Harmonisation is not interpreted by members as “standardisation of evaluation policies and practices.”
– To harmonise is “to bring into consonance or accord.”
– It allows for different voices and diversity among institutions in their quest to achieve good practice standards.
The scope of the ECGThe scope of the ECG
The ECG may take up any matter relating to evaluation in the MDBs that will
– enhance the effectiveness of independent and self-evaluation,
– engage in the sharing of lessons, and
– promote harmonisation among the MDBs.
Membership of the ECGMembership of the ECG
The ECG has a three-tier structure and is composed of founding members, core members and observers:
– ECG membership is restricted to the founding and core members.
– Sub-regional development banks and other IFIs may be invited to the working group meetings as observers for participation on specific topics.
– Members may organize meetings to brief sub-regional development banks and other IFIs on evaluation developments and ECG progress in key areas
Founding ECG members (1995)Founding ECG members (1995)
Heads of Evaluation of the five MDBs: AfrDB, AsDB, IDB (including IIC), EBRD and the World Bank Group (including IFC and MIGA).
Only the founding members are bound by the original harmonization mandate set by the MDB Heads in 1996,
Only founding members may therefore vote on ECG harmonization-related issues, such as good practice standards.
Core ECG membersCore ECG members
Those members who have subsequently joined the ECG. They are the EIB (1998) and the IMF (2001).
Core members may not vote on harmonisation-related issues, the core members are encouraged to move towards harmonisation.
ObserversObservers
UNDP's Evaluation Unit, as Chair of the United Nations Evaluation Group (UNEG),
the Chair of the DAC Network on Development Evaluation
Observers are not ECG members and have no voting powers
GovernanceGovernance
ECG members will select yearly a chairperson on a rotational basis from among the founding members, and if deemed desirable, a co-chairperson.
The ECG chair proposes meeting agendas after consultation with the members.
The chair prepares an aide-memoir for the ECG meetings and the Progress Report on the ECG submitted to the Heads of MDB and MFI annual meetings, and submits these documents to members for their approval.
In executing its activities, the ECG may set up working groups, as needed, with specific Terms of Reference. Working group members will be drawn from the ECG membership and consultants may be recruited for assistance.
Work ProgrammeWork Programme
Considering the increasing importance of the Millennium Development Goals, the Monterrey Consensus, and Managements’ commitment to a results framework, the ECG is focusing now on the following four priority areas of work:
Country Program and Country Assistance Evaluation Methodology
Policy Based Lending Evaluation Methodology
Evaluation Capacity Development in DMCs
Role Refinement between Independent and Self-evaluation
Other priority areasOther priority areas
ECG Members will also devote greater attention to comparative evaluation:
– governance
– disclosure of evaluation findings
– attestation and evaluability
– regional and global public goods
– annual reporting
– joint evaluations
Evaluation Products of ECGEvaluation Products of ECG
Good Practice Standards on the evaluation of individual public sector operations
Good Practice Standards on the evaluation of individual private sector operations
Good Practice for the evaluation of policy based lending operations in MDBs (soon to be published)
Work is ongoing among the core ECG members to harmonise around these Good Practice Standards (see report on recent ECG meeting)
ECG MeetingECG Meeting - - October 2004October 2004
Discussion on harmonisation and results agendas and contributions of ECG members in preparation for HLF-2 in Paris (March 2005)
Reviewed the preparation of “Good Practice Standards on PBL” (phase 2 to PBL publication)
Revisited the Independence of evaluation function:
– External Review of the WB’s Evaluation Function and DGO’s mandate”
– ECG’s cooperation in the pilot phase of the “Evaluation of Multilateral Organisations” study initiated by the DAC Evaluation Network – importance of collaboration
ECG MeetingECG Meeting (cont.)(cont.)
Working Group on Private Sector Evaluation:
– Discussion of outcomes of the second Benchmarking exercise of GPS on private sector evaluation
– Comparability of sets of indicators to show comparable results among MDBs taking into account the mandate of each of the institutions
Decided on initiating a benchmarking exercise on GPS of Public Sector Evaluation
ECG MeetingECG Meeting (cont.)(cont.)
Evaluation Capacity Development
– Compared recent developments and plans for next ECG meeting (exchange of experience by AfrDB and AsDB)
Evaluation of technical assistance (TA): review of IMF
experience and decision that no GPS on TA imminent
Action on dissemination of Lessons learned
– Video conference on exchange of lessons among MDBs
– Establish more formal contacts to enhance use of lessons
learned in the institutions
ConclusionConclusion
ECG has progressed on key good practice standards
Established good relationships among ECG members and observers (bilaterals and UN)
Contributions by ECG towards harmonisation and results agendas
Willingness among members to push for comparability of results
"By three methods we may learn wisdom: "By three methods we may learn wisdom:
First, by reflection, which is noblest; First, by reflection, which is noblest;
Second, by imitation, which is easiest; and Second, by imitation, which is easiest; and
third by experience, which is the bitterest.“third by experience, which is the bitterest.“
Confucius (c. 551-479? BC)Confucius (c. 551-479? BC), Chinese sage, Chinese sage