Country-led impact evaluation: A survey of development practitioners

Denis JobinVice-PresidentIDEAS

Johannesburg – South Africa- March 2009

Presentation outline

Relation between Good governance and CLE (CLIE: country-led impact evaluation)

CLIE and Quality Survey results of development evaluators

practitioners

Why Country-led Evaluation?

Relation between Country-led evaluation and good governance: the role of transaction costs– Relationship with 3 out of 6 characteristics of good

governance (WB) Voice and accountability; Government effectiveness; Control of corruption;

How Country-led Evaluation?

CLIE and Quality: Challenges related with quality are also relevant for CLIE:

– No agreed upon definition of Evaluation quality – Should be method free or method driven?

Farrington Statistical Conclusion Validity Internal Validity Construct Validity External Validity

Jobin, D. – the joint ability that an evaluator will: 1- assess and 2- report on

the performance of an institutional arrangement by the product of its competence (ability to assess) and the product of its independence (ability of revealing)

Why Country-led Evaluation?

Survey results: – Dominant approach: The Logical Framework

Approach – Dominant method: case study– Counterfactuals important?

41% believe not important (32% are important)

Conclusion: Many challenges remains, Capacity, agreed upon definitions standards