Measuring Agency Level Results:

Update Report from ACDI/VOCA

April 10, 2013

Maby Palmisano

Note: All numbers in this presentation are preliminary.

Goals of CaPISC

CaPISC Process

HQ M&E reports on overall results (CAPISC)

Field and HQ Senior Management use data to inform decision making

HQ backstopping (PC) validates accuracy of data (CaPISC againstquarterly report or PMP submitted)

Project M&E Specialist enters data into CaPISC according to PMPdefined frequency of reporting (via quarterly report or PMP – donor

reporting mechanism)

HQ M&E enters PMPs/indicators and their disaggregation levels intoCaPISC

Project field-based M&E specialist sends approved PMP to HQ

CaPISC

Why CaPISC Indicators

Reporting to donors of global results / NBD

Supports information based management of projects

Supports adaptive management (tracking progress towardsresults) and learning during project implementation (versusafter the fact)

Helps us determine which of our approaches work

Aids in oversight from HQ both at the portfolio level & thePresident Office

Allows for looking at the body of our work

Allows for impact monitoring of our vision

ACDI/VOCA

Agribusiness

Community Development

Enterprise Development

Financial Services

Food Security

Use CaPISC to Help Manage Projects

Monitor performance against benchmarksNote: These are preliminarynumbers.

CaPISC in Numbers (4458)

Synthesizing CaPISC information•• Reach & Performance Results:Reach & Performance Results: includes information on global number of

beneficiaries and services and on over all performance results in terms of indicators

•• Economic Change:Economic Change: measurement of improvement in economic status orproductivity, such as volume/value of production, yields, income or dietary diversityscores

•• Behavioral/Social Change:Behavioral/Social Change: change in behavior or customs, which may includeincreased participation of women, beneficiaries voluntarily electing to follow advice(e.g., taking children for vaccinations, enrolling in school) or a shift in management(e.g., policy)

•• Health/Nutrition:Health/Nutrition: includes indicators that report measuring the health and/ornutritional status of beneficiaries (e.g., wasting/stunting z-scores, under-nutrition,anemia, etc.)

•• Sustainability:Sustainability: indication that project initiatives will have impact lasting beyondthe life of the project, such as adoption of technologies/management practices, jobopportunities, etc.

Nota Bene

Indicators are not our only way toevaluate project success or failure –information should only be part of theinformation used to assist field teamsand HQ reflect on our work.

CaPISC 2012 Report

66 Projects in

38 Countries & 5 Regions

59 with Data for 2012Report

No. of Individual Beneficiaries in 2012:

Direct: 54,625

Direct:

130,883

Direct:

318,969

With Indirect:

1,737,561

Direct: 530,605

With Indirect:

1,085,839

Direct:

112,186

3,129,050

Total Direct Beneficiaries: 1,147,268

Total Indirect Beneficiaries: 1,989,738

Note: These arepreliminary numbers.

Definitions

•• Global Reach:Global Reach: A count of individualswho have benefitted directly orindirectly from project activities andSHOULDSHOULD be disaggregated bygender.

Our Beneficiaries by Gender

• Less than 1/4 of all of our projects reportedgender disaggregated data!

• Global number of female beneficiaries reported

both direct & indirect = 693,428

(22% of our Global Reach)

Majority of current gender data from Iraq i.e. inCommunity Development

Agribusiness

CommunityDevelopment

EnterpriseDevelopment

Financial Services

Note: These arepreliminary numbers.

Organizations Reached

Organizations Beneficiaries

Agribusiness

Community Development

Enterprise Development

Financial Services

Food Security

“Organizations’” definitions examples:• No. of producer organizations, water user associations, trade and business associations, and community-based

organizations receiving USG assistance• No. of women’s organizations/associations assisted as a result of USG supported interventions.

Total number of organizations reached = 5,251

- primarily Producers Groups

19% of projectsreported data onorganizations reached

Note: These arepreliminary numbers.

Households Reached

Households Beneficiaries

Agribusiness

Community Development

Enterprise Development

Financial Services

Food Security

300,899 Households Counted in 2012

Note: These arepreliminary numbers.

SustainabilitySustainability

Indicators aimed at showing that projectinitiatives will have impact lasting beyond thelife of the project, such as adoption oftechnologies/management practices, hectaresunder improved management, jobopportunities, market access.

Hectares under improvedtechnologies/Management practices

Agribusiness

Community Development

Enterprise Development

Food Security

[40,080 Hectares]

Note: These arepreliminary numbers.

Average Adoption of NewTechnologies

20 Projects Reporting20 Projects Reporting

Africa

Asia & the Pacific

Europe and CIS

Latin America & theCaribbean

Agribusiness

CommunityDevelopment

EnterpriseDevelopment

Financial Services

Food Security

How Many Indicators?

• Our Avg # of Work Objectives (IRs/Sub IRs) perproject = 5

• 3 indicators per work objective normallyneeded for management purposes (2 output+1 outcome) plus a few (3-7) impactindicators per project

• Thus ideally 18-20 indicators per project

How Many Indicators?

• Our Average # of indicators per project = 2424

• Average indicators per ir/objective = 55

• Current range of # indicators on our projects

= 55 –– 7171

Nota Bene: Is it just Right?

• Number of indicators not a good predictor ofsuccess or failure just provides critical informationto assess progress (output indicators) andachievement of (outcomes and impact indicators)goals/objectives.

• Too many becomes burdensome too few becomesmeaningless.

Our VisionVisionA world in which people are empowered to succeed in theglobal economy.

MissionTo promote economic opportunities for cooperatives,enterprises and communities through the innovativeapplication of sound business practice.

ValuesACDI/VOCA strives to promote positive economic andsocial change worldwide. It is distinguished by commitmentto its overseas beneficiaries, wise stewardship ofdevelopment resources and a knowledgeable,experienced, diverse and effective team

Why Global Performance Indicators?

• To assess the performance of its projects (and its valuesand mission), A/V would like to use a comprehensiveperformance measurement framework.

• ACDI/VOCA will track this progression of itsperformance through results reporting against indicatorsfrom the project level (predominantly outputs), to thebroader program level (predominantly outcomes).

• The indicators will be standardized to the greatestdegree possible, thus allowing ACDI/VOCA and itspartners to compare performance across the portfolio ofprojects.

Suggested Global Indicators –to beto be

disaggregated when appropriatedisaggregated when appropriate

• Number of hectares under improved technologies or management practices as a result ofUSG assistance

• Number of jobs attributed to AV implementation

• Gross margin per unit of land, kilograms of selected crops

• Value of incremental sales (collected at farm-level) attributed AV implementation

• Number of individuals who have received AV supported short-term agricultural sectorproductivity or food security training

• Number of women’s organizations/associations receiving AV assistance

• Number of public-private partnerships formed as a result of AV assistance

• Average percent change in score on key areas of organization capacity among AV directand indirect local implementing partners

• Number of farmers and others who have applied new technologies or managementpractices as a result of AV assistance

• Proportion of female participants in USG-assisted programs designed to increase accessto productive economic resources (assets, credit, income or employment)

• Proportion of females who report increased self-efficacy at the conclusion of USGsupported training/programming

Since 1963 and in 145 countries, ACDI/VOCA has empoweredpeople to succeed in the global economy.