Module 2 presentations

MODULE TWOHIV/TB M&E FRAMEWORK & ITS IMPLEMENTATION

1

Outline of the Module

• WFP HIV/TB Corporate and Project Specific outcomes and indicatorsI • M&E in Global and National contextsII • Designing a project LogframeIII • Designing an M&E PlanIV • Designing data collection tools and set a data collection systemV• Data analysis for HIV and TB programmingVI• Reporting on HIV & TB programmingVII• Module testVIII

2

WFP HIV AND TB CORPORATE AND PROJECT SPECIFIC OUTCOMES AND

INDICATORS

3

4

Results Chain: Casual sequence for an operation to achieve desired objectives

RESULTSACTIVITIES

General Introduction to M&EResult Based Management

INPUTS

E.g.GovernmentEquipmentFoodCashSkills and ExperienceTechnologyServices

EMOP

SO

PRRO

DEV

E.g. People fed

E.g. People fed; assets gained

E.g. Nutritional status

maintained/improved

E.g. Livelihood improved

E.g. Reduced Number of

Hungry people

Action taken or worked performed through which

inputs are mobilised to produce specific outputs

Raw materials needed to bring about the results

being sought

IMPACTOUTCOMESOUTPUTS

Monitoring

Definition of key terms M&E Terminology

Routine tracking of data on inputs, outputs, process and outcomes within relief, recovery, development operations

Process of using data to ascertain the effectiveness, impact, efficiency, relevance and sustainability of an on-going or completed operation

Long-term developmental gains which an intervention is expected to help achieve. WFP’s intervention is a necessary but not a sufficient means for reaching the objective, and often forms part of a government's overall development strategy

The positive and negative intended or unintended long-term results produced by an operation, either directly or indirectly

Medium-term results achieved by an operation. They should be defined in a way that allow verification of achievement, since they form the basis for evaluating the success or failure of the intervention

Quantitative and qualitative factor or variable that provides a simple and reliable means to measure achievement or to reflect changes connected with an operation

5

Evaluation

Outcome

Impact

Objectives

Indicator

CorporateOutcome

Definition of key terms WFP Specific M&E Concepts and Terms

Outcomes on which is mandatory to report on within a particular context and thus according to Programme Category and Programmes operated

Additional and Optional outcomes that might be selected on top of the corporate outcome. They should be chosen according to the project’s objectives as well as the capacity to collect and analyse data within a particular context

The most robust Indicators found in the SRF aligned with the corporate outcomes and outputs to be achieved under specific Strategic Objectives

Indicators aligned with the project specific outcomes that can built up a body of additional data that provide a more accurate and in-depth performance measurement and develop a better understanding of the range of factors influencing the outcomes

6

Project Specific Outcome

CorporateOutcomeIndicator

Project Specific Outcome Indicators

M&E strategy in WFP is designed in conjunction with the general project design. It is composed principally of Logframe, M&E Plan and Reporting flow and formats

Overview in HIV and TB Corporate Outcome and Indicators

7

EMOP PRRO (relief)

PRRO

CP/DEV

SO1

SO3, sometimes

SO1

SO4

C&T-Maintained access to services

C&T-Improved nutritional recovery

M&SN-Adequate food consumption of HIV/TB HHs

C&T-Improved ART adherence and/or Improved TB treatment success + Improved nutritional recovery

M&SN-Adequate food consumption of HIV/TB HHs

• Default rate

• Nutritional recovery rate

• HH Food Consumption Score (FCS)

• ART adherence rate• TB treatment success

rate• Nutritional recovery

rate• HH FCS

Programme Category

Strategic Objectives

CorporateOutcomes

CorporateIndicators

EMERGENCY

RECOVERY & RELIEF

DEVELOPMENT

Overview in HIV and TB Corporate vs. Project Specific Outcome and Indicators

8

EMOP/PRRO SO1

PRROSO3, SO1

CP/DEV-SO4

C&T-Maintained access to services

C&T-Improved nutritional recovery

M&SN-Adequate food consumption of HIV/TB HH

C&T-Improved ART adherence and/or Improved TB treatment success+ Improved nutritional recovery

M&SN-Adequate food consumption of HIV/TB HH

• Nutritional recovery rate• Adherence rate• TB treat. success

• Default rate• Adherence rate• TB treat. success rate• OVC attendance rate

• Default rate• TB treat. adherence rate• OVC attendance rate

Project Specific

Outcomes

Project Specific

Indicators

Corporate Outcome

• Improved nutritional recovery • Improved adherence• Increased TB treat. success

• Reduced default rate• Improved adherence• Increased TB treat. success• Increased access to education,

human capital develop. of OVC

• Reduced default rate• Improved adherence to TB treat.• Increased access to education,

human capital develop. of OVC

Emergency Settings Corporate and Project Specific Outcome and Indicators

9

Project Specific Outcomes

Project Specific Indicators

EMERGENCY settings: Essential services for PLHIV or TB clients may be disrupted and/or increased barriers to access

SO1: Save lives and protect livelihoods in an emergency Programme category: EMOP and PRRO (relief)

Care and Treatment

CorporateOutcomes

CorporateIndicators

Default occurs when the clients has missed the second consecutive scheduled medical visit

Increased success to TB treatment

Improved ART and/or TB treatment

nutritional recovery

Improved adherence to ART and/or TB treatment

Term

ART and/or TB nutritional recovery rate

ART and/or TB treatment adherence rate

TB treatment success rate

Default rate Percentage of clients defaulting from ART, TB, or PMTCT programme during reporting time

Maintained access to services for ART, TB treatment, or PMTCT

Relief and Recovery Settings-C&T Corporate and Project Specific Outcome and Indicators

10

Improved ART and/or TB nutritional recovery

Project Specific

Outcomes

Project Specific

Indicators

Relief and Recovery settings: characterized by prolonged conflict or protracted impact of shock where PLHIV or people infected with TB may be vulnerable to malnutrition or food security

SO3: Restore and rebuild lives and livelihoods in post-conflict, post disaster, or transition situationsProgramme Category: PRRO

Care and Treatment

CorporateOutcomes

CorporateIndicators

Malnutrition is determined using anthropometric measures that vary depending on age, gender, and other factors

Nutritional recovery rate

% of ART or TB clients found to be malnourished at initiation of food support who are considered to have recovered from malnutrition upon completion of food support


Reduced ART, PMTCT or TB treatment default rate


Term

ART, PMTCT or TB default rate

ART, PMTCT or TB treatment adherence rate


Relief and Recovery Settings-M&SN Corporate and Project Specific Outcome and Indicators

11

Adequate food consumption of HIV- or TB- affected HHs

Project Specific

Outcomes

Project Specific

Indicators

Relief and Recovery settings: characterized by prolonged conflict or protracted impact of shock where PLHIV or people infected with TB may be vulnerable to malnutrition or food security

SO3: Restore and rebuild lives and livelihoods in post-conflict, post disaster, or transition situationsProgramme Category: PRRO

Mitigation and Safety Nets

CorporateOutcomes

CorporateIndicators

HH Food Consumption Score

Composite score based on dietary diversity, food frequency, and relative nutritional importance of different food groups



OVC Attendance rate

ART, PMTCT or TB treatment adherence

rate


Increased access to education and human

capital develop. of OVC

While improving HHs food security (measured with FCS) is the primary objective of M&SN activities, there are parallel individual outcome indicators that can be measured

Term

Development Settings-C&T Corporate and Project Specific Outcome and Indicators

12

Improved success of TB treatment

Project Specific Outcomes

Project Specific Indicators

Development settings: characterized by an enabling environment for design and support sustainable longer-term goals solution, as treatment success (TB) and ART adherence.

SO4: Reduce chronic hunger and undernutritionProgramme Category: CP or DEV

Care and Treatment

CorporateOutcomes

CorporateIndicators

Adherence refer to how closely the ART client follows the prescribed treatment regimen

Nutritional recovery rate

Reduced ART, PMTCT or TB treatment default rate

Improved adherence to TB treatment

Term

ART, PMTCT or TB default rate


+Improve nutritional recovery

Improved adherence to ART and/or

TB treatment success rate85% of TB cases receiving WFP support registered under DOTS in given year that have successfully completed treatment

ART adherence rate% of ART clients achieving >95% adherence to medication during the course of previous month

TermTB Success: % of new smear-positive TB cases under DOTS in a given year that successfully completed treatment (with and without bacteriological evidence)

Development Settings-M&SN Corporate and Project Specific Outcome and Indicators

13

Adequate food consumption of HIV- or TB- affected HHs

Project Specific

Outcomes

Project Specific

Indicators

Development settings: characterized by an enabling environment for design and support sustainable longer-term goals solution, as treatment success (TB) and ART adherence

SO4: Reduce chronic hunger and undernutritionProgramme Category: CP or DEV

Mitigation and Safety Nets

CorporateOutcomes

CorporateIndicators

HH Food Consumption Score

Composite score based on dietary diversity, food frequency, and relative nutritional importance of different food groups



OVC Attendance rate



Increased access to education and human

capital develop. of OVC

FCS measures the frequency with which different food groups are consumed by a HH during seven days before the survey

Term

M&E IN GLOBAL & NATIONAL CONTEXTSHOW TO BE HARMONIZED WITH BOTH NATIONAL

AND GLOBAL EXISTING M&E FRAMEWORKS

14

NATIONAL CONTEXT

Until recently, food security and nutrition programming was a neglected aspect of most national strategic plans related to HIV

Country’s priorities differ from WFP or/and other partners, and this may lead to reduced reporting of WFP key indicators

National M&E framework and data collection system may differ from WFP’s and other partners’ framework

National capacity in collecting and analyzing data not always ensured due to lack of means and human resources

15

Global and National M&E Context Challenges and Key Considerations

HIV indicators are not globally harmonised because different stakeholders have different information needs and priorities as well as different mandates

Due to different indicators, it is not consistently possible to compare progress and results across countries or programmes, or aggregate results at regional or global level

Most of key donors (such as GF, PEPFAR, WB) are financing only proposals aligned and supportive to the national HIV strategy

GLOBAL CONTEXT

16

Global Context for M&E HIV- and TB- related interventions

Recent developments in the Global Context:

Success in achieving food and nutrition internationally recognized as critical element around treatment, care and support, through main international commitment and agreements

1

Nutrition Care

Political Declaration on HIV/AIDS

Global Fund PEPFAR

Consultative meeting, WHO

27th PCBUNAIDS

UBRAF

UNAIDS, Division of Labour

Following some revisions, these indicators will likely be included in the UNAIDS Indicator Register in 2012. Three set of proposed indicators resulted, respectively on:

PMTCT and Infant feeding

Food Security

2 In response of the World Health Assembly (WHA) request o f reporting on nutrition and HIV activities, WHO and PEPFAR, through stakeholder consultations, have identified a set of globally harmonized M&E indicators for nutrition and HIV activities that has been reviewed by the Monitoring Evaluation Reference Group (MERG) TWG at UNAIDS

17

National Context for M&E HIV- and TB- related interventions

3

THE THREE ONESA good starting point for thinking about M&E for HIV-related interventions at national level

A set of guiding principles for national authorities, established by UNAIDS (and endorsed by Global Fund, the World Bank and all key donor countries)

Donors and various international actors need to adapt their system and processes to the national ones that are commonly agreed

One agreed-upon country-level monitoring and evaluation system

One agreed HIV/AIDS action framework that provides the basis for coordinating the work of all partners

1 2 One national AIDS coordinating authority, with a broad-based multi-sectorial mandate

Where a national M&E system is in place it often builds on UN General Assembly Special Session (UNGASS) indicators, that are not specifically oriented toward food and nutrition, as well as other (non-UNGASS) indicators suggested by various national stakeholder

SENSITIZATIONADVOCACY

WFP Role at National level Building National M&E framework

18

NATIONAL STRATEGIC

PLAN

NATIONAL M&EFRAMEWORK

NATIONAL M&E REPORTING

SYSTEM

• Ensure adequacy with WFP policies and procedures• Ensure that the link between Programme Category and SOs is preserved

WFP M&E SYSTEM

Despite significant progress in growing evidence in support of integrated HIV, food security and nutrition programming, there is still a need for sensitization and advocacy at national level

• Advocate for the inclusion of food and nutrition programming in the development of, and revisions to, national strategic plans

• Participate to the development of main national strategy, including UNDAF and Joint United Nations Programme on HIV/AIDS in order to ensure food and nutrition is captured in related M&E framework

Review existing national, UNDAF and other development partners M&E systems and where feasible integrate food and nutrition-related specific indicators in the national M&E framework

Acknowledge and understand the national-level reporting systems within the country where is operating and contribute where feasible to national data collection systems

M&E ACTIVITIES

Role of the Government Building National M&E framework

19

CAPACITY BUILDING

INTEGRATED HEALTH

MANAGEMENT SYSTEM

COLLABORATIONPARTNERSHIP

Encourage dynamic participation of government counterpart during the design phase of both M&E framework and reporting system

Manage and implement M&E activities

Build and strengthen government capacity in data collection, processing and analysis to ensure sustainability of programmes

Advocate for a Integrated National Management Systems or other sector wide information system

DESIGNING LOGFRAMEHOW TO REFLECT PROJECT OBJECTIVES IN A

LOGICAL FRAMEWORK

20

Monitoring and Evaluation should not be seen as an isolated exercise, but should be considered a crucial aspect of the larger process of project design and implementation

The development and implementation of the M&E strategy should be led by the government with support from WFP and stakeholders

A comprehensive M&E system should outline in detail what data will be collected, how, when and by whom it will be collected, the process for data analysis, the responsible parties including government and Implementing partners, budgetary requirement and other details

M&E strategy in WFP is designed in conjunction with the general project design. It is composed principally of i) Logframe, ii) M&E Plan and iii) Reporting flows and formats

21

Key Concepts in M&E

M&E Strategy

1

2

3

4

A matrix document submitted with project document that reflects outcome indicators you will be measuring and reporting on

22

What is a logframe?The starting point in the preparation of M&E strategy

The logframe or logical framework is

A management tool used to design projects and programmes, in which hierarchy of basic project elements are linked together in a logical cause and effect arrangement

The link between project design and design of M&E system, specifically at output and outcome levels

Logical framework analysis is a technique used both for designing an intervention and for evaluating its effects

23

What is a Logframe? Main elements and contents

The original logframe is a 4 columns matrix that contains specific information on programme/project:

COLUMN 1

It incorporate a hierarchy of a logic

model: Result chain

COLUMN 2 COLUMN 3 COLUMN 4

Impact

Outcomes

Outputs

Activities

It outlines how the design will be

monitored and evaluated :

Performance Indicators

Impact indicators

Outcomes indicators

Outputs indicators

Inputs/Resources

It specifics the source(s) of

information for assessing indicators:

Means of verification

Programme /project evaluation system

Programme/project evaluation system, report and performance review

Programme/project supervision, monitoring system, report and regular performance review

Monitoring system for validating implementation progress

It outlines the external assumptions

and risks related to each level of the

internal logic: Assumption and risks

Risk regarding strategic impact

Outcome to Impact

Output to Outcome

Activity to Output

24

WFP Logframe Main elements and contents

COLUMN 1

Result chain

COLUMN 2 COLUMN 3 COLUMN 4

IMPACT

OUTCOME

OUTPUT

ACTIVITIES

Indicators

Imp. indicators

Outcome Indicators

Output Indicators

Inputs/ Resources

Means of verification

• The revised SRF focused on the performance of outcome and output indicators measured and reported at the beneficiary and community levels

• Impact level indicators have been removed from logframe- COs are urged to report impact-level indicators through annual Standard Project Reports (SPRs) exercise, when applicable

• WFP is committed to demonstrate change or impact by linking its performance to MDG through national MDG progress report, UNDAF mid term review

• For CP and DEV Project, logframe should be aligned with the UN Development Assistance Framework (UNDAF) and its Result Matrix

SRF (2008-2012) has been further refined in 2011 to better demonstrate the results of WFP operations, and to align definitions of outcomes as medium term results of WFP operations

Priorities

UNDAF & MDGs

Assumption and risks

25

WFP LogframeMain Steps for developing Logframe

STRATEGIC OBJECTIVES

Result-Hierarchy Performance indicators Means of verification Assumption and risks

UNDAF Outcome

Outcomes - Corporate- Project Specific

Outcome indicators• Target, Baseline

Outputs Outputs indicators• Target

Match Programme category and WFP SOs and, for CP/DEV, UNDAF Outcome

Select appropriate Mandatory Corporate Outcome and additional Project-specific Outcome for the SO pertaining to your programme

Define Outputs Strategy for achieving the outcome

Identify appropiate Outcome Indicators per each of the outcomes selected

Ensure that Baseline (if existing), and Targets are provided for each indicators

Ensure connectivity between every Outcome indicator and its corresponding Output Indicator

Add The Monitoring and Evaluation Approach and ensure Data Sources are provided

Identify Assumptions and Risks that may influence success or failure

1

2

1

2

For each Strategic Objective should be filled a separate logframe

3

4

3

4

5

6

6

5

7

7

8

8

1

26

WFP Logframe Matrix HIV and TB Programme under EMOP and PRRO-relief

STRATEGIC OBJECTIVES: SO1-Save lives and protect livelihood in emergencyWhat the operation wants to

achieve?How the performance of the operation will be measured Factors beyond management

control affecting operations

Results-Hierarchy Performance indicators Means of verification (MOV) Assumption and risks

OUTCOMES (Corporate and Project Specific)

1.1 Maintained access to services for ART, TB treatment and/or PMTCT

1.1.1 Default rateTarget: Default rate < 15%

(Sphere)

Source: ART, TB or PMTCT/MCHN registers at health facility level or treatment centre run by partners

Risk regarding programme level impactE.g. Data collection may be affected by the shockE.g. Stigma discourage people from attending ART or TB centres

OUTPUTS

1.1 Food, cash and vouchers distributed in sufficient quantity and quality to target group (ART, TB or PMTCT)1.2 …

List of indicators provided, such as:1.1.1 # of women, men, girls and boys received food, C&V 1.1.2. Tonnage of food distributed…, etc.

Monitoring system for validating operation designSource: E.g. Monthly WFP Food Distribution Reports

Risk regarding design effectiveness

TargetsTargets are project and context-specific. They should take into account objectives of the intervention, planned level of inputs, baseline figures, trend observed prior to the start of interventions and the pre-emergency data, counterpart capacity, expert judgments and the accomplishments of comparable interventions

Select appropriate Project Specific Outcomes/Indicators from the list 1.2…..

27

WFP Logframe Matrix HIV and TB Programme under EMOP and PRRO-relief

1.2.1 ART or TB nutritional recoveryTarget: Nutritional recovery rate > 75 % (Sphere)

1.3.1 ART or TB treatment adherence rateTarget: Context specific

1.4.1 TB treatment success rateTarget: >85% (WHO)

Source: ART or TB registers at health facility level or treatment centres run by partners



1.2 Improved ART or TB nutritional recovery

1.3 Improved adherence to ART, TB treatment

1.4 Increased success of TB treatment

Risk regarding programme level impact

E.g. Data collection may be affected by the shockE.g. Stigma discourage people from attending ART or TB centres…

List of appropriate Project Specific Outcomes and related indicators that might be selected and included into the Logframe

Results-Hierarchy Performance indicators Means of verification (MOV)Assumption and

risks

28

WFP Logframe Matrix HIV and TB Programme under PRRO

STRATEGIC OBJECTIVES: SO3-Restore and rebuild lives and livelihood What the operation wants to

achieve?How the performance of the operation will be measured Factors beyond management

control affecting operations

Results-Hierarchy Performance indicators Means of verification (MOV) Assumption and risks


1.1 Improved ART and or TB nutritional recovery

1.2 Adequate food consumption of HIV or TB- affected HHS

1.1.1 Nutritional recovery rateTarget: Nutritional recovery rate > 75%

1.2.1 HH Food consumption Score

Source: Nutritional registers and clients card at health facility level or treat. centres

Source: Annual monitoring and/or survey report


E.g. Data collection analysis conducted by health care providersE.g. External factors may influence nutritional status

OUTPUTS

1.1 Food, cash and vouchers distributed in sufficient quantity and quality to target group (ART, TB or PMTCT)1.2 ….

List of indicators provided, such as:1.1.1 # of women, men, girls and boys received food, C&V 1.1.2. Tonnage of food distributed…, etc.

Monitoring system for validating operation designSource: E.g. Monthly WFP Food Distribution Reports


Select appropriate Project Specific Outcomes/Indicators from the list 1.3…..

29

WFP Logframe Matrix HIV and TB Programme under PRRO

1.3.1 ART, PMTCT or TB treat. default rateTarget: < 15%

1.4.1. ART or DOTS adherence rateTarget: Context specific

1.5.1 TB treat. success rateTarget: >85%

1.6.1 OVC Attendance rateTarget: 80%

Source: ART or TB registers at health facility level or treatment centres run by partnersSource: ART or TB registers at health facility level or treatment centres run by partnersSource: ART or TB registers at health facility level or treatment centres run by partnersSource: School records

1.3 Reduced ART, PMTCT or TB treatment default rate

1.4 Improved adherence to ART, TB treatment


1.6 Increased access to education and human capital development of OVC


E.g. Data collection analysis conducted by health care providersE.g. External factors may influence nutritional status…..



risks

30

WFP Logframe Matrix

HIV and TB Programme under CP/DEVSTRATEGIC OBJECTIVES: SO4-Reduce Chronic Hunger and Undernutrition

Result-Hierarchy Performance indicators Means of verification Assumption and risks

IMPACT→ UNDAF OUTCOME UNDAF indicators reported as per mid-term UNDAF review, etc.


1.1 Improved adherence to ARTand/or1.2 Improved success of TB treatment 1.3 ART and/or TB Improve nutritional recovery

1.4 Adequate food consumption of HIV- and/or TB affected HHs

1.1.1 ART adherence rateTarget: Context specific

1.2.1 TB treat. success rateTarget: >85%

1.3.1 Nutritional recovery rateTarget: >75%

1.4.1 HH Food Consumption Score

Source: ART or TB registers at health facility level or treatment centresSource: ART or TB registers at health facility level or treatment centreSource: Nutritional registers and clients card at health facility level or treat. centres

Source: Annual monitoring and/or survey report


E.g. Data collection analysis conducted by health care providersE.g. External factors may influence nutritional statusE.g. Burden at health facility may impact the quality of reporting

OUTPUTS

1.1 Food, cash and vouchers distributed in sufficient quantity and quality to ART, TB or PMTCT clients, OVC and HHs…

List of indicators, as per EMOP:1.1.1 # of women, men, girls and boys received food, C&V…, etc.

Source: E.g. Monthly WFP Food Distribution Reports


Select appropriate Project Specific Outcomes/Indicators from the list 1.5….

1.5 Reduced ART, PMTCT or TB treatment default rate

1.6 Improve adherence to TB treatment

1.7 Increased access to education and human capital development of OVC

31

WFP Logframe Matrix HIV and TB Programme under CP/DEV

1.5.1 ART, PMTCT or TB treat. default rateTarget: < 15%

1.6.1 TB adherence rateTarget: Context specific

1.7.1 OVC Attendance rateTarget: 80%

Source: ART or TB registers at health facility level or treatment centres run by partnersSource: ART or TB registers at health facility level or treatment centres run by partners

Source: School records


E.g. Data collection analysis conducted by health care providersE.g. External factors may influence nutritional status

…..



risks

DESIGNING AN M&E PLANWHICH ELEMENTS SHOULD INCLUDE

32

33

Key Concepts in M&E

M&E Strategy




M&E strategy in WFP is designed in conjunction with the general project design. It is composed principally of i) Logframe, ii) M&E Plan and, iii) Reporting flows and formats

1

2

3

4

It is a matrix or table useful for clearly identifying what data is needed, the source of data, how often it will be collected, by whom it will be collected, what methods will be used in collection and finally in which reports and forum the data will be presented

It is critical for establishing clear roles and responsibilities of WFP and partners

34

What is a M&E Plan?Plan to collect and analyse data

The M&E Plan Matrix

It sets out arrangements for routine collection of monitoring data and periodic evaluation data, based on indicators identified in the logical framework

M&E PLAN is a tool built upon the information on the logical framework to plan the collection, analysis, use and dissemination of performance information

35

M&E Matrix Plan Main elements and contents

• Selected performance indicators

• Identified data sources

• Methods for data collection

• Frequency of data collection

• Roles and responsibilities

• How the information will be used & reported

M&E Plan Matrix

Expected Results-

Key Indicators Mean of Verification Use of information

Data Source Collection method Frequency of Collection Responsibilities for collection

1.1

1.2

1.3

The M&E Plan should include:

LOGICAL FRAMEWORK

Result-Hierarchy

Indicators MoV Assumptions

Impact

Outcome

Output

Activities

Each expected result from the fist column

in the Logical Framework gets its

own monitoring plan

36

M&E Matrix Plan Main Steps for Developing a M&E Plan

M&E Plan Matrix

Expected Results-


Data Source Collection method

Frequency of Collection

Responsibilities for collection

1.1 E.g. Quantity of fortified food distributed

1.2

1.3

LOGICAL FRAMEWORK

Results Hierarchy


Impact

Outcome

Outputs E.g. Quantity of fortified food distributed

Activities

For each expected result the M&E Plan matrix gives details of how

selected indicators will actually be used

37


M&E Plan Matrix

Expected Results-






E.g. Monthly WFP Food Distribution Reports

1.2

1.3

LOGICAL FRAMEWORK

Results Hierarchy


Impact

Outcome


Activities

The Primary and/or Secondary data source for each indicator is located

• Primary data are collected through the use of surveys, meetings, focus group discussions, interviews or other methods that involve direct contact with respondents

• Secondary data are existing data that have been or will be collected by WFP or others for another purpose

LOGICAL FRAMEWORK

Results Hierarchy


Impact

Outcome


Activities

38


M&E Plan Matrix

Expected Results-







E.g. Daily food distribution sheet filled at health facility

E.g. Monthly E.g. Field Monitoring Assistance

1.2

1 2 3

Spell out clearly who will do the collection and analysis of the data for each indicator

3

Technical process that will be used to collect and analyse data for each indicator

For each indicator, stakeholders agree on how often data will be collected and the cost for collection is estimated

1

2

39


M&E Plan Matrix

Expected Results-

Key Indicators

Mean of Verification Use of information






E.g. Daily food distribution sheet filled at health facility

E.g. Monthly E.g. Field Monitoring Assistance

1.2

Reporting

In which report(s) the information will be included (E.g. Quarterly

Progress Report; Project Implementation Report, final

evaluation etc)

Presentation

At which forums or meetings the information or report will be presented and discussed (E.g.

Quarterly management meetings; annual progress review

workshop)

DESIGNING DATA COLLECTION TOOLS AND SET A DATA COLLECTION SYSTEMTO ENSURE FLOW OF INFORMATION

40

41

Key Concepts in M&E

M&E Strategy




M&E strategy in WFP is designed in conjunction with the general project design. It is composed principally of i) Logframe, ii) M&E Plan and, iii) Reporting flows and formats

1

2

3

4

42

Overview of Reporting Flow Data Collection Tools

M&E Plan identifies Mean of Verification, including the data collection tools and the reports

TotalGirls 5-18 Boys 5-18 Women Men

Returning Refugees - Re-integration Package

Girls < 5 Boys <5

Refugees

Returning Refugees - Transit Rations

Loss & Damage Reasons

S.I. Number LossesClosing Balance

Damaged/Spoield

Food ReturnsDistributedCommodityOpening

StockReceipts

General Food Distribution

WFP Sudan

Cooperating Partner General Food Distribution Report

Project Number

Report Date Report Number

2. Stock Movements

State, Locality, County CP's FLA NumberLocation / Distribution Site

Distribution Period / Month Distribution Dates From……………………..... To………….………………..

1. Cooperating Partner DetailsCooperating Partner

Boys 5-18 Women

Comments

Girls < 5 Girls 5-18Boys <5 TotalMen

3. Beneficiary Numbers

IDPs

Residents

Returning IDPs - Transit Rations

3.1. Beneficiaries Numbers - Returnees

Resettled

Returning IDPs - Re-integration Package

Total Beneficiaries

World Food Programme EthiopiaUrban HIV/AIDS Project

Assessment Form for the Graduation of PLHIVs

Cooperating PartnerHealth Facility

Name of the patient (2)

Number of months the patient was on the food support (3)

Number of months the patient was on ART(4)

Height (in Cm) (5)

Weight (in Kg) (6)

Body Mass Index (BMI) (7)

Capacity to engage in daily activities (8)

Data Collection Tools

M&E Plan

Based on the indicators selected in the logframe, each CO is responsible for developing Data Collections tools and Reports

Data collection tools should be related to the type of reports expected to be produced in short- and long-term

Reporting Processing Data

43

Data Collection ToolsDefinitions and Key Concepts

Data collection tools, the key for adequate monitoring

• It provides information that allows WFP managers to assess planned vs. actual achievements, progress and changes of the operation

• The indicators selected in the Logframe are the basis on which the data collected tools should be designed

• Data collection tools/formats (questionnaire, checklist, etc.) need to be carefully designed to collect only necessary information to ensure efficient use of M&E resource

44

Data Collection ToolsHIV and TB Programming



Girls < 5 Boys <5

Refugees




Damaged/Spoield


StockReceipts


WFP Sudan


Project Number


2. Stock Movements




Boys 5-18 Women

Comments



IDPs

Residents



Resettled


Total Beneficiaries







Height (in Cm) (5)

Weight (in Kg) (6)



Distribution monitoring checklist

On-site checklist

Post Distribution Monitoring or Beneficiaries Contact Monitoring questionnaire

Cooperating Partners Monthly Reports (stock movement and actual beneficiaries)

1

There are many different data collection tools in use in WFP for HIV and TB interventions.

They can be summarised as:

2

3

4

8.1.1: If there any losses or Theft reported in 8.1, tick and list the lost quantities in MT ?

□ Cereals ________ □ Pulses _________ □ CSB __________ □ Oil ________

□ Sugar __________ □ Salt __________ □ Others ___________

□

□ Cereals ________ □ Pulses _________ □ CSB __________ □ Oil ________ 8.2.1: If there was excesses commodities at the end of the distribution, tick and list the excess Qty in MT.

□ Sugar __________ □ Salt __________ □ Others ___________

8. Stock Reconciliation

□□□

□

Please state any additional information you feel was not captured above. Note lessons learned and opportunities for improvement.

Were there any security incidents during the distribution? If so, please explain.

□

□

□Under-scooping

10. Additional Comments

8.1: If commodities ran out before distribution was completed, give the reason why (tick).

8.2: If there was excesses commodities at the end of the distribution, give the reason why (tick).

Deliveries were less than planned

Losses at the FDP

Over-scooping

Theft at the FDP

Excess deliveries

Fewer beneficiaries turned up (absentees)

Beneficiaries refused the ration

9. Security

45

Data Collection Tools Distribution Monitoring Checklist

Key concepts and information • Most distribution are carried out by Implementing Partners (IPs)

• During a food distribution, WFP Field Monitors check on random basis whether the distribution are been undertaken smoothly and according to the plan

• Main output and process indicators are monitored, such as planned vs. actual numbers of targeted beneficiaries, amount of MT distributed, appropriate ration size, quality of commodities, etc.

General Information

Dispatch and Delivery

Distribution Timeframe

Beneficiaries Selection and Enrolment

Distribution mechanism and Centre management

Gender, Awareness and Protection Issues

Quality of food being distributed

Stock Movement

Security, and other issues

Key elements that may be included

1

Urban HIV/AIDS Input and Process Monitoring Checklist

WFP Ethiopia

1. General Information

Town:

Name of distribution Site: Core Cooperating Partner

Number of Beneficiary served at this distribution site?

□ PLHIV ________________ □ PMTCT_____________ □ OVC________________

Distribution Month and Qty by commodity (mt)

□ Month ________________ □ Cereals_____________ □ Pulses________________ □ CSB ___________ □ Oil __________________

Distribution Dates

Monitoring PersonName_________________________________ Signature____________________________Date_________

2. Dispatch and Delivery

Question/Indicator Control Comments2.1: Did the distribution site receive the correct dispatched food ?(Check the way bills and Goods Receiving Notes)

Yes No

2.2: If no, explain which commodity/s were partially or not completely received? Indicate the QTY missing in MTs

Cereals_____________ Pulses________________

CSB _____________ Oil __________________ If you know, the main reason----------------------------------------------------------

3. Distribution Timeframe

Question/Indicator Control Comments3.1: Was there any agreed upon schedule for the distribution to take place Yes No 3.2: If yes, was it properly communicated with the beneficiaries? Yes No 3.3: Did the distribution start on schedule? Yes No

3.4: If no, how late was the start of the distribution and Why?

Days ----------------- Hours______ Reason: Delay in food delivery □ Store management □ Beneficiary/Targeting issues □ Food shortage □ Others □ (specify) -----------

3.5: Did the distribution end on schedule? Yes No Unknown

3.6: If no, how late was the end of the distribution? Why?

Days ---------------- Reason: Delay in food delivery □ Store management □ Beneficiary/Targeting issues □ Food shortage □ Others □ (specify) -----------------

3.7: What is the average time spent waiting to receive rations? _______ Hours

4. Beneficiary Selection and Enrollwmnt:

Question/Indicator Control Comments4.1: Do the staff of the CP know the targetting criteria of the project for the different beneficiary categories?

Yes No

4.2: Are all PLHIV beneficiaries referred from ART clinics? Yes No

4.3: Are all PLHIV beneficiaries assessed for their BMI? Who is doing the assessment? Yes No Assessed by:

46


General Information

Cooperating Partner………………………..

Name distribution site FMA Name………………………………………..

Distribution month and Qty by commodities

□ PLHIV □ PMTCT □ OVC

Distribution date…………………………

Dispatch and Delivery

Did the distribution site receive the correct dispatched food ?

Yes No

If no, explain which commodity/s were partially or not completely received? Indicate the QTY missing in MTs

Cereals………..Pulses………. CSB……………..Oil…………….

…. Yes No

Distribution Timeframe

Was there any agreed upon schedule for the distribution to take place?

Yes No

Did the distribution start on schedule? Yes No

Did the distribution end on schedule? Yes No

What is average time spent waiting to receive rations

Hours……Beneficiaries Selection and Enrolment

Do the staff of the CP know the targeting criteria of the project?

Yes No

Are all PLHIV beneficiaries referred from ART clinics?

Yes No

Are all PLHIV beneficiaries assessed for their BMI? Who is doing the assessment?

Yes No

Are all PMTCT beneficiaries referred from PMTCT clinics?

Yes No

Does the selection of OVC involve the relevant community bodies?

Yes No

Example of Distribution Monitoring Checklist: Health facility

5. Distribution Mechanism/system & Centre Management

Question/Indicator Control Comments

Quantity of Food Distributed Cereals BlendedFood Pulse V.Oil Comments

5.1: What ration size is reported (by those in charge of the distribution) to be given per person? (in kg)

5.2: What information do beneficiaries have about the ration size /entitlements?. Kg

5.3: What ration size do beneficiaries report having received per person. (in kg)

5.4: What ration size do beneficiaries received per person? (in kg) (Take sample beneficiaries and measure the commodities they received)

Sample-1

Sample-2

Sample-3

Sampl-4

Sample-5

Sample-6

5.5: What was the distribution mechanism/system applied during this distribution? □ Group Distribution □ Individuals Distribution □ Other (Specify) ………………

5.6: Do the distributing staff properly cross-check the documents including the registration list, copons, and their beneficiary ID during food distribution? Yes No

5.12: Is there a committee composed of beneficiaries established to prevent the sales of food? Yes No

5.13: If yes to the previous, is it functional? Yes No

5.14:Is there Beneficiary Discussion being facilitated by trained facilitators? If yes, on what issues? Yes NoIssues: _______________________

5.15 If yes for the previous, do the beneficiaries ask questions? Is there dialogue between them? Yes No

5.16. Is there a training / demonstration about the preparation of meals from CSB/famix at the distribution site? Yes No

5.17: From your observation, how do you rate the management of the distribution center?

1____________ 2____________ 3____________ 4____________ 5

Needs Improvement Fair Good

6. Gender and Protection Issues


6.1: From your observation what is the percentage of women collecting food from the distribution site?

6.2 Who is collecting the food for school attending OVC and chronically sick PLHIV? OVC:themselves____ Guardian_____, Other family member_____Neignbour_____ Other (Specify)___ PLHIV: themselves___ Other Family member______ Neighbour______ Other (Specify)________

6.3 If their food is collected by someone else otherthan themselves (Q 6.2), do the collectors have delegation paper? Yes No

6.4: Are there recent incidents or reports of abuse/ robbery against beneficiaries at distribution site/while transporting the food to their houses? Yes No

6.5: Approximately, how far is the distribution from the residence of most of the beneficiaries? Km _____ km

6.6 Do the vulnerable group like: elderly, chronically ill, pregnant/nursing mothers, and physically disabled beneficiaries were given the first chance to collect their food ? Yes No

6.7 Is there a mechanism put in place to protect beneficiaries against any service charge? Yes No

6.8: How do people receiving food take it home? Carry it themselves □ Pack animals □ Pay for commercial transport □ Other □ (specify) ____________

7. Quality of Food Being Distributed

Commodity Wet bags Faulty packaging Foreign matter Infestation Spoilage/ Expiry Comments

Cereal Blended Food

Pulses V.Oil

8. Stock Movement

ParticularsCommodities (in MT)

Cereals Blended Food Pulse V.Oil other

A: Opening Stock (balance from previous allocation/distribution)

B: Deliveries/Receipts (for this distribution round)

C: A + B (Opening + Receipts)

D: Distribution

E: Losses

F: ( D + E )

G : Book Closing Stock ( C - F)

H : Physical Closing Stock Remarks on Losses:

9. Other Issues


9.1: Are PLHIV beneficiaries properly linked to ART/PMTCT clinics? Yes No

9.2 If yes for the previous, is there a mechanism put in place to ensure that beneficiaries are adhering to ART follow-up /complying to PMTCT service? Yes No

9.3 Do CPs have documented information about the address of all beneficiaries (PLHIV, PMTCT, and OVC)? Yes No

9.4 Do CPs have a mechanism to follow-up the progress of the beneficiaries ? Yes No

9.5 Do CPs provide complimentary services to the beneficiaries? If yes, what types? Yes No Complimentary Services: □ IGA □ HBC □ Education support □Other (Specify)………………

9.6 Is the graduation of beneficiaries properly implemented? Yes No

9.6 Is there a transparent mechanism of handling empty containers that involves all stakeholders? Yes No

47


Distribution Mechanism/System & Centre Management

Are the scoops marches the specified ration scale? Cereal……. Pulses….Oil……. CSB…..

What information do beneficiaries have about the ration size?

Cereal……. Pulses….Oil……. CSB…..

What ration size do beneficiaries report having received per person

Cereal……. Pulses….Oil……. CSB…..

What ration size do beneficiaries received per person? Cereal……. Pulses….Oil……. CSB…..

……..

Gender and Protection issues

From your observation what is the percentage of women collecting food from the distribution site?

Who is collecting the food for chronically sick PLHIV?

PLHIV □ other family member □…

Are there recent incidents or reports of abuse/robbery against beneficiaries at distribution site?

Yes No

Approximately, how far is the distribution from the residence of most of the beneficiaries?

…Km

How do people take the food home? Carry □ Pack animals □….

Quality of food being distributed

Wet bags Faulty packaging Infestation Spoilage/Expiry

Cereals □ □ □ □

Blended Food □ □ □ □

Pulses □ □ □ □

V oil □ □ □ □

…………

Stock movements

Cereal CSB Pulses Oil

Opening stock

Deliveries/Receipts

Opening + Deliveries/Receipts

Distribution

Losses

Example of Distribution Monitoring Checklist: Health facility

Other issues

Are PLHIV beneficiaries properly linked to ART/PMTCT clinics? Yes No

If yes, is there a mechanism in place to ensure adherence to ART follow up/complying PMTCT services?

Yes No

Do CPs have documents information about address of all beneficiaries? Yes No

Do CPs provide complimentary services to the beneficiaries? Is yes, what types?

Yes No

…..

48

Key concepts and information • Most distribution are carried out by Implementing Partners (IPs)

• During on-site visits, WFP Field Monitors visit a health/nutrition centre or hospital on a random basis (not during a food distribution) to monitor whether the project is being implemented as planned

• It is mainly process indicators that are checked. Thus it measures how well the activities has been run, and it tracks how much has been done and how well people like it

General Information

Commodity Delivery

Storage Facilities

Food Quality

Food Distribution

Kitchen and Preparation

Health & Sanitation

Measurement Equipment

Focus Group Discussion

Key elements that may be included

Data Collection Tools On-site visit checklist

2

49

Data Collection Tools One-site Checklist

General Information

Cooperating Partner……………………….. Date of visit …………………………..

Reporting Period/Month…………………….. FMA Name………………………………………..

State, Locally/Country……………… FMA Signature…………………………….

Location/Center…………………………

Nutrition Centre Information

What type of Nutrition feeding programmes are provided?

TFP SFP BSFP

Did Beneficiaries received awareness sessions in HIV/AIDS during distribution?

Yes No

Where there any other awareness sessions conducted?

Yes No

Commodities Delivery

Did the last food delivery occur on schedule?

Yes No

If not, how late? Hours….. Days….

What were the causes of the delay? WFP logistic delay □ Truck mechanic problem □ Bad road/weather □

Storage Facilities

Does the Nutrition Centre have a store available?

Yes No

If yes, is the store adequate in size? Yes No

If, yes is the store secured? Yes No

If yes, is the store adequately ventilated? Yes No

Is food appropriately stacked? Yes No

Food Quality

Commodity Excessive moisture content

Faulty packaging

Foreign matter

Infestation Past expiry date

CSB

Oil

Sugar

Cereal

…..

Example of One-Site Checklist: Nutritional Centre

50

Data Collection Tools On-site visit checklist

Food Distribution for SFP

Are the scoops marches the specified ration scale?

Yes No

Is the actual scooping appropriate? Yes No

Are controls against spillage? Yes No

Are crowd control measures in place during distribution?

Yes No

What is average time spent queuing to receive selective feeding rations?

Yes No

…….. Yes No

Kitchen and Food Preparation

Does the Nutritional Centre have appropriate kitchen?

Yes No

Is the kitchen well ventilated? Yes No

Is the kitchen clean? Yes No

Is the cooking facilities adequate? Yes No

Is the cooked food covered until served? Yes No

………. Yes No

Health and Sanitation

General Hygiene Exist Poor Fair Good

Water □ □ □ □

Latrines Facilitates □ □ □ □

………… □ □ □ □

Example of One-Site Checklist: Nutritional Centre

Measurement Equipment

Does the Nutrition Centre has a salter scale?

Yes No

Does the Centre has Height Board? Yes No

Does the Centre has MUAC Tape? Yes No

…………. Yes No

…………… Yes No

Focus group Discussion with Waiting Beneficiaries

Do you have problems to access to the nutritional centre?

Have any of you faced problems while in the centre?

Do the children and rest of beneficiaries actually consume WFP food? If not why?

Do you share the selective feeding rations with other family members? If so, how much is shared and why?

…..

51

Data Collection Tools PDM or BCM Questionnaire

There are two main types of regular monitoring activities undertaken by WFP staff to monitor if outputs, process and outcomes are achieved according to plan

Post Distribution Monitoring

(PDM)

Beneficiaries Contact Monitoring

(BCM)

A systematic investigation to monitor beneficiaries’ perceptions of an operation to gauge progress in the transition from service delivery (outputs) to outcomes

A routinely investigation that takes place some time after the distribution but before the subsequent one

It monitors process and outputs indicators, such as planned vs. actual numbers of targeted beneficiaries, type and quantity of commodity distributed, etc.

It monitors the end-users at HH and community level, and market survey

• BCM is concerned with beneficiaries’ perspectives of access to, use of and satisfaction with outputs

• It is a qualitative and contextual specific approach to gauge an operation

• They are proxy indicators of the improved situation that an operation aimed to

• Monitor what people receive, quantity and access to, utilization of, satisfaction with, and acceptability of food aid

• Obtain qualitative and quantitative data• Obtain primary data by interviewing

randomly beneficiaries (HH members and hold community), the IP and other people involved

What is it? Which are main elements?

3

52

Example of Post distribution Monitoring Questionnaire

Data Collection Tools PDM Questionnaire

Details of HH Members• Who benefits from WFP intervention• Relationship types • Main Occupations

Receipt of food aids commodities• From whom (WFP, Govt, FBOs, etc.)• Inadequacy/adequacy of rationOpportunity Cost of Food Collection- Time and costs to travel to Food Distribution Point (FDP), Payment for milling, activities sacrificed for collecting the foods, etc.

Food Aid utilization• % of food aids used for market selling, bartering, sharing,

brewing, saving for seeds, feeding animals, etc.• If food aid sold-price received

Coping strategies (in the previous month)Food Consumption:

• Frequency• Dietary Diversity

53

Data Collection Tools CP Monthly reports

Cooperating Partner (CP) Monitoring reports are usually provided usually on monthly basis to WFP Country Office

Actual Number of Beneficiaries and

Outcomes

CP is responsible for providing detailed information on the movements of food stock received.

Especially for C&T activities, the data is registered in daily food distribution sheet by health staff/lay counsellors and then on monthly basis compiled information is provided to WFP through matrix document, as part of CP reports

CP is responsible for providing the actual number of beneficiaries and for monitoring clients’ outcomes (entries, default, lost follow up, recovered, etc.)

For C&T activities health staff/lay counsellors are usually those responsible for filling registers on daily basis and then for compiling monthly matrix to include in the CP reports

What is it?

4

Stock Movements

Cooperating Partner Monthly Food Distribution & Use Report (Version March 2007)

PRRO HIV -ART

1. Cooperating partner detailsProvince District Sector Institution/Centre

Name:Report Number

Project/FLA NumberReporting month: ___________ year ___________

Project Responsible Name

Storekeeper's name:

2.Stock movements/stock details (in Kg) during reporting month (from 1st to 31st of month)

CommodityPRRO number

Opening Stock at 1st of month

Food received

from WFP during month

Actual Food Distributed

during month

Food Returned to WFP during

month

Losses

during

month

Closing Balance at 31st

of month

Loss reasons

TOTAL Comments:

3. Actual Beneficiaries Number during reporting month

Beneficiary category

Entries during month

Total Beneficiaries for

the month

N=(A+B)

Exits during month

Total Exits

M=(C+D+E+F)

Total still on treatment at end of month (N-M)

Comments

Total on treatment at

1st of reporting

month coming from

previous month (A)

New admissions during

month (B)

Defaulted ( C

)

Deaths (D)

finalised

programme (E)

Transferred (F)

< 5 Girls

< 5 Boys

Girls 5-18

Boys 5-18

Women > 18

Men > 18

TOTAL

4. Certification from CP Certification from WFP

CP- submitted by: Title: WFP - certified by Title WFP- endorsed by HSO

Date

Signature: Date Signature Date Signature of HSO 54

Data Collection Tools CP Monthly reports

Actual Number of Beneficiaries and Outcomes

The matrix should contain information such as:

• Beneficiaries category• Entries during month (from previous month

and new entries)• Exits during month (defaulted, death,

recovered, transferred)

Stock movements

The matrix should contain information such as:

• Type of commodity• Opening stock at the 1st of month• Food received from WFP during the month• Actual food distributed• Food returned to WFP during month• Losses during month• Closing balance at 31st of month• Loss reasons

Example of CP Monthly report: ART health centres

VISIT 1 VISIT 2

Date Wt (Kg)

MUAC(cm) Urine BP

wks

FHR PP TT (1, 2, 3, 4, 5) & Date

Albendazol

e (1ST

Dose/2nd Dose)

HIV Re-testing

TB Screening Resul

t (P/N)

CD4 Count

CTX

(Y/N/NA)

Hb (Count)

AZT (Y/N/N

A)

WHO Clinical Stage

(1/2/3/4/NA)

Date Wt (Kg)

MUAC(cm) Urine BP

wks

FHR PP TT (1, 2, 3, 4, 5) & Date

Albendazol

e

(1st/2nd)/Date

HIV Re-testing

TB Screening Resul

t (P/N)

CD4 Count

CTX

(Y/N/NA)

Hb (Count)

AZT (Y/N/N

A)

WHO Clinical Stage

(1/2/3/4/NA)HOF

(cm) Eligible

(Y/N)

Date Re-

tested

Result

(R/NR/Inc

)

First (F)

Repeat (R )

HOF (cm) Eligibl

e (Y/N)

DateRe-

tested

Result (R/NR

/Inc)

First (F)

Repeat

(R )AL AM AN AO AP AQ AR AS AT AU AV AW AX AY AZ BA BB BC BD BE AL AM AN AO AP AQ AR AS AT AU AV AW AX AY AZ BA BB BC BD BE

wks

(1, 2, 3…) (1st, 2nd)

wks

(1, 2, 3…) (1st, 2nd)

HOF(cm) Date Date HOF(cm) Date Date

wks

(1, 2, 3…) (1st, 2nd)

wks

(1, 2, 3…) (1st, 2nd)


wks

(1, 2, 3…) (1st, 2nd)

wks

(1, 2, 3…) (1st, 2nd)


Serial Number Date ID Number (PIN)

First

ANC

(Y/N)

ANC Card Number

Name &

SurnameArea of Residence Contact Number (Cell/Tel)

Gravida

Parity

Age (years)

Height (cm

)

Food by Prescription

BG & Rh

(Result)

Syphilis Testing

HIV Status before this visit: (R/NR/U)

Date ART Initiated before

this visit/pregnancy

HIV Testing for the First Time

Tested

(Y/N)

Result:

(R/NR)

Treatment Given

(Y/N)

Date tested

Result: (R/NR/In

c)

Date Result

Receiv

edAdmission Date

Discharge Date

A B C D E F G H I J K L M N O P Q R S T U V W

55

Data Collection Tools Harmonised tools

Especially in the HIV and TB context, when exiting national data collection tool are available, WFP should opt to harmonize and integrate WFP data monitoring tool with the national ones: some of the information relevant for WFP operations such as nutritional and medical status of patients can be included into health facility registers, patients files, etc.

Example Swaziland: ANC National register

General information on the patients, including if enrolled in Food by Prescription

For each visit specific patients parameters need to be registered, including MUAC

56

Responsibilities for Data Collection

The responsibilities for field-level data collection and analysis depends on the entity operating the programme. This could be the Government, an Implementing Partners (IP) or WFP, where programmes are implemented directly

Government

When Government responsible for the implementation of programme, roles and responsibilities for M&E are outlined in the Letter of Agreement

WFP role Support monitoring through capacity development (training) and technical assistance and through ongoing supervision and oversight

Implementing Partners

If operating by an Implementing Partner, the responsibilities for data collection, analysis and reporting are laid out in the Field-Level Agreement (FLA): a contract that spells out what data needs to be collected, how often and the type of formats used for reporting the information back to WFP

FLA Outline

• Objectives of the partnership • Each organization’s specific roles and responsibilities• Details on food quantities, food rations, and distribution mechanisms• Reporting and financial management requirements• Payment procedures

WFP role

Support data collection and analysis of IPs through training on data collection methodologies and reporting in order to ensure effective information flow

AGREEMENT BETWEEN

WORLD FOOD PROGRAMME

AND

[Insert Full Legal Name of the NGO]

REGARDING THE IMPLEMENTATION OF A WFP ASSISTANCE PROGRAMME (WFP EMOP/PRRO/PROJECT number xxxxx - the “Operation”)

This field level agreement (the “Agreement”) is entered into between: - World Food Programme, an autonomous joint subsidiary programme of the United Nations and the Food and Agriculture Organisation of the United Nations, with headquarters in Rome, Italy, acting through its country office for [insert name of the country], of [insert full address of the Country Office] (“WFP”); and - [Insert full legal name of the NGO], a non-governmental, non-profit, non-political organisation, with offices at [insert full address of the NGO in the country of the Operation] (the “Partner”); (each also a “Party” and, collectively, the “Parties”).

GENERAL CONDITIONS

1. Objectives and scope of the Agreement 1.1 The Partner agrees to cooperate with WFP in providing services for the Operation described in the Plan of Operations and Project Proposal attached hereto as Annexes 2 and 3 (the “Services”). The Partner acknowledges and agrees that the Plan of Operations and Project Proposal specifically describes the envisaged cooperation between the Partner and WFP under this Agreement, and that WFP’s Operation may include other activities that are not described therein and are implemented by WFP directly or with third parties.

DATA ANALYSIS FOR HIV & TB PROGRAMMESHOW MEASURE HIV/TB OUTPUT AND OUTCOME

INDICATORS

57

58

Overview of Reporting Flow Processing Data



Girls < 5 Boys <5

Refugees




Damaged/Spoield


StockReceipts


WFP Sudan


Project Number


2. Stock Movements




Boys 5-18 Women

Comments



IDPs

Residents



Resettled


Total Beneficiaries







Height (in Cm) (5)

Weight (in Kg) (6)



Data Collection Tools

Reporting Processing Data

Data are collected from the field using a variety of data collection tools and instruments

Data need then to be systematically consolidated and appropriately screened and checked for completeness and accuracy

59

What is Data Analysis? Definition and Key Concepts

Quantitative Data Analysis

• Descriptive analysis: it is simply the presentation of numeric results for study population

• Inferential analysis: by contrast this seeks for establishing relationship between variables that may explain why differences exist

Data Analysis is the search for patterns in raw data and for explanations relating to those patternsTerm

Qualitative Data Analysis

It is somewhat free-flowing and subjective and comparisons between groups (or individual) are difficult with open-ended discussion and interview dataIt is difficult to distinguish between data collection and analysis as the two are intertwined and do not follow a distinct, linear sequence

Per each indicator selected in the logframe, data need to be collected and then analysed

60

Data Analysis of HIV and TB Indicators

STRATEGIC OBJECTIVES: SO1-Save lives and protect livelihood in emergency

OUTCOMES (Corporate and Project Specific)Results-Hierarchy Performance indicators Means of verification (MOV) Assumption and risks

1.1 Maintained access to services for ART, TB treatment and/or PMTCT

1.2 Improved ART or TB Nutritional Recovery

1.3 Improved adherence to ART, TB


1.1.1 Default rate

1.2.1 ART or TB Nut. recovery

1.3.1 ART or TB treatment adherence rate

1.4.1 TB treatment success rate

Source: ART, TB or PMTCT/MCHN registers at health facility level or treatment centre run by partners



E.g. Data collection may be affected by the shockE.g. Stigma discourage people from attending ART or TB centres

OUTPUTS 1.1 Food, cash and vouchers distributed in sufficient quantity and quality to target group (ART, TB or PMTCT clients)….

List of indicators provided, such as:1.1.1 # of women, men, girls and boys received food, C&V 1.1.2. Tonnage of food distributed 1.1.3 Quantity of fortified food distributed, etc.

Monitoring system for validating operation design

Source: E.g. Monthly WFP Food Distribution Reports


CORPORATE INDICATORSIn the following slides introduction and explanation, methodology and interpretation of each corporate outcome indicators will be provided. In cases where the indicators double as corporate outcome indicators for other contexts no information will be provided

61

62

SUMMARY: Corporate Outcome Indicators HIV and TB Interventions

Under SO1: EMOP or PRRO

(relief)

Default rate from ART, PMTCT or TB-DOTS programme, amongst beneficiaries of food assistance

Under SO3: PRRO

ART or TB treatment nutritional recovery rate, amongst malnourished clients benefiting from food assistance

Under SO4: CP/DEV

ART Adherence rate and/ or TB treatment success rate, amongst clients benefiting from food assistance

+ ART and/or TB treatment nutritional recovery rate, amongst malnourished clients benefiting from food assistance

Care & Treatment

Household Food Consumption Score of food insecure HHs affected by HIV and TB, including OVC

Mitigation & Safety Nets

Household Food Consumption Score of food insecure HHs affected by HIV and TB, including OVC

63

C&T Interventions under SO1 Data Analysis of HIV/TB Corporate Outcome Indicators

When collecting data from registers care must be taken to distinguish between clients who have died, finalised treatment (TB only), graduated from food assistance or transferred out

KEEP IN MIND

Data Interpretation

It is a proxy for the effectiveness of food assistance in preventing clients from defaulting from ART, TB treatment and PMTCT Programme

Two options for comparison with regard to default rate:• If all clients receiving food assistance, comparison of default rate before and

during the period of food assistance (Baseline needed)

• If only targeted clients receiving food assistance, then comparison of default rate amongst clients receiving and not-receiving food assistance

Measurement Methods

Data collection period should be consistent for all information

Default rate amongst beneficiaries of food assistance

Number of clients missing two consecutive scheduled medical visits during reporting period

Total number of exits (clients that during the reporting period have died+ finalised treatment (TB only) or graduated from food assistance + transferred

out + defaulted)

x 100

Actual Beneficiaries Number during reporting month


ART



the month

N=(A+B)

Exits during month

Total Exits

M=(C+D+E+F)

Total still on treatment at

end of month (N-M)

Number of clients for whom has

been reported

adherence

95%Adherence

to ART during

previous month


1st of reporting

month coming from

previous month (A)


month (B)

Defaulted

( C )

Deaths (D)

Graduated from food

assistance (E)

Transferred (F)

Women > 18 60 40 100 5 3 50 10 68 32 80 72

Men > 18 50 30 80 10 5 40 8 63 17 75 63TOTAL 110 70 180 15 8 90 18 131 49 155 135

64

C&T Interventions under SO1 Measurement Example

Measurement Methods

15 x 100

Default rate

Number of clients missing two consecutive scheduled medical visits during reporting period

Total number of exits (clients that during the reporting period have died+ finalised treatment (TB only) or graduated from food assistance + transferred

out + defaulted)

x 100

131Default rate ≈ 11.45%

65

C&T Interventions under SO3 and SO4Data Analysis of HIV/TB Corporate Outcome Indicators

Malnutrition is determined using anthropometric measures that vary depending on age, gender, and other factors• In adult men and non-PLW → BMI• In PLW→ MUAC• In children 6-59 months → MUAC and WFH• Adolescent → BMI-for-age

All programmes that aim at nutritional rehabilitation of clients normally require multiple weighing at an agreed benchmark/cut-off point before nutritional rehabilitation is confirmed (e.g. two consecutive weighing at BMI>18.5)

KEEP IN MIND

Data Interpretation

It is a proxy for the programme’s success in facilitating nutritional recovery of malnourished ART or TB-DOTS clients

Measurement Methods


Nutritional recovery rate amongst malnourished clients benefiting from food assistance

Number of ART or TB clients who were considered malnourished at the start of food assistance and confirmed recovered during the reporting period

Total number of ART or TB clients who were malnourished at the start of food assistance who exited food assistance for any reason (e.g. cured, death, defaulters, non-responders and transfers) during the reporting period

x 100



ART



the month

N=(A+B)

Exits during month

Total Exits

M=(C+D+E+F)


end of month (N-M)


been reported

adherence

95%Adherence

to ART during

previous month


1st of reporting

month coming from

previous month (A)


month (B)

Defaulted

( C )

Deaths (D)

Graduated from food

assistance (E)

Transferred (F)

Women > 18 60 40 100 5 3 50 10 68 32 80 72

Men > 18 50 30 80 10 5 40 8 63 17 75 63TOTAL 110 70 180 15 8 90 18 131 49 155 135

66

C&T Interventions under SO3 and SO4 Measurement Example

Measurement Methods

90 x 100

131Nutritional recovery rate

Number of ART or TB clients who were considered malnourished at the start of food assistance and confirmed recovered during the reporting period

Total number of ART or TB clients who were malnourished at the start of food assistance who exited food assistance for any reason (e.g. cured, death, defaulters, non-responders and transfers) during the reporting period

x 100

Nutritional recovery rate amongst malnourished clients benefiting from food assistance

≈ 69 %

There is not an internationally agreed method for measuring adherence, therefore WFP CO will need to consider the methodology used/agreed in country specific

67

C&T Interventions under SO4Data Analysis of HIV/TB Corporate Outcome Indicators

Adherence (not to be confused with attendance) measures actual intake of medications and following of the treatment regimen (e.g. taking right medication at right time every day, taking correct dosage, etc.)KEEP IN MIND

Data Interpretation

It is a proxy for the effectiveness of food assistance in enabling clients to follow the prescribed treatment regimen

Two options for comparison with regard to adherence:• If all clients receiving food assistance: comparison of adherence rate before

and during the period of food assistance (Baseline needed), over same period• Comparison of adherence rate of malnourished clients receiving food

assistance and of those not receiving food assistance over the same period

Measurement Methods


ART Adherence rate amongst clients benefiting from food assistance

Number of clients reporting taking > 95% of medications during the course of previous month

Total number of clients for which adherence was reported during the course of previous month

x 100

68


Measurement Methods

135 x 100



ART



the month

N=(A+B)

Exits during month

Total Exits

M=(C+D+E+F)


end of month (N-M)

Number of clients of

whom has been

reported adherence

95%Adherence

to ART during

previous month


1st of reporting

month coming from

previous month (A)


month (B)

Defaulted

( C )

Deaths (D)

Graduated from food

assistance (E)

Transferred (F)

Women > 18 60 40 100 5 3 50 10 68 32 80 72

Men > 18 50 30 80 10 5 40 8 63 17 75 63TOTAL 110 70 180 15 8 90 18 131 49 155 135

155

Adherence rate =

ART Adherence rate amongst clients benefiting from food assistance



x 100

≈ 87 %

69

C&T Interventions under SO4 Data Analysis of HIV/TB Corporate Outcome Indicators

TB success is the % of new smear-positive TB cases registered under DOTS in a given year that successfully completed treatment, whether with or without bacteriological evidence success (“cured” or “treatment completed”)KEEP IN MIND

Data Interpretation

It is a proxy for the effectiveness of food assistance in enabling clients to complete the treatment regimen

Two options for comparison with regard to adherence:• If all clients receiving food assistance: comparison of treatment success rate

before and during the period of food assistance (Baseline needed), over the same period

• Programme may compare the treatment success rate of DOTS clients receiving food assistance to success rate of those not receiving food assistance over the same period of treatment

Measurement Methods


TB treatment success rate amongst clients benefiting from food assistance

Number of TB-DOTS clients “cured” + Number of TB-DOTS clients “completed”

Total number of TB-DOTS clients x 100

70


Measurement Methods

20 + 6 x 100


Beneficiary category TB



the month

N=(A+B)

Exits during month

Total Exits

M=(C+D+E+F+G+H)


end of month (N-M)


1st of reporting

month coming from

previous month (A)


month (B)

Defaulted

( C )

Deaths (D)

Graduated from food

assistance (E)

Transferred (F) Cured

Treatment

completed

Women > 18 60 40 100 5 3 50 10 8 2 78 32

Men > 18 50 30 80 10 5 40 8 12 4 79 17TOTAL 110 70 180 15 8 90 18 20 6 157 49

180 TB treatment success rate = ≈ 14 %

Total number of TB-DOTS clients x 100Number of TB-DOTS clients “cured” + Number of TB-DOTS clients “completed”

TB treatment success rate amongst clients benefiting from food assistance

71

M&SN Interventions under SO3 and SO4 Data Analysis of HIV/TB Corporate Outcome Indicators

FCS is the corporate indicators, for M&SN Programmes targeting food insecure HHs, however it can be complemented by parallel project specific outcome ART or TB adherence rate or TB success rate as supported by the HH food rationKEEP IN MIND

Data Interpretation

It is The FCS is a composite score based on dietary diversity, food frequency, and relative nutritional. It is a proxy indicator of HH food security. A standardized score is calculated by combining 7-day recall dietary diversity data with weights based on nutrient density

• Food items are grouped into 8 standard food groups with a maximum value of 7 days/week

• The consumption frequency of each food group is multiplied by an assigned weight that is based on its nutrient content

• Those values are then summed obtaining the FCS

Measurement Methods

Household Food Consumption Score (FCS) amongst food insecure HH affected by HIV and TB

FCS = Where: a is the weight of each food groupx is frequencies of food consumption= number of days for which each food group was consumed during the last 7 days

PROJECT SPECIFIC INDICATORSIn the following slides introduction and explanation, methodology and interpretation of each project specific outcome indicators will be provided. In cases where the indicators double as outcome indicators for other contexts no information will be provided

72

73

SUMMARY: Project Specific Outcome Indicators HIV and TB Interventions

Under SO1: EMOP or

PRRO (relief)

ART or TB treatment nutritional recovery rate, amongst clients benefiting from food assistance

ART and TB treatment adherence rate, amongst clients benefiting from food assistance

TB treatment success rate, amongst clients benefiting from food assistance

Under SO3: PRRO

Default rate amongst beneficiaries of food assistanceART and TB treatment adherence rate amongst clients benefiting from food assistanceTB treatment success rate amongst clients benefiting from food assistance

Under SO4: CP/DEV

Default rate from ART, PMTCT and TB treatment, amongst beneficiaries of food assistanceTB treatment adherence rate, amongst clients benefiting from food assistance

Care & Treatment

Adherence rate amongst clients benefiting from food assistanceTB treatment success rate amongst clients benefiting from food assistanceOVC attendance rate


Adherence rate amongst clients benefiting from food assistanceTB treatment success rate amongst clients benefiting from food assistanceOVC attendance rate


74

It refers to how closely the TB client follows the prescribed treatment regimen.In the case of TB-DOTS since the intake of drugs is actually observed by a health care providers, adherence can be synonymous with attendance KEEP IN MIND

Data Interpretation

It is a proxy indicator for the effectiveness of food assistance in enabling clients to follow the prescribed treatment regimen. Two options for comparison with regard to adherence:• If all clients are receiving food assistance: comparison of adherence rate before

and during the period of food assistance (Baseline needed), over same period• Comparison of adherence rate of malnourished clients receiving food assistance

and of those not receiving food assistance over the same period

Measurement Methods


TB Adherence rate amongst clients benefiting from food assistance

Number of clients reporting taking > 95% of medications during the course of previous month x 100

There is not an internationally agreed method for measuring adherence, therefore WFP CO will need to consider the methodology used/agreed in country specific

C&T under SO4 Data Analysis of HIV/TB Project Specific Indicators

75


Measurement Methods

163 x 100


Beneficiary category TB



the month

N=(A+B)

Exits during month

Total Exits

M=(C+D+E+F

+ G)


end of month (N-M)


been reported

adherence

95%Adherence

to TB during

previous month

Total on treatment at 1st of reporting

month coming

from previous

month (A)


month (B)

Defaulted ( C )

Deaths (D)

Graduated from food

assistance (E)

Transferred (F)

Cured +

treatment

completed (G)

Women > 18 60 40 100 5 3 50 10 18 68 32 100 85

Men > 18 50 30 80 10 5 40 8 20 63 17 80 78TOTAL 110 70 180 15 8 90 18 38 131 49 180 163

180

TB Adherence rate =

TB Adherence rate amongst clients benefiting from food assistance



x 100

≈ 90 %

Number of OVC enrolled in school * Number of days school was open during month A

The formula below refers to calculation of a monthly attendance rate, however the same formula can be used to calculate attendance rates during other time periods

76

M&SN interventions under SO3 and SO4 Data Analysis of HIV/TB Project Specific Indicators

It is the number of school days that OVC (girls and boys) attend classes in WFP-assisted schools, as percent of total school daysKEEP IN MIND

Data Interpretation

• It is a proxy indicator for the overall well-being of OVC. Food rations are used as leverage for OVC to access additional assistance as cooperating partners should ideally be able to provide a continuum of complementary activities such as health care, IGAs, psycho-social support, etc.

• In school registers no other breakdown is required than boys and girls thus the assumption adopted in order to avoid stigmatization is that all children attending the school are OVC

Measurement Methods


OVC Attendance rate amongst beneficiaries of food assistance

(Number of OVC enrolled in school * Number of days school was open during month A) - (Total OVC absentee days) x 100

Actual Beneficiary Numbers

Level

Number of enrolled school children Month: January

Girls Boys Total

Number of day school

open during month

Number of Girls

absentee

Number of Boys

absentee Total

1st Grade 100 150 250 22 10 5 152nd Grade 150 140 290 22 20 15 35Total 250 290 540 22 30 20 50

77

M&SN under SO3 and SO4 Measurement Example

Measurement Methods

(540 X 22 ) – x 100

540 x 22

OVC Attendance rate = ≈ 90 %

(Number of OVC enrolled in school * Number of days school was open during month A) - (Total OVC absentee days)

Number of OVC enrolled in school * Number of days school was open during month A

x 100

OVC Attendance rate amongst beneficiaries of food assistance

(50)

Work on total numbers and thus divide the total number of recovered, adherence, default etc. by the total cases analysed and multiply by 100 to get the percentage

78

Annual Reporting How to combine monthly data

Combined data

Measurement methods

Method one

Use the weighted average formula

1. At the end of each month- to combine percentages from different sites at the end of each month

2. At the end of the year- to combine percentages of different months from different sites

Method two

Where: a = percentage x = total number of cases analysed

1. Calculate the sum of the total number of clients who exited food assistance for any reason during the reporting month and the total number of these clients who have been discharge because nutritionally recovered

79

Annual Reporting Example: Method one

Method one: Total Numbers

MONTH Tot clients exited Tot clients nutritionally recovered % of clients nutritionally recovered

JANUARY

Site 1 100 25 25%

Site 2 150 45 30%

Site 3 300 150 50%

Sub-total 550 220

FEBRUARY

Site 1 80 45 56.2%

Site 2 200 73 36.5%

Site 3 280 180 64.3%

Sub-total 560 298

TOTAL 1110 518

2. Divide the total number of clients nutritionally recovered for all the months by the total number of clients exited the food assistance

= 518/1110

3. Multiply by 100 to get the percentage

= 46.7%


JANUARY

Site 1 100 25 25%

Site 2 150 45 30%

Site 3 300 150 50%

Sub-total 550 220

FEBRUARY

Site 1 80 45 56.2%

Site 2 200 73 36.5%

Site 3 280 180 64.3%

Sub-total 560

TOTAL1110 518

80

Method two:

1. Calculate the weighted average percentage for each month for all the sites

2. Calculate the weighted average percentage for all sites for all the months, using the weighted average percentage for each months for all sites

(100+150+300)

E.g. Jan= [(25X100) +(30x150)+(50x300)] =

= 40%

= 53.21%

(550+560)[(40x550) +(53.2x 560)] = 46.7%

40%

= 46.7%

Annual Reporting Example: Method two

81

Now, try to calculate the average not weighted…..


JANUARY

Site 1 100 25 25%

Site 2 150 45 30%

Site 3 300 150 50%

Sub-total 550 220

FEBRUARY

Site 1 80 45 56.2%

Site 2 200 73 36.5%

Site 3 280 180 64.3%

Sub-total 560 298

TOTAL 1110 518

If you don’t use one of the two methods described before, your result is different!!!!!

= 25%+30%+50%+56.2%+36.5%+64.3%6

= 43.7

= 46.7%

WARNING

REPORTING ON HIV & TB PROGRAMMESHOW REPORT HIV/TB OUTCOME AND OUTPUTS INDICATORS

82

83

Overview of Reporting Flow Reporting

Processing Data

Reporting

Field reportsCountry reports

Regional reportsGlobal reports

The submission of timely and accurate reports is essential for management follow-up at the county, regional and international levels and thus inform decision making in operation

Timely information flow is critical for ensuring the continuing flow of resources and inter-agency coordination

84

What does Reporting mean within WFP? Definition and Key concepts

A management function of processing, recording and sharing performance information at various levels in WFP for use by internal and external audiences

Internal Reporting to:

• Project Stakeholders• CO Management• Corporate Memory

External Reporting to:

• Executive Board/donors• Government• Public

Learning leading to better decision making

Accomplishment, accountability and advocacy

Terms

Reliable and valid data collected from project level and submitted on time

Standard formats for capturing and compiling performance information from operations (i.e. SPR, APR)

Regular (half-yearly) performance reviews based on CO Work plans

85

What does WFP Reporting mean? Requirements

1

2

3

86

Reporting Flow within WFP From Country Office to Headquarters

Flow of key reports for EMOP, PRRO, and CP/DEV Operations

Field Govt/IP

WFP/IP Field monitoring

report

BCM survey

Govt, field monitors

WFP/IP Field monitoring

report

BCM survey

Govt, field monitors

QPR

PIR

Interim reports

Final reports

Country

Donor report

Coordination report

Blue bookYellow pages

SPR

COR

Blue bookYellow pages

SPR

CAP

SITREP

Final Evaluation

Reports

pipeline

WING

PPIF

pipeline

DEV/CP

EMOP/PRRO/SO

Region HQ EB

CP MTE

Weekly Emergency

Report

RB Mgt report

SPRBlue Book

Yellow Book APRCOMR

87

WFP Reporting Standard Reporting

Reliable and valid data collected from project level and submitted on time

Standard formats for capturing and compiling performance information from operations (i.e. SPR, APR)

Regular (mini. half-yearly) performance reviews based on CO Work plans

1

2

3

Standard Reporting

• Helps assure reliable & valid data on results being collected from project partners

• Makes comparisons between operations easier

• Helps WFP aggregate ("roll-up") project-level performance information for higher-level analysis and reports

• Helps CO to manage projects, programmes and support activities effectively during the year

88

WFP Standard Project Report (SPR) Definitions and key concepts

• SPR is the annual report WFP produces to inform its donors how resources for any given project were used and what results were obtained during the reporting year

• The SPR is prepared for all WFP activities (with exception of bilateral project), including development, protracted relief and recovery, emergency and special operations

• As a project report, the document lays out the objectives of the project, the mode of implementation, the resources used of implementation and the results obtained by the project

• It is the main source of WFP’ corporate statistics, with this (combined with other information from SPRs) feeding into the Annual Performance Report

There are four classes of SPR

Class 1 Full SPR The project had food distribution (or operational activity if it was a Special Operation) in 2011

Class 2 Partial SPR New projects with call-forwards, shipments or food purchases in 2011, but no distribution in 2011

Class 3 Partial SPR Old projects with a closing stock by end 2010 and a resource transfer in 2011 but no distribution in the reporting period

Class 4 Financial SPR Projects that ceased operational activity prior to 2011, but were not financially closed. (No entries are required in DACOTA, only the SPR cover page needs to be cleared)

89

WFP Standard Project Report (SPR) Main Classification

The SPRs reflect the ability of the CO to account for the funds channelled through WFP and thus demonstrate the efficiency and effectiveness of the operations

90

WFP Standard Project Report (SPR) Main Steps to follow for filling the SPR

Narrative: Describe your Programme

Keep the audience in mind – ask “What do donors want to read?” • The SPR is designed to inform donors how WFP has spent their contributions• Be aware of the advocacy aspects of the SPR and of its potential as a fundraising

instrument

Use consistent Language and correct Terminology• Information should be as accurate, consistent and as concise as possible • One of the most basic but also important aspects of writing a strong SPR is using

the correct terminology, especially in the area of HIV and TB

Some tips in writing narratives for reporting HIV & TB in SPR

Audience

SPR narrative should contain the following information for HIV & TB Programme• What are the Objectives?• Who are targeted for the support (be specific: e.g. ART clients, HHs , etc.?• What are the entry and exit criteria for your activity?• What was in the food basket?

Contents

Terminology

1

91

WFP Standard Project Report (SPR) Main Steps to follow to fill the SPR

TERMINOLOGYFrequently misused Terms Preferred TerminologyHIV/AIDS Use the term that is most specific and

appropriate in the context to avoid confusion between HIV (virus) and AIDS (clinical syndrome). When in doubt, consider that HIV is more inclusive term so is usually safe to use

Patients Clients

PLWHA, PLWHIV, PLHIVs PLHIV (People living with HIV)

ARV (antiretroviral) ART (antiretroviral therapy) is generally most appropriate, though if you are referring specifically to the drugs themselves, ARV is appropriate (e.g. “ a pipeline break in ARV supply)

HIV patients ART clients

OVCs OVC (already plural)

Take Note

Keep up-to-date by using UNAIDS Terminology Guidelines, published every year

Under the category of beneficiaries “Total HIV/AIDS and TB Beneficiaries”, all beneficiaries of specific HIV and TB activities should be reported.

92

WFP Standard Project Report (SPR) Main Steps to follow for filling HIV&TB SPR

Reporting on Beneficiaries: Total HIV&TB Beneficiaries

The two main categories of beneficiaries fall under:• Index clients• Household beneficiaries (clients’ household members)

Beneficiaries must be involved in food-based interventions specifically designed to address HIV or TB (specific interventions, under the two pillar: C&T and M&SN):

• Antiretroviral Therapy (ART) • TB treatment • Prevention of mother to Children Transmission (PMTCT)• Orphans and Vulnerable Children (OVC)• Food assistance business, educational or agricultural training activities for

PLHIV or HIV affected people

Some tips for reporting HIV & TB Beneficiaries

Categories

The total number includes both index clients and household members, thus the number of clients/participants receiving food multiply the size of family (if household support is provided) and should equal the sum of relevant outputs

2

TotalNumber

HIV- or TB-Specific

Intervention

If an HIV- or TB-related activity exists within a project, it must be reported in the output table

93


Output Reporting

C&T Output Indicators apply to those programme that target moderate malnourished ART, TB, or PMTCT clients

HIV and TB Outputs Indicator Terminology

Care & Treatment

M&SN outputs indicators apply to those programmes that target food insecure HIV- and TB- affected HHs and OVC

3


ClientsRefers to the individual entitled to the food assistance for a particular activity (no HH beneficiaries included)

BeneficiariesRefers to the total number of recipients of food assistance for a particular activity (beneficiaries= clients + HH beneficiaries)

Individual food assistance

Individual nutritional food supplement refers to the energy-dense food product given to the malnourished ART, TB or PMTCT clients in C&T Programme

Household food

assistance

Refer to general food ration given to HIV- or TB- affected HHs. HH food assistance can be given as part of C&T programme (in addition to the individual nutritional food supplement of clients) or in M&SN Programme

94


Outcome Reporting

Data Source should be appropriate to the outcome (national data should be used)

Tips to keep in mind to ensure a smooth technical review

Data Source

• Data should be not “recycled” from previous years if no new data is available• Data should make sense and should not sound too ambitious

4

Data

Indicators If a project Logframe list an indicator, it should be reported in SPR

Each SO within the operation’s Logframe should have at least one Corporate Outcome Indicator reported upon

HIV and TB Indicators

• Refer to the M&E Guide for HIV and TB Programming for more details on how reporting each single specific indicator for HIV and TB Programming

• http://pgm.wfp.org/index.php/topics:HIVandAIDS#key documents

http://pgm.wfp.org/index.php/topics:HI

Find the mistakes, inaccuracies and oddities in the February CP report….

95

Total on treatment at 1st of reporting month coming from previous

month (A)

New admissions during month (B)

Defaulted ( C )

Deaths (D)

Nutritionally recovered (E)

Transferred (F)

Women > 18 yrs 100 40 140 10 4 31 2 47Men > 18 yrs 80 37 117 7 2 22 0 31TOTAL 180 77 257 17 6 53 2 78

Actual Beneficiaries Number during reporting monthMONTH J ANUARY

93

86


Entries during monthTotal

Beneficiaries for the month

N=(A+B)

Exits during month

Total Exits M=(C+D+E+F)

179


Total on treatment at 1st of reporting month coming from previous

month (A)New admissions during month (B)

Defaulted ( C )

Deaths (D)

Nutritionally recovered (E)

Transferred (F)

Women > 18 yrs 100 32 132 40 0 60 1 101

Men > 18 yrs 80 25 105 31 0 76 0 90

TOTAL 180 57 237 71 0 136 1 191 428

Total Exits M=(C+D+E+F)


Exits during month

233

3. Actual Beneficiaries Number during reporting month

MONTH FEBRUARY

195



Total Beneficiaries for the month

N=(A+B)

1

1- The number of "Total on treatment" does not reflect the total number of patients on nutritional treatment at the end of the previous month but at the beginning

2- Increased default rate from previous month- this should be checked further with the health staff

23

3-The exponential increase of patients who nutritionally recovered need to be checked further to assess its reliability

4

4- The total number of men> 18 years who exited the programme is not correct and this error affected the total number of men and women too

5- Instead of subtracting the total exit from the Total number of beneficiaries, it has been added up

5

Module 2 presentations

Documents

Transcript of Module 2 presentations