Evaluation Findings Presentation

Final Evaluation of SRARA Project

JS Consultancy Serviceswww.jscs.af

http://www.jscs.af/

Outline • Theory of Change Model of the Project• Objectives of Evaluation• Evaluation Methodology • Findings • Recommendations • Questions and Answers

Theory of Change Model

Objectives of Evaluation The endline evaluation is carried out to;• Evaluate the objectives and activities planned for

the project.• Establish the extent to which the project has

achieved its objectives as stated in the project document.

• Establish the impact of the project• Make recommendations for future programming

Evaluation Methodology The mentioned steps were used to collect relevant data for the project evaluation:

• Household Survey Among Project Beneficiaries• Key Informant Interviews with Stakeholders

(Children, Shura Members, Government Officials)• Interviews with Project Implementation Teams• Field Observations

Data Analysis • Data was entered into an online database• Then Data was exported to Stata-12.1 and

Analyzed • Endline Data is compared with Baseline Data

Findings • Impact Findings • Outcome Findings • Outputs Findings (Please refer to the report)

Impact Findings: Reported Diarrheal Cases

Percent Reported had a case diarrhea in Household in last 6

months

56%

58%

60%

62%

64%

66%

68%

70%

72%

74% 73%

62%

Diarrhea Cases in Household in last 6

months

Baseline (N=940)Endline (N=425)

Men Women Children under 5

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

63%67%

90%

26%30%

43%

Type of Household members who had diarrhea in last 6 months

Baseline (N= 686)Endline (N=455)

Impact Findings: Registered Diarrheal Cases

125

130

135

140

145

150

155

160

165

170

175

170

143

Mean Number of Diarrhea Cases per Month-HMIS Data

Mean Number of Cases Per Month Before Implementation of the ProjectMean Number of Cases Per Month After Project Implementation

Water Collection

SourceBaseline

(N=941) Endline (N=425) P-Value

Hand Dug Well 22.52% 18.12% 0.0915Borehole or Deep well 10.95% 20.94% < 0.001

River or Stream 7.65% 0.71% < 0.001

Hand Pump 19.98% 40% < 0.001

Water Pond 10.63% 0% < 0.001

Water Supplier 1.38% 8.71% < 0.001

Outcome Findings: Access to Water

Outcome Findings: Access to Water

• The reported mean time of a round trip to collect water has significantly decreased from 32minustes (baseline) to 18minutes (endline).

Less

than

500 m

eters

Betwee

n 500

mete

rs an

d 2km

Betwee

n 2km

and 5

km

0%10%20%30%40%50%60%70%80%90%

100%

73%

22%

5%

94%

6%1%

Round Trip Distance of Water Source


How is the drinking water stored in the home? (observation)

Baseline (N= 941) Endline (N=424)

Covered, Clean and Sanitory 39%

29%

Clean but Unconvered 18% 59%

Dirty but Covered 19% 9%

Dirty/Not Sanitary 25% 2%

Outcome Findings: Water Storage Behavior

Outcome Findings: Drinking Water Treatment

• The percentage of the households treating water before drinking has increased from 18% reported in the baseline to 36% in the endline.

Chlorin

e Tab

lets

Sach

et of

Chemica

ls

Boiling

Water F

ilter

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

7%1%

85%

8%

42%

6%

50%

1%

Methods Used for Treatment of Drinking Water


Outcome Findings: Hand Washing Knowledge

When do you wash your hands during the day?

Baseline (N= 941) Endline (N=433)

Before eating 85% 89%

After using the toilet 76% 88%

After eating 67% 72%

Before praying 75% 44%

After touching an animal 10% 37%

Before feeding a baby or children 13% 25%

Outcome Findings: Hand Washing Attitude

Very I

mporta

nt

Impo

rtant

Not Im

porta

nt

Not V

ery I

mporta

nt0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

26%

71%

1% 2%

83%

17%

0% 0%

Importance of Handwash-ing Before Meal


Very

Impo

rtant

Impo

rtant

Not Im

porta

nt

Not Ve

ry Im

porta

nt0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

27%

68%

3% 3%

79%

20%

1% 0%

Importance of Handwashing After Using Toilet


Outcome Findings: Materials Used for Hand

Washing

Soap

Nothing

(Jus

t Wate

r)

Hand w

ashin

g liqu

id Ash

Boiled

wate

r 0%

10%

20%

30%

40%

50%

60%

70%

80%

47% 49%

15%

1%

16%

76%

23%

5%1% 0%

Use of Materials for Handwashing

Baseline (N= 941)Endline (N=433)

Very

Impo

rtant

Impo

rtant

Not Im

porta

nt

Not Ve

ry Im

porta

nt0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

25%

62%

5% 7%

77%

23%

0% 0%

Importance of Washing Hands With Soap


Outcome Findings: Defecation Practices

Latri

ne in

side t

he ho

me

Latri

ne ou

tside

the h

ome

Outside

the h

ome o

n the

grou

nd

Inside

the h

ome o

n the

grou

nd0%

10%20%30%40%50%60%70%80%90%

69%

13% 14%4%

79%

17%

3% 0%

Adult Defecation Behav-ior-Day Time

Baseline ( N=941)Endline (N=421)

Latri

ne in

side t

he ho

me

Latri

ne ou

tside

the h

ome

Outside

the h

ome o

n the

grou

nd

Inside

the h

ome o

n the

grou

nd0%

10%20%30%40%50%60%70%80%90%

69%

11% 14%6%

77%

17%

6%0%

Adult Defecation Behavior-Night Time



Latri

ne in

side t

he ho

me

Latri

ne ou

tside

the h

ome

Outside

the h

ome o

n the

grou

nd

Inside

the h

ome o

n the

grou

nd0%

10%

20%

30%

40%

50%

60%

70%

80%

48%

10%15%

25%

73%

15% 13%

0%

Children Defecation Behav-ior-Day Time


Latri

ne in

side t

he ho

me

Latri

ne ou

tside

the h

ome

Outside

the h

ome o

n the

grou

nd

Inside

the h

ome o

n the

grou

nd0%

10%

20%

30%

40%

50%

60%

70%

80%

45%

7%9%

38%

73%

7%

19%

0%

Children Defecation Behv-ior-Night Time



0%

10%

20%

30%

40%

50%

60%

70%64%

25%

Perception about Prevalance of Open Air Defection Behavior Among Vil-lagers

Before the ProjectAt the End of the Project

Outcome Findings: Change in Income

• 45.60% of the IGA beneficiaries have reported that their monthly income has increased by more than 50% in the last two months and mean increase in the monthly income is reported to be 2,975 AFN.

Income has increased

Income has decreased

Income has not Changed

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%83%

3%

12%

Reproted Changes in the Income of IGA

Beneficiaries

Outcome Findings: Positive Parenting

Percent Response about Positive Parenting Yes No

Karim has 5 very naughty children and to discipline them Karim often beats and shouts at them. Do you think that Karim is doing the right thing to discipline his children ?

15% 85%

Do people in your village allow children to talk and participate in important household decisions making process (when decision about important issues in the household issue are made) ?

84% 11%

Do you think that taking opinion from children while making important household decisions is a good practice ?

90% 8%

Outcome Findings: Gender Based

Violence

Shah Jehan has a 13 years old daughter who was married to Haji Akbar 45 year old rich person. While giving birth to her fist baby Shah Jehan’s daughter died in the hospital. What do you think might be the reason for her early death?

Percent Responses

Allah's Will 12%

Due to the Disease 3%

Poor Quality of Services 1%

Underage Marriage 83%Don’t Know 1%

Recommendations • Conduction of TOT for the field trainers before further trainings • Standardize curriculums used for different trainings • Celebration of hand washing days at schools• Mechanisms within schools to promote hygiene besides trainings• Soap holders in the constructed hand washing facilities to be

introduced• Maintenance mechanism for constructed Wells• Recognition of ODF villages (mass media campaigns)• Involvement of the local government officials during hand over of the

activities to the communities • Improve coordination with government entities at national and

provincial level• IEC materials should be developed by the expert in the field

Recommendations • Proper assets mapping among the target groups to

identify the most vulnerable households • Criteria for the selection of beneficiaries (children) for

IG skills training (school affected by the activity)• Development of a mechanism so that IG beneficiaries

can record and manage their earnings properly• Strengthen monitoring and on the job support

mechanism for IG beneficiaries• Training in occupational health and mechanism for

maintenance of optimal health for IG beneficiaries • Sustainability plans for the IG Skills Trainings

Component

Thank You

• Questions/Comments ??

Evaluation Findings Presentation

Government & Nonprofit

Transcript of Evaluation Findings Presentation