Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

download Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

of 84

Transcript of Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    1/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    2/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    3/84

    BUDDHISTLEADERSHIPINITIATIVE

    EVALUATION2008-2012

    O C T O B E R 2 0 1 2C A M B O D I A

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    4/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    5/84

    ABOUT THIS EVALUATION

    This evaluation of the Buddhist Leadership Initiative, Cambodia, took place through a desk

    review of programme documents, a literature review, and quantitative and qualitative data

    collection in ve provinces: Kampong Thom, Kampot, Siem Reap, Takeo and Prey Veng.

    Interviews were conducted with key stakeholders and activity implementers includingrepresentatives of the Ministry of Cult & Religion, Provincial Departments of Cult & Religion,

    UNICEF country ofce & sub-national staff, NGOs, monks & programme participants. A

    quantitative survey was administered to programme participants in all ve provinces over

    15 consecutive days in August 2012. Twenty focus group discussions were conducted with

    programme participants (adults, children and monks) in the same time period.

    The purpose of the evaluation was to provide relevant, comprehensive and timely data to

    inform the future direction of the programme and to contribute to national learning.

    ACkNOwLEDgEMENTS

    The Evaluation Team extend their sincere thanks to H.E. Dork Narin, Mr Chhoeum Chhad

    and Mr Ho Silin of the Ministry of Cult and Religion; the Provincial Departments of Cult

    and Religion Directors and BLI Focal Points: Mr Korm Dampheng, Mr Chum Em, Mr Mom

    Chandara, Mr Hoeun Yenthy, Mr Vann Bunna, Mr Tan Taychroan; Ven. Oeun Sam Art,

    Ofce of the Great Supreme Patriarch of the Kingdom of Cambodia; Mr Hing Yan, Dean of

    Preah Sihanouk Reach University; UNICEF country & regional ofce staff: Souad Al Hebshi,

    Ulrike Gilbert-Nandra, Bunthy Chea, Gabrielle Robens, Usha Mishra and Ada Ocampo;

    UNICEF zonal child protection staff: Soyorn Choun, Phalla Chem, and Chivith Rottanak;

    Chanthy Prang, Save the Children Cambodia, Mr San Vandin and colleagues at Partners

    in Compassion; and the many programme participants, adults, children, volunteers, and

    the valuable input of the Buddhist monks within communities and at the highest levels in

    Phnom Penh. The Lead Consultant would like to thank Ulrike Gilbert-Nandra, HIV Specialist

    at UNICEF, specifically for providing substantial technical support throughout the

    evaluation and through the process of developing this report. Special thanks also go toNikki Ward, Mr Savath, Mr Komsath and Mr Phim.

    EVALUATION TEAM

    JO kAyBRyN (Lead Consultant)

    HOEUN SOPHEAk (Interpreter)

    TONg SOPRACH (Interpreter)

    MAk CHANTANARy(Researcher)

    HANg PHALLy(Researcher)

    PRUM VISETH (Researcher)

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    6/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    7/84

    CONTENTSACRONyMS ............................................................................................................................ 9

    ExECUTIVE SUMMARy....................................................................................................... 11PURPOSE Of THE EVALUATION........................................................................................ 19

    SCOPE AND METHODOLOgy............................................................................................. 21

    scope ................................................................................................................................... 21

    Methodology .................................................................................................................... 21

    participants profile..................................................................................................... 23

    liMitations ......................................................................................................................... 24

    ethical considerations ................................................................................................ 25

    INTRODUCTION TO THE BUDDHIST LEADERSHIP INITIATIVE ..................................... 27

    iMpleMentation................................................................................................................ 30fINDINgS ............................................................................................................................. 33

    survey coverage and focus group participants ............................................... 33

    - PARTICIPATION IN ACTIVITIES................................................................................................ 36

    relevance .......................................................................................................................... 38

    - RELEVANCE TO NATIONAL POLICIES ..................................................................................... 38

    - RELEVANCE TO UNICEF STRATEGIES .................................................................................... 41

    - RELEVANCE TO THE MOST VULNERABLE PEOPLE ................................................................ 42

    coverage and effectiveness ...................................................................................... 44

    efficiency........................................................................................................................... 47

    iMpact .................................................................................................................................. 49

    - SPIRITUAL AND PRACTICAL SUPPORT FOR VULNERABLE CHILDREN ................................... 49

    - SPIRITUAL AND PRACTICAL SUPPORT FOR VULNERABLE ADULTS ....................................... 53

    - REALISED AND POTENTIAL OPPORTUNITIES ........................................................................ 54

    - THE VULNERABILITY OF ADULTS........................................................................................... 55

    - PROMOTING RIGHTS............................................................................................................. 56

    - STIGMA & DISCRIMINATION.................................................................................................. 58

    - THE ROLE OF MONKS ........................................................................................................... 62

    sustainability................................................................................................................... 63

    - MANAGEMENT AND OWNERSHIP OF THE INITIATIVE............................................................ 64

    CHILD PROTECTION ISSUES ............................................................................................. 67

    CONCLUSIONS..................................................................................................................... 69

    RECOMMENDATIONS ......................................................................................................... 71

    Ministry of cult and religion .................................................................................... 71

    buddhist leadership and hierarchy ....................................................................... 72

    unicef .................................................................................................................................. 74

    BIBLIOgRAPHy ................................................................................................................... 75

    SURVEy................................................................................................................................. 77

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    8/84

    LIST Of fIgURES

    FIGURE 1: Survey participants by province and as a proportion ....................................... 23

    of programme participants

    FIGURE 2: Detailed information on all evaluation participants by province ..................... 24

    FIGURE 3: Number of Districts, Communes and Pagodas participating ........................... 28

    in the Buddhist Leadership by year

    FIGURE 4: Numbers of adult and child participants by province (2011) ..........................28

    FIGURE 5: Annual budgets by province and by year 2008-2012 ...................................... 29

    FIGURE 6: Age distribution of survey respondents by sex .................................................. 33

    FIGURE 7: Ages of focus group participants by province and by sex ................................. 34

    FIGURE 8: Household size by province ................................................................................ 34

    FIGURE 9: Household income per month by province ........................................................ 34

    FIGURE 10: Income per capita per month by province in table format .............................35

    FIGURE 11: Income per capita per month by province in graph format ............................35

    FIGURE 12: Annual average income per capita by province .............................................. 36

    FIGURE 13: Women self-help group members who meet regularly .................................. 36

    at the pagoda for meditation sessions

    FIGURE 14: Length of time as participants in the BLI by province .................................... 37

    FIGURE 15: Participation in different types of BLI activities .............................................. 37

    FIGURE 16: Based on monitoring data 2012 (11) .............................................................. 44

    FIGURE 17: The most important activity for participants by province ...............................45

    FIGURE 18: Children who meet regularly at a pagoda for support sessions .................... 49

    FIGURE 19: Children who meet regularly at the pagoda for support sessions ................. 51

    FIGURE 20: A self-help group member with her child ........................................................ 53

    FIGURE 21: The activities considered most important by BLI participants ...................... 53

    FIGURE 22: Expenditure of cash support by sex ................................................................ 58

    FIGURE 23: Proportion of women and men excluded from social activities: .................... 58

    BLI evaluation data 2012

    FIGURE 24: Proportion of women and men excluded from social activities: .................... 59

    Stigma Index data 2010

    FIGURE 25: Proportion of women and men excluded from religious activities: ............... 59Stigma Index data 2010

    FIGURE 26: Feelings of internal stigma by sex over the last 12 months: .........................60

    BLI evaluation data 2012

    FIGURE 27: Feelings of internal stigma by sex over the last 12 months: .......................... 61

    Stigma Index data 2010

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    9/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    10/84

    10

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    11/84

    11

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    ExECUTIVE SUMMARy

    introduction to the buddhist

    leadership initiative

    The Buddhist Leadership Initiative originated in Thailand in 1997 as part of UNICEFs

    regional strategy for Buddhist engagement in the response to HIV and AIDS in the Mekong

    Sub-region1. It was launched in Cambodia in 2000 by the Ministry of Cult and Religion,

    with UNICEF support. An evaluation of Cambodias Buddhist Leadership Initiative was

    commissioned by UNICEF, in 2007. The programme expanded from seven to 14 provinces

    over its twelve years and currently 10 provinces participate reaching 2,300 adults living

    with HIV and 1,500 vulnerable children in 239 communes. These men & women regularly

    attend self-help group meetings at the pagoda which is preceded by a meditation session

    led by a monk at the pagoda, usually twice per quarter. The Buddhist Leadership component

    to reach vulnerable children takes the form of group sessions at the pagoda twice per

    quarter and children get their transport reimbursed, a small amount of cash support, andmaterials especially for school.

    An agreement through Annual Work Plans which have been in place since 2004 have been

    signed between the Ministry of Cults and Religion, the Provincial Departments of Cult and

    Religion and UNICEF to provide technical and nancial support and capacity building to

    government staff and monks and the development of training materials. UNICEFs support

    was targeted to reach adults and children over a longer period of time in order to increase

    the effectiveness of the response to HIV and AIDS.

    purpose

    This evaluation aims to assess the organisational and programme performance between

    2008 and 2012, including the Buddhist Leadership Initiatives efciency & effectiveness.It further sought to review the institutional capacity of the initiative; evaluate the outcome

    of the programme with regard to the provision of support to individuals and families

    affected by HIV at the household level; provide recommendations on how to include other

    areas of child protection; and draw lessons & recommendations for programme adaptation

    and revision. The evaluation was guided by the OECD DAC Principles for Evaluation of

    Development Assistance as well as the UNICEF-adapted United Nations Evaluation Group

    (UNEG) Evaluation Report Standards. It was implemented between July and September

    2012 and collected quantitative & qualitative data in ve of the ten participating provinces.

    Methodology

    Field data collection took place over 15 consecutive days in August. The methodologyincluded a comprehensive literature review, key informant interviews with policy makers,

    implementers and technical support staff, focus group discussions with women, men and

    children affected by HIV, focus group discussions with monks, surveys of adults affected

    by HIV, and observations of group interactions and individual behaviours during the data

    collection. A total of 357 adults and children participated in the assessment: 214 adults in

    the quantitative survey, 116 women, men, children and monks in focus group discussions,

    and 27 government, NGO, Buddhist leadership and UNICEF representatives. Preliminary

    evaluation ndings were discussed with representatives from MoCR & Buddhist leadership.

    1 Initiated by UNICEF East Asia and the Pacic Regional Ofce (EAPRO) and Country Ofces, the Buddhist Leadership

    Initiative was introduced in ve countries (Cambodia, China, Lao PDR, Myanmar and Viet Nam) of the Greater MekongSub-region between 1998 and 2004 (29).

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    12/84

    12

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    participants profile

    The majority of the assessment participants were women aged between 30 and 49, which

    reected the wider Buddhist Leadership Initiative demographic prole. In total 154 women

    and 60 men participated in the quantitative survey, which mirrors that generally more

    women participate in the initiative than men. Among the 20 focus groups there were 30women, 30 men and 30 children (18 girls and 12 boys). Among the 214 survey participants

    there were noticeable demographic differences between provinces. A large proportion

    (43%) of the surveyed participants had been involved in the programme for ve years or

    longer. Approximately a quarter had been involved for 3-4 years, another quarter had been

    involved for 1-2 years, and the remaining 9% had been involved for less than 12 months.

    intended audience

    Primary users of this evaluation will be Ministry of Cult and Religion, Buddhist leaders and

    UNICEF. The ndings will be also shared with a broader group of relevant stakeholders,

    including NGOs and development partners, working in the area of HIV and AIDS. The good

    practices and lessons learned are intended to be used by MoCR, Buddhist leaders and

    other relevant stakeholders to address the gaps and expand the services to other areasof child protection and inform MoCR on steps to institutionalise and sustain the initiative.

    liMitations

    Participants for focus group discussions were not selected randomly by the researchers,

    who relied on Provincial Department of Cult and Religion representatives to select

    participants. This was also true for the survey participants to some extent as the research-

    ers relied on the Provincial Departments of Cult and Religion to select which pagoda they

    would visit, but as visits were mostly arranged when regular meditation and self-help group

    meetings were taking place all members of any self-help group had the opportunity to

    participate in the survey. There were challenges with the quantitative survey, particularly in

    relation to interpretation of questions into Khmer. In some cases this was due to emphasesaltering during the translation from English to Khmer, and in other cases there were

    differences in understandings of terms or concepts. The majority of these were claried in

    the early phase of data collection and in most cases earlier completed surveys could be

    reviewed and corrected by corroborating responses within each participants responses.

    ethical considerations

    All programme participants (adults and children) were provided with written information

    explaining the purpose of the research and with the researchers contact details. All partici-

    pants were made aware that their participation was voluntary, that there responses were

    given in condence, and all signed an informed consent form. Photographs were taken only

    of those people who gave their consent, and with the understanding that the images would

    be used in relation to these research ndings and not as part of any widespread publicitymaterial for HIV campaigns or public health messages in Cambodia.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    13/84

    13

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    fINDINgS

    relevance

    The objectives of the Buddhist Leadership Initiative were found to be in line with and therefore

    relevant to national and UNICEF strategies and policy frameworks. At national policy level,

    the Buddhist Leadership Initiative directly responded to the governments Policy on

    Religious Response to the HIV/AIDS Epidemic in Cambodia which was the rst of its kind

    in May 2002. Alongside this, other HIV focused policies make specic references to the

    role of faith leaders including the National Strategic Plan for the Comprehensive and

    Multi-sectoral Response to HIV/AIDS III (2011-2015) which promotes the role of faith

    leaders in reducing stigma and discrimination. The governments commitment to the

    Convention on the Rights of the Child provided the backdrop for introducing the childrens

    component. This looked at including children affected by AIDS and children vulnerable for

    other reasons, championing an AIDS sensitive, but not AIDS exclusive approach.

    Within UNICEF, the programme contributes to strategies and targets in UNICEFs CountryProgram Action Plan (2011-2015) such as developing national capacity for realisation of

    child rights, results at greater scale for children, results-based programming, and the support

    of key interventions for multi-sectoral response in HIV prevention, treatment and care.

    For the most vulnerable people, the value of the initiative was found to be extremely high

    and relevant, with almost all of the survey respondents reporting that the spiritual support

    they had received through the BLI was very important.

    Noting the rapid decline of HIV prevalence in Cambodia in recent years and the concentrated

    epidemiological context among key affected populations, the research ndings question

    whether the main objectives are still appropriate given the changing circumstances. Overall,

    the support provided by the programme remains highly relevant to the most poor and

    vulnerable community members, but the narrow focus on people affected by HIV meansthose who are highly vulnerable for reasons other than HIV do not qualify for support.

    coverage and effectiveness

    The Buddhist Leadership Initiative nancially supported 653 people living with HIV in

    2011 to access their medication on a regular basis. Although the programme provides

    some nancial support to child participants, if it also facilitates access to HIV services for

    children who need them, this aspect was not emphasised in programme documentation

    or by participants.

    The cash support that the programme provides to children amounts to approximately $6

    USD which is provided twice a quarter, part of which ($2 USD) is to reimburse their travel

    costs for coming to the session, and the remainder is intended for education and other

    household needs. Some children of adults in the self-help groups benet as well from the

    cash that their parents receive from the Buddhist Leadership, for example, 6% of survey

    respondents said they used the money to pay for their childrens education (fees and school

    materials), and 5% of women who received cash said they used some of it for transport

    costs for education.

    Overall, according to programme monitoring data, largely output data, nearly all provinces

    reached or exceeded their quantitative targets. One province reached 78% of its targets,

    with the main barrier being that trained monks either left the monkhood or moved to

    another pagoda and were not replaced.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    14/84

    14

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    The initiative provided spiritual care to 2,355 adults living with HIV in 2011 through

    its activities, and 64% of survey participants said meditation sessions were the most

    important activity for them. In the same year the programme provided spiritual support

    to 1,622 orphans and vulnerable children.

    efficiencyEfforts to reduce the administrative costs were discussed at annual review meetings as

    were comparisons between costs between different provinces implementing the same

    activities. However, operational costs by the Provincial Departments of Cult and Religion

    appeared quite high at the time of the evaluation, questioning whether activities were

    delivered in the most cost efcient way.

    Further, there were differing views about whether the Buddhist Leadership Initiative

    activities were formally recognised as part of the Ministry of Cult and Religions workplan

    which caused some implementers at provincial level to experience their engagement in

    the programme as an imposition. Related to this, was an overall nding that government

    civil servants requested nancial incentives (allowances in addition to travel costs) which

    seemed contentious for several reasons and ultimately a disincentive to increase theefciency of the programme.

    Cost efciency varied among the provinces. This was largely due to the way activities were

    organised, with some provinces organising activities locally at district level requiring less

    travel from provincial levels. Another reason was that in some provinces selected wats were

    in faraway districts, necessitating long journeys to transport cash and in kind support to

    programme participants.

    iMpact

    The Buddhist Leadership Initiative made a decision in 2010 to increase awareness among

    children of their rights by developing a set of advocacy messages for monks to promoteduring the group sessions.

    Monks often used the Five Buddhist Precepts or Virtues to encourage qualities such as

    loving-kindness and compassion, while discouraging high-risk behaviours. The Dharma

    (the teaching of the Buddha) was also mentioned as an important vehicle for transfer

    of information from monks to community members, albeit by only 10% of focus group

    participants. More members of the focus groups, approximately a quarter, mentioned

    specic Buddhist teachings, such as aspiring to become self-reliant. On the whole, focus

    group participants seemed to think that the messages that Buddhist monks give them

    were appropriate, and a small proportion acknowledged that they would not expect monks

    to use sexually explicit language to discuss HIV.

    i m mm . Spiritual and practical support for adults is provided through the twice quarterly

    meditation sessions and self-help groups. The practical application of meditating was

    found effective and mentioned by nearly all of the focus group participants who described

    how it helps calm them, helps them feel spiritually and emotionally strong, and it helps

    relieve depression and anxiety. The self-help group activities, whether they focussed on

    health and hygiene messages or had a more dynamic entrepreneurial emphasis were also

    valued by the participants. The importance of the dual spiritual and secular approaches of

    the initiative was mentioned specically by a small number of participants.

    The self-help groups seemed to vary in their effectiveness to reduce peoples vulner-

    abilities. Some had developed overlapping micronance mechanisms to facilitate loans

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    15/84

    15

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    for income generating activities and for emergencies, while others had never heard of a

    savings and loan club and the nature and content of the quarterly sessions had essentially

    remained unchanged for many years. There were noticeable differences within self-help

    groups as well as between them, for example, one-off income generating activities had

    been implemented prior to 2008 and the members of a self-help group who had been

    programme participants at the time had benetted and continued to benet, while peoplewho had joined the programme later did not get access to the same opportunity.

    Effects on rights awareness seemed to vary dramatically across the focus group

    participants with some people citing legislation which should protect people living with

    HIV from discrimination, despite which they felt that potential employers still managed to

    sidestep the law.

    The effects of cash support were considered very important by 83% of the survey

    respondents and the most frequently cited expenditure was on food. A small number of

    people used the cash for generating income. Many more said they would like to spend the

    money on income generation but seemed more compelled to meet their immediate needs

    of food with the cash rather than make investments which could earn them more income

    in the future.

    Almost all the survey participants said that levels of stigma and discrimination had reduced

    as a result of the activities that involve monks. Meditation sessions and spiritual support

    from monks seems to have impacted positively on peoples feelings of self-stigma, which

    overall was reported at lower rates compared to respondents of the Stigma Index survey.

    Although there were extremely positive effects for most focus group participants of being

    visited at home by a monk, one participant pointed out that all of the activities inadvert-

    ently advertise her HIV status without her consent, particularly the home visits. The visit by

    the monks is not a quiet private event, it is quite the opposite when a contingent of people

    descends on a persons home and the monk begins sharing messages about HIV.

    Whether the Buddhist Leadership Initiative was able to reduce inequalities between theworst-off or most vulnerable and other people was more complex to ascertain. Data was

    not systematically collected on whether participants nancial or social statuses had

    increased, so any evidence of change was gathered qualitatively in the focus group

    discussions. Within the same self-help group some individuals discussed increases in

    economic stability while others had not achieved any improvements. Those that reported

    improvements cited income generation activities and/or saving and loan schemes as the

    key factor in changes to their economic situation.

    At a strategic coordination and partnership level there were Provincial Departments of Cult

    and Religion that regularly participated in Provincial Department of Health meetings in

    order to coordinate responses, including with local NGOs, for example in Prey Veng and

    Kampong Thom. However, close engagement with other government departments andNGO service providers was not consistent across all provinces. Similarly at local level, some

    of pagodas linked in with existing governance and community structures such as Village

    Health Support Groups (initiated by the Ministry of Health) while others did not.

    sustainability

    Most of the activities as they are currently implemented rely on external donor support.

    Some one-off or time-limited activities have had profound results and do not need to be

    repeated consistently, such as the rst home visit to a person living with HIV which can

    signicantly reduce stigma and discrimination experienced by the person. The activities

    seem more likely to be sustainable if they originate from each wat rather than organised

    by the Ministry of Cult and Religion at provincial level. Monks can distribute donations

    given to the pagoda to vulnerable people in the local community without incurring the

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    16/84

    16

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    administrative costs associated with the provincial level engagement, although the

    amount of cash support that participants receive is likely to be less than current rates.

    Sustainability of results could be increased if monks and other implementers more

    systematically connected participants to other social protection schemes and other exist-

    ing services.

    At most levels of organisation of the programme, implementers and participants alike

    did not seem to claim ownership over the activities, meaning they did not feel in charge.

    It seemed to them all that someone else was responsible and they did not want to

    suggest changes or take ownership for fear of stepping on toes. This is potentially most

    problematic among monks who arguably should be more at the centre of the decision

    making. A minority of self-help groups seemed to have increased their participation

    spontaneously by meeting regularly within their communes once a week or more. Recently

    (in 2011) UNICEF re-iterated that the initiative is only sustainable if integrated into

    government plans and budgets, but to date most implementers and participants continue

    to refer to the activities as a UNICEF initiative.

    However, given the overwhelming value of participants of the spiritual support, the

    initiative may well be sustained if planned locally, with monks at the centre and even in theabsence of external funding support. A challenge may be as to how overall achievements

    and progress would be monitored and data shared.

    child protection issues

    Vulnerable children are supported by the Buddhist Leadership Initiative and opportunities

    are taken to increase their awareness of their rights such as the right to have a name, to

    be cared for, to be fed etc. The programmes approach to child protection issues could

    go further than awareness raising, for example, informing children and parents that chil-

    dren have the right to a name could more be more closely linked to birth registration by

    monks and implementers providing specic support to register births such as instructions,

    accompaniment or help completing forms. Currently, the programme promotes messages

    for a limited number of child protection issues and there is scope for monks at both senior

    level and at the pagodas to have greater understanding of serious abuse of childrens

    rights.

    conclusions

    The Buddhist Leadership Initiative seems highly relevant to the national HIV policy

    expectations of religious leaders to engage in the HIV and AIDS response. It has made

    a signicant difference to most of its participants. With the HIV context in Cambodia

    changing dramatically since its launch, with lower rates of HIV prevalence, increases in

    access to treatment and an overall reduction in stigma & discrimination, the programme

    has an opportunity to re-focus its efforts on reaching the most vulnerable and the worst

    off, which is likely to include many people living with HIV but would also include peoplewho are vulnerable for reasons such as other illnesses and extreme poverty. Monks have

    a positive inuence on both external & internal HIV related stigma experienced by people

    living with HIV, while the cash support is very important to the poorest participants, at the

    same time it causes some limitations to the programmes ability to include more people.

    The more dynamic self-help groups have skills & experience of micronance mechanisms

    to share with other groups which create opportunities for learning within the programme.

    Overall the efciency of the programme does not compare well with other organisations

    which are designed to implement similar activities, and its reliance on external donor

    funding raises challenges to its sustainability. It seems likely that efficiency and

    sustainability would be increased if ownership of the programme was with the monks

    implementing the activity at pagoda level, and with senior monks in the Buddhist hierarchy

    who have the authority and inuence to institute its aims and objectives into its networks

    and education system.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    17/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    18/84

    18

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    16. Design and promote cost-effective activities.

    To increase effectiveness the following suggestions are made:

    17. Promote the successful approach of providing spiritual support for vulnerable

    community members.18. Facilitate monks increased capacity to identify people and organisations which can

    support local communities to reduce their economic vulnerability.

    19. Identify routes to agreeing and sharing the provision of spiritual support.

    20. Increase awareness and training in child protection.

    To increase sustainability the following suggestions are made:

    21. Institute good practices around Buddhist responses to reducing vulnerabilities.

    22. Use its leadership networks to explore expanding the role of monks in community

    engagement.

    unicef

    To increase relevance the following suggestions are made:

    Noting the rapid decline of HIV prevalence in Cambodia in recent years and the

    concentrated epidemiological context among key affected populations, the research

    ndings question whether the main objectives are still appropriate given the changing

    circumstances. Overall, the support provided by the programme remains highly relevant

    to the most poor and vulnerable community members, but the narrow focus on people

    affected by HIV means those who are highly vulnerable for reasons other HIV do not qualify

    for support. Therefore an overall relevance recommendation is for UNICEF to review the

    objectives and the intent of the programme.

    23. Support MoCR in the process of initiating and strengthening dialogue

    24. Support MoCR to transition out of the current initiative

    To increase effectiveness the following suggestions are made:

    25. Provide technical support on income generation & reducing economic vulnerabilities

    26. Promote the successful spiritual support approaches of the initiative

    To increase efciency and sustainability the following suggestions are made:

    27. Facilitate capacity building between current implementers.28. Help identify strategies to institute capacity building within the Buddhist hierarchy.

    29. Support the MoCR and PDCRs to transition into a more strategic leadership and

    coordination role.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    19/84

    19

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    PURPOSEOf THE EVALUATION

    The purpose of this end-of-programme evaluation, commissioned by UNICEF, was to

    provide relevant, comprehensive and timely information to analyse the strengths & gaps in

    the Buddhist Leadership Initiative in order to inform decisions about the future direction of

    the programme. The evaluation report is available in Khmer & English and will contribute

    to national learning and discourse on faith-based responses to HIV and development. The

    ndings of the evaluation will be discussed with national partners to determine whether

    the value and cost-effectiveness of the programme warrants its continuation, and in the

    case of continuation whether changes are required to its strategies and implementation.

    The evaluation will be used by UNICEF and Ministry of Cults and Religion to identify the

    lessons learned and map the future programmatic directions with a concise national

    adaptation by the Ministry and exit strategy for UNICEF.

    Specically the evaluation aimed to:

    Assess the organisational and programme performance for the time period 2008-

    2012 (i.e. subsequent activities to the earlier evaluation in 2007 as part of a regional

    process), including its efciency and effectiveness;

    Review the institutional capacity and set-up of the initiative;

    Evaluate the outcome of the programme with regard to the provision of support to

    individuals and families affected by HIV at the household level;

    Provide recommendations on how to include other areas of child protection; and

    Draw lessons and recommendations for programme adaptation and revision;

    The following criteria & evaluation questions were utilised to guide the evaluation following

    the format of the OECD Development Assistance Committees Principles for Evaluation of

    Development Assistance:

    relevance

    To what extent are the objectives and activities of the programme suited to contribute

    to achieving the priorities and policies agreed at the national level as well as the

    strategies of the Ministry of Cult and Religion (MoCR), Provincial Departments of Cult

    and Religion (PDCR), Orphans and Vulnerable Children (OVC) Task Force and UNICEF

    (e.g. National HIV Strategic Plan III, UNICEF Country Program Action Plan 2011-2015)

    as well as human rights (Right to Health, Rights of the Child)?

    What is the value of the initiative in relation to the needs of the worst-off groups/mostvulnerable people? What is the value of the initiative in reducing inequalities between

    worst-off groups/ most vulnerable people and others?

    effectiveness

    To what extent were objectives achieved and what were the major inuencing factors?

    To what extent did the initiative provide spiritual care for families and children infected

    with and affected by HIV and AIDS (how appropriate are the messages)?

    To what extent did the initiative contribute to support referral for most vulnerable

    adults and children living with HIV to access medical care?

    2 Organisation for Economic Co-operation and Development

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    20/84

    20

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    To what extent did the initiative contribute to cash support to vulnerable children and

    what were the results?

    To what extent did the initiative contribute to promote family based care for vulnerable

    children as the best option for child care?

    efficiency

    Were the activities cost-efcient compared to other programs that aim to provide

    support and to reduce stigma and discrimination against families and children

    affected by HIV and AIDS?

    Were the activities cost-effective with respect to operational costs?

    How does the cost-efciency vary within the programme and why?

    iMpact

    What are the intended and unintended results of the Buddhist Leadership Initiative?

    In particular in respect to:

    The extent and the way the initiative contributed to increased self and community

    acceptance and to reduced stigma and discrimination against families and chil-

    dren affected by HIV and AIDS;

    The extent to which the initiative was able to reach the most vulnerable people;

    The extent to which the initiative contributed to decreasing inequalities between

    the worst-off and best-off;

    The contribution to strengthen the rights of people infected with and affected

    by HIV;

    The level of impact with respect to HIV knowledge and attitudes towards families

    and children affected by HIV among communities, Ministry of Cult and Religion &

    Provincial Departments of Cult and Religion staff, as well as monks;

    Management and ownership of the initiative; and

    Achieved coordination and partnerships.

    sustainability

    What are major factors that inuence the achievement or non-achievement of

    sustainability of the programme (inter alia role, ownership and leadership of MoCR)?

    Are the interventions and impacts on the worst-off/ most vulnerable people likely to

    continue when external support is withdrawn?

    What needs to be done to achieve sustainability?

    How likely is it that the initiative will be replicated or scaled up?

    In addition, the evaluation considered:

    To what extent, and how, can the Buddhist Leadership Initiative structure be used to

    address broader child protection issues?

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    21/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    22/84

    22

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    Key informant interviews with concerned NGOs (Save the Children Cambodia and

    Partners in Compassion);

    Focus group discussions and in-depth interviews with women, men & children affected

    by HIV, and implementing monks;

    Observations of participants.

    The lead consultant led the qualitative data collection in English & Khmer which consisted of:

    20 focus group discussions with 90 programme participants (30 men, 30 women and

    30 children: 18 girls and 12 boys) and 26 junior and senior monks (total 116). Focus

    group discussions lasted between 45 minutes and 1.5 hours. Groups were asked

    a selection of similar and unique questions, and participants were encouraged to

    discuss the issues that were most important to them;

    Semi-structured interviews with 27 representatives of the Ministry of Cult and Religion

    (1), Provincial Departments of Cult and Religion (17), UNICEF (5), members of the

    Buddhist hierarchy (2) and NGO stakeholders (2). Questions were based on a prepared

    interview framework and participants were encouraged to discuss the issues that

    were most important to them.

    A team of three researchers collected quantitative data from 214 programme participants

    (154 women and 60 men) in the ve provinces. The survey was conducted in Khmer and

    took between 20 and 40 minutes per respondent.

    The evaluation team relied on requests to the Provincial Departments of Cult and Religion

    to help identify programme participants to take part in the focus group discussions and

    survey data collection. Nearly all data collection took place at a pagoda. In most instances

    the participants were attending a regular support meeting for the meditation and self-help

    group meetings. Provincial Departments of Cult and Religion selected the focus group

    discussion participants in order to identify six male, six female and six child participants

    per focus group, and all of the members of the self-help groups were invited to take partin the survey. The focus group discussions were conducted using an interview framework

    to facilitate responses to similar questions across all groups as well as unique questions

    depending on their specic contexts and situations. They were conducted in an informal

    manner, often sitting in a circle on the oor of the wat or meeting space, or at a table with

    seats in the grounds of the pagoda. Among the childrens focus groups the children were

    encouraged to discuss what was important to them.

    The mix of data sources was designed to obtain a diversity of perspectives. In order to

    increase the level of data accuracy, the data collectors were trained in the data collection

    tools, and daily debriengs during the eld work provided opportunities to clarify categories

    of responses from programme participants. The quantitative data was input into Excel during

    the eld work so that anomalies or patterns could be identied and followed up in focus

    group discussions. Basic analysis was performed in Excel to identify proportional responsesto multiple choice questions and averages of data related to income levels. These

    computed results focussed on identifying similarities and difference between responses

    given by women and men and responses distributed by province.

    A stakeholder consultation meeting was held at the completion of the of data collection to

    share and discuss the preliminary ndings of the evaluation. Subsequently the survey data

    was cleaned for errors, and analysed again in Excel with the results triangulated with the

    qualitative data to both substantiate ndings and identify unique insights.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    23/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    24/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    25/84

    25

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    Some questions in the survey instrument required some clarications or revisions as the

    data collection progressed. For example, one of the response options to a question about

    what activities people participated in was A monk gave me cash. There were differing

    beliefs about whether monks can handle money so some respondents answered no but

    indicated that someone else in the programme had given them cash. The question was

    rephrased during the interviews so it emphasised the receiving of cash as part of theinitiative rather than whether a monk specically handed cash to the participant. An

    ambiguity was revealed in the same question with the option A monk (or representative

    from the District Ofce of Cult & Religion) referred me to a service because the initial

    translation into Khmer placed an unintended emphasis on referring participants to this

    service (i.e. the Buddhist Leadership Initiative activities) rather than another service as

    the question was originally intended. The incorrect emphasis was not identied until the

    latter part of the data collection. Responses to similar questions within each survey

    response were corroborated and errors were corrected where possible. For example, some

    participants indicated that they were referred to another service as above, but later when

    asked which service they were referred to answered none. In these cases, the earlier

    response was changed in the data cleaning process.

    ETHICAL CONSIDERATIONS

    Participation in the data collection was entirely voluntary and this was made clear to

    potential participants. All participants (including children in focus groups) were provided

    with written information in Khmer about the purpose of the data collection and the

    contact details of the researchers and interviewers, and all signed a consent form. When

    participants were asked to pose for photographs, the researchers emphasised their

    prerogative to decline. Most agreed to appear in photographs on the understanding that

    they will be used in relation to these research ndings and not as part of public media

    campaign materials about HIV in Cambodia. A small number of individuals declined to

    appear in photographs and they were reassured that their decision was respected by theresearchers. Photographs were taken only of those participants that consented.

    The approach taken to interviewing children in the focus groups was to allow children

    to lead in raising sensitive issues themselves rather than ask direct questions which

    may have made them uncomfortable. For example, the researchers assumed that most

    children were affected by HIV and some may have been living with HIV, and did not assume

    that all the children in any group knew about each others situation or status. Therefore,

    no questions were asked which would have caused a child to reveal their HIV status or

    how they were affected by HIV. The researchers did not mention HIV unless the children

    raised it as an issue rst. In some cases children mentioned they received HIV information

    as part of the initiatives childrens sessions, in which case, the researcher asked them

    how useful the information was and whether they talked to their friends and family

    members about the HIV information they received. The researchers asked children about

    their relationships with friends at school and whether any other children were unkind to

    them. In one case, a child responded that other children bullied her by saying that she

    would give the other children HIV. The researcher made no assumption that she was living

    with HIV and asked her and all the children present about their own reactions to bullying

    and what they do about it. At all times the researcher encouraged children to speak about

    what was important to them.

    The decision to focus on adults in the quantitative survey was motivated by the fact that

    the majority of programme participants are adults. Children had the opportunity to share

    their views as part of the focus group discussions.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    26/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    27/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    28/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    29/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    30/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    31/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    32/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    33/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    34/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    35/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    36/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    37/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    38/84

    38

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    A signicant proportion (164 or 77%) of people was visited at home by a monk and other

    implementer although the frequency and number of visits were not recorded for these

    respondents. The 2007 evaluation noted that monks in focus groups mentioned that home

    visits were infrequent at that time and constrained by: a lack of material support; a lack

    of support from senior monks; and a lack of motivation for monks to spend their time

    on home visits (12). Since then the BLI has instituted regular home visits as part of itsactivities. In general, according to programme documentation, home visits are made twice

    per quarter to persons living with HIV and who are too ill or frail to come to the pagoda.

    Across Cambodia the number of people who are inrm because of HIV has reduced

    dramatically as a result of increased access to treatment. In most provinces the number of

    people visited per quarter is less than 30.

    There was ambiguity about the fourth option on the list A monk (or representative from the

    District Ofce of Cult & Religion) referred me to a service because the initial translation

    into Khmer placed an unintended emphasis on referring participants to this service (i.e.

    the Buddhist Leadership Initiative activities) rather than another service as the question

    was originally intended. The incorrect emphasis was not identied until the latter part of

    the data collection. Initially 173 participants checked this option, but 148 conrmed that

    they were referred to another service in a later question. The results in the chart have beenupdated to reect the lower number.

    RELEVANCE

    relevance to national policies

    The objectives of the Buddhist Leadership Initiative were found to be in line with and

    therefore relevant to national and UNICEF strategies and policy frameworks. At national

    policy level, the Buddhist Leadership Initiatives aims and impacts contribute to achievinga range of the HIV related priorities and policies. The programmes key priorities, agreed

    on in late 2011, are (13):

    To improve care and support for people living with HIV

    To promote compassion for and support to families affected by HIV, & other vulnerable

    children

    To provide care and support to vulnerable children, including children affected by HIV

    The Buddhist Leadership Initiative component that includes vulnerable children was

    introduced as part of the governments commitment to the Convention on the Rights of the

    Child which Cambodia ratied in 1992. Recognising that the state has the responsibility

    to act in the best interest of the child, the government has introduced a wide range of

    policies related to the care of orphans and other vulnerable children. Over one third of allHIV affected households are caring for a child orphaned by HIV, and there are more than

    85,000 children in Cambodia who have been orphaned or made vulnerable by HIV (1).

    As such the BLI started to promote family based care for vulnerable children as the best

    option for child care in 2010 and this was piloted in the four provinces of Prey Veng, Svay

    Rieng, Kampong Speu and Kampong Thom (14). This was undertaken to explore if and how

    local religious clergy can play a role in promoting family based care among households who

    have high child dependency ratio and who are economically impoverished or vulnerable for

    other reasons. As a result of this pilot, the important role of religious leaders was formally

    recognized in the new government guideline on alternative care.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    39/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    40/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    41/84

    41

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    commune councils & religious leaders should be supported to maintain a prominent role &

    ensure that monks play a key role in mobilising the community and reducing stigma (22).

    In the above context of national priorities & policies which emphasise the role that Buddhist

    monks can and should have in the response to HIV, the Buddhist Leadership Initiative

    upholds its relevance because participating monks are perceived by the target group toplay a hugely signicant role in reaching out to people living with HIV by visiting them at

    home and inviting them to the pagoda, and by applying Buddhist messages to the context

    of HIV.

    relevance to unicef strategies

    The Buddhist Leadership Initiative commenced in the previous UNICEF Country Programme

    of Collaboration (2005-2010), and has been modied and adapted over the years. It

    remains relevant to a number of UNICEF strategies and targets as articulated in the

    Country Program Action Plan (CPAP) (2011-2015), namely:

    Developing national capacity for realisation of child rights: The programme has contributed

    to this strategy by promoting child rights across the participating provinces through the

    Provincial Departments of Cult and Religion & monks engaged in the Buddhist Leadership

    Initiative. The emphasis on child rights was introduced in 2010, and as a result has raised

    awareness of child rights among all the implementers and the participating children and

    their families. The CPAP additionally identies the strategy of simultaneously developing

    the capacity of local groups at village level to effectively interact with village leaders,

    demand quality service provision, and identify local solutions to issues. In this regard, the

    Buddhist Leadership Initiative has signicant potential to contribute to this secondary

    strategy because of its implementation location at pagodas. However, to date, manage-

    ment and coordination has remained at provincial level with limited engagement of local

    communities in implementation.

    Results at scale for children: UNICEFs engagement in Cambodia, prior to the current CPAPtimeframe, was concentrated in six of the 24 provinces. The Buddhist Leadership Initiative

    has contributed to the strategy of more comprehensive coverage by UNICEF by expanding

    its reach. It currently operates in ten provinces, and over its twelve years has been opera-

    tional in fourteen.

    Results-based programming: Systematic data collection has become instituted in the

    Buddhist Leadership Initiative activities and all provinces provide detailed records of the

    numbers of adults & children participating in the range of activities every quarter. Learning

    and knowledge sharing takes place at annual meetings of all provincial level implementers.

    The quantitative data collection allows the programme to monitor its progress and

    achievement of targets easily. This is signicant in the context of the limited capacity

    in monitoring evaluation of the Provincial Departments of Cult and Religion, however, it

    should be noted that currently the targets are all output-based rather than outcome-basedThis means that the programme records the numbers of pagodas, villages, districts and

    provinces involved, and the numbers of children and adults in receipt of activities.

    Support key interventions for multi-sectoral response in HIV prevention, treatment and

    care: The Buddhist Leadership Initiative has engaged the Ministry of Cult and Religion at

    national & provincial level in the response to HIV, including through cross-ministry working

    groups and the development of the rst national policy on faith-based responses to HIV.

    The Buddhist Leadership Initiative is relevant to the following Programme Components and

    corresponding Key Progress Indicators

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    42/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    43/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    44/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    45/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    46/84

    46

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    Two focus group participants mentioned that the rst precept conicts with income

    generating activities that involve livestock. They explained that the monks promote the

    message that they should not take life, not even from the smallest bird, while at the same

    time the participants are or have been encouraged by Buddhist Leadership Initiative

    representatives or NGOs to breed chickens and other animals. Given that vegetarianism

    is not a deliberate practice by Buddhists (some participants said they could afford toeat meat only rarely) or Buddhist monks to any signicant degree in Cambodia, these

    participants did not seem highly conicted by the opposing messages but they acknowl-

    edged the dissonance.

    The Five Buddhist Precepts or Virtues to encourage qualities such as loving-kindness and

    compassion, while discouraging high-risk behaviours that were mentioned by both monks

    and participants in focus groups were:

    1. Abstain from taking life.

    2. Abstain from taking what is not given.

    3. Abstain from sexual misconduct.

    4. Abstain from false speech.

    5. Abstain from fermented drink that causes heedlessness.

    the extent to which the initiative

    supported referrals

    In the fourth quarter of 2011, the BLI provided nancial support to 653 people living with HIV

    to access treatment. Among the 214 survey participants, 133 said they were referred to

    HIV services and 60 said they were referred to health services for non-HIV related matters.

    The programme provides some nancial support to child participants ($6 USD which is for

    their transport to the sessions and to spend on education or other household needs) but it

    does not explicitly provide nancial support for children living with HIV to access treatment.

    One monk and a handful of participants mentioned that monks discuss PMTCT servicesbut no data was collected which could indicate whether messages around PMTCT create

    referrals in practice.

    In the context of the Buddhist Leadership Initiative referral support means helping a

    person living with HIV with nancial resources to collect their antiretroviral therapy from a

    hospital or clinic on an on-going basis. This is a different denition from the more widely

    used understanding in that a referral is the process of directing someone to medical care,

    and once that person has been connected to the medical service that they require the

    referral is complete.

    the extent to which the initiative contributed

    to cash support to vulnerable children

    As mentioned the children participating in the BLI activities received a small cash benet of

    $6 USD for their transport costs to attend the sessions at the pagoda, and the remainder

    is intended for education and other household needs. Children did not participate in the

    quantitative survey so detailed information is not available on the expenditure and results

    of the cash support. However, anecdotally, in the focus groups with children, most said they

    give the money to their parents who do the household purchasing and manage household

    budgets. One boy who lives with his grandmother spends the money himself by buying food

    and he explained that he likes to be able to use the money this way and feels proud to be

    able to bring food to his career.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    47/84

    47

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    Some of the children of adults participating in the self-help groups also benet directly

    from the cash that the adults receive. Five per cent of women who received cash said they

    used some of it for transport costs for education; 13 people (6%) said they used the money

    to pay for their childrens education (fees and school materials); and two people said they

    bought medicine for their children.

    the extent to which the initiative proMoted

    faMily based care for vulnerable children

    Monks in focus groups reported promoting messages about good parenting skills among

    adults with children, particularly by giving encouragement to children. In this way the

    initiative promoted more caring family environments. This must be understood against the

    background of a pilot where in 2010, UNICEF supported PDCRs in ve provinces to pilot

    in selected communes the support to testing a new government guideline (Prakas) on

    implementing the Alternative Care Policy. This test saw monks assisting families in crisis

    situations and thereby linking the BLI to the evolving child welfare system under the Prakas.

    This process included the training of all ve PDCR, MoCR focal points and monks from the

    10 communes on the Prakas new procedures. During this time, monks conducted homevisits to 340 families which were believed to be at risk of separating from their children

    and provided moral, spiritual and small cash allowances (one to three times per family per

    quarter). Monks worked closely with commune council focal points for women and children

    and district social workers. Small, regular cash transfers of $10 USD per family were used

    to support vulnerable childrens basic needs and education.

    A review of programme documents found that eld visits demonstrated that the support

    from monks was well appreciated by government, commune workers and, importantly,

    vulnerable families, many of whom were affected by HIV. The decentralized approach

    greatly assisted in the forging of a high degree of involvement and ownership by PDCRs.

    Moreover, visits by UNICEF staff to Tep Vong, the Great Supreme Patriarch of Cambodia,

    also supported this collaboration and revitalized high-level support within the Buddhist

    fraternity for this initiative. As a result of this pilot, the important role religious leaders playin protecting children at the community level was formally recognized in the Prakas

    EffICIENCy

    Support to orphans and vulnerable children was noted to have signicant variances in

    spending between provinces in 2010. Participants were asked to review the operational

    costs and reduce them where possible and a target limit was set of 25% for operational

    costs in 2009 (24) and reiterated in 2011 (14).

    There are potential inaccuracies in the monitoring of participants and therefore thecalculations of the costs of activity per person. An effort was agreed in 2009 that Provincial

    Departments of Cult and Religion would reduce the likelihood of double counting of

    orphans and vulnerable children by preparing a master plan which would include all

    children who are enrolled for support (25).

    Other issues of efciency were not claried in the evaluation, for example, there are costs

    associated with providing cash for transport (referral support) to people living with HIV to

    access treatment. The costs are for travel and allowances for a Provincial Department of

    Cult and Religion representative to make a visit to each of eight districts once per quarter

    to distribute the cash to 80 participants receiving this support. It is not clear why there are

    separate costs for a person to deliver this support when presumably the cash could be

    given to participants at the meditation sessions/self-help group meetings or during home

    visits.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    48/84

    48

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    The cash payments to programme participants are potentially divisive between those who

    get a cash benet and those who do not, and are one of the reasons why the monks and

    Provincial Departments of Cult and Religion nd it difcult to include more people in the

    activities that take place at the pagoda. They nd it awkward to try and explain why most of

    the participants receive cash for coming to the activity and some do not.

    Another challenge related to the cash benet is that it is given to all self-help group

    members and vulnerable children participants regardless of whether income is one of their

    priority vulnerability factors. In identifying children to participate in the programme, income

    is among the selection criteria, however, among both adults and children it is hard for the

    Provincial Departments of Cult and Religion to differentiate which participants are poorer

    than others. From the focus group discussions and the survey data it seems that some

    of the participants are living in severe poverty and that the cash helps them signicantly.

    However without facilitating any routes to increase their income on their own, the practice

    of giving cash seems likely to be needed indenitely for some of the participants.

    Although in earlier joint reviews of the programme, Ministry of Cult and Religion & UNICEF

    agreed that the Buddhist Leadership Initiative would be integrated into the ministrys

    workplans, there seemed to be mixed views within Provincial Departments of Cult andReligion as to whether this had happened. One Provincial Department of Cult & Religion

    director was condent that the programme had been integrated into its work plan, while

    others were adamant that it had not. Regardless of whether the activities are integrated

    into workplans, a senior representative from the Ministry of Cult & Religion highlighted

    the fact that the ministrys structures are not designed to implement a programme of

    this nature. This accounts in large part for why the activities are implemented with higher

    costs compared to other initiatives of a similar nature: the Buddhist Leadership Initiative

    activities are not part of the ministrys core business, and every activity that a provincial

    or district representative participates in incurs allowance and travel costs for each person

    per activity. A comprehensive cost comparison with a range of other implementing organi -

    sations was not possible within the time constraints of this evaluation; however the costs

    of the home visits within the BLI were compared to home visits of an NGO. Essentially the

    NGO could make 10 times the number of home visits per quarter as one of the Provincial

    Departments of Cult and Religion.

    In 2009 the costs of home visits in the programme were reviewed and found that on

    average, home visits cost $35 USD to deliver $20 USD (24). A maximum target of 25% for

    administrative costs was set for home visits in 2009 (24). Some cost-comparison tables/

    charts were included in an annual meeting report which highlighted the variances in

    expenditure between provinces for the second quarter of 2011 (26). Some of the differences

    seem to be caused by the differences in distance that monks had to travel to visit people,

    and the suggestion was made that more pagodas should be involved, particularly those

    more local to where people live. Overall it seemed that there was some tension between

    UNICEFs expectations about how the provinces spend and monitor their budgets (14) (26)

    and the provinces capacity to increase their efciency.

    The 2010 annual review meeting discussed the difference between the costs to provide

    meditation sessions between two provinces when they reached the same number of people.

    The suggestion was made that provinces that spent more should review the situation with

    the staff that manage the activities to nd ways to achieve the same results with less money

    (14). The efciency of the programme is hampered by the distribution of incentives

    both to the implementers and the programme participants. Incentives are requested by

    the government to perform tasks and providing them is common practice in Cambodia,

    similar to sitting fees or meeting fees given to government ofcials who participate

    in external meetings in other countries. Therefore, implementers (i.e. representatives

    of Provincial Departments of Cult and Religion and District Ofces of Cult and Religion,

    volunteers and monks) receive an incentive and their travel costs for each activity, as do

    the programme participants. The payment per person for carrying out activities creates adisincentive among implementers to increase the efciency of the programme and reduce

    implementing costs.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    49/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    50/84

    50

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    Group sessions for orphans and vulnerable children are usually held at pagodas twice a

    quarter for up to 30 children at each pagoda. The format consists of a monk leading the

    children in meditation for ve to ten minutes and then providing advice on appropriate

    behaviours, such as paying attention in school and to teachers, and respecting older

    people. A representative from the Provincial Department of Cult and Religion or District

    Ofce of Cult and Religion gives the children advice about hygiene, health and nutrition.

    A decision was made in 2010 to increase childrens awareness of their rights as part of

    the programme. Advocacy messages for monks to share during the support sessions with

    vulnerable children, including children affected by HIV, were agreed at the 2010 annual

    review meeting (27). In one pagoda, children were informed of their rights through a written

    letter which was sent to their home so they could discuss it with their parents or guardians.

    ADVOCACY MESSAGES FOR MONKS TO SHARE DURING SUPPORT SESSIONS FOR

    VULNERABLE CHILDREN

    1. Children and adults who have HIV or another chronic illness have the same rights

    than all other people and deserve respect and compassion.

    2. All children have four fundamental rights:

    You should not suffer discrimination.

    Your best interests should be at the top of the agenda when decisions affecting

    you are being made.

    You have the right to survive and develop. This includes the right to mental and

    physical well-being.

    You should be free to express your views. And these views should be taken into

    account in all matters that affect you.

    3. You have the right to have a name. The birth of any child should be registered with

    the commune council within 30 days after the child is born.

    4. You have the right to be protected from physical and mental injury and abuse, and

    from neglect, whether youre living with your parents or other approved caregiv-

    ers; no one should hurt you.

    5. HIV is not transmitted by everyday contact. HIV is not transmitted by: hugging,

    shaking hands, everyday contact, sharing bed or food, mosquito and other insect

    bites.

    6. Education gives you choices & the condence to take advantage of those choices.

    7. Education is not just good for you as an individual. If you are educated, you can

    share what you have learned with your family and friends.

    8. Washing hands with water alone is not enough! Proper hand washing requires

    soap and only a small amount of water. Hand washing with soap can preventdiseases. You have to wash your hands at two critical moments: before touching

    food and after using the toilet, and always with soap! You should wash your hand

    while signing Sa-at cheanich.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    51/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    52/84

    52

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    negotiated with the head teacher for her granddaughter to register at the school at no

    cost. But having successfully achieved this, she did not dare to try and negotiate any other

    discounts (i.e. for fees for the private afternoon schooling). The girl has one notebook for

    her school work which she writes in for all her subjects. She grows some vegetables and

    can sometimes sell them for 500-1000 riel ($0.12-0.25 USD).

    In contrast another girl in the same group lives with her mother who owns a food stall

    selling noodles and earning approximately $5 USD a day. Her mother has successfully

    negotiated all of her daughters afternoon private schooling for free with the teachers. The

    girl also earns money herself with her friends when she is not at school by carrying bricks

    from the factory to the truck; they earn $2.50 USD per day which they share between them.

    The isolation of the girl living with her elderly grandmother with zero income except the

    occasional sale of some vegetables and living off the goodwill of her neighbour made

    her seem exceptionally vulnerable in comparison to her peers in the same group. But the

    activities at the pagoda did not seem to meet her specic needs. She seemed to be in a

    precarious position and in need of food and safe adult supervision. The sessions at the

    pagoda provide her with peer support, friendships and good advice, and she receives $6

    USD (twice per quarter) and some in kind support such as school materials. However, thissupport does not address the underlying causes of her vulnerability.

    All of the facilitators and monks who supported the childrens sessions seemed committed

    and enthusiastic about the activity. But there were instances which raised questions

    about the level of training in and understanding of inclusive practices among some of the

    group facilitators. During a session for children in which a monk provided advice, there

    were children loitering at the doorway and some sitting inside the wat that were ushered

    outside by a facilitator because they were not OVC before the monks blessing took place.

    It is understandable that children that are not ofcially part of the programme would not

    receive the resource-constrained aspects such as the money for transport but it seemed

    unnecessary to reject them from the activity. In another instance, a number of children

    among a large group were instructed to stand up and the facilitator explained that these

    were taking daily medication, presumably identifying them as living with HIV. None of the

    children standing or remaining sitting had any noticeable reaction to this announcement,

    but nevertheless it seemed to be a breach of the privacy of the children if they were living

    with HIV. Even if everyone in the group already knew that they were living with HIV, identify-

    ing them to a group of visiting strangers (i.e. the researchers) showed a lack of judgment

    and understanding regarding the childrens right to condentiality.

    Overall, the outcomes of the childrens sessions were dependent on the skills and abilities

    of the facilitating monk and Provincial Department of Cult and Religion or District Ofce of

    Cult and Religion representative. Where a monk engaged with the children outside of the

    six-weekly activities of the Buddhist Leadership Initiative, children were lively and talkative

    about their participation and experiences. Where childrens participation was limited to

    the six-weekly sessions there were varying responses. One group of children was visiblysupportive of each other, as they chatted and planned who would ride on which bicycle on

    their journey home after the focus group discussion. In other cases, children respectfully

    expressed their appreciation for the sessions but their near-identical responses could be

    interpreted to reect socially desirable bias (the tendency of respondents to answer

    questions in a manner that they think will be viewed favourably by others). Stigma and

    discrimination remains an issue for some children, whether they experience victimisation

    at school or whether they prefer to keep their visits to the pagoda a secret.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    53/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    54/84

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    55/84

    55

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    There was a difference noted between the current activities of the Buddhist Leadership

    Initiative and the practices reported by people living with HIV in the 2007 evaluation. Most

    of the people living with HIV in the focus groups in the earlier evaluation said they belonged

    to a self-help group that met regularly at a pagoda. The focus seemed similar to the current

    programmes self-help group content: advice and discussions about health care, hygiene

    and taking antiretroviral therapy. The people living with HIV surveyed in 2007 said theywere encouraged by monks to contribute money to the group to help individual members

    in the case of emergency. Among the monks surveyed at the same time, 49% said they

    met with the groups once a month, and 19% reported weekly meetings (12). The 2007

    evaluation reported that the rationale for introducing the self-help groups was linked to the

    economic impact that people living with HIV experienced as result of their status. When

    asked, in 2007, who assisted them most with their economic problems, 32% of people

    living with HIV said family members, 28% said NGOs, and 10% said wats and monks,

    although 59% of self-help group members also said that monks provided income generat-

    ing support for their group.

    At one end of the spectrum, the self-help groups showed a high level of autonomy and

    organisation by sub-dividing into smaller groups according to the members village/com-

    mune, and with elected leaders. These smaller local groups met regularly outside of theprogrammes activities, and the members demonstrated high levels of nancial literacy

    with multiple types of savings and loan schemes. In response to questioning about the

    high levels of activity in the active self-help groups with savings and loan facilities, the

    facilitating monk said that the people in the area were particularly entrepreneurial and

    self-organised. They lived close to a major tourist destination which offered opportunities

    for employment and income earning.

    At the other end of the scale, the activities did not seem to reect any denition of self-

    help group: they were one-way information streams from facilitator to participant, and the

    information given did not change over time. Male participants of one focus group described

    coming to the pagoda twice per quarter for eight years and receiving the exact same

    messages on health, hygiene and reminders to collect their medication. These and other

    participants said they were too shy to make suggestions in the group, and in most cases

    there was no opportunity for discussions or to make suggestions. They said they were

    too afraid to go off-topic and talk about anything other than their health. Among the

    male focus group participants mentioned, none had ever heard of a savings club. When

    asked about what they might do if they could have some help increasing their income, two

    responded they had no idea; that they had never thought about; and that no-one had

    ever asked them before. The self-help groups should provide a support network for the

    members and facilitators to help each other solve their challenges, whatever they might be.

    the vulnerability of adults

    The question of whether the initiative has reduced inequalities between the worst-off or

    most vulnerable people and others has a more varied response. Although the activitiesincreased peoples feelings of inner strength as reported by approximately half of focus

    group participants, it seemed to reduce inequalities for some but not all of the worst-off

    and most vulnerable people. An obvious measure of inequality is income disparity, which,

    as already mentioned, had become a key factor for many people living with HIV. At one

    pagoda, four out of six participants in the focus group reported increases in their nancial

    situations as a result of self-help group activities, while the other two members had

    not achieved the same improvements. The range of activities that take place within the

    self-help group meetings, which happen immediately after the meditation sessions, was

    highly variable. Where self-help groups facilitated savings & loan facilities, or participants

    beneted from income generating grants in an earlier iteration of the programme (pre-

    2008) there were examples of women and men who had turned around their situations of

    nancial instability and poverty. However, this success was achieved inconsistently both

    between provinces and also within individual self-help groups. So while for some of theparticipants the initiative has reduced inequalities it does not seem to have a deliberate or

    comprehensive strategy for doing so.

  • 7/28/2019 Buddhist Leadership Initiative Evaluation 2008-2012, Cambodia (English)

    56/84

    56

    BUDDHIST LEADERSHIP

    INITIATIVE EVALUATION

    Similarly to the disparity in circumstances among members of the childrens groups, there

    were notable differences in the economic and health stability of adults within some of the

    self-help groups. Statistically signicant data was not collected in regard to improvements