Project Completion Report - PSF Librarypsflibrary.org/catalog/repository/3919_CC_PCR.pdf · TPK Tim...
Transcript of Project Completion Report - PSF Librarypsflibrary.org/catalog/repository/3919_CC_PCR.pdf · TPK Tim...
CREATIVE COMMUNITIES 2Project Completion Report
Ingvild Solvang
May 2015Jakarta Indonesia
Ayo Kumpul, Ayo Usul!
komunitaskreatif
With Support From:Implemented by:
CREATIVE COMMUNITIES 2Project Completion Report
Ingvild Solvang
May 2015
Jakarta Indonesia
With Support From:Implemented by:
Ayo Kumpul, Ayo Usul!
komunitaskreatif
Creative Communities 2 Project Completion Report
iiiAcknowledgements
“With the activities of Creative Communities in Rianggede, our eyes have been opened and we understand better the aspirations of our community. The Creative Community Group members have changed. Before they didn’t voice their
concerns, now they are brave enough to express what they want.”
Mr. Dewa Putu Arya, Head of Village, Rianggede
Creative Communities 2 Project Completion Report
iv Acknowledgements
ACKNOWLEDGEMENTS
This project evaluation has been a collaborative effort.
Special thanks to Amna Kusumo, Endro Sulistyanto, Meuthia Susanti, Egbert Wits, Joned Suryatmoko, Ade Tanesia, Field Coordinators and Facilitators from the Kelola Foundation. Community Empowerment Cadres (KPKs), Creative Communities and sub-grantees from CC2 Phase 1 Extension villages. Sim Kok Eng Amy, Natasha Hayward, Gregorius Kelik, Ian Pollock, Jackie Pomeroy, Caroline Sage, and Annie Sloman from the PNPM Support Facility (PSF); and to MIGUNANI for carrying out the Perception Survey of CC2 Phase 1 Extension Evaluation; to Dyah Widuri S., Agung Haryanto , Ami Priwardhani, Aant subhansyah and Sri Kuncoro for researching and documenting case studies.
This evaluation process and report was managed and written by Kelola Monitoring, Evaluation and Learning (MEL) Specialist, Ingvild Solvang with support from MEL Officer, Joeni Hartanto.
Creative Communities 2 Project Completion Report
vList of Contents
CONTENTS
Acknowledgements ......................................................................................................................................................................................... iv
Contents ............................................................................................................................................................................................................... v
Acronyms And Abbreviations ....................................................................................................................................................................... vi
List of Tables and Figures ................................................................................................................................................................................ vii
Executive Summary .......................................................................................................................................................................................... ix
Background ......................................................................................................................................................................................................... 1
About Creative Communities 2 .................................................................................................................................................................... 3
CC2 Activities ....................................................................................................................................................................................................... 6
Outcomes .............................................................................................................................................................................................................. 17
Conclusion ............................................................................................................................................................................................................ 45
Key Recommendations .................................................................................................................................................................................... 48
CC2 Phase 1 Extension Key Performance Indicators ............................................................................................................................. 50
CC2 Phase 1 Key Performance Indicators .................................................................................................................................................. 51
References ............................................................................................................................................................................................................. 52
List of Annexes .................................................................................................................................................................................................... 53
Annexes
Available for download:
http://psflibrary.org/collection/detail.php?id=7105
Creative Communities 2 Project Completion Report
vi Acronyms and Abbreviations
ACRONYMS AND ABBREVIATIONS
BETF Bank Executed Trust FundBPMPD Badan Pemberdayaan Masyarakat dan Pemerintahan Desa (Board of Community
Empowerment and Village Governance) CC2 Creative Communities 2CCG Creative Community GroupCDD Community Driven DevelopmentCEP Creative Empowerment Process DFAT Department of Foreign Affairs and Trade (refers to Australia DFAT in this document)Dusun Sub-Village FGD Focus Group Discussion FK Fasilitator Kecamatan (PNPM Sub-district Facilitator) JMC Joint Management Committee (for the PNPM Support Facility)KPI Key Performance IndicatorKPK Kader Pemberdayaan Kreatif (CC2 Village Level Creative Empowerment Cadre)KPMD Kader Pemberdayaan Masyarakat Desa (PNPM Village Empowerment Cadre)MC Managing ContractorMEL Monitoring, Evaluation and LearningMusrembangdes Musyawarah Perencanaan Pembangunan Desa (Village Development Planning
Meeting)PDO Project Development ObjectivePMD Pemberdayaan Masyarakat dan Desa (Ministry of Home Affairs Directorate General
of Village and Community Empowerment)PNPM Generasi Sehat dan Cerdas PNPM Healthy and Smart Generation PNPM Mandiri Program Nasional Pemberdayan Masyarakat (The National Program for Community
Empowerment)PSF PNPM Support Facility PV Participatory VideoRETF Recipient Executed Trust FundTfD Theater for Development ToT Training of Trainers TPK Tim Pengelola Kegiatan (PNPM Activity Implementation Team) UU Desa Village LawWB World Bank
Creative Communities 2 Project Completion Report
viiList of Tables and Figures
LIST OF TABLES AND FIGURES
TABLE 1 - DEFINITION OF DIRECT AND INDIRECT BENEFICIARIES 5
TABLE 2 - CEP ACTIVITIES DURING PHASE 1 8
TABLE 3 - CEP ACTIVITIES DURING PHASE 1 EXTENSION 8
TABLE 4 - OVERVIEW OF ALL CC2 CEP ACTIVITIES 9
TABLE 5 - SUB-GRANTS DURING CC2 PHASE 1 10
TABLE 6 - SUB-GRANTS DURING CC2 PHASE 1 EXTENSION 12
TABLE 7 - CC2 INPUTS AND OUTPUTS OVERVIEW 16
TABLE 8 - CC2 PHASE 1 KEY PERFORMANCE INDICATORS (AS PER CC2 PROPOSAL APPROVED BY THE JMC) 20
TABLE 9 - TOTAL PEOPLE ATTENDING CC2 PHASE 1 EXTENSION CEP ACTIVITIES AT LEAST ONCE 22
TABLE 10 - CC2 PHASE 1 EXTENSION CREATIVE COMMUNITY "CORE" MEMBERS 23
TABLE 11 - DISTRIBUTION BY WEALTH, CREATIVE COMMUNITY GROUP MEMBERS, CC2 PHASE 1 EXTENSION 24
TABLE 12 - CORE MEMBERS OF CCGS THAT DID NOT PARTICIPATE IN PNPM ACTIVITIES DURING SIX MONTHS PRIOR TO ACTIVITIES 25
TABLE 13 - DIRECT PARTICIPANTS IN CC2 PHASE 1 EXTENSION SUB-GRANTS ACTIVITIES 43
FIGURE 1 - CRITERIA FOR SELECTION OF CC2 LOCATIONS 6
FIGURE 1a - CC2 PHASE 1 EXTENSION CEP BENEFICIARIES’ PERCEPTIONS ABOUT WHAT THEY WOULD DO WHEN THERE WAS A PROBLEM OR COMPLAINT IN THE VILLAGE BEFORE AND AFTER CC2 xFIGURE 2 - THE CREATIVE EMPOWERMENT PROCESS (CEP) 7
FIGURE 2a - CC2 PHASE 1 EXTENSION CEP BENEFICIARIES’ PERCEPTIONS ABOUT WHAT THEY GAIN FROM PARTICIPATING IN CREATIVE COMMUNITIES (IN RESPONSE TO OPEN ENDED QUESTIONS ALLOWING MULTIPLE ANSWERS, IN PERCENTAGE) xiFIGURE 3 - CC2 THEORY OF CHANGE 20
FIGURE 4 - PERCEPTION OF INDIVIDUAL BENEFITS GAINED FROM BEING MEMBERS OF CCGS
(IN PERCENTAGE) 28
FIGURE 5 - PROBLEM TREE ANALYSIS FROM BERANGBANG VILLAGE, BALI 31
FIGURE 6 - CCG CORE MEMBERS' PERCEPTIONS ABOUT WHETHER THEIR KNOWLEDGE ON PNPM AND OTHER VILLAGE PLANNING AND DEVELOPMENT PROCESSES INCREASED 33
FIGURE 7 - CCG CORE MEMBERS' PERCEPTIONS ABOUT WHAT THEY WOULD DO WHEN THERE WAS A PROBLEM OR COMPLAINT IN THE VILLAGE BEFORE AND AFTER CC2 34FIGURE 8 - CCG CORE MEMBERS' PERCEPTIONS ABOUT THEIR MOTIVATION TO PARTICIPATE IN VILLAGE MEETINGS
COMPARED WITH SIX MONTHS EARLIER 35
FIGURE 9 - CCG CORE MEMBERS' PERCEPTIONS ABOUT WHAT CCGS CAN BE USED FOR IN THE COMMUNITY (PERCENTAGE) 35
FIGURE 10 - MODEL OF PNPM - CC2 COORDINATION 37
Creative Communities 2 Project Completion Report
viii Acknowledgements
Illus
trat
ion
1: C
C2 P
roje
ct L
ocat
ions
Creative Communities 2 Project Completion Report
ixExecutive Summary
EXECUTIVE SUMMARY
The Creative Community 2 (CC2) project was implemented from April 2013 – March 2015 by the Kelola Foundation with support from the PNPM Support Facility (PSF). Project Development Objective (PDO) was “to improve the ability of villagers, especially the poor and marginalized people, to participate actively in PNPM processes using cultural expressions in project locations. The project was designed to support The National Program for Community Empowerment (PNPM) in addressing challenges in achieving broad based participation for community planning.
The project was implemented in two stages: Phase 1 (April 2013 – September 2014 1) and Phase 1 Extension (October 2014 – March 2015). The project was implemented through two main modalities: firstly the Creative Empowerment Process (CEP) where Creative Community Groups (CCG) were formed and trained in using Theater for Development (TfD) or Participatory Video methodologies to explore their situation and express their ideas and concerns; secondly sub-grants were provided to local individuals and organizations to support the use of cultural expressions to stimulate community participation in village planning. Overall, the project focused on creating informal forums and developing engaging facilitation techniques to enable the participation of community members typically not involved in formal development processes.
In total, the CC2 project worked in 44 villages, 30 sub-districts and 20 districts in six provinces.
Villages Sub-Districts Districts Provinces
Phase 1 11 6 3 3
Phase 1 Extension 33 24 17 3
Total 44 30 20 6
Phase 1 developed and tested the design for introducing creative approaches to support participation in PNPM. The Creative Empowerment Process was implemented in a total of four villages in West Nusa Tenggara, South Sulawesi and West Kalimantan Provinces. A total of 206 (123 women, 83 men) community members directly benefitted from the theater and video activities, which culminated in 17 public events and cultural dialogues held jointly with PNPM Rural and PNPM Generasi. An estimated 2,700 community members were indirectly involved as members of the audience. In addition, eight sub-grants projects were implemented in 10 other villages in the same districts. Lessons from Phase 1 showed that when creative approaches were used in integration with PNPM and formal development processes, there was a significant increase in attendance of the marginal, poor, women and youth. Village level PNPM workers and community members were enthusiastic about the approaches, and the opportunities created for community members to express their concerns and ideas and interact directly with PNPM workers and village governments.
By June 2014, a new village law was promulgated, which will dramatically increase the role, responsibilities and resources of the village community. Consequently, PNPM began a transition towards the new law and to meet the demands of the changing policy environment. At the same time, PSF began its own transition towards a hand over of several programs, including CC2 to a Managing Contractor (MC) under the Australian DFAT. This led to a restructuring of CC2 at the end of Phase 1, which reduced the number of locations from 50 to 24, and brought forward the closing date of the project to 31 March 2015 instead of 30 June 2015 as originally stated in the approved World Bank Creative Communities II Project Paper.
The CC2 Phase 1 Extension was implemented effectively between October 2014 and March 2015. CEP activities were implemented in 24 villages in East Nusa Tenggara (NTT), Bali and West Java Provinces. 1055 community members (546 female, 476 male) were members of video or theater CCGs. The CCGs were supported by 24 facilitators (with experience in video and theater making) and 24 village level creative empowerment cadres (KPK) who were trained in community facilitation using creative approaches. 72 theater and video events were held attracting an estimated 9,600 members of the audience, including PNPM workers and village leaders. In addition, 6 sub-grants were provided to local organizations and individuals with the aim of supporting the socialization of the new Village Law or supporting PNPM Generasi to raise awareness on health and nutrition related issues in a total of ten villages.
1 Between July – September 2014, the project went through a restructuring process in view of the transition of PSF. During this period of time, the focus of the project was on modifying the implementation plan to reduce the scope and period for the replication of activities.
Creative Communities 2 Project Completion Report
x Executive Summary
Lessons from CC2 Phase 1 were documented in an external evaluation (June 2014) and in the CC2 Phase 1 Progress Report (September 2014). An evaluation of the CC2 Phase 1 Extension was carried out in February – March 2015 using mixed methodologies including a perception survey in 24 CEP villages, documentation of case studies in CEP and sub-grants villages and facilitators’ reflection workshops.
Key Lessons Leaned from CC2
• Creative approaches are highly effective in engaging the marginal, poor, women and youth. More than half of direct participants in CEP activities were female. Most of the facilitators and KPKs were male. A male dominance could be an obstacle to women’s participation, however the high number of female participants regardless, indicates that the approach is well suited to enable women to participate. During the Extension, 43% of participants were classified as poor, 2 72% were marginalized3 and 36% youth under 17. The latter group was not intended as a target group in CC2 Phase 1. The experience of Phase 1 noted, however, that youth were often not included in village planning processes but they gravitated towards the opportunity to learn new technology and have new experiences. Youth were therefore included as one of the target groups in the Extension.
• 70% of beneficiaries in CEP Extension reported to be more motivated to participate in formal meetings in the villages after the project. The beneficiaries perceived themselves to have become more active in the community after participating in the project. Figure 1 shows what the beneficiaries perceive they would do before and after the project when they heard about complaints and problems in the community. 53% reported they did nothing before the project, while 6% reported they do nothing after the project.
Figure 1a: CC2 Phase 1 Extension CEP beneficiaries’ perceptions about what they would do when there was a problem or complaint in the village before and after CC2
• Creative approaches were also effective in increasing the agency of CCG members, defined by the project as an increase in self-esteem, ability to express themselves, strengthened networks and a stage for expression and understanding of participation as a right. Figure 2 shows beneficiaries’ perceptions about the individual benefits of participating in the project.
2 Poor defined as belonging to the 40% lowest household income
3 Defined as non-participants in formal PNPM or village planning meetings in the 6 months prior to CC2 activities
Creative Communities 2 Project Completion Report
xiExecutive Summary
Figure 2a: CC2 phase 1 extension CEP beneficiaries’ perceptions about what they gain from participating in Creative Communities (in response to open ended questions allowing multiple answers, in percentage)
More self con�ident, 52.48
Learned new skills/knowledge, 3
8.2
Understand situation in
village better, 31.43
Learn new ways of expressing
complaints, 34.59
More aware of my rights to
participate in village
development, 12.63
Gained place and friends to disuss with and express opinions, 19.55
Can access important people
such as KPK, KPMD, village
gvmnt, 8.12
More activities in the village, 18.5
Added organizational
experience, 20.15
Get to know other communities in
other villages, 7.82
There were no significant differences in how the poor and non-poor perceived these benefits, indicating that the approaches are also effective in empowering the poor.
• The use of cultural expressions and creative approaches in formal community planning processes generates community interest and breaks down formal power structures that stand as barriers to the participation of the marginalized. CC2 Phase 1 showed examples of how attendance at PNPM events increased as a direct result of the project. By offering a service to village government in attracting community members to formal meetings, creative communities could generate support for creative communities and increase leverage and opportunities for the marginal to voice their concerns.
• Barriers to the projects ability to directly support PNPM by directly impacting attendance and influencing facilitation skills of PNPM workers included PNPM’s capacity to engage directly with CC2 given the PNPM facilitators’ workloads, and the lack of formal instructions from the central government (Ministry of Home Affairs) to village level PNPM workers to engage with CC2. CC2 also did not succeed in mainstreaming creative approaches into PNPM SOPs aside from allowing the use of culture mediums in socializing PNPM in the revised PNPM Rural Technical and Operational Guidelines (PTO). Similar challenges may be anticipated when using creative communities in the future to support the implementation of the new village law.
• During CC2 Phase 1, the use of cultural activities in integration with formal PNPM meetings had a significant positive impact on increasing the attendance of community members who typically would not attend. Due to the PNPM transition such integration could not be replicated in the Extension. There is nevertheless evidence that the CEP process and sub-grants overall created new opportunities for community members to get together and discuss their ideas and concerns, and meet with village leaders and stakeholders to express their opinions. There is also anecdotal evidence that the CCG groups were able to directly influence decision making in some villages through their use of theater and video.
• For creative communities to have an impact on active participation on villagers in development processes joint planning between the project and village level stakeholders is necessary to create the integration required between the project and formal development processes. The lesson from CC2 is that sufficient time needs to be allocated to such joint planning. Where integration with formal village planning processes occurs, creative approaches are highly effective in increasing attendance at formal meetings, motivating people to participate, and in bringing the voices of the marginal and poor into decision-making processes.
Creative Communities 2 Project Completion Report
xii Executive Summary
• Creative approaches can be used to impact different levels of participation from attendance to knowledge about how to participate, motivation to participate, access to arenas of decision-making and control in the decision-making process. For a project that aims to increase communities’ ability to participate, it is important to define and operationalize the objectives of the project clearly, and select appropriate indicators to reflect the PDO. The CC2 PDO includes “active participation”. However, “increased attendance at PNPM meetings” as a KPI proved ineffective in measuring the real impact of the project on community empowerment given the gap between attendance and actual participation. The M&E plan for the Extension added indicators for empowerment to bridge this gap. In terms of influencing attendance, the evaluation shows that attendance at village level meetings was often closed and structured rather than open, and hence could not be easily influenced. The baseline highlighted a larger opportunity to impact attendance at sub-village level (i.e. dusun or RT/RW levels) or on improving quality of representation rather than mass attendance. Timely assessments and baselines can provide the information about the barriers and opportunities for active participation of the community needed to design effective project strategies.
• Development initiatives often aim to change dynamics of decision-making in a community by enabling more people to participate. Particular groups in the community may see this as a threat to their own access to resources. As such, development initiatives are political and often contentious. 4 When implementing the CEP, CCGs may become a stakeholder positioned along the fault-lines of pre-existing tensions and conflicts in the communities. This was documented in case studies from e.g. Barang and Ngabheo Villages during the Extension. The CEP will likely be most effective in achieving influence over decision-making in villages that have leaders who are committed to broad and active participation. Management of the risk of potential backlashes against project participants with the involvement of village leaders is needed to ensure that no harm is done.
• When Creative Community Group (CCG) members have ownership of the mission and vision of the group, it is more likely that the group will without support after the project ends. Assessments at the outsight helps to identify key groups and individuals in the community that are likely to have a vision and mission for community engagement and/or creative skills. The evaluation of CC2 shows that in communities like Panji (Bali) and Malaka (Lombok) where the communities have a strong motivation driven by key members, they also have the ability to find resources needed to continue their activities independently. CC2 also adopted strategies to support CCGs in making future strategies and plans and the sharing between creative communities of different villages.
• The Evaluation of the CC2 Phase 1 Extension CEP showed that the lack of strategic engagement with formal development processes that could have increased the CCGs’ success in influencing policy and decision-making. Participatory social analysis generated issues and themes for video and theater, however too much focus on the media also influences the agenda, e.g. where issues not suited for video were left out or focus was issues causing family tragedy as that makes good theater. A more open ended approach to advocacy with less focus on pre-determined media and project driven video screenings and theater performances, would have allowed for a mapping of priorities and development of strategies for how to deal with the most important issues effectively. Linking these strategies directly to formal processes of village planning and decision-making would likely have increased their effectiveness in achieving higher levels of active participation.
• The strengthening of the main Grant Recipient’s (i.e. Kelola) capacity for M&E led to a systematic analysis of the barriers to community participation linked to the articulation of the project’s theory of change and the design of logical frameworks and M&E plans that improved the management of project results during the Extension, and enabled the measuring and documentation of project impact. Such evidence based documentation allowed the project management to build a case for the effectiveness of creative approaches for future development initiatives, such as the implementation of the new village law.
• The CEP model implemented in CC2 is intensive and requires resources. Better integration with formal development processes will make the intervention more efficient, and will provide CCG members with insight into the workings of formal planning processes, and an experience in accessing and influencing decision-making that is likely to motivate more active participation in the future.
4 Barron, P., Diprose, R. and M. Woolcock. 2011. Contesting development: participatory projects and local conflict dynamics in Indonesia. Yale Agrarian Studies Series. Yale University Press, Ithaca.
Creative Communities 2 Project Completion Report
xiiiExecutive Summary
• Sub-granting is an effective modality to mobilize communities and socialize messages. Sub-grantees use of cultural events and activities created broad participation and opportunities to socialize messages about PNPM processes, health and the new village law. E.g. during the Phase 1 Extension, Lite Institute in Bali, engaged hundreds of local cultural workers (e.g. dancers, musicians and craftspeople) in a village festival that pulled a large audience to a socialization of the new village law. The most effective sub-grantees also succeeded in creating opportunities for communities to interact directly with PNPM workers or representatives of village government to address issues of concern. E.g. during Phase 1 Extension, Jatiwangi Art Factory (West Java) facilitated community members in making community television that allowed them to meet directly with PNPM Generasi and village leaders. The television production also brought the dialogue into people’s homes, which created new forms of dialogue about community health issues. 5
• The Sub-grant model is best implemented based on an understanding of partners’ capacity to deliver quality programs to the communities. Lessons from CC2 show that grassroots organizations, especially in remote areas, could benefit from capacity building, not only on administration, finance and report writing, but also community facilitation and technical skills. Implementation timeframes should allow for such capacity building activities with sub-grantees. Future capacity building of sub-grantees could be integrated with the CEP training to make effective use of training modules and materials developed for effective community facilitation.
Key recommendations for Future Creative Communities Projects
Result-based Management
1. Ensure that results-based management and M&E and learning frameworks are built into the project, for example, by using appropriate logical frameworks and indicators and incorporate a MEL plan into day-to-day management and implementation of the project. When working through an implementing partner, ensure the partner has effective project cycle and result-based management capacity.
Design
2. In the design phase, conduct an analysis of entry points and barriers to the project’s ability to influence formal development processes, both in terms of attempting to mainstream “creative approaches” within government at the national level, or for project participants to gain access to and influence over local development planning processes.
3. Articulate strategies for using Creative Communities activities for the communication of key messages as a service to authorities, and for community mobilization to build positive relations and leverage between its participants and village leaders.
4. Take a wider approach to the use of media (e.g. theater and video) in empowerment to stimulate active participation that leads to influence over decision-making processes. Key issues generated through a social analysis require strategy for how to best create a wanted change that benefits the marginalized. Too much focus on the media may lead to the question: What should we make theater/videos about? Rather than: what are our key challenges, and how to change them? The latter being the most relevant to active participation. Future projects should let the issues guide the making of effective strategies for wanted change.
5. Continue sub-grants as a modality to support local NGOs, CBOs and individuals. using creative approaches to stimulate broad participation. Allocate sufficient time and resources that allow for capacity assessments and the capacity building of sub-grantees to ensure that they are able to delivery high quality activities and results. The provider of sub-grants (in this case Kelola) needs to have “Partnership and Capacity Building Specialists” in their sub-grants management structure. Capacity building of sub-grants partners may integrate with CEP capacity building for community facilitators for increased efficiency.
5 Creative Communities 2 Evaluation Report on CC2 Phase 1 Extension Sub-grants (Annex 3)
Creative Communities 2 Project Completion Report
xiv Executive Summary
Implementation
6. In the inception phase, conduct a timely baseline study to identify who are marginal and poor and barriers to and opportunities for participation to inform implementation strategies and facilitators’ manuals, and conduct village level assessments to identify people and groups that share a vision of community development, and community leaders committed to broad participation.
7. Start implementation with joint strategy and planning, including joint risk analysis, with authorities at all levels, including village level, to identify potential for integration of the project with specific formal development processes.
Creative Communities 2 Project Completion Report
1Background
BACKGROUND
Creative Communities 2 (CC2) was implemented by the Kelola Foundation with support from the National Program for Community Empowerment (PNPM) Support Facility (PSF 6) from April 2013 7 to March 2015 with the aim to pilot ways to utilize creative expressions and community-based approaches to enable communities, especially the poor and marginalized, to actively participate in the National Program for Community Empowerment (PNPM) and other village planning and development processes.
The project was designed to support PNPM Mandiri, an umbrella program that seeks to bring together all community-driven development (CDD) initiatives in Indonesia. More specifically, it was developed to improve community participation in PNPM Rural and PNPM Generasi. PNPM Rural is the largest of the many programs under PNPM Mandiri. PNPM Rural focuses on rural communities and covers more than 72,000 villages across Indonesia. PNPM Generasi, which is implemented as part of PNPM Rural, focuses on improving achievements of basic education and health indicators within the Millennium Development Goals.
PNPM, often regarded as the largest community driven development program in the world, has made significant contributions towards poverty alleviation, development of infrastructure and public services in Indonesia. Despite its success, PNPM’s quick national scale-up from 2007 posed a number of challenges to facilitator recruitment process, their performance management, oversight and training, and consequently to the effectiveness of that facilitation, given the massive scale at which PNPM was implemented. Combined with some reported community fatigue from the repeated planning cycles, the possibility that enthusiasm for public participation could wane over time was recognized, including risks that community voice – especially that of the poor and marginalized – could diminish. In particular,
6 The PSF was established in 2007 by the Government of Indonesia (GoI) and international development partners to support effective leadership and management of PNPM. It provides technical assistance, policy and planning advice and financial assistance to the GoI to complement PNPM and support poverty alleviation. PSF is supported by multi-donor grants, which are administered by the World Bank.
7 A World Bank-Executed Trust Fund was activated in September 2012 to enable initial preparation work on the project. The Recipient-Executed Trust Fund was activated in May 2013, but field activities started in April 2013 using funds pre-financed by the recipient Yayasan Kelola.
Creative Communities 2 Project Completion Report
2 Background
the Marginalized Groups Study found that PNPM village meetings where decisions are made are often dominated by local elites, with 75% of poor members of the community attending these meetings being passive participants 8 9,. Barriers related to class, ethnicity, religious beliefs and gender norms deter certain segments of the community from participating at these meetings.
The PNPM Rural Impact Evaluation (2012) pointed to a need to address the strains associated with the scale up and the fatigue caused by the numerous community forums and steps required of PNPM Rural in many locations. This Evaluation called for a renewed effort to strengthen community engagement and to ensure the inclusion of poor and disadvantaged members of the community in decision- making processes. 10 As one of the strategies to address this challenge, the PNPM Support Facility (PSF) developed the Creative Communities 2 (CC2) project in 2012.
8 World Bank. 2010. Marginalized Groups in PNPM Rural. Washington, DC: World Bank. http://documents.worldbank.org/curated/en/2010/06/15423996/ marginalized-groups-pnpm-rural.
9 Voss, J. 2008. PNPM Rural Baseline Project. Jakarta: The World Bank.
10 Voss, J. 2013. PNPM Rural Impact Evaluation April 2012. Jakarta, Indonesia. PNPM Support Facility.
Creative Communities 2 Project Completion Report
3About Creative Communities 2
ABOUT CREATIVE COMMUNITIES 2
CC2 was developed based on the experience of an earlier initiative, the Creative Communities Fund (CC1), which was implemented in the period from 2008 to 2010 to empower communities under PNPM through community arts and cultural activities. Learning from CC1, which supported a range of activities from socialization of PNPM to supporting local cultural economy, CC2 adopted a narrower scope by developing creative processes that empower communities to play an active role in village development processes.
3.1 CC2 OBJECTIVES AND MODALITIES
The Project Development Objective (PDO) of the CC2 was to “to improve the ability of villagers, especially the poor and marginalized people, to participate actively in PNPM processes using cultural expressions in project locations”.
In particular CC2’s objectives were to
1. Increase the communities’ participation in the PNPM Rural and PNPM Generasi;2. Increase participation of the poor and marginalized communities in PNPM Rural and PNPM Generasi; and3. Improve the capacity of PNPM facilitators and cultural workers in using creative approaches to increase the
community’s participation in both PNPM Rural and PNPM Generasi.
The project was implemented in two phases, Phase 1 (April 2013 – September 2014 )11 and the Phase 1 Extension (October 2014 – March 2015).
CC2 utilized two main modalities: 1) The Creative Empowerment Process (CEP) harnessing Theater for Development (TfD) and Participatory Video (PV) methodologies to mobilize and empower villagers; and, 2) sub-grants disbursed to individuals and community based organizations to undertake creative activities in line with the project’s goal.
11 The project was given a No Cost Extension by the World Bank until September 30, 2014 while the request for additional funds from the PSF donors for the implementation of further project activities was being prepared.
Creative Communities 2 Project Completion Report
4 About Creative Communities 2
3.2 RESTRUCTURING OF CC2 IN RESPONSE TO A CHANGING ENVIRONMENT
The original project design, approved by the World Bank following internal review and appraisal, was for a period of 2.5 years (until June 2015) and to be implemented in two phases:
1. Phase 1 Operation Set Up – Design project based on the lessons from CC1 and the findings of a field assessment conducted in this phase, in order to address PNPM needs for quality participation. Testing of the design in seven sub-districts in the districts of North Lombok (West Nusa Tenggara), Landak (West Kalimantan) and Bone (South Sulawesi). Establishment of project management and operational system.
2. Phase 2 Implementation –Implementation of tested design in 50 sub-districts that receive funds from the PNPM Rural and PNPM Generasi programs.
However during project implementation, the decision to transform PSF led to the need to restructure the project. The uncertainties around PNPM following the passing of the Village Law also created significant challenges to the project.
Towards the end of CC2 Phase 1, the PNPM Support Facility (PSF) was going through a transition to provide more consolidated support to the government’s community empowerment based poverty reduction programs and policies, in response to the changes in the government policy context, especially the decentralization to village governments through the Village Law. As part of this change, PSF planned to transfer the oversight responsibilities of some of its projects, including Creative Communities 2, from the World Bank to a Managing Contractor (MC) hired by the Australian Department of Foreign Affairs (DFAT). In light of this, CC2 was restructured to reduce the number and scale of activities as originally planned in the Project Paper that was approved by the Bank on May 30, 2013. Instead of Phase 2, the project implemented a “Phase 1 Extension” to carry out a transitional phase until March 31, 2015, including a replication of the design in 24 locations, prior to the handover of the project to the MC. CC2 would continue to support PNPM Rural and PNPM Generasi during the transition.
Following the Government of Indonesia strategy to increase autonomy and capacity of village governments, PNPM started its transition to be replaced by mechanisms to implement the Village Law (Undang-undang Republik Indonesia No.6 Tahun 2014 tentang Desa) that will dramatically increase the role, responsibilities, power and resources of village communities. The Law adopts the community driven development approaches that have been developed and tested through PNPM programs.
Since the project was developed in the first place to support PNPM Rural, CC2’s PDO and the results framework emphasize the project’s effects on participation in PNPM processes. The disruption to PNPM Rural's delivery owing to the ongoing “transition” of PNPM towards implementation of the Village Law, and a lengthy period of “stalemate” between Ministry of Home Affairs and the new Ministry of Villages—unforeseen at the time of CC2 design—has meant that (i) there were few or no PNPM processes taking place in project locations over the implementation extension period (September 2014 – March 2015) and (ii) there were little recording of routine PNPM Rural administrative data, making the CC2 project effects on PNPM highly difficult to measure.12
To remain relevant to formal development processes at village level during the Extension, it became necessary for CC2 to broaden its definition of these processes beyond PNPM. It was also necessary to generate new indicators to measure the effectiveness of the project, beyond key performance indicators about increased attendance of the marginalized at PNPM meetings. In addition to looking at the support provided to remaining PNPM activities, the final evaluation of the project also looked at the overall effectiveness and potential of creative approaches in increasing communities’ ability to participate actively in broader village planning and development processes, which are integral to the use of Village Funds under the new Village Law. This generates important lessons for the future development of the project.
12 CC2 Interim Status Report, PSF, March 2015
Creative Communities 2 Project Completion Report
5About Creative Communities 2
3.3 PROJECT CONCEPT AND DEFINITIONS
The CC2 M&E Framework (December 2014) was based on the following definitions of core concepts derived from project documents and interviews with field staff and managers:
Participation is a process through which stakeholders influence and share control over development initiatives, decisions and resources that affect them 13. The project was originally designed to influence: 1) communities knowledge about PNPM and development processes; 2) shape people’s perceptions about these processes, and increase their motivation to participation; 3) provide access to development processes, and 4) strengthen control over development processes. More specifically participation in this project refers to being involved in the planning, implementing and overseeing of initiatives that directly address local development priorities. 14
Beneficiaries are villagers who receive benefits from the CC2 program, and can be broken down by direct and indirect beneficiaries of CEP and sub-grants interventions, as shown in Table 1:
Table 1 - Definition of Direct and Indirect Beneficiaries
Direct Beneficiaries Indirect Beneficiaries
a) Active members of the Creative Communities;
b) Community facilitators (including PNPM and village government officials) and cultural workers actively participating in CC activities;
Villagers who receive benefits but are not active members in the communities, e.g. the audience, people interviewed or featured in video or theater performances
a) Recipients of sub-grants;
b) Villagers, community facilitators (including PNPM and village government officials) and cultural workers actively involved in sub grants activities
Villagers who receive benefits but are not actively involved e.g. the audience, people interviewed or featured in video or theater performances
Cultural workers in CEP and Sub-Grants refers to people at village level or higher, who were engaged in cultural groups, i.e. dancers, musicians, traditional craftspeople etc., prior to CC2, and who collaborated with sub-grantees or CCGs at cultural events. Some of these cultural workers were also members of CCGs, and are then counted as direct participants.
Marginalized people are defined by the project as those regularly excluded in PNPM and which can be characterized as having no (valuable) assets, living in outlying areas with limited basic infrastructure, having limited income with a large number of dependents, with disabilities or originating from an ethnic/religious/gender minority.15
Community Empowerment is a process that enables the community to take more control over their lives. This involves not only attendance at meetings, but also the active pursuit of social and political change. Community empowerment is a process of re-negotiating power in order to gain control. And thus, when one group of people is empowered, another group will have to share some of their power.16
‘Creative Approaches’ refer to a) use of cultural mediums, such as video, theater, music and dance, to achieve broad community participation; b) use of cultural, customary and social mechanisms to stimulate participation, and c) the use of informal and bottom-up methodologies to attract and enable people, who usually do not participate in formal development processes, to actively participate in activities, e.g. meetings held in the rice field during work hours and generally outside of intimidating centers of power, using games and mutual sharing rather than formal speeches and protocols.17
13 The Worldbank Participation Sourcebook. (1996). Washington DC: The International Bank for Reconstruction and Development.
14 CC2 Revised Result Framework (June 2014)
15 Creative Communities 2 Revised Results Framework, June 2014
16 Baum (2008) cited on the WHO website: http://www.who.int/healhpromotion/conferences/7gchp/track1/en/index.html cited in Creative Communities Trial Evaluation, December 2013
17 Definition derived from the reflections of CC2 facilitators and managers
Sub-
Gra
nts
CEP
Creative Communities 2 Project Completion Report
6 CC2 Activities
CC2 ACTIVITIESSelection of Project Locations
In total, the CC2 project worked in 44 villages, 30 sub-districts and 20 districts in six provinces.
Villages Sub-Districts Districts ProvincesPhase 1 11 6 3 3Phase 1 Extension 33 24 17 3Total 44 30 20 6
Project Locations were selected in consultation with the Secretariats of PNPM Rural and PNPM Generasi at PMD. Yayasan Kelola has also conducted location assessments, jointly with the PNPM Generasi and PNPM Rural teams, to verify these locations according to the selection criteria shown in Figure 1. 18
Figure 1 - Criteria for selection of CC2 locations
» PNPM Rural and/or PNPM Generasi site, » Lower level of participation of community members in PNPM, » For PNPM Generasi locations, lower achievement in health and education indicators, » Support from PNPM Rural and Generasi for the project to be implemented in the location, » Located in a province targeted by CC2, » Feasibility of supervise, taking into account travel time from the main town center, » CC II has the resource capacity to implement in the location, » A supportive enabling environment to implement the project, » A desire from the local community and stakeholders for the project to be implemented, » Potential for further development and replication in other villages.18
18 PSF. 2014. CC2 Phase 1 Progress Report, Jakarta
Creative Communities 2 Project Completion Report
7CC2 Activities
Creative Empowerment Process (CEP) using Theater for Development and Participatory Video Methodologies
A Creative Empowerment Process was developed as a key modality for community engagement. Figure 2 shows an outline of the process, which was anchored by the establishment of Creative Community Groups (CCG) at village level targeting primarily the poor, marginalized, women and youth. Field facilitators were videographers and theater workers, who were trained in facilitation. During the Extension, village level Creative Empowerment Cadres (KPKs) were recruited from each village to support the process, based on lessons from Phase 1. The facilitators went to “live in” each community for three months. Villages were targeted for either theater or video activities based on province level assessments and management considerations, consequently CCGs were mobilized to utilize either Theater for Development (TfD) or Participatory Video (PV) techniques to voice their aspirations and challenges. The process generated stories for and by the communities themselves that were told through theater or video. Theater and video provided the groups with a common project to deliver, however, the process of establishing a creative, informal and safe environment where people could build self-esteem, understand that participation is a right, and learn new ways to express their opinions and ideas was prioritized over quality and quality of outputs. The focus was on bringing the CCG members through a learning experience that could enable them to work independently in the future without external support.
The CEP process consisted of the following steps (Figure 2):
1. Socialization of project objectives and identification of target group in collaboration with PNPM workers, village leaders and the wider community;
2. Formation of CCGs and recruitment of members. The first weeks focused on the introduction of the project to local communities, and in some instances mini performances and video screenings were held to demonstrate the project and to attract even more members.
3. Social analysis was conducted with the CCG members to map out key development concerns in the village and identify the key processes where these issues could be addressed.
4. Story and theme development based on the social analysis;5. Preparation for theater performance or video screening. Cultural workers in the village, e.g. dancers, musical
groups, martial arts, were invited to collaborate during these events. Village leaders, PNPM workers and the community were invited to the events.
6. Post performance focus group discussions with key stakeholders to discuss potential solutions to the communities’ concerns;
7. End-of-cycle evaluation with the CCGs and development of future plans. These future plans were supported by a small CC2 seed fund (IDR 20 million to CCGs in Bali and NTT, IDR 10 million to CCGs in West Java 19)
Figure 2 The Creative Empowerment Process (CEP)
Monitoring
Socialization Social and
Technical
Public
Story Development
Follow-up
meetings with
stakeholders Production
Preparation of
performance or
videos; ongoing
Social Analysis
Mapping of issues;
Understanding of
development
Evaluation
of impact
Group Formation
19 The lesser amount in West Java was due to a reduced implementation timeframe
Creative Communities 2 Project Completion Report
8 CC2 Activities
CEP Activities during Phase 1
During CC2 Phase 1, seven theater and video facilitators worked in four villages in three sub-districts and three districts as a pilot of the approach for potential scale up in the following phases of the project.
Table 2 - CEP activities during Phase 1
Province District Sub-district Village ModalityWest Nusa Tenggara North Lombok Pemenang East Pemenang, (Malaka and Nipah Hamlets) VideoSouth Sulawesi Bone East Tanete Riattang Bajo’e TfD West Kalimantan Landak Sengah Temila Sahamp TfD & VideoWest Kalimantan Landak Sengah Temila Petai TfD & VideoTotal 3 districts 3 Sub-Districts 4 villages
During Phase 1, in total, 206 members of the community (123 women, 83 men) participated directly in the CEP. The theater productions and videos created through this process were presented to the communities through 17 public events and cultural dialogues held jointly with PNPM Rural and PNPM Generasi. These events were attended by members of the general public, community leaders, PNPM personnel, the Board of Community Empowerment and Village Governance (BPMPD), and other government and community representatives. Whenever possible, CCG in each location also presented their works during the PNPM local community forums that were taking place at that period of time. Across the three villages, altogether more than 2,700 people attended these and additional spontaneous presentations.
CEP Activities during CC2 Phase 1 Extension
During Phase 1 Extension, 24 facilitators were recruited along with 24 local Creative Community Cadres (KPK) to work in 24 villages in Bali, West Java and East Nusa Tenggara Provinces. Among these CEP villages, 12 villages carried out Theater for Development and the remaining 12 carried out the Participatory Video process.
Table 3 - CEP activities during Phase 1 Extension
BALI PROVINCEDistrict Sub district Villages Modality Jembrana Negara Berambang CEP – TfD Buleleng Sukasada Panji CEP – TfD Bangli Bangli Pengotan CEP – TfD Badung Abiansemal Desa Bongkasa Pertiwi CEP – TfD Karangasem Bebandem Budakeling CEP – TfD Gianyar Tampak Siring Manukaya CEP – TfD Tabanan Penebel Riang Gede CEP – TfD Karangasem Karangasem Jasri CEP – TfD FLORES ISLAND, EAST NUSA TENGGARA (NTT) PROVINCEManggarai Timur Poco Ranaka Lento CEP – VideoManggarai Timur Sambi Rampas Golo Wangkung CEP – VideoManggarai Timur Borong Waling CEP – VideoManggarai Cibal Barang CEP – VideoManggarai Wae Rii Golo Wua CEP – VideoNgada Golewa Malanuza CEP – VideoNgada Soa Ngabeo CEP – VideoNgada Inerie Manubhara CEP – VideoWEST JAVA PROVINCESukabumi Caringin Caringin Wetan CEP – TfD Subang Tanjung Siang Cimeumal CEP – TfD Sumedang Ganeas Cikoneng CEP – TfD Cianjur Cikalong Kulon Sukamulya CEP – TfD Garut Bayongbong Panembong CEP – VideoBandung Barat Cililin Cililin CEP – VideoKuningan Cilimus Kali Aren CEP – VideoKuningan Garawangi Garawangi CEP – Video18 Districts 24 Sub-districts 24 Villages CEP – Video
Creative Communities 2 Project Completion Report
9CC2 Activities
In total, 1055 individuals (546 female and 476 male) participated as core members 20 of CCGs during Phase 1 Extension. The project carried out 72 cultural events during this period that were witnessed by an estimated 9,600 individuals along with village, sub-district and, in some cases, district government officials and PNPM workers.
831 cultural workers, 21 defined as existing members of cultural groups in the communities, e.g. traditional or contemporary music and dance troupes, religious prayer and music groups, martial arts groups et cetera, performed at CC2’s cultural events and/or participated as core members of the CCGs.
To support the CCGs to continue their activities after their facilitators depart and enhance the sustainability of the groups beyond the lifespan of the project, small funds were provided to CCGs: IDR 20 million to 16 CCGs in Bali and NTT, IDR 10 million to 8 CCGs in West Java (due to a shorter timeframe for implementation), to carry out further CEP activities in all 24 villages with reduced direct support from the project.
Table 4 - Overview of all CC2 CEP activities
Project Phase Facilitators KPKs Villages Sub-districts Districts Direct
participantsIndirect
participantsCultural workers
Phase 1 7 0 3 3 3 206 2,700 N/APhase 1 Extension 24 24 24 24 18 1,055 9,600 831Total 31 24 27 27 21 1,261 12,300 N/A
Sub-grants for Creative Approaches by Grassroots Organizations and Individuals
In addition to CEP, sub-grants (between IDR 27 million and 85 million) were provided to 14 community based organizations or individuals based on proposals to utilize creative approaches to stimulate broad participation in village development processes. In Phase 1 Extension, sub-grantees were specifically requested to communicate health messages in support of PNPM Generasi or to raise public awareness of the new Village Law (UU Desa). Sub-grants activities were carried out in 20 villages in 12 sub-districts. 225 individuals (564 men, 585 women 22) participated directly in sub-grants activities.
Sub-grants during CC2 Phase 1
During phase 1, the sub-grants model was piloted and tested for potential scale-up. Eight sub-grants were provided to grassroots organizations ten villages located in six sub-districts, three districts in three provinces. 803 individuals (375 male and 428 female) participated directly in activities. Figure 7 shows and overview of sub-grants provided during Phase 1.
20 “Core members” of Phase 1 Extension CCGs were defined primarily as those considered by facilitators and KPKs to have participated regularly in CCG activities throughout the process. Lists of core members were verified against attendance lists (Annex 5)
21 Based on numbers provided by field facilitators
22 Genders of 77 participants from Phase 1 Extensions were not listed in sub-grantee reports.
Creative Communities 2 Project Completion Report
10 CC2 Activities
Tabl
e 5
- Su
b-gr
ants
dur
ing
CC2
Phas
e 1
Sub-
Gra
ntee
A
ctiv
ity
Loca
tion
D
etai
ls o
f Act
ivit
y Im
pact
s (b
ased
on
Proj
ect R
epor
ting
and
Sub
-G
rant
s Ca
se S
tudi
es)
Am
ount
of
Sub-
Gra
nt
Num
ber o
f Dir
ect
Part
icip
ants
Re
mad
i - S
angg
ar
Seni
Cup
ak G
eran
tang
Ta
runa
Sak
ti
Suka
dana
Vill
age,
Ba
yan
Sub-
dis
tric
t, N
orth
Lom
bok,
Wes
t N
usa
Teng
gara
Hel
d re
hear
sals
and
per
form
ance
s of
Cup
ak
Ger
anta
ng a
t PN
PM v
illag
e co
mm
unity
foru
ms
to
mot
ivat
e pu
blic
par
ticip
atio
n. T
he lo
cal p
erfo
rman
ce
trad
ition
use
s m
ask
danc
e, a
nd d
epic
ts th
e go
od a
nd
evil
with
in h
uman
's so
ul. R
ehea
rsal
s w
ere
used
as
a ch
anne
l to
colle
ct v
illag
ers'
thou
ghts
and
opi
nion
s on
vill
age
plan
ning
, pro
vidi
ng a
n al
tern
ativ
e to
th
e fo
rmal
PN
PM fo
rum
s. Si
x pr
esen
tatio
ns w
ere
unde
rtak
en in
diff
eren
t ham
lets
.
This
act
ivity
was
suc
cess
ful i
n in
crea
sing
the
com
mun
ities
' par
ticip
atio
n in
PN
PM d
iscu
ssio
ns
and
faci
litat
ing
crea
tive
way
s fo
r mar
gina
l co
mm
unity
mem
bers
to v
oice
thei
r vie
ws.
IDR
79,1
00,0
00
104
(55
Mal
es, 4
9 Fe
mal
es)
Hel
iana
Sin
aga
- Mai
n te
ater
Ban
dung
Ba
jo’e
Vill
age,
Eas
t Ta
nete
Ria
ttan
g Su
b-di
stric
t, Bo
ne, S
outh
Su
law
esi
Supp
orte
d th
e fu
rthe
r dev
elop
men
t and
su
stai
nabi
lity
of th
e Ba
jo'e
Cre
ativ
e Co
mm
unity
G
roup
. Und
er th
e gu
idan
ce o
f est
ablis
hed
thea
ter
grou
p M
ain
teat
er B
andu
ng, t
he g
roup
dev
elop
ed
and
perf
orm
ed a
pla
y w
ith v
illag
ers
on y
outh
is
sues
and
the
disa
ppea
ranc
e of
trad
ition
al g
ames
, w
atch
ed b
y hu
ndre
ds fr
om lo
cal a
nd n
eigh
borin
g co
mm
uniti
es.
Thro
ugh
this
act
ivity
, Baj
o’e
Crea
tive
Com
mun
ities
G
roup
mem
bers
furt
her d
evel
oped
thei
r cap
acity
an
d be
en s
tren
gthe
ned
as a
gent
s th
at c
an m
otiv
ate
com
mun
ity p
artic
ipat
ion
in v
illag
e pl
anni
ng. T
hey
have
als
o ra
ised
aw
aren
ess
of P
NPM
pro
gram
s an
d st
reng
then
ed th
e vo
ice
and
part
icip
atio
n of
you
th w
ithin
PN
PM p
roce
sses
.
IDR
80,0
00,0
0094
(39
Mal
es, 5
5 Fe
mal
es)
Syam
sul F
ajri
East
Pem
enan
g Vi
llage
, Pem
enan
g Su
b-di
stric
t, N
orth
Lo
mbo
k, W
est N
usa
Teng
gara
The
2014
Eas
t Pem
enan
g Vi
llage
Art
Fes
tival
w
as h
eld
thro
ugh
an a
rt re
side
ncy
orga
nize
d by
Ko
mun
itas
Aka
r Poh
on, K
omun
itas
Pasi
r Put
ih
and
Exce
lsio
r Dan
ce P
roje
ct. T
he fe
stiv
al in
volv
ed
com
mun
ities
with
hig
h ra
tes
of p
oor h
ouse
hold
s an
d m
argi
naliz
ed g
roup
s, su
ch a
s th
e Bu
ddhi
st
com
mun
ity fr
om Te
bang
o Bo
lot h
amle
t. Th
e Fe
stiv
al
incl
uded
wor
ksho
ps a
nd p
rese
ntat
ions
with
the
villa
gers
exp
lorin
g vi
llage
issu
e. U
sing
vid
eo, p
oetr
y,
mus
ic, t
heat
er, d
ance
and
trad
ition
al c
erem
onie
s an
d pe
rfor
man
ces.
The
resi
denc
y bu
ilt a
syn
ergy
bet
wee
n lo
cal
artis
ts a
nd th
e co
mm
unity
, and
cre
ated
cre
ativ
e fo
rms
of m
edia
that
con
veye
d m
argi
naliz
ed
voic
es, p
artic
ular
ly th
at o
f the
poo
r, w
omen
and
m
argi
naliz
ed g
roup
s. Th
ere
wer
e po
etry
abo
ut th
e pr
oble
m o
f rub
bish
, the
ater
abo
ut th
e im
pact
of
preg
nant
wom
an w
ho h
ave
diffi
culty
acc
essi
ng
publ
ic h
ealth
ser
vice
s du
e to
the
dist
ance
from
th
e vi
llage
and
trad
ition
al B
uddh
ist d
ance
by
the
isol
ated
Bud
dhis
t com
mun
ity. C
omm
unity
m
embe
rs, s
uch
as w
omen
and
mem
bers
of t
he
Budd
hist
com
mun
ity, w
ho h
ad n
ever
bee
n in
volv
ed
in P
NPM
bef
ore
beca
me
invo
lved
thro
ugh
the
CC2
part
icip
atio
n.
IDR
78,8
85,0
00
127
(56
Mal
es, 7
1 Fe
mal
es)
Creative Communities 2 Project Completion Report
11CC2 Activities
Mr.
And
hiLa
ngi,
Patu
ku,
and
Kahu
Vill
ages
, Bo
ntoc
ani S
ub-
dist
rict,
Bone
, Sou
th
Sula
wes
i
The
team
, con
sist
ing
of a
uni
vers
ity le
ctur
er A
nd h
i’s
stud
ents
from
the
Art
s a
nd D
esig
n Fa
culty
wor
ked
with
com
mun
ities
acr
oss
3 vi
llage
s to
dev
elop
cu
ltura
l exp
ress
ion
base
d on
thei
r dai
ly e
ncou
nter
s, th
roug
h vi
deo
mak
ing,
cre
ativ
e ga
mes
, cre
ativ
e co
mpe
titio
ns, a
nd w
orks
hops
on
danc
e an
d vo
cal
tech
niqu
es. T
he c
limax
of t
he a
ctiv
ity w
as a
thre
e-da
y fe
stiv
al h
eld
at th
e Su
b-di
stric
t Offi
ce c
ompo
und.
Th
e fe
stiv
al w
as p
art o
f the
ann
ual S
ub- d
istr
ict
Dev
elop
men
t Pla
nnin
g D
iscu
ssio
n (M
usre
mba
ng
Keca
mat
an) T
he F
estiv
al c
onsi
sted
of d
ance
, mus
ic,
thea
ter,
a fa
shio
n sh
ow p
erfo
rman
ces
and
a m
arke
t se
lling
loca
l pro
duct
s.
The
Fest
ival
suc
cess
fully
use
d lo
cal c
reat
ive
expr
essi
ons
to e
nliv
en th
e an
nual
Mus
renb
ang
Keca
mat
an, a
nd h
elpe
d vi
llage
rs e
ffect
ivel
y co
nvey
th
eir n
eeds
and
cha
lleng
es d
irect
ly to
loca
l dec
isio
n m
aker
s.
IDR
80,0
00,0
00
190
(70
Mal
es, 1
20
Fem
ales
)
Suha
nja
- San
ggar
Jo
ngga
n Pa
dagi
Ray
a Se
batih
Vill
age,
Se
ngah
Tem
ila S
ub-
dist
rict,
Land
ak, W
est
Kalim
anta
n
The
Day
ak K
anay
atn
Art
& C
ultu
ral F
estiv
al p
rese
nted
lo
cal t
radi
tiona
l son
gs, m
usic
, and
dan
ce, w
hich
ex
plor
ed s
torie
s ab
out p
robl
ems
and
issu
es fa
ced
daily
by
the
com
mun
ity.
The
Fest
ival
was
an
oppo
rtun
ity fo
r com
mun
ity
mem
bers
to s
hare
thei
r sto
ries
abou
t life
in th
eir
com
mun
ity w
ith d
ecis
ion
mak
ers
who
att
ende
d th
e Fe
stiv
al a
nd re
invi
gora
ted
the
loca
l cul
tura
l gro
up
Sang
gar J
ongg
an P
adag
i Ray
a w
hose
mem
bers
ha
ve b
een
cons
iste
ntly
rehe
arsi
ng a
nd p
erfo
rmin
g po
st th
e Su
b-G
rant
. The
opp
ortu
nity
to m
anag
e th
is g
rant
by
Suha
nja,
the
loca
l ele
cted
Vill
age
Hea
d, e
ncou
rage
d hi
m to
focu
s on
usi
ng a
cre
ativ
e ap
proa
ch in
how
he
gove
rns
the
villa
ge.
IDR
27,0
00,0
00
59 (3
9 M
ales
, 20
Fem
ales
)
Edi S
usan
to -
Sang
gar
Jaja
k Bu
ru
Gom
bang
Vill
age,
Se
ngah
Tem
ila S
ub-
dist
rict,
Land
ak
rege
ncy,
Wes
t Ka
liman
tan
Ratt
an w
eavi
ng tr
aini
ng fo
r stu
dent
s an
d an
“E
xhib
ition
of F
orgo
tten
Cra
fts”
sho
wca
sing
wea
ving
cr
afts
mad
e by
wom
en in
the
villa
ge.
This
gra
nt in
crea
sed
the
econ
omic
pot
entia
l of a
n al
mos
t for
gott
en c
raft
in th
e co
mm
unity
and
the
trai
ning
ser
ved
as a
n at
tem
pt to
pre
serv
e cu
lture
an
d su
ppor
t the
PN
PM W
omen
's Sa
ving
s an
d Lo
ans
Gro
up in
the
villa
ge.
IDR
27,0
00,0
00
72 (3
6 M
ales
, 36
Fem
ales
)
Fran
sisk
us E
ngge
- Sa
ngga
r Cam
ar B
okor
Ra
mba
ng R
ambu
nut
Mar
o'o
Ham
let,
Gom
bang
Vill
age,
Se
ngah
Tem
ila S
ub-
dist
rict,
Land
ak, W
est
Kalim
anta
n
A tr
aditi
onal
Day
ak B
ajon
ggan
dan
ce-in
-rhy
mes
pe
rfor
man
ce w
as d
evel
oped
with
the
loca
l co
mm
unity
, rev
ivin
g th
is tr
aditi
onal
art
form
and
ex
plor
ing
the
issu
es fa
ced
daily
by
the
com
mun
ity.
Thro
ugh
its s
ucce
ss in
att
ract
ing
villa
gers
' in
tere
st, t
he p
erfo
rman
ce d
eliv
ered
the
voic
e an
d as
pira
tion
of th
e m
argi
nal r
emot
e D
ayak
co
mm
unity
, dem
onst
ratin
g th
e pe
rfor
man
ces
pote
ntia
l as
a w
ay to
dis
sem
inat
e in
form
atio
n ab
out P
NPM
act
iviti
es to
the
com
mun
ity.
IDR
27,0
00,0
00
78 (M
ales
66,
Fe
mal
es 1
2)
Moe
lyon
o - Y
ayas
an
Seni
Rup
a Ko
mun
itas
Paw
is H
ilir V
illag
e,
Jelim
po S
ub- d
istr
ict,
Land
ak, W
est
Kalim
anta
n
This
pro
ject
sup
port
ed th
e fo
rmul
atio
n an
d te
stin
g of
a p
ilot l
ocal
wis
dom
-bas
ed e
arly
edu
catio
n m
odel
- H
olis
tic E
arly
Chi
ldca
re a
nd D
evel
opm
ent (
PAU
D
Hol
istik
) as
part
of t
he E
arly
Chi
ldho
od C
are
for
Dev
elop
men
t (EC
CD) p
rogr
am ru
n by
Yay
asan
Sen
i Ru
pa K
omun
itas.
The
mod
el m
obili
zed
wom
en a
nd
yout
h as
chi
ldre
n ed
ucat
ors
and
utili
zed
trad
ition
al
gam
es a
nd lo
cal p
rodu
cts.
Whi
le a
t the
tim
e of
sub
-gra
nt im
plem
enta
tion
this
loca
tion
was
not
a P
NPM
Gen
eras
i loc
atio
n,
it ha
s no
w b
ecom
e on
e. T
his
activ
ity d
emon
stra
ted
how
loca
l cul
ture
can
sup
port
ear
ly c
hild
hood
le
arni
ng fo
r the
PN
PM G
ener
asi p
rogr
am. T
he
proj
ect t
eam
has
sha
red
the
educ
atio
n m
odel
to
the
PNPM
Gen
eras
i tea
m. T
he L
ande
k Re
gion
Hea
d of
Edu
catio
n ha
s sa
id th
at h
e su
ppor
ted
the
proj
ect
and
is p
lann
ing
to fo
rm a
dev
elop
men
t tea
m fo
r PA
UD
Hol
isitk
so
that
the
pilo
t can
be
repl
icat
ed in
15
6 vi
llage
s in
the
Land
ek R
egio
n.
IDR
80,0
00,0
00
79 (1
4 M
ales
, 65
Fem
ales
)
Creative Communities 2 Project Completion Report
12 CC2 Activities
Sub-Grants during CC2 Phase 1 Extension
Six grassroots organizations (two in West Java, two in Bali, two in NTT) received a sub-grant of IDR 80 million each to fund proposals to use creative approaches to either socialize health messages in support of PNPM Generasi or to socialize the Village Law (UU Desa). 422 individuals participated directly in activities (156 women, 189 men)23 in a total of ten villages.
The sub-grants activities during Phase 1 Extension were more focused on socialization of key messages, but several of the sub-grantees succeeded in creating new space where communities could interact directly with PNPM workers, village government and other stakeholders, also creating potential for communities to influence village decision-making. Sub-grantees all used different approaches to reach their objectives: trainings and workshops, cultural festivals, bazaars and performances were held in collaboration with cultural groups, PNPM workers and village representatives.
Table 6 - Sub-grants during CC2 Phase 1 Extension
Sub-Grantee Activity Location Details of Activity Impacts (based on Project
Reporting and Sub-Grants Case Studies)
Amount of Sub-Grant
Number of Direct
Participants Jatiwangi Art Factory (JAF)
Bandorasa, Cilimus, Kuningan, West Java
Using creative approaches (community television, bazaar and art festival) to raise pregnant women and mothers of children <5 awareness about health
Successful communication of key messages, and create new space for women to raise their concerns to village government and PNPM Generasi
IDR 80,000,000
48
SAPA Institute
Cikawung, Tanjungsiang, Subang, West Java
Raise community’s understanding of sexual and reproductive health, especially targeting women and mothers of small children through training, bazaar and art festival
Successful communication of key messages. Ability to encourage broad participation of target group and opportunities for PNPM, village government and target group to discuss issues
IDR 80,000,000
82
Lite Institute Sidem Bunut, Bangli, Bali Socialize the new Village Law to the community in Pakraman village, Sidem Buntut, Bagli through workshop and art festival
High mobilization of cultural workers, and their engagement at workshop on village law. High community participation as indirect participants during village art festival and creative show, where messages about village law were conveyed.
IDR 80,000,000
109
Taman Penasar
Tampaksiring and Sanding Villages, Gianyar, Bali
Increase community’s understanding for new Village Law in Gianyar, Bali through mobile arts and theater performances
The sub-grantee demonstrated good understanding of the village law and its implications, and provided high quality information to communities that witnessed performances. More time would allow more active participation of community and more two-way interactions between communities and leaders.
IDR 80,000,000
30
Papa Wiu Mengeruda, Piga I and Bogoboa Villages, Soa, Ngada, NTT
Raise knowledge of parents’ about child nutrition and increase parents’ sills in preparing nutritious food from local ingredients
Training on nutrition, local food and cooking. Support to livestock groups.
IDR 80,000,000
92
Komunitas Satu Tekad
Malanuza and Ratogesa Villages, Golewa, Ngada, NTT
Increase community’s understanding about new village law and people’s participation in village development, while also support local traditions and art utilizing traditional bamboo music instruments.
Successful in setting up traditional music workshops for instrument making and concert. More time needed to create improved links to issues of village law and develop space for communities to engage with village government and other stakeholders.
IDR 80,000,000
61
23 The gender of 77 participants was unspecified in sub-grantee reports
Creative Communities 2 Project Completion Report
13CC2 Activities
Capacity Building
Phase 1 Capacity Building Activities
Training of Trainers (TOT) on Creative Empowerment Processes
TOTs were provided to 39 participants in the period from June 2-9, 2014 at the Disaster Oasis Training Centre in Yogyakarta. The objective of the TOT was to train facilitators and cadres to implement the CEP under the Phase 1 Extension of the project in the provinces of Bali, West Java and East Nusa Tenggara (NTT) to prepare them to become future trainers for the project. The participants consisted of selected Theater and Video Facilitators and Creative Empowerment Cadres (KPK) from project locations who may or may not have expertise in the given creative area.
CEP Training Manuals for TfD and Participatory Video were developed by Yayasan Kelola in consultation with external experts in theater, video, and community empowerment. The ToT also included sessions on issues related to PNPM, the Village Law, financial and administrative management, and communication and outreach.
Training of PNPM Facilitators on Creative Approaches for Community Engagement
22 PNPM KPMD from Sengah Temila district, in Landak, West Kalimantan were trained in the use of creative expressions to improve the level of participation in PNPM on 26 October 2013 at the Sengah Temila sub-district office. This training was not originally budgeted or planned for, but was held in direct response to a specific request from the West Kalimantan PNPM team. The KPMDs were trained in the use of games, theater activities, horizontal communication techniques and other creative means to motivate villagers to attend and engage in PNPM forums. According to project reports prepared by Yayasan Kelola, the PNPM KPMDs who participated in the training session were very positive about it, with participants stating it was “inspiring”, “related to their everyday situation”, and “full of new ideas on how to creatively involve society with PNPM”.
Capacity Building for Kelola and Sub-grantees
All eight recipients of sub-grants received capacity building support in the areas of project and financial management. This included two days of training in September 2013 for shortlisted sub-grant applicants who were invited to develop a full-length proposal (see Sub-Grant Activities). Applicants who were selected for sub-grants subsequently received mentoring and guidance on project and finance management by the CC2 team during project implementation. A Sub-Grant Manual was developed and provided to the recipients, with this manual establishing guidelines and procedures according to which the sub-grant component of the CC II project was implemented. At the start of Phase 1 Yayasan Kelola staffs were also trained by the PSF/World Bank in matters related to financial reporting, safeguards and procurement.
Phase 1 Extension Capacity Building Activities
Refresher Training on Creative Empowerment Process
Between October 5 and November 23, 2014, intensive week-long refresher training sessions were provided for 68 individuals, including 24 Facilitators, 22 KPKs and Kelola field coordinators and Technical Specialists. Two PNPM workers from West Java also attended the training. The trainings were facilitated by external Participatory Video and TfD specialists along side Kelola’s cultural and technical specialists. The focus was on the CC2 project concept, creative facilitation techniques, participatory social analysis tools, formal development processes and technical skills for TfD and PV. In addition, Kelola’s admin and finance teams provided practical guidance to the internal policies and procedures of the projects.
The evaluation of the trainings showed that participants were inspired and able to look at their work as facilitators or cultural workers in new ways. It was especially enlightening for theater workers and videographers to realize the potential of their art to play a role in communality development, a new perspective for most of the participants.
Creative Communities 2 Project Completion Report
14 CC2 Activities
Capacity Building of Sub-grantees
The 6 sub-grantees in Bali, NTT and West Java received hands on support by Kelola management in the development of proposals and program design. In addition, they were also given support in financial and operational procedures and the reporting requirements of the project. Field facilitators and an M&E officer were assigned to provide hands on programmatic advice based on observation of the their activities and review of their progress reports.
Developing of Training Modules
External experts on Creative Empowerment Process were contracted to develop two training modules:
a) Tumbuh Dalam Lingkaran. Modul Fasilitator Efektif dengan Pendekatan Kreatif (Grow Within the Circle. A module for Effective Facilitators with Creative Approaches) is a basic TOT module specifically aimed at training people to use creative approaches for effective community facilitation and mobilization.
b) Mengelola Pertumbuhan (Managing growth) is an advanced module for how to manage the sustainable growth and continuation of a creative community. This includes focus on managerial aspects such as planning processes, M&E and reporting).
These modules are unique resources developed to support future Creative Communities interventions ,in particular for supporting the implementation of the Village Law, and capacity building of community leaders, NGOs, cultural workers, grass roots organizations and others in creative facilitation skills aimed at stimulating broad participation using any cultural medium, not limited to theater and video.
Theater Workshop on the Ethics and Esthetics of Theater for Development
A workshop was held in Yogyakarta on March 28-29, 2015 to reflect on the ethics and esthetics of Theater for Development. The objectives of the workshop were:
a. To transform the facilitators’ practical experience into collective knowledgeb. To reflect on CC2 in light of community theater ‘best practice’c. To generate recommendations for future empowerment and creative theater processes
20 theater workers (including all theater facilitators) attended the workshop, facilitated by Lono Simatupang, a Cultural Anthropology lecturer at the Gajah Madah University.
Monitoring, Evaluation and Learning
Monitoring and Evaluation during CC2 Phase 1
The following monitoring and evaluation activities were carried out during CC2 Phase 1:
» In the period from October 2012 to January 2013, as part of the preparation for the design of CC2, the PSF commissioned a team of researchers to conduct a field assessment in six provinces of existing cultural practices that could function as a community forum and/or that provide channels for a diverse range of community groups to express their opinions and to convey their aspirations for potential inclusion in village planning processes. This assessment included extensive consultations and discussions with local PNPM teams and government officials on the concept of the CC2 project. Findings from the field assessment helped to inform the design of CC2.
» Yayasan Kelola and the PSF conducted regular monitoring activities throughout the project and developed forms to enable facilitators and sub-grant recipients to collect basic attendance data and monitor project progress.
» An Impact Assessment of the Creative Empowerment Process and a series of case studies on both CEP and sub-grant activities were conducted to evaluate Phase 1 of CC2, document project progress, and identify lessons to inform the subsequent phase of the project.
Creative Communities 2 Project Completion Report
15CC2 Activities
» In April 2014, CC2 also partnered with researchers from the University of Melbourne’s Centre for Culture Partnerships (Australia) and the Kunci Cultural Studies Centre (Indonesia) to conduct two public discussions, in Jakarta and Yogyakarta respectively, on the evaluation of community arts projects as well as two research capacity building workshops for local researchers on methodologies and tools for the evaluation of community arts projects. A total of 37 researchers attended the workshops.
MEL during the CC2 Phase 1 Extension
The following MEL activities were carried out during the Phase 1 Extension:
» The CC2 Baseline Study, originally planned for Phase 1, was carried out in December 2014, to identify the marginalized and the poor, as well as the barriers and opportunities for their participation in PNPM and other formal development processes.
» Kelola recruited an M&E Specialist in November, 2014, who revised CC2 Monitoring and Evaluation Framework to include a logical framework that allowed the final evaluation to measure quality impact of the project beyond the Key Performance Indicators in the Revised Results Framework. A perception survey was designed and carried out in 24 CEP villages by the Yogyakarta-based research institute MIGUANI. A household survey and interviews were conducted with 665 core CCG members. In addition, 24 heads of villages, 24 KPKs and 52 PNPM workers were interviewed to measure perceptions about the CC2 program and its impact. Five ethnographers, anthropologists were recruited to document 11 case studies on CEP and six case studies on sub-grants. The compilation of case studies is available in English and Indonesian.
» Several reflection workshops were held both to improve ongoing operations and to generate recommendations for future creative communities projects. This includes, an internal Kelola Learning Workshop in December 2014 to generate lessons and recommendations. Mid-term reflections were held with field facilitators half way into their three months period in the villages. In NTT, the eight KPK also attended this reflection. For four theater facilitators in West Java, two such reflections were held within the three-month period. Final reflections were held with facilitators from Bali and NTT in Bangka (January 2015) and for West Java facilitators in Bail (March 2015) to generate lessons learned both at organizational and individual levels. A final PSF/Kelola reflection was held at the end of March 2015 to discuss preliminary evaluation findings and generate recommendations for the future.
» A separate Evaluation Report was written on the relevance, efficiency, effectiveness and sustainability of sub-grants (Annex 3). In addition, field facilitators, coordinators and KPKs produced a wealth of reports that document their reflections and lessons learned from their field activities, all which were reviewed and used for the final evaluation of the project.
Creative Communities 2 Project Completion Report
16 CC2 Activities
Tabl
e 7
- CC
2 In
puts
and
Out
puts
Ove
rvie
w
Bu
dget
Orig
inal
Re
vise
d in
Se
ptem
ber 2
015
Phas
e 1
(Apr
201
3–
Sept
201
4)Ph
ase
1 Ex
t (O
ct 2
014
– M
ar 2
015)
Fina
l Tot
al E
xpen
ditu
re (M
ay 2
7, 2
015)
24
RETF
(USD
)4,
700,
000
1,92
0,00
060
6,00
01,
314,
000
1,37
2,51
025
BETF
(USD
)27
4,00
037
4,00
027
4,00
070
,000
Budg
et st
ill o
pen
Tota
l (US
D)
4,97
4,00
02,
294,
000
880,
000
1,38
4,00
0-
Crea
tive
Empo
wer
men
t Pro
cess
es#
of V
illag
es#
of C
reat
ive
Com
mun
ity G
roup
s#
of D
irect
Par
ticip
ants
# of
Indi
rect
Pa
rtic
ipan
ts#V
illag
e Cu
ltura
l W
orke
rs
# of
KP
Ks#
of Fa
cilit
ator
s (vi
llage
fa
cilit
ator
s, co
ordi
nato
rs,
spec
ialis
ts)
# Ev
ents
/cul
tura
l di
alog
ues
Phas
e 1
43
Vide
o 3
TfD
206
2,70
0 N/
A0
87
Phas
e 1
Ext.
24
8 Vi
deo
8 Tf
D 1,
055
9,60
0 83
124
3072
Tota
l28
11
Vid
eo
11 T
fD
1,26
112
,300
>8
3124
38
89Su
b-gr
ants
# of
Vill
ages
# of
Gra
nts
# of
Dire
ct
Part
icip
ants
# of
Indi
rect
Pa
rtic
ipan
ts#
Villa
ge C
ultu
ral
Wor
kers
Ne
t Val
ue
of G
rant
s (ID
R)
TOTA
L UN
IQUE
VIL
LAGE
S (C
EP
+Gra
nts)
Tota
l Cul
tura
l w
orke
rs
Phas
e 1
10
880
3 (3
75 m
ale
and
428
fem
ale
N/A
N/A
478,
985,
000
Phas
e 1
11n/
a
Phas
e 1
Ext.
10
642
2 (1
56 w
omen
, 18
9 m
en)
3650
418
480,
000,
000
Phas
e 1
ext
3313
11
Tota
l20
141,
225
(at l
east
564
m
en, 5
84 w
omen
)At
leas
t 365
0At
leas
t 418
958,
985,
000
Tota
l44
>131
1
Capa
city
Bui
ldin
gTr
aine
d in
use
of m
edia
an
d se
lf-ex
pres
sion
TOT
in Fa
cilit
atio
n Sk
ills a
nd C
EPM
odul
es
Dev
elop
ed#
Sub-
gran
tees
su
ppor
ted
in
adm
in, fi
nanc
e an
d re
port
ing
Phas
e 1
206
Core
CCG
mem
bers
tra
ined
7 Fa
cilit
ator
sN/
ATf
D an
d Vi
deo
Man
uals
(Dra
ft)8
Sub-
gran
tees
Phas
e 1
Ext.
1055
Cor
e CC
G m
embe
rs tr
aine
d24
Faci
litat
ors
24 K
PKs t
rain
ed in
fa
cilit
atio
n Sk
ills
a) T
fD a
nd V
ideo
Man
uals
(Refi
ned)
b) Tu
mbu
h da
lam
Lin
gkar
an. A
man
ual f
or e
ffect
ive
faci
litat
ion
usin
g cr
eativ
e ap
proa
ches
c) M
enge
lola
Per
tum
buha
n ad
vanc
ed m
odul
e fo
r man
agem
ent o
f cre
ativ
e co
mm
uniti
es
(incl
. pla
nnin
g, M
&E, R
epor
ting)
6 Su
b-gr
ante
es
Tota
l12
61 C
CG m
embe
rs
31
24 K
PK4
CC2
Faci
litat
or
Man
uals
12 su
b-gr
ante
es
24
Kel
ola'
s bu
dget
(RET
F) c
lose
d on
Mar
ch 3
1, 2
015.
BET
F cl
oses
in S
epte
mbe
r 30,
201
5
25
IDR
1,50
7,53
4,24
8
Creative Communities 2 Project Completion Report
17Outcomes
OUTCOMESSUMMARY OF THE CC2 PHASE 1 EVALUATION26
Impact of CC2 Phase 1
In Phase 1, more than 1,200 individuals (participating villagers, PNPM facilitators and cultural workers) participated directly in CC II activities, while more than 5,600 participated indirectly (villagers and others who attended presentations and/or performances). The project provided support for 14 types of cultural activities, which resulted in a total of 37 presentations and/or performances in 13 villages in seven sub-districts. Each presentation and/or performance was jointly organized with, or attended by, PNPM Rural and/or PNPM Generasi personnel. The majority of the participants were women, children and youths who had little or no previous knowledge of PNPM Rural or PNPM Generasi.
CC2 Increased Public Understanding, Access and Opportunity to Participate in PNPM
The evaluation of Phase 1 found that CC2’s creative initiatives were effective in increasing people’s understanding of PNPM and in creating opportunities to participate in PNPM. They were also more likely to participate in PNPM forums and be involved in PNPM in general following this involvement.
Working with PNPM facilitators, CC2 used creative empowerment approaches to create opportunities for all sectors of the community to participate in PNPM forums, for examples. PNPM forums were held in community spaces normally not used for such meetings that were accessible to a broader range of the community. PNPM forums were combined with entertaining and interactive cultural activities that involved community members, which resulted in increased enthusiasm for such events. Creative approached were used to create an alternative space to traditional PNPM forums that enabled voices of the poor and marginalized to be head.
26 This section is an excerpt summary of the Creative Communities II Progress Report, September 2014
Creative Communities 2 Project Completion Report
18 Outcomes
Increased General Attendance and Participation in PNPM
Phase 1 of CC2 has demonstrated the value of using creative processes to improve participation in PNPM processes and other village development initiatives, both in terms of the quality of participation and attendance. Through direct synergies between CC2 activities and PNPM forums, attendance increased from around 20-40 participants to 70-200. Creative media also proved a non-confrontational channel for villagers to express their grievances directly to decision-makers.
Increased Attendance and Participation of Youth, Women and Poor People
Looking specifically at the attendance of the marginalized, poor, women and youth in PNPM forums, participants at such forums included demographic groups whose members rarely or never previously attended such forums.
The Phase 1 evaluation also found that CC2 has been effective at increasing the quality of participation by poor members of the community and women in village planning processes. E.g. In Bone, Sulawesi, under the Creative Empowerment Process, members of the village, including members of the marginalized Bajo’e community, came together with PNPM actors to stage a performance to raise awareness regarding the PNPM program. During this performance, members of the community were able to address questions to PNPM actors and to express their opinions regarding village level development initiatives.
CC2 Phase 1 supported Agency, Empowerment and Capacity of Villagers
Despite the short implementation timeframe, the Phase 1 Evaluation findings show that the project facilitated some changes of agency, empowerment and capacity of villagers, including the following:
» Improved self-confidence, particularly in terms of voicing views and issues related to community level development initiatives;
» Ability to undertake discussions, including expressing one’s views and valuing the views of others;
» Ability to work as a team; Increased sense of community; Increased technical capacities in terms of the use of video, theater and other forms of creative expression.
CC II also provided support to community members to enable them to act as agents of change and to identify issues that could be raised at PNPM forums and possibly addressed through the provision of PNPM block grants.
Challenges and Lessons from Phase 1
In some villages CC2 Phase 1 succeeded in creating direct synergies between CC2 activities and PNPM forums, which made the project effective and efficient in achieving its goals. Synergies occurred thanks to coordination at different levels. Importantly, PNPM workers at village, sub-district levels were directly involved in activities in some of the villages that showed best results, e.g. in Bajo’e Village. 27 CC2 creative outputs were used during PNPM forums to foster community interest and to facilitate the achievement of increased participation. CC2 also provided inputs for the revision of the PNPM Technical and Operation Guidelines (PTO).
CC2 supported PNPM in improving the level of community participation in program processes. CC II has facilitated these improvements by:
» Using TfD, PV and other forms of creative expression to serve as alternative channels for inputs, trigger of discussion and renewed interest in participation;
» Enabling PNPM facilitators to use forms of creative expression to support the community empowerment processes, with these forms of expression acting as an alternative means of engaging communities, supporting participatory processes, providing information and encouraging participation;
27 Widuri, D. & Haryanto, A. A. Lima Studi Kasus Komunitas Kreatif II: Kabupaten Bone, Sulawesi Selatan dan Kabupaten Lombok Utara, Nusa Tenggara Barat, Creative Communities II, PNPM Support Facility, Indonesia.
Creative Communities 2 Project Completion Report
19Outcomes
» Creating Creative Community Groups and partnership with sub-grant recipients so that they can act as local partners to assist PNPM in reaching out to the community, particularly to poor people and members of marginalized groups;
» Supporting the training of PNPM facilitators and volunteers in the use of creative approaches and forms of expression to engage the community in village planning processes.
Despite an informal understanding between the CC2 with the Ministry of Home Affairs Directorate of Village and Community Empowerment (PMD) to partner with PNPM Rural, there was no formal communication from PMD to the PNPM facilitators in CC II project sites to explain the partnership, which created barriers to the involvement of PNPM facilitators in CC2 activities. Achieving systematic integration of creative approaches into PNPM across Indonesia was difficult to achieve because PNPM already had defined and established procedures of implementation.
Overall, the lack of any form of formal communication from PMD to local PNPM teams CC2, had a negative impact on the degree to which support was provided. While there is evidence that PNPM benefited to some extent in areas where CC2 was implemented, even when the level of engagement between PNPM and CC II was minimal, the benefits were generally less apparent than in areas where the level of support provided by PNPM was high or very high, including reduced likelihood that creative approaches would be utilized by PNPM without the continued support of CC2.
Short implementation timeframes made it difficult to measure the extent to which community inputs to PNPM were in fact formulated into PNPM proposals. Longitudinal measurement options are needed in the future to gauge such take-up of proposals of the poor and marginalized. Lack of take-up could lead to disempowerment in the long run. Additionally, more work needs to be undertaken to integrate project activities into formal village planning processes, whether these processors are implemented through PNPM or through the newly promulgated Village Law, so that the needs that have been voiced will be addressed and development funds will be made available to address the needs.
In CC2 Phase 1, it was found that many sub-grant recipients did not have a good understanding of PNPM and their activities were not directly relevant to PNPM processes and therefore could not be effectively integrated with these processes. To address this during the Extension, sub-grantees were provided with more time and support to develop their proposals with inputs from local PNPM teams, especially in PNPM Generasi locations.
Lessons from CC2 Phase 1 called for increased integration between CEP component and sub-grants activities. This remained a challenge during the Extension due to short the implementation period and the PNPM transition towards the new village law. Overall the main lessons from Phase 1 about integration between CC2 activities with the formal PNPM process was challenging to implement during the Extension, also due to the PNPM transition.
Key Performance Indicators for CC2 Phase 1
CC2 Phase 1 was governed by two sets of KPI, one as outlined in the approved proposal to the JMC (Figure 10), and the other as Intermediary Results of the World Bank Results Framework for CC2 (Annex 1). Table 8 is a reports against CC2 Phase 1 performance against the JMC approved Key Performance Indicators.
Creative Communities 2 Project Completion Report
20 Outcomes
Table 8 - CC2 Phase 1 Key Performance Indicators (as per CC2 proposal approved by the JMC)
Key Performance IndicatorsIndicator
Project Development Objective: To carry out preparation and pilot activities for Creative Communities II (CC II), and ensure the design of the program uses locally-appropriate cultural approaches to enhance public participation and increases voices of the poor and marginalized groups in community planning.
Projectdesigncompleted &CCII formallylaunched
CC II formallylaunched
Project designcompleted
On target Project design andoperational manualscompleted; CC II launched
Project design andoperational manualscompleted;
Formallaunchof CCII
Launch event plannedfor period under MC’soversight instead. Itsbudget allocation usedto cover operationsneeds during no costextension period.
-
50 - 100 peopleper PNPMvillage forum
70 - 200 people +20-100 50 - 100 people per PNPMvillage forum
70 - 200 people 20-100 Attendance datacollected from pilot sites
20-40 peopleper PNPMvillage forum
The poor andmarginalizedare able toconvey theirneeds to policymakers throughCC II culturalactivities
Evaluation ofpilot shows thatCCII has enlargedaccess of the poorand marginalizedto communityplanning in PNPM
On target Poor and marginalized areable to convey their needsto policy makers
Poor andmarginalized areable to convey theirneeds to policymakers
Ontarget
Findings based onqualitative evaluation.
Poor peopleandmarginalizedgroups havelimited accessto decision-making ofPNPM-Rural.
Pilotindicatesimprovementsin PNPMpublicparticipationPilotindicates thatpoor &marginalizedpeople arebetter able toraise theirconcerns
Consultationson lessonsfrom CC I &design of CCIIFieldassessment toinform design
Full fledgedesign thatcan operateat scale
10
Fieldassessmentcompleted
Operationaldesign andbudgetdeveloped
18
Field assessmentreport completed
Operationaldesign and budgetdeveloped
+8
On target
On target
2
Field assessment reportcompleted
Project Operations Manualand Sub grant Manualadopted; budget developed
3
Field assessmentreport completed
Project OperationsManual and Subgrant manualadopted; budgetdeveloped
Ontarget
Ontarget
Ontarget
-
-
In light of transition toMC, longer-term designof project will bediscussed with MC in Q12015.
-
-
-
Component 1 Review lessons from CC I and carry out field assessment to inform the design of CCII
Component 2: Design a full-fledge CC II program
Baseline CumulativeTarget
CumulativeAchievements
VAR Target for 2014 Achieved in 2014 VAR Remarks
CC2 PHASE 1 EXTENSION EVALUATION FINDINGS
The Applied Theory of Change of CC2
Kelola recruited a Monitoring, Evaluation and Learning Specialist in November 2014, who developed an M&E Framework by consolidating the “Theory of Change” as expressed in various key project documents, including the project proposal and facilitators’ manuals (Figure 3). The theory of change highlighted three pathways towards achieving the project’s Project Development Objective of “active participation”: 1) Communities increased agency; 2) Community Representatives improved quality of their representation of the marginal and poor; and, 3) Village Facilitators and Cultural Workers increased capacity to facilitate development using creative approaches.
Figure 3 - CC2 Theory of Change
Definition of ‘Creative approaches’Participatory Video, Theater for Development and grants for creative proposalsCreatie community mobilization techniques
Creative approaches are applied so that…
Community members, specifically the marginal and poor, have increased agency Community Representatives
Facilitators/cultural workers
Under-standing of their rights to
partici-pate
Self-esteem Capacity for self-expre-ssion
Social net-works and arenas for
expre-ssion
Under-standing of PNPM and dev
pro-cesses
Improve quality of represen-tation
Increased capacity for use of creative method-ologies
GOAL: Community members, specifically the poor and marginalized, have increased capacity to participate actively in PNPM and development processes
Definition of ‘Active Participation’• Awareness about PNPM and/or other development processes• Motivation to participate• Access to participate • Ability to influence decision making in the development processes
Based on this theory of change, an M&E plan developed to measure the impact of the Phase 1 Extension.
Creative Communities 2 Project Completion Report
21Outcomes
M&E FRAMEWORK AND KEY PERFORMANCE INDICATORS OF CC2 PHASE 1 EXTENSION
A mixed-methodology evaluation was carried out in all CC2 Phase 1 Extension locations to support the documentation of lessons learned and document the effectiveness of creative approaches in achieving broad participation in development processes. Details about the evaluation methodology are found in Annex 1.
A report against the Key Performance Indicators of the project are found at the end of this Project Completion Report, which includes the measurement of PDO Level Results Indicators:
Indicator One: Increase in public participation in village planning processes in project locations
Indicator Two: Beneficiaries have increased understanding of PNPM and village planning process.
Indicator Three: PNPM facilitators and cultural workers have increased capacity to use cultural mediums to improve participation in village planning
For the final evaluation of the Extension, a Monitoring and Evaluation Framework was developed around a more comprehensive logical framework approach to the PDO, which included indicators for the measuring of “empowerment”. This Framework is found in Annex 2.
Creative Communities 2 Project Completion Report
22 Outcomes
KEY LESSONS FROM THE CEP COMPONENT
Targeting
Targeting Criteria of CEP
The Projects Results Framework was revised as a part of the program restructuring carried out in June 2014. The Revised Results Framework identifies the target group of the project as the marginal, poor, women and youth. As mentioned above, the definition of marginal encompasses “those regularly excluded in PNPM and which can be characterized as having no (valuable) assets, living in outlying areas with limited basic infrastructure, having limited income with a large number of dependents, with disabilities or originating from an ethnic/religious/gender minority.” In November 2014, a baseline was carried out to identify the marginal and poor and the barriers to their participation in PNPM and other village development processes. Unfortunately the baseline was conducted too late to inform targeting strategies, and consequently the definition of the marginal was never fully operationalized.
The Kelola field manual for the project facilitators and cadres includes the term “marginal” without an operational definition except “including people living with disabilities/people with special needs”. The manual also lists a gender target (50% women or more), adults above the age of 17 and at least one PNPM village facilitator (KPMD) as active member of the creative community. 28 The criteria in field manuals were not fully aligned with the results framework, but the target group was extensively discussed with the facilitators and readdressed during mid-term reviews held with facilitators and KPK midway though the village processes. The field facilitators and the KPKs were given a mandate to identify participants in coordination with the community in collaboration with the KPKs, PNPM officials and the communities. Facilitators reported that identifying the marginal and poor was challenging, also due to time constraints. Nevertheless, the evaluation shows that the participants and direct beneficiaries of the project aligned well with the intended target group.
Phase 1 Extension Participation in CEP Activities
A total of 2017 people signed attendance lists at least once during the CEP processes in the 24 villages of the extension phase (Table 9). This included people who attended socialization or just one meeting, and who would not have experienced the full impacts of the project. 54% were female, 31% children under 17 years of age.29
Attendance lists were not always used, so these numbers are likely lower than actual. Although methods were used to avoid double counting, some people have signed attendance lists using both birth names and nicknames.
Table 9 - Total people attending CC2 Phase 1 Extension CEP activities at least once
Total Male Female Children (<17) Boys GirlsGender
30N/AAge N/A
Bali 794 306 39% 482 61% 185 23% 103 56% 82 44% 6 205Flores 858 457 53% 401 47% 292 30% 142 49% 150 51% 0 119West Java 365 117 32% 215 59% 143 39% 60 42% 82 57% 33 Total 2017 880 44% 1098 54% 620 31% 305 49% 314 51% 39 324
* Children percentage of total. Boys and girls percentage of children. Individuals listed in attendance sheet whose gender was unknown adds to 2% of total, 9% of West Java. Ages of 16% of total are unknown.
Numbers of participation was fluctuated throughout the CEP process, which is in line with the understanding of a “community” as a dynamic entity that remains open to new members, rather than a closed group.31 “Core members”
28 Kelola Foundation. 2014. Manual Pelatihan Fasiltiator Dan Kader Pemberdayaan Komunitas Kreatif. Jakarta: Yayasan Kelola/PSF Creative Communities 2.
29 <17 years was used as a definition of “youth” in the evaluation, to match 17 as the legal age for participation in PNPM activities. The baseline concludes, however, that most unmarried individuals are marginalized in development processes regardless of age.
30 The data is generated from attendance lists of field activities. The columns “Gender N/A” and “Age N/A” refer to individuals whose gender and/or age were not listed. This means that gender and age cannot be accurately stated for the table of total individuals who participated at least in one activity.
31 Conversation with CEP Theater for Development Coordinator, December 2014.
Creative Communities 2 Project Completion Report
23Outcomes
were identified for this evaluation as those who participated “regularly enough”32 to have experienced a direct impact of the project. KPKs and facilitators in Flores and some villages in West Java generated lists of their most active members. In the remaining villages in Bali and West Java, the evaluation team eliminated people from attendance lists, who only participated once. This adds up to 1055 core members. An overview of “Core Members” is shown in Table 10.
Table 10 - CC2 Phase 1 Extension Creative Community "Core" Members
Total Male Female Children (<17) Boys Girls Gender N/A
Age N/A
Bali 408 207 51% 201 49% 132 32% 71 54% 61 46% 0 205Flores 282 152 54% 130 46% 145 52% 72 50% 73 50% 0 119West Java 365 117 32% 215 59% 143 39% 60 42% 82 57% 33 Total 1055 476 45% 546 52% 420 39% 203 48% 216 51% 33 324
* Children percentage of total. Boys and girls percentage of children. Gender unknown for 3% of total and 9% of West Java.
52% of the core CC members are female, with a high 59% in West Java and low 46% in Flores 33. The high percentage in West Java can be explained with the targeting of women with children involved in PNPM Generasi activities. 39% of the members were youth and children below 17. The youngest participants were six years old in Panembong village, West Java, where CC2 also worked with Grade One Elementary School students.
Working with Women
Women often experience additional barriers to participation in development, and the baseline confirms that female attendance at formal PNPM meetings is tokenistic.34 Effective gender targets are usually achieved with specific gender strategies to overcome gender biases that exist internally within the project and in the community. Despite efforts of recruitment, only 4 out of 24 video and theater facilitators were women (17%). Similarly, only 5 out of 24 KPKs were women (21%). Based on experience from other development programs, 35the fact that a team of predominantly male facilitators and KPKs that did not receive specific gender training succeeded in engaging more women than men, indicate that creative approaches are particularly suitable for women. This observation is supported by how facilitators experienced being guided by village leaders towards women and youth, especially once it was made clear that the project operated within the “cultural arena” with few material resources, hence being perceived as more appropriate for women and youth.36
Coordination with PNPM Generasi in West Java also contributed to the high number of female participants in Java (59%), where the main target groups were women and children given the relevance to PNPM Generasi’s health and education activities.
Engaging Youth
The CC2 Baseline Study shows that unmarried youth under 35 were generally marginalized from participation in formal village meetings in all three provinces of the CC2 Extension because invitations to such meetings are largely based on household representation. A survey of core CCG members showed that 56% belonged to this group.
According to the facilitators’ manuals, children and youth were not initially intended as direct participants of the project. 37 However, lessons from Phase 1 showed the potential of the approaches to attract youth, and facilitators were encouraged by project management to include youth. As mentioned also, village leaders and PNPM officials often guided facilitators and KPKs towards youth groups and school children38 resulting in a remarkable 39% participation
32 The definition of “regularly” varied from village to village where facilitators’ were asked to list, those considered as core members. It was generally understood that a core member had at least participated in the social analysis or exercise to generate themes for theater or videos, during “most” theater rehearsals or video production processes, during the large performance or screening and at the final CC meeting to plan for future activities.
33 The perception survey verified the core member lists to identify respondents and found that 56% of core members were female.
34 Creative Communities II Phase 1 Extension Qualitative Baseline Study: Summary Report. Draft 4. PSF. March 2015
35 Source:
36 E.g. Flores Facilitator’s and KPK’s Mid-term evaluation, November 2014.
37 Kelola Foundation. 2014. Manual Pelatihan Fasiltiator Dan Kader Pemberdayaan Komunitas Kreatif. Jakarta: Yayasan Kelola/PSF Creative Communities 2.
38 Interview with Kelola CEP Coordinator and Cultural Specialist, March 2015.
Creative Communities 2 Project Completion Report
24 Outcomes
of youth and children under 17 of which 52% were girls and 48% boys. This indicates that creative approaches are also highly effective in engaging youth in development.
In line with the experience of CC2 Phase 1, youths gravitated towards the project due to the creative approaches: the informal meeting style, their curiosity and interest for new experiences and, particularly for video, the opportunity to learn how to use new technology. Community leaders, teachers and parents also wished to step aside and offer the opportunity to their children add youth, as it was seen as an investment in their education.39 A lesson from Phase 1 showed that youth in general have little understanding for PNPM processes and village development.40 The baseline also underlined the findings that the unmarried are marginalized as they often lack formal access to village meetings.41 The project also succeeded in providing alternative space for the expression of opinions. Overall, the evaluation concludes that creative approaches are especially powerful when working with youth.
Targeting of The Poor
The initial idea was for CC2 to follow PNPM’s modality of using community definition of the poor. However CC2 facilitators reported that they could not access reliable data on the poor in the communities. Short timeframes also did not allow assessments or use of participatory wealth mapping methodologies to identify the poor. Delays caused by the project restructuring also impacted the timeliness of baseline results. Despite these challenges for targeting, a household (HH) survey conducted on CCG members showed that 43% of core CCG members came from poor households. 42 The highest number of poor was achieved in NTT with 80% because when using a cross province methodology, NTT has significantly lower income per household.
Table 11 - Distribution by wealth, Creative Community Group Members, CC2 Phase 1 Extension
Poor Non Poor N % N %Bali 58 26.85 158 73.15West Java 50 22.12 176 77.88NTT 177 80.09 44 19.91TOTAL 285 42.99 378 57.01
Based on the Indonesian Central Statistics Agency (BPN) data on provincial level poverty 43 9,18% in West Java, 5,39% in Bali and 19,6% in NTT live below the poverty line. The CC2 survey data does not lend itself to direct comparison with these provincial surveys but are useful in giving an impression about the effectiveness of CC2 targeting. The high participation of the poor indicates that creative approaches are effective in engaging poor community members. The baseline concludes that the lack of time and a feeling of embarrassment and fear of not meeting dress codes when meeting in formal settings contribute to the barriers to participation of the poor. 44 These are exactly what creative approaches work to overcome by meeting people where they are, e.g. in the fields or gardens during work breaks, rather than in formal meeting spaces, using games and sharing rather than top down, formal speeches that demand adherence to formal hierarchies.
Targeting People Living with Disabilities
The facilitator’s manuals list people living with disabilities as a targeting criterion, and there are several examples of how creative communities have been inclusive. For example, in Panji Village, Bali, a young man with hearing and speech impairment performed a pantomime sketch, and although he didn’t directly address rights issues in his performance, he showed the community that he could participate. In the same village, the CC2 created a momentum existing creative individuals and groups in the community, including the KPK, who made space available in his house for people
39 MEL Specialist interview with villagers in Lento, NTT, November 2014.
40 PSF 2014. Creative Communities II. Phase 1 Progress Report. Jakarta: PNPM Support Facility. September 2014.
41 Creative Communities II Phase 1 Extension Qualitative Baseline Study: Summary Report. Draft 4. PSF. March 2015
42 The 590 households surveyed were home to the 663 respondents of the Perception Survey in all CC2 Phase 1 Extension 24 CEP villages. The HH survey used an income quintile, naming households of the 2 lowest quintiles “poor”. In other words, CCG members belonging to household that fell into lowest 40% income, without accounting for provincial differences in income, were classified poor.
43 Badan Pusat Statistik, September 2014
44 Creative Communities II Phase 1 Extension Qualitative Baseline Study: Summary Report. Draft 4. PSF. March 2015
Creative Communities 2 Project Completion Report
25Outcomes
to meet. The availability of this space generated additional support from individuals in the community that enabled the CCG to procure tools for jewelry making that provided livelihood opportunities for one of their members with physical disabilities.
In Flores several creative communities made videos about people living with disabilities in their communities. These people were provided opportunities to speak about their lives and the challenges they face in the video, or their family members would speak on their behalf. In Manubhara village, a video about members in the community living with physical and mental disabilities was awarded the best video, and the people were called up on stage to receive the award.45
The project team needs to carefully consider how to involve people in the project, who do not have the physical ability to express themselves. Involving people in videos only and not as full members of CCGs is only indirect involvement, when people are not in position to determine the consequences of their participation in videos, because they do not have a say in when and where the videos are shown, even at village level. Considerations should be given to the slogan of many associations for people living with disabilities: “nothing about us without us”. There are also ethical issues about the use of video and theater to portray stories of the lives of the marginal and poor, that should be considered in future projects, potentially as a part of future facilitator and KPK trainings. For example, how to predict consequences of a video or theater performance for those involved, how to avoid “social pornography”, additional stigma and perceived ridicule?
Targeting the Marginalized
Using no participation in PNPM and other village planning activities as the definition of marginalization in the six months prior to CC2 entered the village, 72% of CCG members were marginalized (Table 12). This number was highest in Bali (86%). The baseline showed that in Bali only married men were eligible to participate at formal village meetings,46 which makes a large part of the population “marginal”. Participation in PNPM process in Bali was also mostly affected by the transitioning of PNPM Mandiri. Most CC2 villages had no PNPM meetings in 2014.
Table 12 - Core members of CCGs that did not participate in PNPM activities during six months prior to activities
Marginalized Non Marginalized
N Percentage N Percentage
Bali 186 86.11 30 13.89Jawa Barat 124 54.87 102 45.13NTT 169 76.47 52 23.53TOTAL 479 72.25 184 27.75
The baseline findings show that the main cause of marginalization was that PNPM meetings were not open, and that in all three provinces, PNPM meetings had a structured attendance limited to male family heads (kepala keluarga) and elites.47 The high number of marginal in the CC2 project may be partly accredited to support by the community to identify people who rarely participated in formal processes, but also the fact that most people in these villages were by this definition marginal.
CCGs provided opportunities also to stigmatized groups in the community, who rarely participated in formal village development processes. E.g.:
» In a village in Flores, the KPK and adult members of the Creative Community Group were perceived by the head of village to be in opposition to the established elite in the community. They were also stigmatized as the “drinkers” in the community.48 Through their membership in the CCG they had an opportunity to express their ideas and challenge the head of village, which caused some tension.49
45 Manubhara Village, NTT
46 Creative Communities II Phase 1 Extension Qualitative Baseline Study: Summary Report. Draft 4. PSF. March 2015
47 Creative Communities II Phase 1 Extension Qualitative Baseline Study: Summary Report. Draft 4. PSF. March 2015
48 Creative Communities 2 Compilation of Case Studies. 2015. Agung Haryanto. “Case Study from Barang Village, NTT.” Jakarta: Yayasan Kelola/PSF.
49 Ibid.
Creative Communities 2 Project Completion Report
26 Outcomes
» In a village in Flores, a community of gamblers requested that a video was made about them because they wanted to warn youth about repeating their mistakes in life.50 A man from the group said he was at first embarrassed when he saw himself on screen, but at the same time he was happy to set an example for the young people.
» In Bongkasa Pertiwi Village in Bali, the so-called “village drunks” were invited to participate in the theater play to show their ability to contribute to the community. .51
» A woman and mother of six, active in a Creative Community Group in Bali had divorced her abusive husband, which placed her outside formal structures in Bali where women are represented by their husband. Hence she belongs to one of the most marginalized groups in Bali. 52 She found acceptance amongst her CCG peers.53
Why Targeting Matters
The Creative Communities project literally provides a stage to its direct participants as it aims to bring out the voices rarely heard. It provides an opportunity for community members to (re)produce culture and (re)shape discourse. Targeting becomes especially important in a project of this nature to ensure that all activities are organized to bring forward unheard voices – defined in the Extension as those belonging to the marginal, poor, youth and women.
It should remain the project’s priority to adapt strategies to involve its target group as direct participants rather than indirectly as interview subjects of the community videos or as audience members at its cultural events. Even when their concerns are raised through the theater or videos, if they are not provided with the opportunity to engage in the strategic decision making about when and where their stories are told, they may feel disempowered, and in worst case scenarios they may also face backlashes from their communities.
It may be most challenging to involve marginalized people in activities, as the barriers to their participation are real and must be overcome. Working only with socially engaged community members, who declare themselves allies of the marginalized and consider themselves fit to speak on their behalf cannot be seen as a satisfactory strategy. Empowered marginal groups are likely to demand to speak for themselves.
If the project fails to target the right people as participants, the project may give renewed legitimacy to the already powerful, or become vulnerable to exploitation of groups and individuals in the community with specific political agendas. In this way, the Creative Communities Project is no different from other development initiatives that are by default political and potentially contentious as they aim to redefine structures of power and influence.54
It was easiest to achieve a relaxed and informal atmosphere, where the marginalized, poor, youth and women could express themselves freely, in a homogenous and egalitarian group.55 At the same time, mixed groups, where the marginalized and members of the elite participated together, have the added value of building extended networks. The facilitators needed skills to ensure that dominance of more resourceful members of the Creative Communities did not occur, and to make sure that the project’s main target group held influence and control over the agenda.
50 Facilitator Narrative Report Lento village, NTT
51 Kelola Foundation. 2015. Creative Communities 2 Compilation of Case Studies. Diya S. Widuri. “Case Study from Bongkasa Pertiwi Village, Bali.” Jakarta: Yayasan Kelola/PSF.
52 Creative Communities II Phase 1 Extension Qualitative Baseline Study: Summary Report. Draft 4. PSF. March 2015
53 Interview with CC member, Panji Village, January 2015
54 Barron, P., Diprose, R. and M. Woolcock. 2011. Contesting development: participatory projects and local conflict dynamics in Indonesia. Yale Agrarian Studies Series. Yale University Press, Ithaca.
55 Ibid.
Creative Communities 2 Project Completion Report
27Outcomes
Ideology about women, wives and mothers expressed from a theater stage in Cimeumal, West JavaAfter a social analysis to identify issues most important to the women active in the Creative Community Group in Cimeumal Village, they decided to make a theater performance about a woman, who due to poor targeting of government welfare programs found her family in great financial difficulties. She had little support from her husband, which eventually made her leave to work in Saudi Arabia as a domestic worker. After she left, the family at home fell apart and her teenage daughter became pregnant out of wedlock. According to Sri Kuncoro (2015) the performance expresses an ideology about women, wives and mothers in West Java understood within the local cultural context where women are responsible for the financial situation of their families while also being mainly responsible to ensure the moral, spiritual and social wellbeing of their families. When these roles are at odds, the women experience guilt and social condemnation. This is an example showing the power of Creative Communities in both reproducing and critiquing cultural norms. However in the case of Cimeumal, the Case Studies researcher argues that the women did not reflect critically enough on this double burden of women in the community. 56
Empowerment
The evaluation found evidence that the CC2 Phase 1 Extension has achieved positive results in terms of increasing people’s agency and empowerment of Creative Communities participants. The project’s theory of change outlines the pathways towards an enabling environment for people’s active participation. An increase in people’s agency, or ability and opportunity to express themselves and participate, constitutes one pathway.
Core members in all locations reported to have benefitted positively from participating in the TfD and participatory video communities. Figure 5 shows the response of core CCG members when asked an open-ended question about how they benefitted from participated in the project. Each respondent was allowed multiple answers, which means the total responses adds up to more than 100%. People reported to have increased self-confidence, increased ability to express complaints, increased understanding of the situation in the village and increased awareness of their rights to
56 Creative Communities 2 Compilation of Case Studies. 2015. Sri Kuncoro. “Salah Saha – Exploring the Burdens of Women in Poverty on Stage, A Case Study from Caringin Wetan Village, Sukabumi, West Java.” Jakarta: Yayasan Kelola/PSF.
Creative Communities 2 Project Completion Report
28 Outcomes
participate in development processes. Strengthened networks were also highlighted by some respondents, such as the opportunity to access important people in the village, having a place to meet and discuss with friends and a chance to meet with communities in other villages.
Figure 4 - Perception of individual benefits gained from being members of CCGs (in percentage) 57
0 10 20 30 40 50 60 70
More self con�ident
Learn new ways of expressing complaints
Understand situation in village better
Added organizational experience
Gained place and friends to disuss with and express opinions
Learned new skills/knowledge
More activities in the village
in other villages
More aware of my rights to participate in village …
Can access important people (i.e. KPK, KPMD, village gvmnt)
% of non-poor
% of poor
% of total
Both poor and non-poor members reported to have benefitted from the project. The opportunity to learn new skills and knowledge was highlighted by participants in Flores, who were also poorer and younger than those in other provinces, which may indicate a felt need for additional activities and alternative spaces in villages that are isolated with limited access to modern technology. More non-poor reported to have increased self-confidence after participating in CCG activities. More theater participants reported to have increased self-confidence than video, which may be attributed to the focus in theater on stage performance in front of an audience. As the majority of the poor where involved the video, this may account for the difference.
Overall the findings indicate that the CEP process is a powerful tool for empowerment that brings both poor and non-poor participants beyond passive attendance. The process has proven effective in ensuring that the poor and marginalized have benefitted equitably from the project. Importantly, learning goes beyond the technical aspects of video and theater as media, towards an understanding about issues in the village, how to express complaints, build networks and create a space wherein to interact with other community members, all of which the project’s theory of change identified as pre-requisites for active participation in village planning and development processes.
57 Respondents were asked an open ended question about the benefits of participating in CCGs. They were allowed multiple answers, which means the total of responses exceed 100%.
Creative Communities 2 Project Completion Report
29Outcomes
CC2 Created Space for Reflection and Critical Thinking
The Baseline Study showed that associational life is rich in all three provinces with a strong emphasis on religious life.58 However, the evaluation showed that the CC2 provided coveted new spaces and opportunities for people to get together and discuss their concerns and the potential for future development in their villages outside the boundaries and formalities of religious and customary groups.59 This new space offered different forms of interaction, new opportunities to discuss and express opinions and ideas, informally, yet without being “pointless gossip sessions”, as articulated by a group of women in Panembong Village, Garut, West Java.60 It may also be argued that there was a need for such alternative spaces for the marginalized, considering that the formal village planning and development arenas were largely closed to the majority of villagers.61
When first arriving in the villages, the facilitators struggled with explaining the project objectives to the communities. There was a need to transform people’s thinking about creativity, theater and video as mere entertainment rather than as tools for influence in development processes.62 The facilitator had to guide the group through a cycle from social analysis to story development, presentations and post-presentation follow-up activities to showcase how theater and video can be used as ways to express opinions and influence decision-making. The strength of the process is found in the journey made by the participants from technical knowledge about media and social analysis to gradual awareness about issues in the village and one’s ability to exercise influence, and to the experience of being an active participant in village development. For example, in Ngabheo Village following visual research and brainstorming about issues facing the village, the facilitator guided the group through video making about the lives of one of the poorest families in the village. The processes sparked them to initiate a fundraising campaign for the family, which was also documented in the video. One of the female members of the
58 Creative Communities II Phase 1 Extension Qualitative Baseline Study: Summary Report. Draft 4. PSF. March 2015
59 CC2 Phase 1 Extension Case Studies from Barang Village, NTT; Panembong Village, West Java; Pengotan Village, Bali
60 Creative Communities 2 Compilation of Case Studies. 2015. Agung Haryanto. “Case Study from Panembomg Village, Garut, West Java.” Jakarta: Yayasan Kelola/PSF.
61 With the exception of Manubhara and Ngabheo Villages, Nada, NTT, where collected attendance data showed that village meetings where held with broad participation.
62 E.g. Facilitators reflections for Bali and NTT and Mid term Evaluations West Java
63 Creative Communities 2 Compilation of Case Studies. 2015. Agung Haryanto. “Case Study from Panembong Village, West Java.” Jakarta: Yayasan Kelola/PSF.
Creative Communities 2 Project Completion Report
30 Outcomes
New Space for Women in Panembong, West Java, to Talk about Being Women
Women in the Participatory Video Community in Panembong, Garut, West Java, were used to meeting weekly for religious
activities (pengajian). However, with the Creative Communities Project they realized that they had missed an opportunity to get
together informally and talk about issues. After analyzing their lives within the village, they decided to make a film about their
work burdens as women, mothers and wives. They were nervous at first because they knew their roles as women and a wives
were largely defined by religion beyond critique and questioning. However, when they started they realized how they shared
their heavy loads with other women. When they returned home to their husbands after a day of film making, they told their
husbands what they were working on, and it created an opportunity to also talk to their husbands about things they hadn’t
shared before. 63
community said they had always known about the family’s misery but that she rarely thought there was something she could do for them.64 Later the community members independently took the initiative to document the life of a man living with disabilities working as a cleaner at the local market. They had seen the man there every day for as long as they could remember, but they had never previously felt a responsibility to advocate for the rights of people with disabilities.65 66
“People who appeared in videos, especially those telling stories about the struggles in life, felt sad seeing themselves, but also
happy because many people could understand their real suffering and hopefully pay attention. On the other hand, many people
who watched the videos said they didn’t know that people lived like that, because the most marginal people live out in the
vegetable gardens.”67
Both active members of the creative communities and people in the audience noted that the theater and videos brought things that people saw every day to a screen or stage – a mirror was held up for the community to see themselves – which made people reflect and question things usually taken for granted.68 There seems to have been particularly high leverage for issues of people living with disabilities, wrong targeting of government welfare programs,69 teen pregnancies70 and women turning to domestic work overseas to improve their family economy.71 In addition, development needs (e.g. health, water, sanitation and education) and village development potential (e.g. agriculture, handicrafts, traditional music) were addressed.
The videos were made by, for and about the communities and the facilitators were instructed not to interfere with the stories. Issues were chosen after a social analysis or brainstorming processes to identify root causes of development challenges. Figure 7 shows an example of a problem tree analysis developed by the Creative Community in Berangbang Village, Bali.
64 MEL Specialist interview with Ngabheo CCG Member, February 2015
65 Ibid.
66 Creative Communities 2 Compilation of Case Studies. 2015. Agung Haryanto. “Case Study from Ngabheo Village, Nada, NTT.” Jakarta: Yayasan Kelola/PSF.
67 Facilitator, Maubhara FGD Report, February 2015
68 E.g. Case studies, Facilitator Reflection, FGD reports from Facilitators.
69 E.g. Ngabheo, Cimeumal, Sukamulya villages
70 E.g. Cimeumal, Panji, Pengotan
71 E.g. Sukamulya, Cimeumal
Creative Communities 2 Project Completion Report
31Outcomes
Figure 5 - Problem Tree Analysis from Berangbang Village, Bali
POHON MASALAH KK BERANGBANG
MUDA-MUDITIDAK KOMPAK
BALAPAN LIARDAN MABUK
JUDIJADI KEBIASAAN
TIDAK ADAFASILITAS KEGIATAN
MUDA-MUDI
LAPANGANPEKERJAANTIDAK ADA
KURANG FASILITASPENDIDIKANNONFORMAL
PAMONG DESAKURANG PEDULI
HUTAN DANLINGKUNGAN
RUSAK
PENGELOLAANAIR TIDAK BAIK
PARTISIPASIMASYARAKATSANGAT KECIL
PENERANGANJALAN TIDAK
MEMADAI
BUANG SAMPAHSEMBARANGAN
LINGKUNGANKOTOR
KEKERINGANDAN KURANG
AIR BERSIH
The root cause of problems in Barengbang village was identi�ed as “non-caring village government”, which consequently led to environmental degradation, lack of water and non-formal education. The latter caused lack of jobs, which again caused moral and social degradation of the village youth, who engaged in gambling, drinking and wild driving.
The root cause of problems in Barengbang village was identified as “non-caring village government”, which consequently led to environmental degradation, lack of water and non-formal education. The latter caused lack of jobs, which again caused moral and social degradation of the village youth, who engaged in gambling, drinking and wild driving.
There is a risk that the media – theater or video –influenced the groups decisions about which issues to raise. For example, in one village the story about a rape was left out in a video about a woman because it was too sensitive; the sales of land in relation to a new airport was not dealt with due to fear of controversy if filmed. Asking the question: “what are our main challenges?” is quite different than asking: “what should we make theater or video about?” Not giving too much attention to the media, which are mere tools of communication, but to allow communities’ development priorities to dictate the most effective and appropriate formats of advocacy is important, and to provide advice and support to communities on how to address particularly sensitive issues or issues that require different means of advocacy.
The researcher of the case study of Cimeumal argued that the women involved in a theater performance were not being critical about the double burden of poor women who choose to travel overseas as domestic workers to care for their family finances, while at the same time they must feel guilty when the family they leave behind falls apart. The researcher argued that although aware of the imbalance of these gender roles, their performance did not bring the audience to a conclusion about solutions but chose to leave the performance on an open ending.72 There was also a tendency, in theater especially, to focus on family tragedy, gambling, drinking, pregnancy out of wedlock, which may have played to the potential of theater as a media of entertainment, rather than its potential to influence decision-making in a development process.
In Pengotan Village, Bali, where the theater performance raised the issue of teen pregnancies. The performance did not offer solutions to the problem. Local leaders took the performance as confirmation that the village legislation about
72 Creative Communities 2 Compilation of Case Studies. 2015. Sri Kuncoro. “Salah Saha – Exploring the Burdens of Women in Poverty on Stage, A Case Study from Caringin Wetan Village, Sukabumi, West Java.” Jakarta: Yayasan Kelola/PSF
Creative Communities 2 Project Completion Report
32 Outcomes
the issue was a priority for the community,73 although nowhere in the theater play was it recommended that the issue should be regulated by law.
In future it is recommended that the project take more strategic approaches that brings the creative communities towards higher levels of participation where they have influence in decision-making, which requires also the expression of desired solutions and recommendations. In the creative process, the communities should also consider the potential and limitations of the media (e.g. video and theater) and consider using alternative ways of expression when required. This requires strategies that bring the project outputs from performance to influence, which is also the highest level of achieving the project’s goal of active participation.
Active Participation
The project’s definition of “active participation" recognizes that meaningful participation goes beyond attendance, and encompasses the need for knowledge about development processes, motivation to participate, access to processes and opportunity to actually influence decision-making. However since the evaluation covered a short six-month period of the project, the evaluation team started out with cautious optimism about what could possibly be expected in terms of participation in such short a short time. Nevertheless, the evaluation found some remarkable results that illustrate the short-term effectiveness of creative approaches. However, a longer timeframe for the project could potentially make the short-term achievements more sustainable.
73 Kelola Foundation. 2015. Creative Communities 2 Compilation of Case Studies. Diya S. Widuri. “Case Study from Pengotan Village, Bali.” Jakarta: Yayasan Kelola/PSF.
Creative Communities 2 Project Completion Report
33Outcomes
Knowledge about PNPM and Other Development Processes
The increased knowledge about PNPM and other village planning and development processes was included as a key performance indicator (KPI) for the project. Knowledge about development processes is considered a pre-requisite for active participation in the project’s theory of change. 53% of all participants74 (42% of youth) reported to have gained increased knowledge as a result of the project (Figure 8). On the other hand, a high 30% of the members did not know how to answer a question about whether or not their knowledge of PNPM and other development processes had increased after participating in the project. The latter indicates that more can be done to achieve this indicator. During Phase 1, the project had some success in integrating its activities directly with PNPM processes at the village and sub-district levels. This made Phase 1 more effective in generating higher attendance of people at these meetings and increased awareness about PNPM processes. However during CC2 Phase 1 Extension, PNPM was already going through a transition to the Village Law model, which dramatically reduced PNPM activities in many villages. To remain relevant to the reality of development processes in the villages, the project needed to shift its focus from PNPM to village government planning processes, specifically the village planning for 2015 (Musrembangdes 2015) held in early 2015. In theory, CC2 could have linked in directly with Musrembangdes, support village government in rasing awareness about this meeting and offer its services to the village government in creating cultural events to increase participation at the planning meting. However, such a shift was challenging because of the projects function as a PNPM support project. Another challenge was the short timeframe of the project in each village (3 months). Ideally, the opportunity for the project provided by the Musrembangdes should have been identified at the outset, however the project teams were still making attempts to work alongside a less potent PNPM.
A recommendation for future projects is to start out by developing specific joint strategies between communities and village government under the new village law to generate knowledge about ongoing development processes in the village, and to identify opportunities for the Creative Community project participants to effectively link in with these processes.
Figure 6 - CCG core members' perceptions about whether their knowledge on PNPM and other village planning and development processes increased
0
10
20
30
40
50
60
70
Yes
No
Don’t know
Specific strategies to increase knowledge are needed especially for youth and the marginalized groups who would have less knowledge about formal development processes at the outset. Field facilitators and Kelola management also require a relatively high level understanding of the development processes relevant to the project’s goals and objectives.
74 42.3% of participants between 14-17 reported an increase in knowledge about PNPM and other village planning and development processes, but 44% stated they did not know whether their knowledge increased or not. 42.4% of unmarried under 35 stated they had increased knowledge with 37.8% saying they did not know. 46.8 of all below 35 years old said they had their knowledge increased with 35% not knowing.
Creative Communities 2 Project Completion Report
34 Outcomes
Motivation to Participate in PNPM and Development Processes
The perception survey found that CCG members’ perceptions about themselves as active participants in the community have changed over time with their participation in the project. Figure 9 shows what core CCG members perceive that they did when there were problems or complaints in the community before the CC2 and what they perceive they do now after the CC2.
Figure 7 - CCG core members' perceptions about what they would do when there was a problem or complaint in the village before and after CC2
Do nothingDiscuss with friend/neig
hbors
Bring to community
meetingOther Don't know
Before CC 53.08 22.41 9.62 4.81 10.08After CC 6.02 39.1 31.28 18.05 5.56
0
10
20
30
40
50
60
Perc
enta
ge
The figure shows that 53% said that they used to do nothing to respond to complaints or problems before the project. Only 6% said that also after the project they do nothing. There was a significant increase in people’s perception that now after being active in CCGs, they will bring complaints and problems into discussions with friends and neighbors, into community meetings or find other ways to address the problems.
This is an indicator that the creative community members conceptually linked the project activities to their own participation in the community. It also shows that the direct participants in creative communities perceive themselves to have gone from more passive to more active members of the community as a result of the CC2 project.
Near 70% of CCG members said they are now more motivated to participate actively in community meetings compared to 6 months ago (Figure 10). In NTT and West Java around 80% reported they were now more motivated than before. Only 46% of the respondents in Bali said the same, and more people in Bali stated they did not know. This is again likely due to the inactivity of PNPM in Bali, where PNPM Rural has closed its operations, which natural caused challenges in creating synergies and conceptual links between CC2, PNPM and other development processes in Bali.
However all in all, CEP shows signs of being an effective tool to motivate the marginal and poor to participate actively in development processes, also because it brings people through an experience of participation that transforms people’s notions about their ability to participate.
Creative Communities 2 Project Completion Report
35Outcomes
Figure 8 - CCG core members' perceptions about their motivation to participate in village meetings compared with six months earlier
45.87
83.6378.73
69.62
10.555.31
11.76 9.5
43.58
11.06 9.5
21.2
0
10
20
30
40
50
60
70
8090
Bali West Java NTT Total
Yes No Don't know
“Experience” was central to the CEP processes. Being active in the creative journey together with peers increased participants’ knowledge and awareness about the situation in the village. From there grew their motivation to express their ideas and opinions. The creative processes provides opportunities to access and influence development processes by way of cultural expressions and events. Experience shows that participants were often confused at first about the objectives of the project, however by following a cycle from first meeting to joint social analysis, story making and performances or video screenings, the participants experienced several “revelations” leading to “enlightenment”, i.e. transformed perceptions about their ability to participate actively. Figure 11 shows that most CCG core members could see how CCGs could be used in the community to support development processes and express problems and potential, relative to those who saw the groups as tools to document customary (adat) practices, entertain, build tourism potential and revive arts.
The CCGs offered a new way of getting together to talk abut issues in the community, where the marginal were given status as equals. The performances and screenings created new space for communities to express themselves and interact directly with PNPM and village representatives.
Figure 9 - CCG core members' perceptions about what CCGs can be used for in the community (Percentage)
05
1015202530354045
Creative Communities 2 Project Completion Report
36 Outcomes
Access to PNPM and Development Processes
The CC2 evaluation was conducted too soon to record long-term effects of the project in terms of attendance and participation in PNPM and other development processes. In measuring short term impact on attendance following CC2 Phase 1 Extension, the disruption to PNPM Rural's delivery owing to the ongoing “transition” of PNPM towards implementation of the Village Law, and a lengthy period of “stalemate” between Ministry of Home Affairs and the new Ministry of Villages—unforeseen at the time of CC2 design—has meant that (i) there have been few or no PNPM processes taking place in project locations over the implementation extension period (September 2014 – March 2015) and (ii) there has been little recording of routine PNPM Rural administrative data, making the CC2 project effects on PNPM highly difficult to measure. Efforts were made to collect available data in all 24 CEP villages to measure CC2’s impact on attendance at PNPM and other formal processes, however comparable pre and post data that showed any significant change in participation before and after the project were only found in two villages. In Golo Wua Village, NTT, there was an increase in the annual village planning meeting (Musrembangdes) attendance in January 2015 compared with the year before. A member of the village government stated that the increase was partly due to CC2. He also said that women from the CCG were active at the meeting and proposed water and sanitation facilities in line with the theme they documented in their video.75 In Manubhara, on the other hand, attendance at Musrembangdes 2015 dropped significantly compared to 2014. The head of the village made a statement on social media blaming CC2 for negatively impacting attendance at community meetings.76 77 This statement was contested by the KPK and facilitators in Manubhara, who claimed that people in general were unsatisfied with the state of affairs in the village, which caused them to not attend. The KPK reported that CCG members did attend, and proposed new policies for people living with disabilities, which was one of the themes addressed in a video.78
In other words, the evaluation of CC2 Phase 1 Extension found little evidence of the project direct impact on attendance in PNPM or other village development processes. The baseline79 already predicted this in its conclusion. Although PNPM meetings were intended as open and inclusive, they were in fact closed because the minimum requirement of 40 participants at each meeting was treated as a maximum regulated through targeted invitations of village leaders and members of the elite. In future creative community projects, the assessments should provide information on which processes can in fact be influenced. In the case of CC2 and PNPM, dusun or RT and RW level meetings tended to be more open for broader participation than village level meetings. Overall, a focus on improved community representation would have been more effective than attempting to increase attendance.
Contrary to in Phase 1, there is little evidence to support claims that CEP activities during the Extension succeeded in opening access to formal PNPM and other development processes, the project nevertheless succeeded in creating new, alternative arenas, namely during theater performances and video screenings. Follow-up FGDs with stakeholders, were women, youth, the poor and marginal were also held that provided additional opportunities for community members to express their opinions and concerns to people in position. This was important to the participants’ experience of being active members of the community, which might be an important step towards more formal participation in the future.
Control or Influence over PNPM and Development Decision-making
As respondents in the perception survey, heads of Villages (90%) and village level PNPM workers (81%) were optimistic that the issues raised in theater or video performances would be followed-up within formal development processes because they recognized how the issues were generated through broad participation from the communities in line with the community’s aspirations. At the time of the evaluation, activities were still ongoing, and there were only anecdotal evidence to support that the CCGs were in fact able to influence PNPM and other formal development processes, for example:
75 Interview with a Village Government member by Golo Wua Field Facilitator on request from the MEL Team, March 2015
76 Facebook Status, February 23 at 11:41 AM
77 The Manubhara Head of Village was not available for interview when the MEL Specialist visited the village in January 2015.
78 MEL Specialist’s phone interview with Manubhara KPK, March 2015
79 PSF. 2015. Creative Communities II Phase 1 Extension Qualitative Baseline Study: Summary Report. Draft 4. PSF. March 2015
Creative Communities 2 Project Completion Report
37Outcomes
• Members of the creative community in Manubhara, NTT, made suggestions to improve the lives of people living with disabilities at the Village Planning meeting (Musrembangdes) in January 2015
• The CCG in Ngabheo, NTT, made a film about the lives of one of the poorest families and organized a fundraising campaign. The head of the village suggested the community consider torevive traditional mechanisms to care for the poor.
• In line with the CCG video production in Golo Wua, NTT, women from the creative community proposed water and sanitation facilitates during the village planning (Murembangdes).
• In Panji Village, Bali, the play developed by the CCG discussed how the development of new, modern housing complexes near the village cut off children’s access to school and strained the community’s access to water. The developer became angry at first, but at the time of the evaluation the community were in dialogue about how to find solutions.
• In Pengotan village, Bali, the theater performance raised the issue of teenage marriage. Village leaders stated they were reminded that to develop village legislations about this issue, even though it was not suggested as a solution by the CCG through the play.
• In Berambang Village, Bali, two issues were raised through the CCG plays, i.e. bad lighting on certain road sections and the bad quality of village road. The local government swiftly acted on the problems portrayed and improved the road condition with renovation works and villagers collectively put in place lighting in the badly lit areas of the village.
To fully capture the projects impact on village policies and long-term changes in participation of the marginalized require a longitudinal study beyond the scope of this evaluation. Findings do suggest again that Creative Communities projects in the future that apply more strategic approaches towards influence over decision-making have the potential to give marginal, poor, women and youth opportunities to influence village development. Strategies may include way to ensure synergy with formal development processes and more strategic plans of action to stimulate social and political change, beyond the limitations of creative medias, e.g. theater and video.
CC2, PNPM and Village Government Collaboration
Significant efforts were put into collaboration and coordination with PNPM at all levels. The model of coordination is shown in Figure 12.
Figure 10 - Model of PNPM - CC2 Coordination
National Level The World Bank/PSF PMD
Yayasan Kelola PNPM Provincial & District staff and BPMPD
CC II Facilitators PNPM Sub-district Facilitators
PNPM Village Actors
(Activity Implementation Team, Village
Community Empowerment Cadres, etc)Creative Communities Group
Community Members, including the poor and marginalized
Provincial/Kabupaten(District) Level
Kacamatan(Sub-district) Level
Village Level
Creative Communities 2 Project Completion Report
38 Outcomes
PNPM workers participated directly as members in the CC Group. In eight villages 80, the KPKs were current or former PMPM officials, and current or former PNPM workers were active CCG members in several villages. PNPM staff played an important role in the targeting of CC members. They knew the communities well, and CC2 could take advantage of their strong networks, both at grassroots and village and sub-district levels government and PNPM. If not directly involved as KPK or CCG members, PNPM staff were invited to social analysis sessions and other events where issues were explored, where they played important role as co-facilitators or contributors of the process. Such direct PNPM participation helped align key messages with PNPM messages for health, sanitation, education and development more broadly.81
PNPM and government officials showed support to theater performances and video screenings. At the main performances and video screenings, PNPM and government officials attended and held speeches in support of the creative communities. They praised the CCGs for raising awareness about the potential and challenges in a village, and for offering critique to improve the situation in the village. Community leaders also highlighted the potential of cultural expressions in placing the village on the map both for tourism and development of other livelihoods opportunities.82
“The Creative Approach is very effective in getting many people to participate. We don’t have this level of participation at our PNPM activities.” – PNPM FK, West Java
“This project is about increasing traditional values, decreasing stupidity and poverty and increase the capacity of the community.” - Head of village Manukaya Village, Bali
“This project can make Panji more developed. The point is to be critical for the sake of development. The youth involved in this theater can bring the name of Panji Village to the world.” - Village Secretary, Panji Village, Bali
“We thought that only people in Jakarta could make TV. No we can do it for us and by us. Farmers can also edit! We can show that walking ants can achieve more than sleeping cattle.” - Head of Village Ngabheo.
“With the activities of Creative Communities in Rianggede, our eyes have been opened and we understand better the aspirations of our community. The CCG members have changed. Before they didn’t voice their concerns, now they are brave enough to express what they want.” – Mr. Dewa Putu Arya, Head of Village Rianggede83
Handover of CC2 outputs to PNPM and village government: Videos, problem tree analysis, synopsis of theater plays were submitted to government and PNPM officials at village, sub-district and district levels at the end of the facilitators stay. Follow up actions to the themes raised were discussed, as well as the future role of CCGs in the villages.
During Phase 1, thanks to active engagement with village level PNPM workers, the project had success in some locations at integrating CC2 activities with PNPM, which resulted in significant increases in PNPM attendance in some villages. During the Extension, although the CC2 had the formal backing of the PMD, PNPM activities at village level were defined by the PNPM transition towards the new village law. This made direct integration of activities challenging and in many village impossible. Short timeframes set after the restructuring of the project in June 2014, hindered joint planning with PNPM and village government at village level. Future creative communities projects should allow sufficient time for such joint planning, as lessons from CC2 demonstrates how integration with formal development processes makes creative approaches to stimulate active participation of the marginalized more effective and efficient.
80 West Java (4): Cikoneng, Garawangi, Cililin, Panembong; Bali (2): Bongkasa Pertiwi, Budakeling; NTT: Lento, Manubhara
81 E.g. Laporan Akhir Fasilitator Video, Golowangkung, NTT, January 2015. P.3
82 E.g. Village Secretary (Sekdes) in an opening speech to the Theater Performance in Panji Village, January 14, 2015
83 “Dengan keberadaan KK di Rianggede mata kami lebih terbuka dan bisa lebih mamahami kemauan dari masyarakat desa kami. Karena mereka (peserta KK, red.) sudah banyak mengalami perubahan, di mana masyarakat yang dulu tidak berani bersuara atau menyampaikan segala permasalahan kini mereka sudah berani untuk mengutarakan apa keinginannya” Head of village Rianggede, Mr. Dewa Putu Arya
Creative Communities 2 Project Completion Report
39Outcomes
CAPACITY BUILDING AND TRANSFER OF FACILITATION SKILLS
Village Level PNPM Facilitators
The continued capacity of community facilitators' ability to use creative approaches in development was identified as a pathway in the project’s theory of change. Through the use of creative approaches in village development processes in the future, it is believed that the marginal, poor, women and youth would have more opportunities for active participation. This involved raising the capacity of PNPM facilitators in the use of creative approaches.
The perception survey showed that an overwhelming majority of village level PNPM workers (KPMD and TPKs) and heads of villages interviewed for the perception survey were positive about the effectiveness of creative approaches. As mentioned above 81% of PNPM workers and 91% of Villages Heads were optimistic that the issues raised in performances and videos would be followed-up because the issues were generated through broad participation, in a way that was easy to understand, and because the issues truly represented people’s aspirations.
94% of PNPM workers and 96% of Village Heads stated that they wanted to use creative approaches in future village planning and development processes because the communities were more open, confident and able to express themselves and it creates broader participation.
79% of PNPM facilitators were confident that they had the skills needed to use creative approaches in the future. This confidence was less in theater villages (63%), where the outputs are less tangible compared to participatory video and where the process may be more difficult to link conceptually to participation in development processes. The highest level of confidence was found in NTT (94%), which is surprising as it was assumed that the technological learning curve for video would be steeper in more remote areas without electricity.
Despite optimism, a key obstacle to transfer of skills and a change in facilitation techniques in future government development programs is that the SOPs may not be aligned with the time and resources required to implement creative approaches. Large government development programs tend to be bureaucratic and hierarchal and if not
Creative Communities 2 Project Completion Report
40 Outcomes
incorporated in formal management and accountability structures, it is less likely that a program like CC2 will have a significant impact on how development processes are facilitated in the future. This was also articulated by a Sub-District PNPM Facilitator (FK) in West Java:
“Creative approaches are very effective in creating mass participation. We never achieve the same level of participation at formal PNPM meetings, where bureaucracy gets in the way of empowerment initiatives. The creative approaches could be very effective if adapted by the head of the organization within its punishment and rewards systems”. 84
Future Creative Communities activities linked with the new village law may be more flexible and have renewed opportunities to influence village representatives to use creative approaches, where village level champions can play important roles in integrating creative approaches in village level planning and development processes.
Capacity Building of KPK and Project Sustainability
All KPKs reported to have gained from participating in CC2. Video KPK highlighted new technical skills, whereas Theater KPKs gained most facilitation skills. Male KPKs were most positive about what they gained, compared to female KPKs, and KPKs with higher education gained more than those with low education, which may reflect KPKs inputs to the projects formal TOTs for Facilitators and KPKs that often were perceived by the KPKs to be too technical and advanced for people with little experience with theater and video and facilitation skills in general.85
53% of theater KPKs and 47% of video KPKs anticipated challenges when expected to carry on with Creative Communities after the facilitators’ departure from the villages. The more educated KPKs had more worries than those with lower education. All Video KPKs were worried that the technical equipment provided would malfunction in the future. All KPKs were optimistic that Creative Community activities would continue after the facilitators’ departures.
88% of KPKs felt that their participation in the project as KPK had a positive impact on how they are perceived in the community. For examples, they felt that the community had become more comfortable in sharing their opinions and they gained more trust and respect in the community. The latter would have a positive impact on KPKs that also serve as village facilitators, and their ability to carry out their duties or work as facilitators of development in the future.
4% of the KPKs experienced negative sanctions, for example envy from other village officials. The remaining 8% did not feel any difference in how they were perceived by the community after CC2.
84 MEL Specialist interview with a PNPM sub-district facilitator (FK) in West Java, February 8, 2015
85 TOT Evaluations, June 2014, November 2014.
Creative Communities 2 Project Completion Report
41Outcomes
CEP and The Risks of Adverse Effects
Development programs introduce resources to the community and typically challenges patterns of power and influence over decision-making processes. Therefore, development programs are often contentious by nature.86 Although most heads of villages reported no negative effects from the CEP process in the village, two mentioned that the CEP process took too much time away from children/youths study time; one head of village stated that there was garbage left behind after performances. Three heads of villages said that people were offended by the theater performances or videos.87
Case studies, facilitators’ reflections and observations show that tension may occur more frequently than the survey suggested. In some villages tensions emerged between the Creative Community Groups and the Village Heads. Lack of coordination and communication between the facilitator, KPK and village government caused some tension in some villages.88 Other Village Heads questioned the legitimacy of the CCG and failed to see the intended links between CC2 and PNPM processes, which would have been avoided with more direct synergy with formal PNPM processes.89
In Panji village, the developer of a new housing project was offended when he realized the CCG was rehearsing a play about water difficulties and children’s cut-off access to school as a result of their business. In Ngabheo village, the documentation of a poor household, which led to a community fundraising effort, generated some frustration by other disadvantaged villagers, who did not receive any attention and aid. This potentially placed the poor family that received support in a more vulnerable position as a consequence of their participation in a video. In Sukamulya village, the Village Head ordered security guards to be present at the theater performance because he feared unrest when communities complaints about the targeting in government initiatives for the poor.90 Such unrest did not occur,
86 Barron, P., Diprose, R. and M. Woolcock. 2011. Contesting development: participatory projects and local conflict dynamics in Indonesia. Yale Agrarian Studies Series. Yale University Press, Ithaca.
87 From Survey Findings: Pengotan Village: “some audiences felt embarrassed”; Golowangkung Village: “afraid that the CC activities revealed mis-administration of the government project such as Raskin (rice for the poor) that was distributed equally to each household”; Unknown village: “perception that the project just want to video people activities for the project’s own interest because the video equipment belongs to Yayasan Kelola”.
88 Creative Communities 2 Compilation of Case Studies. 2015. Agung Haryanto. “Case Study from Panembong Village, Garut, West Java.” Jakarta: Yayasan Kelola/PSF.
89 E.g. Interview with head of village in Waling and Barang, NTT
90 Kelola Foundation. 2015. Creative Communities 2 Compilation of Case Studies. Sri Kuncoro. “Experiencing narrative play in “Not My Desire” (Lain Kahayang Kuring), A Creative Community Case Study from Sukamulya Village, Cianjur District, West Java”. Jakarta: Yayasan Kelola/PSF.
Creative Communities 2 Project Completion Report
42 Outcomes
however, it shows the potential strength of Creative Communities in mobilizing communities but also the fears among people in power and the risk of tension and conflict.
Through the project, communities anticipated and gained access to video and computer equipment of high value by local standards. Few safeguards were in place, e.g. formal criteria and requirements for sustainable handover of such equipment. Such safeguards are needed to prevent misuse and tensions in the community. There were reports of misuse and tensions in one village in NTT directly linked to the use of equipment. Although this occurred only in one village, experience from other development interventions shows a risks of tension when resources are concerned. To avoid doing harm to the communities, appropriate strategies are required to ensure productive and sustainable handover of resources in ways that continue to benefit the marginalized.
Tension ran comparatively high in a village in NTT where the KPK and the Head of Village had been at odds prior to the project. Tension escalated during and partly as a direct result of the project triggered initially by lack of communication between the KPK and the Village Head at an early stage. The Village Head perceived the adult members of the creative community to be his opponents. Despite efforts to bring the parties together, the Village Head chose not to attend the video screening event, which was seen as a sign of continued tension. The case study from the village shows how the project became politicized along the existing patterns of tension and conflict in the community.91
Preparations and joint planning between the project and local village government is important to identify opportunities for synergies. Risks to the project should also be addressed at an earlier stage, considering that efforts to shift decision-making structures in the community and critique village leadership have a high likelihood of tension and conflict. Villages that have leaders that are truly committed to broad participation are ideal locations for future creative community projects.
LESSONS LEARNED FROM THE SUB-GRANTS COMPONENT
Six grants of IDR 80,000,000 were distributed during CC2 Phase 1 Extension (Bali (2), West Java (2), NTT (2)). Following a call for proposals six partners were identified, as shown in Table 6.
91 Creative Communities 2 Compilation of Case Studies. 2015. Agung Haryanto. “Case Study from Barang Village, NTT” Jakarta: Yayasan Kelola/PSF.
Creative Communities 2 Project Completion Report
43Outcomes
The recipients of grants were given three months to implement their plans. Kelola initially provided support for proposal development and briefing on reporting and financial requirements. Two facilitators (one for Bali and Flores and one for West Java) were recruited to support monitoring and field activities.
A three month time period of implementation of relatively ambitious proposals indicate that the grants component of the Phase 1 Extension was carried out on the assumption that Kelola would be able to identify local and grass roots organizations with the required capacity to deliver programs in the community while contributing to the overall goal of CC2. Experience shows that the sub-grantees could benefit from more capacity building on project design, management and community facilitation. It is recommended in the future to allow for longer time frames, appropriate capacity assessments and capacity building activities to uphold the projects accountability towards the communities. The project could make better use of opportunities to synergize capacity building of sub-grantees with CEP training activities.
The implementing partner of sub-grants should have the organizational structure in place to support sub-grants including partnership and capacity building expertise.
Three of the sub-grantees focused on socializing the new village law, whereas three focused on health messages. The latter had most opportunities for synergy with PNPM Generasi. The former generated support from government at village, sub-district and district levels.
Sub-grants proved effective in engaging community members directly in activities. Table 13 shows that 422 community members were direct participants in cultural activities, trainings and workshop. 54% were female.
Table 13 - Direct Participants in CC2 Phase 1 Extension sub-grants activities
Female Male Total
Total PNPM Girls Total PNPM Boys Total
Jatiwangi Art Factory, Bandorasa, Cilimus, Kuningan
18 N/A 7 23 N/A N/A 48
SAPA Institute, Cikawung, Tanjungsiang, Subang
63 2 N/A 17 N/A N/A 82
LITE Institute, Pakraman Sidembunut, Bangli 29 N/A N/A 80 N/A N/A 109
RBM-Taman Penasar Paras-Paros, Gianyar. 3 3 N/A 21 3 N/A 30
Papa Wiu, Soa, Ngada. 68 N/A N/A 24 N/A N/A 92
Komunitas Satu Tekad Wogo, Golewa, Ngada. 27 N/A 6 24 N/A 4 61
208 5 13 189 3 4 422
Female 226 Male 196 PNPM 8 Children 17
54% 46% 2% 4%
In addition, 3650 community members were counted as indirect participants for example as audience members at cultural performances and festivals. 418 cultural workers were involved in the sub-grant activities. This indicates that sub-grants were efficient, and shows potential for future creative community programs in combination with capacity building activities.
The evaluation shows that five out of six sub-grants where effectively implemented to increase community knowledge and motivation to participate. The evaluation saw signs that four of the partners also succeeded in creating new space where participants could discuss issues and express their ideas and concerns directly to authorities or relevant stakeholders. Only one of the grants was considered ineffective. The local partner did not have the capacity to develop the cultural activities using traditional music instruments from a cultural event to an arena of knowledge sharing and exchange of opinions and ideas.
Overall the evaluation concludes that the sub-grants were effective and efficient and contributes towards the goal of the CC2 project. However it is recommended in the future that partners’ capacity is assessed, and that capacity building for technical and facilitation skills is offered as needed.
Creative Communities 2 Project Completion Report
44 Outcomes
Sub-grants and Collaboration with PNPM and Government
Several opportunities were seen for sub-grants to support PNPM and other development processes in the villages. Especially in villages where sub-grantees focused on health education, productive links were formed with PNPM Generasi.
PNPM worked closely with sub-grants recipients in the villages to identify community marginalized community members. The target group for sub-grants activities coincided with PNPM Generasi beneficiaries, i.e. pregnant women and parents of children under 5. KPMDs provided guidance to sub-grantees about the poor and marginal community members that rarely participated in regular PNPM activities, or who needed additional support.
Village level PNPM officials also provided support in the development of key health messages to ensure that the messages were in line with official messages and the needs of the communities.
Sub-grants created alternative space for communities to meet with PNPM workers and government officials to raise their concerns and voice their opinions. This happened in four out of six sub-grants village, and was mostly seen in West Java where a local partner used community television to talk about woman and child health. The village government office and village health clinic (Posyandu) were transformed into television studios and a feature was made on women and child health, which allowed people to voice their concerns, ask questions and express their opinions that were addressed by village officials from PNPM Generasi and the government. Similar exchanges were created in three out of six sub-grant villages, and shows how sub-grants to creative approaches can be effective in allow people to participate actively in development processes.
In villages where sub-grantees focused on socialization of the new Village Law, the sub-grantees worked together with village government and sub-district and district level officials to develop key messages. Government officials participated actively in activities, and seized the opportunity to voice their aspirations for village development under the new legislation.
It may be argued that using creative approaches in socializing of key messages, which was the main objectives of all sub-grants, made collaboration with PNPM and village government less challenging than what we saw in the CEP process because sub-grantees provided a communication service, which was seen as a win-win scenario.
OPPORTUNITIES UNDER THE NEW VILLAGE LAW (UNDANG UNDANG REPUBLIK INDONESIA NOMOR 6 TAHUN 2014 TENTANG DESA)
The newly promulgated Village Law dramatically increases the role, responsibilities, power and resources of village communities. This law adopts a number of community- driven development approaches that have been developed and tested through PNPM programs. With the enactment of this law, PNPM is expected to go through a period of transition, to support the implementation of the law through the provision of facilitation and other technical support. The new law creates opportunities to integrate creative empowerment approaches into systems created by the law, particularly as a high level of community participation will be a vital precondition for ensuring that village funds are put to good use and are used effectively to meet local needs. The ability of all segments of the community, including poor members of the community and members of marginalized groups, to participate meaningfully in this process will be crucial. Thus, there is potential for future creative communities projects to play an important role in this process.
It is also envisaged that future projects, through its synergies within a larger DFAT project, can influence the design and implementation of national or regional programs linked to the new village law, encourage the use of other cultural resources to facilitate the implementation of community empowerment processes. In particular, future projects should focus on introducing the approaches and tools developed under the project into the village development planning processes. Given the massive investment that has been made in community empowerment programming through PNPM and other national and regional programs, and with the huge increase in funds that will flow to the village level under the Village Law, the use of such funds to promote approaches that facilitates the more effective engagement of communities on their own terms in village level development is an extremely valid investment at this point in the history of Indonesia’s community development programs.
Creative Communities 2 Project Completion Report
45Conclusions
CONCLUSIONS
• Creative approaches are highly effective in engaging and empowering the marginal, poor, women and youth. Participants in the project reported to have increased motivation to participate in formal development processes, increased self-esteem, better understanding of their village and right to participate and ability to express themselves. New, safe spaces were created to discuss ideas and concerns with peers and to interact directly with village leaders and other stakeholders. When integrated with formal development processes knowledge about village development and create opportunities for communities to access and influence decision-making.
• The use of cultural expressions and creative approaches in formal community planning processes generates community interest and breaks down formal power structures that stand as barriers to the participation of the marginalized. CC2 Phase 1 showed examples of how attendance at PNPM events increased as a direct result of the project. By offering a service to village government in attracting community members to formal meetings, creative communities could generate support for creative communities and increase leverage and opportunities for the marginal to voice their concerns.
• Barriers to the projects ability to directly support PNPM by directly impacting attendance and influencing facilitation skills of PNPM workers included PNPM’s capacity to engage directly with CC2 given the PNPM facilitators’ workloads, and the lack of formal instructions from the central government (Ministry of Home Affairs) to village level PNPM workers to engage with CC2. CC2 also did not succeed in mainstreaming creative approaches into PNPM SOPs aside from allowing the use of culture mediums in socializing PNPM in the revised PNPM Rural Technical and Operational Guidelines (PTO). Similar challenges may be anticipated when using creative communities in the future to support the implementation of the new village law.
• During CC2 Phase 1, the use of cultural activities in integration with formal PNPM meetings had a significant positive impact on increasing the attendance of community members who typically would not attend. Due to the PNPM transition such integration could not be replicated in the Extension. There is nevertheless evidence that the
Creative Communities 2 Project Completion Report
46 Conclusions
CEP process and sub-grants overall created new opportunities for community members to get together and discuss their ideas and concerns, and meet with village leaders and stakeholders to express their opinions. There is also anecdotal evidence that the CCG groups were able to directly influence decision making in some villages through their use of theater and video.
• For creative communities to have an impact on active participation on villagers in development processes joint planning between the project and village level stakeholders is necessary to create the integration required between the project and formal development processes. The lesson from CC2 is that sufficient time needs to be allocated to such joint planning. Where integration with formal village planning processes occurs, creative approaches are highly effective in increasing attendance at formal meetings, motivating people to participate, and in bringing the voices of the marginal and poor into decision-making processes.
• Creative approaches can be used to impact different levels of participation from attendance to knowledge about how to participate, motivation to participate, access to arenas of decision-making and control in the decision-making process. For a project that aims to increase communities’ ability to participate, it is important to define and operationalize the objectives of the project clearly, and select appropriate indicators to reflect the PDO. The CC2 PDO includes “active participation”. However, “increased attendance at PNPM meetings” as a KPI proved ineffective in measuring the real impact of the project on community empowerment given the gap between attendance and actual participation. The M&E plan for the Extension added indicators for empowerment to bridge this gap. In terms of influencing attendance, the evaluation shows that attendance at village level meetings was often closed and structured rather than open, and hence could not be easily influenced. The baseline highlighted a larger opportunity to impact attendance at sub-village level (i.e. dusun or RT/RW levels) or on improving quality of representation rather than mass attendance. Timely assessments and baselines can provide the information about the barriers and opportunities for active participation of the community needed to design effective project strategies.
• Development initiatives often aim to change dynamics of decision-making in a community by enabling more people to participate. Particular groups in the community may see this as a threat to their own access to resources. As such, development initiatives are political and often contentious92 . When implementing the CEP, CCGs may become a stakeholder positioned along the fault-lines of pre-existing tensions and conflicts in the communities. This was documented in case studies from e.g. Barang and Ngabheo Villages during the Extension. The CEP will likely be most effective in achieving influence over decision-making in villages that have leaders who are committed to broad and active participation. Management of the risk of potential backlashes against project participants with the involvement of village leaders is needed to ensure that no harm is done.
• When Creative Community Group (CCG) members have ownership of the mission and vision of the group, it is more likely that the group will without support after the project ends. Assessments at the outsight helps to identify key groups and individuals in the community that are likely to have a vision and mission for community engagement and/or creative skills. The evaluation of CC2 shows that in communities like Panji (Bali) and Malaka (Lombok) where the communities have a strong motivation driven by key members, they also have the ability to find resources needed to continue their activities independently. CC2 also adopted strategies to support CCGs in making future strategies and plans and the sharing between creative communities of different villages.
• The Evaluation of the CC2 Phase 1 Extension CEP showed that the lack of strategic engagement with formal development processes that could have increased the CCGs’ success in influencing policy and decision-making. Participatory social analysis generated issues and themes for video and theater, however too much focus on the media also influences the agenda, e.g. where issues not suited for video were left out or focus was issues causing family tragedy as that makes good theater. A more open ended approach to advocacy with less focus on pre-determined media and project driven video screenings and theater performances, would have allowed for a mapping of priorities and development of strategies for how to deal with the most important issues effectively. Linking these strategies directly to formal processes of village planning and decision-making would likely have
92 Barron, P., Diprose, R. and M. Woolcock. 2011. Contesting development: participatory projects and local conflict dynamics in Indonesia. Yale Agrarian Studies Series. Yale University Press, Ithaca.
Creative Communities 2 Project Completion Report
47Conclusions
increased their effectiveness in achieving higher levels of active participation.
• The strengthening of the main Grant Recipient (i.e. Kelola) for M&E led to a systematic analysis of the barriers to community participation linked to the articulation of the project’s theory of change and the design of logical frameworks and M&E plans that improved the management of project results during the Extension, and enabled the measuring and documentation of project impact. Such evidence based documentation allowed the project management to build a case for the effectiveness of creative approaches for future development initiatives, such as the implementation of the new village law.
• The CEP model implemented in CC2 is intensive and requires resources. Better integration with formal development processes will make the intervention more efficient, and will provide CCG members with insight into the workings of formal planning processes, and an experience in accessing and influencing decision-making that is likely to motivate more active participation in the future.
• Sub-granting is an effective modality to mobilize communities and socialize messages. Sub-grantees use of cultural events and activities created broad participation and opportunities to socialize messages about PNPM processes, health and the new village law. E.g. during the Phase 1 Extension, Lite Institute in Bali, engaged hundreds of local cultural workers (e.g. dancers, musicians and craftspeople) in a village festival that pulled a large audience to a socialization of the new village law. The most effective sub-grantees also succeeded in creating opportunities for communities to interact directly with PNPM workers or representatives of village government to address issues of concern. E.g. during Phase 1 Extension, Jatiwangi Art Factory (West Java) facilitated community members in making community television that allowed them to meet directly with PNPM Generasi and village leaders. The television production also brought the dialogue into people’s homes, which created new forms of dialogue about community health issues 93.
• The Sub-grant model is best implemented based on an understanding of partners’ capacity to deliver quality programs to the communities. Lessons from CC2 show that grassroots organizations, especially in remote areas, could benefit from capacity building, not only on administration, finance and report writing, but also community facilitation and technical skills. Implementation timeframes should allow for such capacity building activities with sub-grantees. Future capacity building of sub-grantees could be integrated with the CEP training to make effective use of training modules and materials developed for effective community facilitation.
93 Creative Communities 2 Evaluation Report on CC2 Phase 1 Extension Sub-grants (Annex 3)
Creative Communities 2 Project Completion Report
48 Key Recommendations
KEY RECOMMENDATIONSResult-based Management
1. Ensure that results-based management and M&E and learning frameworks are built into the project, for example, by using appropriate logical frameworks and indicators and incorporate a MEL plan into day-to-day management and implementation of the project. When working through an implementing partner, ensure the partner has effective project cycle and result-based management capacity.
Design
2. In the design phase, conduct an analysis of entry points and barriers to the project’s ability to influence formal development processes, both in terms of attempting to mainstream “creative approaches” within government at the national level, or for project participants to gain access to and influence over local development planning processes.
3. Articulate strategies for using Creative Communities activities for the communication of key messages as a service to authorities, and for community mobilization to build positive relations and leverage between its participants and village leaders.
4. Take a wider approach to the use of media (e.g. theater and video) in empowerment to stimulate active participation that leads to influence over decision-making processes. Key issues generated through a social analysis require strategy for how to best create a wanted change that benefits the marginalized. Too much focus on the media may lead to the question: What should we make theater/videos about? Rather than: what are our key challenges, and how to change them? The latter being the most relevant to active participation. Future projects should let the issues guide the making of effective strategies for wanted change.
Creative Communities 2 Project Completion Report
49Key Recommendations
5. Continue sub-grants as a modality to support local NGOs, CBOs and individuals. using creative approaches to stimulate broad participation. Allocate sufficient time and resources that allow for capacity assessments and the capacity building of sub-grantees to ensure that they are able to delivery high quality activities and results. The provider of sub-grants (in this case Kelola) needs to have “Partnership and Capacity Building Specialists” in their sub-grants management structure. Capacity building of sub-grants partners may integrate with CEP capacity building for community facilitators for increased efficiency.
Implementation
6. In the inception phase, conduct a timely baseline study to identify who are marginal and poor and barriers to and opportunities for participation to inform implementation strategies and facilitators’ manuals, and conduct village level assessments to identify people and groups that share a vision of community development, and community leaders committed to broad participation.
7. Start implementation with joint strategy and planning, including joint risk analysis, with authorities at all levels, including village level, to identify potential for integration of the project with specific formal development processes.
Creative Communities 2 Project Completion Report
50 Key Recommendations
CC2
PHA
SE 1
EXT
ENSI
ON
KEY
PER
FORM
AN
CE IN
DIC
ATO
RS
Key
Perf
orm
ance
Indi
cato
rsIn
dica
tor/
Uni
t of M
easu
reBa
selin
eTa
rget
Val
ueCu
mul
ativ
e Ac
hiev
emen
tsVA
RTa
rget
for
2015
*Ac
hiev
ed
in 2
015
VAR*
Rem
arks
Proj
ect D
evel
opm
ent O
bjec
tive:
To
impr
ove
the
abili
ty o
f vill
ager
s, es
peci
ally
poo
r and
mar
gina
lized
peo
ple,
to p
artic
ipat
e ac
tivel
y in
PNP
M p
roce
sses
usin
g cu
ltura
l exp
ress
ions
in p
roje
ct lo
catio
ns.
PDO
Lev
el R
esul
ts In
dica
tors
In
dica
tor O
ne: I
ncre
ase
in p
ublic
par
ticip
atio
n in
vill
age
plan
ning
pro
cess
es in
pro
ject
loca
tions
% in
crea
se in
PNP
M
part
icip
ants
PNPM
atte
ndan
ce
in lo
catio
n50
%N/
AN/
AN/
AN/
AN/
ACC
II w
as d
esig
ned
to su
ppor
t PNP
M R
ural
. How
ever
with
the
unex
pect
ed
chan
ge in
the
oper
atin
g en
viro
nmen
t i.e
. the
“tra
nsiti
on” o
f PNP
M R
ural
in
view
of V
illag
e La
w d
urin
g pr
ojec
t im
plem
enta
tion
perio
d, th
ere
wer
e fe
w
or n
o PN
PM a
ctiv
ities
in C
C II
loca
tions
. PNP
M a
ttend
ance
dat
a w
as a
lso n
ot
atta
inab
le. A
ttem
pts w
ere
mad
e to
use
par
ticip
atio
n in
oth
er v
illag
e pl
anni
ng
proc
esse
s as a
pro
xy b
ut d
ata
for t
hese
mee
tings
was
not
ava
ilabl
e.
Addi
tiona
l ind
icat
ors w
ere
used
inst
ead
to a
sses
s im
pact
on
mot
ivat
ion
of
part
icip
atio
n. Th
e be
nefic
iarie
s’ pe
rcep
tion
surv
ey fo
und
that
nea
rly 7
0%
of re
spon
dent
s fee
l mor
e m
otiv
ated
to p
artic
ipat
e in
com
mun
ity p
lann
ing
mee
ting
afte
r par
ticip
atin
g in
CC
II. W
hen
aske
d w
hat t
hey
wou
ld d
o w
hen
ther
e w
as a
pro
blem
or c
ompl
aint
in th
eir v
illag
e, 5
3% sa
id th
ey w
ould
do
not
hing
prio
r to
part
icip
atin
g in
CC
II an
d af
ter p
artic
ipat
ing
in C
C II
the
perc
enta
ge fe
ll to
6%
. On
the
othe
r han
d, th
ose
who
ans
wer
ed th
ey
wou
ld b
ring
the
prob
lem
to v
illag
e m
eetin
gs in
crea
sed
from
9.6
% p
rior t
o pa
rtic
ipat
ing
in C
C II
to 3
1.3%
pos
t CC2
.
% p
oor c
omm
unity
mem
bers
As a
bove
50%
N/A
N/A
N/A
N/A
N/A
% o
f wom
an p
artic
ipan
tsAs
abo
ve50
%N/
AN/
AN/
AN/
AN/
A
% o
f mar
gina
lized
par
ticip
ants
050
%N/
AN/
AN/
AN/
AN/
A
Indi
cato
r Tw
o: B
enefi
ciar
ies h
ave
incr
ease
d un
ders
tand
ing
of P
NPM
and
vill
age
plan
ning
pro
cess
.%
of b
enefi
ciar
ies
070
%53
%
-17%
N/A
53%
N/A
Whi
lst th
e hi
gh ta
rget
was
not
met
, the
ach
ieve
men
t of 5
3% in
crea
sed
unde
rsta
ndin
g of
PNP
M a
nd v
illag
e-pl
anni
ng p
roce
ss is
satis
fact
ory,
cons
ider
ing
the
prev
ailin
g ch
alle
nge
of th
e cl
osin
g of
PNP
M.
% o
f fem
ale
bene
ficia
ries
050
%55
%+5
%N/
AN/
AN/
A%
of y
outh
ben
efici
arie
s0
50%
42%
- 8
%N/
AN/
AN/
ATh
e va
rianc
e in
ach
ieve
men
t is l
ikel
y du
e to
the
lack
of P
NPM
act
iviti
es d
urin
g pr
ojec
t im
plem
enta
tion.
%
of m
argi
naliz
ed
bene
ficia
ries
050
%40
%- 1
0%N/
AN/
AN/
AAs
abo
ve
% o
f poo
r ben
efici
arie
s0
50%
45%
- 5%
N/
AN/
AN/
AAs
abo
ve#
peop
le tr
aine
d0
600
1531
+255
%N/
A80
3N/
ATh
e pr
ojec
t was
abl
e to
mob
ilize
man
y m
ore
com
mun
ity m
embe
rs th
an it
or
igin
ally
exp
ecte
d. In
tota
l, 110
9 pe
ople
wer
e tra
ined
in u
sing
thea
ter o
r vi
deo
to id
entif
y lo
cal i
ssue
s and
solu
tions
(Cre
ativ
e Em
pow
erm
ent P
roce
ss
or C
EP). T
his i
nclu
des r
egul
ar p
artic
ipan
ts o
f CEP
, fac
ilita
tors
, loca
l cad
res,
coor
dina
tors
and
supe
rviso
rs. M
ore
than
hal
f of w
hich
are
wom
en. A
furt
her
422
villa
gers
wer
e tra
ined
by
sub
gran
t rec
ipie
nts i
n us
ing
othe
r cre
ativ
e ex
pres
sions
to su
ppor
t com
mun
ity p
lann
ing.
In
dica
tor T
hree
: PNP
M fa
cilit
ator
s and
cultu
ral w
orke
rs h
ave
incr
ease
d ca
paci
ty to
use
cultu
ral m
ediu
ms t
o im
prov
e pa
rtic
ipat
ion
in v
illag
e pl
anni
ng
Creative Communities 2 Project Completion Report
51Key Recommendations
Trai
ning
mod
ule
and
tool
s fo
r PNP
M a
nd V
illag
e La
w
Impl
emen
tatio
n
0M
odul
e an
d to
ols
deve
lope
d
4 se
ts o
f m
odul
es a
nd
tool
s dev
elop
ed
N.A.
N/A
2 se
ts o
f m
odul
es
deve
lope
d
N/A
The
4 se
ts o
f tra
inin
g m
odul
es a
nd to
ols p
rodu
ced
are:
1. M
anua
l on
usin
g Th
eate
r for
Dev
elop
men
t for
com
mun
ity p
lann
ing.
2. M
anua
l on
usin
g Pa
rtic
ipat
ory V
ideo
for c
omm
unity
pla
nnin
g.3.
Tum
buh
dala
m L
ingk
aran
. Tra
inin
g m
odul
e ta
rget
ing
villa
ge fa
cilit
ator
s on
Crea
tive
Appr
oach
es to
Effe
ctiv
ely
Faci
litat
e Co
mm
unity
Pla
nnin
g (d
esig
ned
to su
ppor
t im
plem
enta
tion
of V
illag
e La
w)
4. M
enge
lola
Per
tum
buha
n –
Guid
elin
es fo
r Cre
ativ
e Co
mm
uniti
es o
n co
ntin
uing
and
exp
andi
ng th
eir a
ctiv
ities
to fa
cilit
ate
com
mun
ity p
lann
ing.
# cu
ltura
l wor
kers
040
013
11+3
28%
N/A
893
N/A
The
proj
ect a
ttrac
ted
and
mob
ilize
d fa
r mor
e cu
ltura
l wor
kers
than
exp
ecte
d at
the
villa
ge le
vel t
o pa
rtak
e in
its a
ctiv
ities
. At e
very
CC
II pr
esen
tatio
n, lo
cal
cultu
ral g
roup
s and
art
ists e
ither
per
form
ed a
long
side
CC II
par
ticip
ants
or
prov
ided
ent
erta
inm
ent p
rogr
ams.
Cultu
ral w
orke
rs h
ere
refe
r to
danc
ers,
mus
icia
ns, v
ideo
grap
hers
, and
thea
ter w
orke
rs in
volv
ed in
CC
II pr
oces
ses,
incl
udin
g pr
ojec
t fiel
d fa
cilit
ator
s, co
ordi
nato
rs, s
uper
viso
rs a
nd lo
cal c
adre
s.
CC2
PHA
SE 1
KEY
PER
FORM
AN
CE IN
DIC
ATO
RS
INTE
RMED
IATE
RES
ULTS
Proj
ect D
evel
opm
ent O
bjec
tive
(PDO
): To
impr
ove
the
abili
ty o
f vill
ager
s, es
peci
ally
poo
r and
mar
gina
lized
peo
ple,
to p
artic
ipat
e ac
tivel
y in
PNP
M p
roce
sses
usin
g cu
ltura
l exp
ress
ions
in p
roje
ct lo
catio
ns.
Inte
rmed
iate
Res
ult (
Com
pone
nt O
ne):
Com
mun
ity-b
ased
cultu
ral a
ctiv
ities
(Rec
ipie
nt-E
xecu
ted)
PDO
Lev
el R
esul
ts In
dica
tors
*Un
it of
Mea
sure
Base
line
Cum
ulat
ive
Targ
et V
alue
s**
Freq
uenc
yDa
ta S
ourc
e/M
etho
dolo
gyRe
spon
sibili
ty fo
r Da
ta C
olle
ctio
nD
escr
iptio
n (in
dica
tor
defin
ition
etc
.)Ye
ar 1
Year
2
Proj
ect d
evel
opm
ent c
ompl
eted
Stat
usN/
APr
ojec
t man
ual d
evel
oped
N/A
once
Proj
ect
repo
rts
Kelo
laSt
atus
of d
ocum
ent
Des
ign
mod
ifica
tions
test
edSt
atus
N/A
Pilo
t act
iviti
es st
arte
dPi
lot a
ctiv
ities
co
mpl
eted
once
Proj
ect
repo
rts
Kelo
laSt
atus
of a
ctiv
ities
Man
agem
ent t
eam
and
ope
ratio
nal s
truct
ure
esta
blish
ed fo
r ful
l im
plem
enta
tion
Stat
usN/
AM
anag
emen
t tea
m a
nd
oper
atio
nal s
truct
ure
esta
blish
ed
N/A
once
Proj
ect
repo
rts
Kelo
laSt
atus
of a
ctiv
ities
Inte
rmed
iate
Res
ult (
Com
pone
nt Tw
o):
Capa
city
bui
ldin
g (R
ecip
ient
-Exe
cute
d)
Trai
ners
are
trai
ned
for i
mpl
emen
ting
CC2
# of
trai
ners
040
80on
cePr
ojec
t re
port
sKe
lola
# of
trai
ners
trai
ned
to
impl
emen
t CC
II
*Tar
get v
alue
s sho
uld
be e
nter
ed fo
r the
yea
rs d
ata
will
be
avai
labl
e, n
ot n
eces
saril
y an
nual
ly
Creative Communities 2 Project Completion Report
52 References
REFERENCES
Barron, P., Diprose, R. and M. Woolcock. 2011. Contesting development: participatory projects and local conflict dynamics in Indonesia. Yale Agrarian Studies Series. Yale University Press, Ithaca
Gultom, M.L. Yohanna. 2013. Creative Communities Trial Program Final Evaluation. Jakarta: Yayasan Kelola/PSF Creative Communities
Kelola Foundation. 2015. Creative Communities 2 Compilation of Case Studies. Sri Kuncoro. “Experiencing narrative play in “Not My Desire” (Lain Kahayang Kuring), A Creative Community Case Study from Sukamulya Village, Cianjur District, West Java”. Jakarta: Yayasan Kelola/PSF
Kelola Foundation. 2015. Creative Communities 2 Compilation of Case Studies. Sri Kuncoro. “Salah Saha – Exploring the Burdens of Women in Poverty on Stage, A Case Study from Caringin Wetan Village, Sukabumi, West Java.” Jakarta: Yayasan Kelola/PSF
Kelola Foundation. 2015. Creative Communities 2 Compilation of Case Studies. Diya S. Widuri. “Case Study from Bongkasa Pertiwi Village, Bali.” Jakarta: Yayasan Kelola/PSF
Kelola Foundation. 2015. Creative Communities 2 Compilation of Case Studies. Diya S. Widuri. “Case Study from Pengotan Village, Bali.” Jakarta: Yayasan Kelola/PSF
Creative Communities 2 Compilation of Case Studies. 2015. Agung Haryanto. “Case Study from Panembong Village, Garut, West Java.” Jakarta: Yayasan Kelola/PSF
Kelola Foundation. 2015. Tumbuh dalam Lingkaran. Modul Fasiltiator Efektif dengan Pendekatan Kreatif. Jakarta: Yayasan Kelola
Kelola Foundation. 2014. Manual Pelatihan Fasiltiator Dan Kader Pemberdayaan Komunitas Kreatif. Jakarta: Yayasan Kelola/PSF Creative Communities 2
PSF. 2015. Creative Communities II Phase 1 Extension Qualitative Baseline Study: Summary Report. Draft 4. PSF. March 2015
PSF 2014. Creative Communities II. Phase 1 Progress Report. Jakarta: PNPM Support Facility. September 2014
World Bank. 1996. The Worldbank Participation Sourcebook. Washington DC: The International Bank for Reconstruction and Development.
Voss, J. 2008. PNPM Rural Baseline Project. Jakarta: The World Bank.
Voss, J. 2013. PNPM Rural Impact Evaluation April 2012. Jakarta, Indonesia. PNPM Support Facility.
World Bank. 2010. Marginalized Groups in PNPM Rural. Washington, DC: World Bank. http://documents.worldbank.org/curated/en/2010/06/15423996/ marginalized-groups-pnpm-rural.
Creative Communities 2 Project Completion Report
53List of Annexes
LIST OF ANNEXES
Available for download: http://psflibrary.org/collection/detail.php?id=7105
1. CC2 Phase 1 Extension Evaluation Methodology
2. CC2 Monitoring and Evaluation Framework (December 2014)
3. CC2 Phase 1 Extension Sub-Grant Evaluation Report
a. In English
b. In Bahasa Indonesia
4. CC2 Case Studies
a. In English
b. In Bahasa Indonesia
5. CC2 Phase 1 Extension Creative Empowerment Process Attendance Data
6. CC2 Phase 1 Extension Beneficiaries’ Perception Study Report
7. Kelola/PSF Reflection Workshop Summary Report, March 30, 2015
8. CC2 Phase 1 Extension Qualitative Baseline Study (March 2015)
9. CC2 Phase 1 Extension Secondary Data on PNPM and village meeting attendance