Evaluation of UNESCO Strategic Programme Objective...

94
Internal Oversight Service Evaluation Section IOS/EVS/PI/104 REV. Original: English Evaluation of UNESCO Strategic Programme Objective (SPO) 11 “Sustainably Protecting and Enhancing Cultural Heritage” External evaluation team: Dr. June Taboroff and Jehanne Phares with Dr. Julie Scott March 2010 The views and opinions expressed in this document are those of the author and do not necessarily represent the views of UNESCO or of the IOS. The designations employed and the presentation of material throughout this document do not imply the expression of any opinion whatsoever on the part of UNESCO concerning the legal status of any country, territory, city or area of its authorities, or concerning its frontiers or boundaries.

Transcript of Evaluation of UNESCO Strategic Programme Objective...

Page 1: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

Internal Oversight Service

Evaluation Section

IOS/EVS/PI/104 REV.

Original: English

Evaluation of UNESCO Strategic Programme Objective (SPO) 11

“Sustainably Protecting and Enhancing Cultural Heritage”

External evaluation team:

Dr. June Taboroff and Jehanne Phares with Dr. Julie Scott March 2010

The views and opinions expressed in this document are those of the author and do not necessarily represent the views of UNESCO or of the IOS. The designations employed and the presentation of material throughout this document do not imply the expression of any opinion whatsoever on the part of UNESCO concerning the legal status of any country, territory, city or area of its authorities, or concerning its frontiers or boundaries.

Page 2: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

TABLE OF CONTENTS

EXECUTIVE SUMMARY ............................................................................................................................ 1

1. EVALUATION PURPOSE AND METHODOLOGY............................................................................... 4

1.1. Purpose of the evaluation ..................................................................................................... 4 1.2. Scope of the evaluation......................................................................................................... 4 1.3. Evaluation methodology........................................................................................................ 5 1.4. Strengths and limitations ......................................................................................................5

2. UNESCO’S WORK IN CULTURE AND CULTURAL HERITAGE ............................................................ 7

3. MAJOR FINDINGS .........................................................................................................................12

3.1. Progress made towards achieving Expected Outcome 1 .................................................... 12 3.2. Progress made towards achieving Expected Outcome 2 .................................................... 18 3.3. Progress made towards achieving Expected Outcome 3 .................................................... 22 3.4. Progress made towards achieving Expected Outcome 4 .................................................... 23 3.5. UNESCO’s comparative advantages ....................................................................................27 3.6. Africa priority.......................................................................................................................28 3.7. Gender priority ....................................................................................................................29 3.8. Intersectoral and inter-disciplinary work ............................................................................31 3.9. Monitoring and reporting....................................................................................................32

4. KEY CONCLUSIONS AND RECOMMENDATIONS ...........................................................................34

Annex I Terms of Reference .............................................................................................................38

Annex II Evaluation Questions ......................................................................................................44

Annex III Evaluation Planning Matrix .............................................................................................45

Annex IV Work on the Conventions with examples .......................................................................48

Annex V Table of Projects analyzed ..............................................................................................50

Annex VI Questionnaire for UNESCO Culture staff ........................................................................63

Annex VII Questionnaire for External Partners ...............................................................................75

Annex VIII Assessment of Accra Field Office Intangible Heritage Activities.....................................81

Annex IX Operational Procedures and Practices in relation to Expected Outcomes.....................87

Annex X Documents Consulted .....................................................................................................89

Annex XI List of Interviewees .........................................................................................................90

LIST OF TABLES

Table 1 The three levels of working on the five Culture Conventions...........................................8

Table 2 Conventions by expected outcome, MLA and budget allocation, 34 C/5.........................9

Table 3 RP activities and budget allocations for the Field Office sample, 34 C/5 .......................10

Table 4 RP and EXB allocations to Bamako and Maputo, 33C/5 and 34C/5................................29

Page 3: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

PREFACE

The Evaluation Team would like to thank UNESCO Headquarters and Field Office staff,

especially the Reference Group and the Accra Field Office, for their assistance in providing

information for this evaluation. They also wish to acknowledge the insight provided by the

external experts who generously gave their time and expertise.

June Taboroff, Jehanne Phares and Julie Scott

Page 4: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

LIST OF ACRONYMS

CIS Commonwealth of Independent States

EXB Extrabudgetary

ICOM International Council of Museums

ICOMOS International Council on Monuments and Sites

ICCROM International Centre for the Conservation and Restoration of Monuments

IUCN International Union for the Conservation of Nature

MLA Main Line of Action

RP Regular Programme

SPO Strategic Programme Objective

UNODC United Nations Office on Drugs and Crime

WIPO World Intellectual Property Organization

Page 5: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

1

EXECUTIVE SUMMARY

As the United Nations agency designated to lead the field of culture and cultural heritage,

UNESCO enjoys an uncontested comparative advantage in supporting the protection and

enhancement of cultural heritage, an area of activity widely acknowledged as a flagship of the

Organization. This evaluation of UNESCO’s work in culture and cultural heritage has found that

UNESCO has established a significant degree of respect and goodwill for its work internationally

and in Member States. As the architect of five culture-related Conventions, UNESCO’s strengths

lie in its international stature, prestige, infrastructure and networks.

The brief of this evaluation was to assess progress towards achieving the expected outcomes of

SPO 11 and to examine how progress might be enhanced through improving programme policy,

design and delivery. Overall, the evaluation has concluded that progress towards the

achievement of the expected outcomes is modest, but some strategic action is taking place that

augurs well for the future.

The Sector has made considerable efforts to support Member States with the ratification and

implementation of the Culture Conventions. The evaluation team found a number of examples

of UNESCO having contributed to, or in the process of contributing to, integrating the

provisions of the five Conventions into national and local policies. This was particularly the case

for the World Heritage Convention and to lesser extents the Intangible Heritage Convention

and the Illicit Traffic Convention.

Most activities reviewed, however, as part of the evaluation did not focus on the kind of policy

work required to help States Parties integrate the conservation of cultural heritage into

national and local policies. Instead, many focused on the implementation of policies at the

programme/project level and were therefore expected to influence the policy level indirectly.

Less mature conventions in particular call for increased focus at the policy level because many

States Parties have not yet sufficiently incorporated provisions into their national policies and

strategies.

While the Culture Sector has given some attention to climate change and cities, primarily

through meetings and several publications, the evaluators did not find any case where national

policies or legislation were updated or where there was a clear link with UNESCO’s work. The

projects sampled for this evaluation paid scant attention to the global trends mentioned in

Expected Outcome 2. The evaluation also found that joint work with the Social and Human

Sciences Sector on these global trends of urbanization, migration, etc. is minimal.

Page 6: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

2

From the sample review, all Field Offices had conducted small-scale activities linked to the 1970

illicit traffic convention, mainly in relation to awareness raising. However, most activities

related to museum management, training for curators, etc. rather than international

cooperation. While progress overall is modest with respect to Expected Outcome 3, it can be

viewed as strategic, given recent efforts to engage with the private art market and

experimentation of a range of activities to raise awareness and influence legislation. There are

some examples of well designed activities, but the geographic scope is quite limited due to

resource constraints.

UNESCO’s museum programme has responded to corresponding needs in Member States with

a series of activities to support museums when exercising their educational role and developing

their educational messages. Decision-makers in the museum sector have recognized the

educational role of museums and cooperate with UNESCO in strengthening this educational

role. However, few initiatives were found that directly target the policy level of the museum

sector and attempt to help Member States anchor the educational role of museums in relevant

policies and strategies. There is little evidence that points to decision-makers in formal and

informal education paying heed to museums as a direct result of UNESCO intervention.

This evaluation report provides a number of recommendations intended to enhance UNESCO’s

actions in the domain of culture and cultural heritage, i.e. activities within the sphere of SPO 11.

The recommendations relate to:

– Developing a comprehensive, strategic and integrated approach to working on the

Culture Conventions that guides culture staff in their efforts to develop an optimal

mix between up-stream and down-stream activities

– Sharpening the focus of capacity development activities

– Supporting States Parties to Conventions to include emerging trends such as

urbanization, climate change and migration in their national culture conservation

policies

– Making full use of the reports on the implementation of the Conventions submitted

by States Parties to decide on the focus and type of support to be provided to them

– Taking a strategic decision with regard to the importance to be given to the

achievement of Expected Outcome 3, which relates to the development of new

forms of international cooperation to strengthen the application of the 1970

Convention on Illicit Trafficking

– Working more directly with the Education Sector of UNESCO and with education

sectors and relevant non-formal training institutions in Member States to ensure

that the role of museums is recognised within formal and non-formal education

programmes

Page 7: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

3

– Develop a coherent framework for the Culture Sector’s work in Africa

– Assess how gender equality issues could be addressed in the five Culture

Conventions when helping States Parties work on the implementation of the

Conventions at the policy and programme levels

– Further strengthen the development of UNESCO Country Programme Documents so

that they always reflect the Culture Sector’s strategic priorities for a given country

– Systematically assess progress made towards the achievement of the Expected

Outcomes of SPO 11.

Page 8: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

4

1. EVALUATION PURPOSE AND METHODOLOGY

1.1. Purpose of the evaluation

The evaluation of SPO 11 was called for in the 34 C/5 Evaluation Plan. As with all other SPO

evaluations, its purpose was to assess progress towards achieving the expected outcomes of

the SPO and to examine how progress might be enhanced through improving programme

policy, design and delivery. The SPO 11 evaluation was expected to reach findings and draw

lessons learnt on:

– Progress made towards achieving the expected outcomes of the SPO

– Where UNESCO’s comparative advantages currently lie and where they potentially

lie

– Evolving areas of strategic importance to which UNESCO may need to pay more

attention

– The extent to which the two global programme priorities of Africa and gender

equality have been addressed through the SPO

– The degree of intersectoral and interdisciplinary work

– The relevance, efficiency, effectiveness including cost-effectiveness, impacts and

sustainability for a sample of projects and programmes.

1.2. Scope of the evaluation

The evaluation focused on programmatic activity of the 2008–2009 biennium, but programme

activities planned in the 2006–2007 biennium were also taken into consideration. The

evaluation covered both Regular Programme and extrabudgetary projects that were expected

to contribute to the SPO.

During the inception phase, the evaluation team refined the evaluation questions presented in

the Terms of Reference (ANNEX I) and formulated a number of additional questions:

– What is effective implementation of each of the Conventions in the period 2006–

2008? This examines what is required during the period under review to implement

each of the respective Conventions, in view of progress made prior to 2006 and with

a focus on national level actions.

– What is UNESCO’s role in the implementation of the Conventions as distinct from

the role of States Parties?

– What is the demonstrated need for improved implementation of cultural heritage-

related Conventions? What innovations have been introduced in the period under

review and how have they increased effectiveness?

Page 9: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

5

1.3. Evaluation methodology

The evaluation planning matrix (ANNEX II) served as the main conceptual tool guiding the

evaluation methodology. The matrix identifies the key evaluation questions with indicators,

data sources and data collection methods for each.

The methods used for data collection are listed below. In addition to data from Headquarters,

ten UNESCO field offices were selected to provide additional data: Bamako, Beirut, Cairo,

Havana, Maputo, Moscow, New Delhi, Phnom Penh, Quito and Venice.1

– Document review: planning, implementation and reporting documents (ANNEX IX) as

well as documentation requested from the sample of ten UNESCO field offices.

– Interviews: Interviews were held with approximately 30 stakeholders (ANNEX X).

– Questionnaires: One questionnaire (ANNEX V) was sent to all 122 culture specialists

working at Headquarters and in Field Offices; the response rate was 59%. A second

questionnaire (ANNEX VI) was distributed to 190 key implementing partners and

programme beneficiaries, identified by the ten Field Offices; the response rate was

44%.

– Database review: The UNESCO Database of National Cultural Heritage Law, established

in 2005, contains 2250 pieces of legislation from 177 countries in force for the

protection of cultural heritage.

– Field visit: The Terms of Reference anticipated two field visits to be carried out, with

one to an African country. Due to budget constraints, however, only one field visit

was possible – Ghana. The UNESCO Accra office established a programme of site

visits and interviews with all key partners and beneficiaries.

1.4. Strengths and limitations

The amount of data gathered directly from the field through site visits, observation, and face-

to-face interviews was limited to one Field Office. However, in order to supplement this data,

questionnaires were sent to ten Field Offices, project monitoring reports were extensively

reviewed and telephone interviews conducted.

A particular challenge for this evaluation was to establish attribution, or in other words to show

that a change in policy was a consequence of an activity undertaken by UNESCO. This proved to

be very difficult and often impossible, mostly due to the fact that UNESCO usually does not

systematically collect the data required to document such positive outcomes of its work. In

1 The sample was selected with the Reference Group based on the following criteria: (a) geographical distribution (two offices

per region); (b) mix of country, cluster and regional offices; and (c) size of office. The sample covers a total of 104 RP activities and 75 extrabudgetary projects, representing approximately 18% of programmatic financial resources dedicated to the SPO for the 34 C/5.

Page 10: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

6

addition, the document review revealed that much of what is reported as results are in fact

outputs. A further challenge was that UNESCO does not directly report against the expected

outcomes of the C/4 Medium-Term Strategy.

Page 11: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

7

2. UNESCO’S WORK IN CULTURE AND CULTURAL HERITAGE

According to the 34 C/4 Medium-Term Strategy, SPO11 “Sustainably Protecting and Enhancing

Cultural Heritage” is an example of the specific application of UNESCO’s overall strategy on

cultural diversity and dialogue. According to the said strategy, the field of heritage consists of

natural and cultural, movable and immovable, tangible and intangible heritage, where heritage

fulfils a triple role: a foundation of identity, a vector for development and a tool for

reconciliation.

The 34 C/4 articulated the following expected outcomes for SPO 11:

– Expected Outcome 1: The preservation of cultural heritage and its effects on

development, social cohesion and peace integrated into national and local policies

– Expected Outcome 2: National conservation policies and processes revised to take

account of global trends such as climate change, urbanization and migration

– Expected Outcome 3: New forms of international cooperation developed to

strengthen the application of the 1970 Convention

– Expected Outcome 4: Role of museums recognized by decision-makers as part of

formal and non-formal education programmes.

The four Expected Outcomes of SPO 11 all relate to the policy level, either by directly trying to

influence policy or by supporting the application of policy. For the purposes of this evaluation

“policy” is viewed in a broad sense, referring to policies, legislation, strategies, and major

development plans. The framework for this policy work is provided by legal instruments, the

most important of which are the following five Conventions:

– Convention on the Protection of Cultural Property in the Event of Armed Conflict,

known as the Hague Convention (1954), ratified by 123 Member States2

– Convention on the Means of Prohibiting and Preventing the Illicit Import, Export and

Transfer of Cultural Property (1970), accepted or ratified by 118 Member States3

– Convention concerning the protection of the World Cultural and Natural Heritage

(1972), ratified by 186 Member States with 890 properties listed as world heritage4

– Convention on the Protection of the Underwater Cultural Heritage (2001), ratified by

29 Member States5

2 One hundred Member States are also party to its First Protocol (1954) and 55 to its Second Protocol (1999). Status October

2009. 3 Status October 2009.

4 Status April 2009. The number increased to 187 during the first quarter of 2010.

5 Status December 2009.

Page 12: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

8

– Convention for the Safeguarding of the Intangible Cultural Heritage (2003), ratified

by 117 Member States with 166 elements listed as intangible heritage.6

Each Convention contains provisions that are concerned with the development of policies,

legislation or development plans, such as the development of a general cultural and natural

heritage policy, or the formulation of draft laws and regulations designed to secure the

protection of the cultural heritage. On the other hand, they also contain provisions that require

action at the programme/project level. These include, for instance, awareness-raising of the

importance of safeguarding of cultural and natural heritage, the development of inventories of

the national cultural and natural heritage, or the training of experts for research, conservation

and protection of cultural heritage. The different ‘levels’ of working on the Conventions are

summarised in Table 1. This work is done by State Parties.

Table 1 The three levels of working on the five Culture Conventions

Level Nature of activities

I RATIFICATION/ACCEPTANCE/APPROVAL/ACCESSION

II IMPLEMENTATION AT THE POLICY LEVEL

– Integration of the provisions of the Conventions into national legislation,

regional/national policies and development plans

III IMPLEMENTATION AT THE PROGRAMME/PROJECT LEVEL

– Application of national legislation, regional/national policies, development

plans once the provisions of the Conventions have been included

– Implementation of those provisions of the Conventions that directly

address the programme/project level

The focus of the expected outcomes of SPO 11 is on implementation of the Conventions at the

policy level (Level II), and to a lesser extent at Level III:

– Expected Outcomes 1 and 2 relate to integrating cultural heritage and global trends

into policies (Level II)

– Expected Outcome 3 could be understood to be relating to both Levels II and III,

since the 1970 Convention includes provisions that directly concern policy and

legislation and others that relate to more programmatic activities such as research

and capacity development

– Expected Outcome 4 can be interpreted as mostly relating to Level II, since the

recognition of the role of museums as part of education programmes would have to

be anchored in some kind of policy, strategy or development plan.

6 Status October 2009.

Page 13: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

9

This kind of policy work is supported by UNESCO through various types of intervention such as

raising awareness of key policy makers about the need to translate the conventions into

concrete policies; supporting countries through policy/legislation analysis; distribution of model

policies; helping countries draft policies that take the provisions of the conventions into

account. The table in ANNEX III provides specific examples of technical assistance that has been

(or could have been) provided by UNESCO to support the integration of the conservation of

cultural heritage into policies of State Parties.

At the level of the 33 and 34 C/5 Programme and Budget, several Main Lines of Action (MLA)

are expected to contribute to the achievement of SPO 11. In the 34 C/5 period, the following

MLAs were identified as mostly contributing to SPO 11:

– MLA 1: Protecting and conserving immovable cultural and natural properties, in

particular through the effective implementation of the World Heritage Convention

– MLA 2: Safeguarding living heritage, particularly through the promotion and

implementation of the 2003 Convention for the Safeguarding of the Intangible

Cultural Heritage

– MLA 3: Enhancing the protection of cultural objects, the fight against illicit trafficking

in them, and the development of museums, particularly in developing countries.

Table 2 shows the budget allocated by Main Line of Action for each specific Convention along

with the Expected Outcome to which it most closely relates. The financial figures show the

central role of the World Heritage Convention and the emerging role of the Intangible Heritage

Convention. The World Heritage Convention generates almost twice as much extrabudgetary

funding as what it receives from the RP budget.

Table 2 Conventions by expected outcome, MLA and budget allocation, 34 C/5

Expected

Outcome*

Main Line of

Action

RP Budget

Activities

RP Budget

Staff EXB Budget

World Heritage Convention (1972) 1 and 2 1 4,314,900 9,451,900 24,385,800

Intangible Heritage Convention (2003) 1 2 3,222,100 5,119,300 2,758,800

Underwater Heritage (2001)

Illicit import cultural property (1970)

Protection armed conflict (1954)

1, 3 and 4 3 2,932,400 4,490,400 4,938,000

Source: 34 C/5. * The relationship between each Convention and the Expected Outcomes are approximative.

Page 14: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

10

The budget figures7 also illustrate the incongruity between the budget distribution by

Convention and the Expected Outcomes: EO1 is covered by all five Conventions; EO2 is mostly

covered by the World Heritage Convention which has the largest share of the budget; EOs 3 and

4 are mostly linked to the Conventions on underwater heritage, illicit import of cultural

property and the protection of cultural property in the event of armed conflict, and together

only receive $3 million. The focus of SPO 11 on illicit traffic and museum and education is

therefore not reflected in the distribution of budget by Convention.

The RP budget allocations for each of the ten Field Offices sampled are shown in Table 3, by

Convention. With respect to extrabudgetary funds, the evaluation team established that

activities financed by extrabudgetary funds in the 10 countries focused foremost on

conservation and capacity building related to Expected Outcome 1. Explicit linkages with the

three other Expected Outcomes are either marginal or non-existent. While the extrabudgetary

funds come from a variety of donors, some patterns can be discerned, such as an emphasis on

the safeguarding of intangible heritage by the Japan Funds-In-Trust, or the conservation of

Angkor by France over many years. Two projects under review are financed by other UN

agencies. The case of the UNESCO Office in Venice was found to be specific with substantial

sums of money managed by the Venice office for the preservation of Venetian monuments.

Table 3 RP activities and budget allocations for the Field Office sample, 34 C/5

World Heritage Intangible Heritage Illicit Traffic Underwater Armed Conflict

No of

activities Budget

No of

activities Budget

No of

activities Budget

No of

activities Budget

No of

activities Budget

Bamako 4 60,000 4 168,620 1 25,000 - - - -

Beirut 5 144,000 3 22,027 2 22,000 1* 41,507 1 18,546

Cairo 5 1,249,473 4 81,024 1 20,000 - - - -

Havana 5 71,658 5 127,085 2 70,100 - - - -

Maputo 3 39,901 4 22,655 - - - - - -

Moscow 3** 120,600 4** 160,383 1** 25,000 1** 25,000 1** 25,000

New Delhi 3 98,791 3 188,355 - - - - - -

Phnom Penh 10 1,187,079 2 25,000 2 55,348 - - - -

Quito 3 352,850 6 171,632 1 45,000 1 35,000 - -

Venice 7*** 1,889,469 5 158,713 1 29,450 1 30,000 - -

Source: FABS. Notes: Museum activities related to illicit traffic are included under the illicit traffic related activities. * The underwater activity undertaken in Beirut FO includes also illicit trafficking. ** Moscow FO has implemented one activity targeting all Conventions “Strengthening legislative activity of the cluster countries for protection and safeguarding of their cultural property and heritage”. The Venice office has a double role of regional bureau and of project office for Venice. There are 42 projects for the restoration and safeguarding of Venice amounting to USD 5,466,364. The table presents only the regional projects.

7 All budget figures in this report are in US Dollars.

Page 15: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

11

Quito and Maputo each have two major extrabudgetary projects linked to capacity building and the development of cultural institutions and policies. They do not appear because they are not related to a specific Convention.

Field Offices are diverse in their staffing and orientation. The pool of culture experts available in

the field is unlikely to have the knowledge of all various culture Conventions and programme

activities. This calls for a more interactive approach between Headquarters and Field Offices,

especially with regard to sharing of information. The Regional Office for Culture in Havana has

already taken important steps to bring UNESCO’s culture experts working in the Latin America

and Caribbean region closer together. This initiative is going to be further strengthened in the

future.

The Expected Outcomes pertaining to SPO 11 call for additional efforts to be made by UNESCO

to support State Parties integrate the provisions of the Conventions into their national policies,

strategies and plans (level II). This work requires additional expertise. Right now, the staffing of

the sections dealing with the 1954, 1970, 2001 and 2003 Conventions, does not allow these

Conventions to be fully served. UNESCO needs to take a strategic decision as to how and where

to prioritize the level II work required to achieve the Expected Outcomes of SPO 11.

Page 16: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

12

3. MAJOR FINDINGS

Evaluation findings are based on the document review, the interviews held, the sample of ten

Field Offices, the field visit to Accra and information provided by UNESCO staff and external

experts.

3.1. Progress made towards achieving Expected Outcome 1

The preservation of cultural heritage and its effects on development, social cohesion and peace

integrated into national and local policies

Expected Outcome 1 acknowledges the fact that ratification of the Conventions (Level I) needs

to be followed by the integration of the provisions of the conventions into national and local

policies (Level II). States Parties can do this either by developing new policies or by adapting

existing policies to ensure that they take the provisions of the conventions into account.

The degree to which national and local policies take into account conservation of cultural

heritage and its impact on social and economic development is highly variable. Generally

speaking, developed countries have the most evolved policies and regulations to conserve

heritage, as manifested in regulations that require site management plans to be prepared for all

World Heritage Sites. Such national level policies are less visible in those parts of world that do

not have strong supporting institutional infrastructure. But on balance a positive trend is

evident in many individual countries all over the world.

The responses received to the questionnaire indicate that the vast majority of Culture Staff

strongly agreed or agreed that the Culture programme activities managed by their Office or

Headquarters Division focused on Expected Outcome 1. Of the 35 partner respondents, 83%

strongly agreed or agreed that UNESCO’s activities have had an impact on national and local

policy development aimed at preserving cultural heritage, in particular the integration of its

effects on development, social cohesion, and peace.

Staff from the World Heritage Centre believe that the World Heritage Convention encourages

States Parties to identify policy issues at the national level, as in the case of Ecuador and the

Galapagos where conservation policy has become part of the new constitution. The World

Heritage Convention also provides a channel of communication for States Parties with regard to

cultural heritage and conservation policies for protected areas. It furthermore encourages the

development of policy at sites, concerned primarily with management and monitoring.

The World Heritage Convention Periodic Reporting requirement constitutes an important

mechanism for capturing policy change initiated by State Parties.

Page 17: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

13

The evaluation team found a number of examples from the sample of 10 Field Offices of how

UNESCO has contributed to, or is in the process of contributing to, integrating the provisions of

the World Heritage Convention into national and local policies:

– In Ecuador, the project Capacity-Building and Support for the Consolidation of

Integral Cultural Policies in Ecuador (2007) focused on strengthening the recently

created Ecuador Ministry of Culture. A National Plan of Culture for Ecuador was

published, serving as a framework for the design and development of national

policies. The National Plan of Culture was taken into consideration for the new

national Constitution and is part of the basic documents for the new round tables

convened by the Government for the new cultural law.

– In Moldova, a National Conference on ‘UNESCO Conventions in the Field of

Protection and Development of Cultural Heritage in Relation to the National

Legislation of the Republic of Moldova’ was conducted in 2009 and followed by

training on «The Problems of Protection of Immovable Monuments of History and

Culture». This was aimed at strengthening national cultural legislation and cultural

policy relying on existing legal international instruments, notably the Conventions of

1972, 2003 and 2005. Draft legislative and normative acts were formulated and a

report “Normative and Legislative Acts of the Republic of Moldova in the Field of

Cultural Heritage Protection” was published and distributed among the main

stakeholders, including policy makers.

– In the Commonwealth of Independent States (CIS) cluster countries, strengthening

legislative activity for protection and safeguarding of cultural property and heritage,

in particular, to improve national implementation of UNESCO conventions, was

accomplished in partnership with the Inter-parliamentary Assembly of the CIS

countries and in cooperation with the Ministry of Culture of the Republic of Belarus.

The International Conference “The UNESCO Conventions in the Field of the

Protection of Cultural Heritage and National Legislation of the CIS Countries” was

conducted in 2007 at the premises of the Executive Committee of the

Commonwealth of Independent States in the Republic of Belarus. The Proceedings

of the Conference were published by the State and Law Institute of the Academy of

Sciences of Belarus with the support of the UNESCO Moscow Office.

– The Moscow Office also contributed with a concept paper to the Regional

Conference of the Commonwealth of Independent States (CIS) entitled “Cultural

Policy and Policy for Culture: Towards a New Cultural Policy Profile” that took place

in Armenia in 2009. In cooperation with the Russian Institute for Cultural Research

UNESCO furthermore developed an analytical paper on Strategic Directions of

Cultural Policy in the CIS Countries.

Page 18: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

14

– The Office in New Delhi, in the context of the Indian Heritage Cities Network,

collaborated with the Ministry of Urban Development to develop a guideline and to

review its city development plans to assess their impact on urban heritage (2009).

According to the India Office, the Ministry is now committed to ensuring that

heritage impact assessment is a systematic part of the City Development Plan. It also

agreed to contribute financially to this initiative.

– At the regional level, the UNESCO Regional Office for Culture in Havana supports the

Forum of Ministers for Culture and Officials in Charge of Cultural Policies in Latin

America and the Caribbean. The Office provides the technical secretariat to the

Forum, which was established in 1989. The work with the Forum enables the Office

to support regional integration and cooperation as well as ongoing discussions about

culture policies. The Forum has expressed its interest for UNESCO to play a more

active role in the future and to facilitate a regional discussion on cultural policies at

the next Forum scheduled for 2010.

A number of activities in support of the Intangible Heritage Convention are also beginning to

have a direct impact on policies at the national level:

– In Egypt, a Code of Conduct has been produced for the protection and promotion of

traditional festivals, which reinforces the Charter of Traditional Festivals of the

Mediterranean, issued previously by the Network of Traditional Festivals of the

Mediterranean launched by the UNESCO Mediterranean Programme. An analysis of

the existing policies had shown that a policy gap existed, both at the culture and

tourism ministries, especially with regard to intangible heritage. According to the

Cairo office, the activity was successful in influencing national policies, as

demonstrated by the recent creation of a Centre for National Folklore Archives and a

Folk Traditions Documentation and Development Project by the Ministry of Culture

to which the project also contributes.

– In Mozambique, UNESCO is supporting the Government in the elaboration of a

National Language Policy and in reviewing the legal framework for the creative

industries. A related initiative is being implemented under the MDG-F Joint Program

on Culture & Development, where one of the major expected results is the inclusion

of social and cultural aspects in development policies and strategies.

With regard to the Illicit Traffic Convention of 1970, a range of practical and ethical

instruments in favour of the implementation of the Convention at the policy level have been

developed by UNESCO. In the period under evaluation, for instance, the UNESCO “Handbook:

Legal and Practical Measure against Illicit Trafficking in Cultural Property” (2006) was published.

Databases such as the UNESCO Cultural Heritage Laws Database, INTERPOL Database about

Page 19: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

15

stolen works of art, and Carabinieri National Stolen Cultural Property Database have also been

updated.

A compendium of documents on the return of cultural objects was published8, and a model

custom certificate with the World Custom Organization was developed. Seven out of ten Field

Offices in the evaluation sample have carried out at least one activity in support of the

Convention, most often linked to museum management (see for more on this under EO3

below).

The 1970 Convention is possibly the least visible of the Conventions under review. Even though

a variety of achievements took place from 2006, not many activities were conducted to support

the 10 countries of the sample with the integration of the provisions of the Convention into

local policies and strategies (Level II). However, according to the section dealing with this

Convention, from 2006 – 2009 a total of 19 countries (both western and non-western) have

integrated the provisions of the Convention into national legislation and policies. Some of these

countries requested assistance for this from UNESCO, which was provided in the form of

capacity-building workshops that included discussions about the legislative requirements

related to the implementation of the Convention and about operational issues. The section also

shared legislation from countries where the provisions of the Convention had been well taken

care of (best practice) and helped a few States Parties with a review of the legislation they had

drafted.

In 2004 UNESCO commissioned an evaluation to analyze the actions of its International

Standards Section (INS) during the 1998-2004 period in regard to: the contribution to the

prevention of, and fight against illicit trafficking, and the effect of its activities aimed at favoring

return/restitution, particularly legislative and policy consequences; and the adequacy of human

and financial resources allocated to INS. The evaluation identified several achievements,

including its contribution to awareness/advocacy/dialogue, as well as a number of challenges. It

is of concern that the recommendations from the 2004 evaluation on the Illicit Traffic

Convention have not been put into place, thus dampening its effectiveness.

The findings above, both related to the achievements in supporting the policy work related to

the Convention and to the 2004 evaluation, need to be seen in the context of the staffing

situation of the Section of Museums and Cultural Objects, where only one staff member is

assigned to work on the 1970 Convention.

Although the Hague Convention predates the World Heritage Convention by nearly twenty

years and is the oldest of the Conventions (1954), it has not been a focus of the evaluation as

8 Witnesses to History: A Compendium of Documents and Writings on the Return of Cultural Objects (ed. Lydel Prott)

Page 20: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

16

within the sample of 10 countries only one activity (with a budget of less than $20,000)

explicitly refers to it. Nevertheless it is related to Expected Outcome I and working towards a

culture of peace. During the period under review, the third meeting of the Parties to the Second

Protocol to the Hague Convention resulted in the endorsement of the Guidelines for the

Implementation of the Second Protocol and the adoption of the Guidelines for the use of the

Fund. The Information Kit on the Hague Convention and its two Protocols was updated and

reprinted in various languages.

As with other Conventions, State Parties to the Hague Convention are required to periodically

report to the DG on the measures taken by their respective administrations in fulfillment of the

present Convention (and its two Protocols). This reporting requirement constitutes an

important mechanism for capturing policy change initiated by State Parties. In order to help

State Parties improve the quality and timeliness of the reports, a user-friendly questionnaire

was developed to assist State Parties in reporting.

In the context of conflict and post-conflict countries, UNESCO has also been instrumental in

protecting cultural heritage in countries such as Bosnia-Herzegovina, Cambodia, Iraq,

Afghanistan, and Mozambique, with some work directly targeting the policy level (Level II).

– The Moscow Office’s project for the rehabilitation of heritage in the Chechen

republic and South Caucasus was designed to promote partnership for the

safeguarding and rehabilitation of heritage in the post-conflict regions. The pilot

project on conducting the inventory, assessment and monitoring of the monuments

and their conditions located on the territory of the Argunski State Historical-

Architectural and Natural Museum-Reserve was implemented in close co-operation

with the Ministry of Culture and Mass Communications of the Russian Federation

and the Ministry of Culture of the Chechen Republic. The project has direct impact

on national policy for heritage safeguarding through inclusion of the prepared

inventory of the Chechen cultural monuments located on the territory under study

into the national inventory database of the Ministry of Culture of the Russian

Federation.

– The New Delhi Office undertook several activities over the years that finally led to

the National Disaster Management Authority of India to develop a strategy on

Disaster Management of the Heritage Sites.

– The Bamako Office contributed to various activities in Niger that were meant to

build the capacity of Government officials for cultural heritage protection, and

contributed to the development of a legal document for the protection and

management of cultural sites.

Page 21: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

17

The UNESCO Convention on the Protection of the Underwater Cultural Heritage of 2001 only

entered into force in January 2009. It is UNESCO’s main tool to improve the legal and

operational protection of underwater cultural heritage. Operational Guidelines are currently

under discussion.

In order to support the ratification and implementation of the Convention as well as to

introduce its scientific standards in national policy, a number of regional policy meetings were

held in 2008 and 20099. Additional meetings have been scheduled for 2010. The St. Lucia

meeting of 2008 specifically focused on the integration of the provisions of the Convention into

national legislation. At this occasion UNESCO provided a model law for the protection of

cultural heritage, in particular underwater cultural heritage, to the Caribbean States.

The activities under review employed a variety of mechanisms to integrate heritage

conservation into national and local policies (Level II). Among these mechanisms are:

– Support to a review of national cultural legislation to make sure that the provisions

of the Conventions have been integrated.

– Assistance to drafting of legislation

– Support to discussions about cultural policies at the regional level

– Support to the improvement of national cultural management plans

– Support to the preparation of a code of conduct for the protection of intangible

cultural heritage

– Translation of the Conventions into the local language to increase compliance

– Awareness-raising among government officials and communities about how to

integrate the provisions of the Conventions into development strategies and plans at

the regional, national and local levels.

The initiatives listed above are examples of work that contributed to the integration of the

preservation of cultural heritage into national and local policies (Level II). Overall, however, the

analysis shows that most activities undertaken in the 10 sample countries did not focus on the

kind of (Level II) policy work required to help Member States integrate the preservation of

cultural heritage into national and local policies. Instead, many focused on the implementation

of policies at the programme/project level (Level III) and were therefore expected to influence

the policy level indirectly.

Achieving a balance between upstream policy work and programme implementation will to a

large extent be determined by the maturity of the respective Convention. For more mature

9 Regional policy meetings were held in Saint Lucia (2008), UK (2008), Denmark (2008) and South Africa (2009). Further

meetings have been scheduled for 2010/2011 as follows: Cuba (for Latin America and the Caribbean), Italy (for Eastern Europe), Turkey (for the Mediterranean States), and the Solomon Islands.

Page 22: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

18

Conventions, such as the World Heritage Convention of 1972, a lot of policy level work (Level II)

has already been done by many States Parties. The challenge for UNESCO is now to help States

Parties update their policies and strategies in light of new global developments and trends, and

to strategically complement this (Level II) policy work with initiatives at the programme/policy

level (Level III).

Less mature Conventions, such as the Convention for the Safeguarding of the Intangible

Cultural Heritage of 2003, call for increased focus on the policy level (Level II), because many

States Parties have not yet sufficiently incorporated the provisions of the Convention into their

national policies and strategies.

Without a clear approach in place for working on the Conventions, UNESCO’s efforts remain

fragmented, and therefore neither as relevant nor efficient as they could be.

3.2. Progress made towards achieving Expected Outcome 2

National conservation policies and processes revised to take account of global trends such as climate

change, urbanization and migration

In the period under review, UNESCO has given some attention to climate change and cities,

primarily through meetings and several publications. Although it is fair to say that UNESCO staff

are more aware of the risks posed by climate change, the evaluators did not find any case

where national policies or legislation were updated or where there was a clear link with

UNESCO’s work. There was no evidence from the evaluation sample to indicate that UNESCO

concentrated on programmes to address these trends. As shown in ANNEX IV, there was not

one activity that clearly belonged to this Expected Outcome. The projects under review paid

scant attention to the global trends mentioned in Expected Outcome 2, i.e. climate change,

urbanization and migration, with the exception of the World Heritage Centre’s thematic

initiatives on climate change and cities. Therefore, for the sample of 10, progress towards

Expected Outcome 2 can be seen as negligible due to a lack of focused attention.

Culture Staff and partners are cognizant of the major impact of global trends on their work and

activities. However, this awareness has yet to become a determining factor in the development

of the work programme, perhaps because the needs in the field are still much more “basic.” It is

also significant that joint work with the Social and Human Sciences Sector of UNESCO on these

global trends of urbanizations, migration etc seems to be minimal.

A review of UNESCO’s Law database of 170 countries did not provide information on legislation

related to these issues. Little evidence was found that projects benefitted from knowledge and

good practice in these issues produced by institutions such as the World Bank, Asian

Development Bank or specialist organizations such as the International Council on Monuments

Page 23: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

19

and Sites (ICOMOS) and ProVention and other UN agencies. The Royal Institute of British

Architect’s Trust ongoing International Dialogues on architecture and climate change constitute

another source of current thinking and case studies.

Climate Change

A review of the activities suggests that climate change is yet to be seriously addressed, although

some background research has been carried out by the WH Centre. A publication by the World

Heritage Centre10 highlights the impacts of climate change on 26 natural and cultural World

Heritage properties, along with ongoing and planned adaptation and mitigation measures. The

publication was prepared with inputs from relevant States Parties and experts in climate

change and heritage conservation.

The case studies demonstrate that even well recognized and protected icons of the natural and

cultural world are threatened by climate change, and that public awareness and support is

crucial for addressing the impacts of climate change on World Heritage. Although the impacts

of climate change on biodiversity and protected areas are relatively better known, very little is

known about the impacts on cultural heritage. While varying greatly from site to site, such

impacts on cultural heritage include direct physical effects on property, buildings, and

structures, and effects on social structures and habitats that could lead to changes in cultural

groups, or even the migration of societies currently sustaining the site. A more recent

publication looked specifically at Climate Change and arctic sustainable development: scientific,

social, cultural and educational challenges11

. This publication was prepared jointly by UNESCO’s

Culture (1972 and 2003 Conventions) and Science Sectors.

Little operational work has been devoted to climate change and its impacts, with only two

activities related to risk-preparedness following a natural disaster in India in the sample.

The issue of climate change and World Heritage was first discussed at the 29th session of the

World Heritage Committee in 2005. Noting "that the impacts of Climate Change are affecting

many and are likely to affect many more World Heritage properties, both natural and cultural in

the years to come," the Committee decided to further investigate the subject. Since then, a

Strategy to assist States Parties to implement appropriate management responses and a report

entitled Predicting and Managing the Effects of Climate Change on World Heritage have been

developed and endorsed by the Committee.12

10

Case Studies on Climate Change and World Heritage; 2007. 11

“Climate Change and arctic sustainable development: scientific, social, cultural and educational challenges”, UNESCO, 2009. 12 World Heritage Paper 22.

Page 24: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

20

The International Union for the Conservation of Nature (IUCN) is particularly concerned about

climate change in the context of the World Heritage Convention:

“Climate Change is one of the most significant threats to many World Heritage properties, and is an area

where the World Heritage Convention has the potential to show significant leadership. IUCN considers

that World Heritage properties provide a platform to develop best practice in designing strategies to

adapt to climate change. This will require creative thinking and this should be the subject of a targeted

strategy and fundraising activity. IUCN is willing to take a lead role in such an initiative. The scope for

closer cooperation arrangements with the UN Framework Convention on Climate Change should be

discussed.”13

Urbanization

Over 200 urban properties are inscribed on the World Heritage List and cities are one of the

most abundant and diverse categories of heritage. The process of urbanization shapes much of

cultural heritage whether cultural sites, intangible heritage, museums or trade in cultural

objects. Aware of the need to stay at the forefront of international practice and to contribute to

ongoing debates involving development of standards and practices of urban conservation, a

World Heritage Cities Programme was established to assist States Parties in their efforts to

protect and conserve their urban heritage. Because cities have a constant need for upgrading or

further development of infrastructure, housing and services, the World Heritage Cities

Programme aims to address the permanent challenge of how to accommodate the needs for

modernization and investment in historic cities and city centres without compromising historic

character and identity.

Expert, regional, and international meetings have been organized or attended by the World

Heritage Centre in association with its partners in the context of UNESCO's initiative on the

Safeguarding of Historic Urban Landscapes. An Expert Planning Meeting on Historic Urban

Landscapes, was held at UNESCO Headquarters in 2008 and a Regional Conference on Historic

Urban Landscapes in the Americas, in 2007 in Olinda, Brazil.

Historic Urban Landscapes is an important new concept. It was defined to better address the

contemporary socio-economic transformations that do not respect the authenticity and

integrity of historic cities and their landscape. It provides general principles that acknowledge

the continuous change in functional use and social structure as part of the city’s tradition, and it

proposes policies and strategies for proper planning processes. UNESCO’s General Conference

decided at its 35th session in 2009 that existing UNESCO standard-setting instruments relating

to the conservation of historic urban landscapes should be supplemented by a new

recommendation on this matter. This is an important step forward in dealing, in an

intersectoral manner, with new trends that affect the protection of World Heritage.

13 “The Future of The World Heritage Convention: Challenges for The Next Twenty Years,” IUCN, Quebec meeting, 2008

Page 25: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

21

In Mozambique, the UNESCO office has placed emphasis on working with remote communities,

arguably as a means to retard urbanization. In India, the Indian Heritage Cities Network and the

creation of an India Urban Cultural Foundation are further indications of attention to urban

issues.

Migration

Migration is a thematic issue that has not yet been addressed directly by the Culture Sector. On

the basis of the documents reviewed and the interviews conducted, UNESCO does not seem to

have looked systematically at the impact of migration on cultural heritage. Some respondents

noted that the safeguarding of intangible heritage was necessary as a result of migration, but

without any reference to systematic analysis. The questionnaire completed by culture staff

found that 63 % strongly agreed or agreed that a focus on the revision of national conservation

policies and processes to take into account global trend is key, while 29% neither agreed nor

disagreed.

There are, however, several sites on the Tentative Lists14 in which migration plays a role:

– The archeological site of Tanais: following migration of Greek settlers in the 3rd

century who came from Bosporon to the mouth of the Tanais river (now Don) which

was the area of habitation and migration of various tribes, Tanais quickly developed

into an emporium.

– Chinese Section of the Silk Road: Land routes in Henan, Shaanxi, Gansu and Qinghai

Provinces, Ningxia Hui Autonomous Region, and Xinjiang Uyghur Autonomous

Region and Sea Routes in Ningbo and Quanzhou Cities from the Western-Han to

Qing Dynasties. Archaeological and palaeoanthropological data show that the Silk

Road had functioned as the main road for migration and communication before the

Western Han dynasty (206 BC - 25 AD).

– The Marshlands of Mesopotamia of the Ma'dan population unaccounted for in

population censuses. One anthropological study put their number at 400,000 in the

1950s. Economic migration between the 1960s and the 1980s had reduced the

population to an estimated 250,000 by 1991.

– World Heritage cultural sites or rock carvings: The property's collection of Neolithic

and Iron Age sites, together with rock art found there, reflects a major migration

route of Bantu and other peoples from West Africa along the River Ogooue valley to

the north and east of the dense evergreen Congo forests.

14

States Parties are encouraged to submit in their Tentative Lists properties which they consider to be cultural and/or natural heritage of

outstanding universal value and therefore suitable for inscription on the World Heritage List.

Page 26: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

22

3.3. Progress made towards achieving Expected Outcome 3

New forms of international cooperation developed to strengthen the application of the 1970 Convention

(The Convention on the Means of Prohibiting and Preventing the Illicit Import, Export and Transfer of

Ownership of Cultural Property)

Expected Outcome 3 represents Level III of working on the 1970 Convention, i.e., strengthening

of international cooperation to support the implementation of the Convention at the

programme level. The outcome is supported by MLA 3 of the 34 C/5, “Enhancing the protection

of cultural objects, the fight against illicit trafficking in them, and the development of museums,

particularly in developing countries”.

From the sample review, all ten Field Offices had conducted small-scale activities linked to the

1970 illicit traffic convention, mainly in relation to awareness raising. Most of these activities

related to museum management, training for curators, etc. rather than international

cooperation. No extrabudgetary activities related to the 1970 convention were found in the

sample. A search of the database shows: one Memorandum of Understanding on the

imposition of import restriction between USA and Cambodia 2008 on archaeological materials

from Cambodia, and information on countries adopting legislation. Within the sample of 10

countries no other examples of international cooperation were found.

In other countries, however, the evaluation found a small number of projects in support of the

1970 Convention. Types of cooperation that were used included workshops on legal issues

related to the Convention, the application of the Convention with law enforcement, ministry

and heritage experts; training courses for law enforcement staff; use of a regional

governmental forum to discuss legislative reform; and invitations to private sector art market

representatives to participate in UNESCO workshops. Participants included academic

institutions, professional organizations, and national police forces. Among these projects are

the following:

– The Andean workshop on application of 1970 UNESCO Convention on Illicit Traffic of

Cultural Goods involved Interpol France, Law School of London, Carabinieri of Italy,

International Council on Museums for Latin American and the Caribbean, with

coordination of the Ministry of Natural and Cultural Heritage of Ecuador and the

National Institute of Heritage, national cultural attorney generals, heritage centers,

and institutes.

– In the Palestinian territories, despite the volatile situation, RP funds were used to

organize two training courses for Palestinian Authority police and security forces (54

officers from the Tourist Police and other various forces), in police networking

Page 27: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

23

aspects and Object ID during the period under review. In previous years similar

trainings were also held in other countries.

– In an effort to link the various actors in the art market, both public and private, in

the fight against the illicit traffic of cultural property, a representative of Christie’s, a

leader in the art market, participated in a workshop (Fifteenth Session of the

Intergovernmental Committee for Promoting the Return of Cultural Property to its

Country of Origin or its Restitution in Case of Illicit Appropriation).

The types of organizations with which the Convention cooperates include: international bodies

such as UNIDROIT, Interpol, the World Intellectual Property Organization (WIPO), UNODC and

ICOM; regional governmental bodies such as Inter-parliamentary Assemblies; bi-laterals such as

GTZ; national institutions such as Ministries, Tourist Police, police forces etc; educational

institutions such as law schools; the private art market, including Christie’s and Sotheby’s and

the French Syndicat National des Antiquaires; and societies for the protection of cultural

heritage such as Europa Nostra, the Union Europeene des Demeures Historiques and others.

Although projects focusing on new forms of international cooperation to strengthen the

application of the 1970 Convention are few, in the opinion of culture staff who responded to

the questionnaire, slightly more than half either strongly agreed or agreed that new forms of

international cooperation are in place to strengthen the 1970 Convention. This points to weak

awareness of the actual work of the Convention.

Progress towards Expected Outcome 3 can be judged as modest but strategic, especially in

regard to engaging with the private art market and experimenting with a range of activities to

raise awareness and influence legislation. There are some examples of well designed activities,

but the geographic scope is quite limited due to resource constraints. It needs to be pointed out

that during the period under review only one professional staff member at HQ was dealing with

the implementation of the 1970 Convention.

3.4. Progress made towards achieving Expected Outcome 4

Role of museums recognized by decision-makers as part of formal and non-formal education

programmes

UNESCO’s programme for the safeguarding of cultural objects was re-established in 2004, with

renewed interest in museums since 2007. This is reflected in the section’s name, the Section of

Museums and Cultural Objects. This institutional decision recognizes the role of museums in

promoting the Illicit Traffic Convention, the Hague Convention, and broader social and

economic development objectives.

Page 28: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

24

Few museum experts would dispute the educational potential of museums as places where all

sorts of education can take place, including learning about diversity and reconciliation.

UNESCO’s museums programme has responded to corresponding needs in Member States with

numerous activities to support museums when exercising their educational role and developing

their educational messages. Staff members asserted that in the museum projects, mainly in

developing countries, UNESCO promotes awareness that museums are not just repositories of

cultural goods but have an educational role. This is done through advocacy, training, capacity

building, production of educational tools etc. Examples of such initiatives are mentioned below.

By supporting inventory activities a number of the projects with museums are also directly

linked to the implementation of the Illicit Traffic Convention.

In the survey of partners, in response to the question on recognition by decision-makers of the

role of museums in education, 71% responded affirmatively. Moreover, respondents to the

questionnaires noted the support provided by governments and decision-makers of museum

projects, especially in developing and post-conflict (or ongoing conflict) countries that

demonstrates their belief that museums can provide neutral territory for diverse cultures to

learn as part of formal or non formal education programmes. This confirms the finding of the

present evaluation that decision-makers in the museum sector have recognized the educational

role of museums and cooperate with UNESCO in strengthening this educational role.

Some of UNESCO’s initiatives that support museums when carrying out their educational work

are the following:

– In Afghanistan, UNESCO has developed a "Policy Framework for the Rehabilitation of

the Museum Sector" that has become the museum policy statement for the country,

with clear objectives with regard to the educational role to be played by museums,

and steps to contribute to this.

– The "Riwaya Museum - Bethlehem" (Museum of Narratives) represents Palestinian

tangible and intangible heritage in a contemporary way. It foresees a strong

educational component, especially for children and youth, being based on

interactive multimedia display. A permanent educational workshop is based at the

museum premises. The project involves institutions as the Ministry of Tourism and

Antiquities and the Municipality of Bethlehem as key partners as well as many other

stakeholders from the Civil Society.

– In Mali, Niger, and Burkina Faso, a project aiming at developing guides for the

permanent collections targeting schools was implemented. These guides have been

used during schools visits and have provided pedagogical tools for teachers to

discuss the visit and make students aware of cultural artefacts in museum.

Page 29: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

25

– Numerous projects in all regions funded by the US Contribution to UNESCO

supported the development of online databases of museum collections. These can

be used for researchers and eventually be part of websites that allow students and

the public in general to learn more about their collections. For example, nine

museums in Guatemala came together to create a web portal about their museum

that is also a link for students/teachers. Another project sponsored by the US

Contribution in Honduras created new links with local communities and also

developed new learning resources for students.

– In Mozambique, a project undertook activities that reinforced the principles of strict

linkage between Education-Culture through the organization of public outreach

activities in remote schools and communities. The project furnished museums with

appropriate equipment and educational activities are undertaken in the community,

school-community and vice-versa. Sensitization and use of museum replicas for

communities are some of the successful activities undertaken within the framework

of the project.

– The UNESCO/ICOM Regional Training for trainers “Running a Museum” for museum

professionals of the CIS in association with the UNESCO Cluster Office in Almaty and

UNESCO Office in Tashkent within the Agreement between UNESCO and IFESCCO

(Intergovernmental Foundation for Educational, Scientific and Cultural Cooperation)

took place in, 2008, in partnership with the Peter the Great Museum of

Anthropology and Ethnography (Kunstkamera). 25 Museum professionals from 9

countries, including Armenia, Azerbaijan, Belarus, Kazakhstan, Kyrgyzstan, Republic

of Moldova, the Russian Federation, Tajikistan and Uzbekistan were trained and

prepared for conducting national trainings in their respective countries.

– One of the flagship projects of the museum division is the Nubian museums,

bringing together activities to safeguard intangible heritage and address social and

cultural dislocations caused by forced resettlement. The project aims at creating the

Nubia Museum of Wadi Halfa, on the Sudanese side of the border between Egypt

and Sudan. This is done in close cooperation with the Nubia Museum of Aswan. The

raison d’être of the Wadi Halfa Museum is to complement the Aswan Museum with

Nubian artifacts from Sudan and to be a community-based museum and cultural

centre for the Nubian people living in the area. The project also helps with the

creation of new tools of international cooperation between Egypt and Sudan, as the

two countries cooperate closely in it, both at the level of Museums (Nubia Museum

of Aswan, National Museum of Khartoum) and at that of authorities (Ministries of

Culture and tourism, regional authorities such as the governors of Aswan and Wadi

Halfa) and the private sectors (sponsors). The project has also launched a regular

cooperation between the two countries to train museum staff.

Page 30: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

26

The initiatives mentioned above are interesting examples of UNESCO’s engagement with

museums in Member States and show that serious efforts have been made by the museums

programme to strengthen the educational role of museums at the programme level. However,

not many initiatives were found (within the sample of 10 countries) that directly target the

policy level of the museum sector and try to help Member States anchor the educational role of

museums in relevant policies and strategies.

Moreover, even though the formulation of Expected Outcome 4 can be interpreted in various

ways, it is the understanding of the evaluation team, that “the recognition of decision-makers

of the role of museums as part of formal and non-formal education programmes” also calls for

cooperation between the museum sector on one side and the education sector and/or non-

formal education mechanisms on the other, and for the integration of the educational role of

museums in the policies and strategies of the education sector. This should be considered a

must if UNESCO’s engagement with museums is to have a long-term perspective and be

sustainable.

Current initiatives at the programme level therefore need to be complemented by strategic

work undertaken with the policy level of the education sector in Member States. Naturally, this

also requires increased cooperation between the museums programme of UNESCO and

UNESCO’s education sector. The World Heritage in Young Hands programme, although not

museum related, paves the way for inter-sectoral cooperation between Culture and Education .

The evaluation concludes that there is little evidence to support UNESCO’s role in forging an

explicit link between museums and the formal education sector and informal education

mechanisms in Member States, despite the Organization’s stated priority to increase the

educational role of museums. There is only scant evidence that points to decision-makers in

formal and informal education paying heed to museums as a direct result of UNESCO

intervention. The evaluation has not discovered any explicit strategy by the Culture Sector to

link museums and education, and within the sample there are no joint inter-sectoral

programmes with the Education Sector of UNESCO, and (with one or two exceptions) Field

Office museum activities are not linked to ministries of education (see Section 3.8). Although

museum activities are numerous, progress toward Expected Outcome 4 is therefore very

modest.

As the museum’s section is young, being established in 2005, further progress can be expected

if adequate funds and staff are allocated to this programme area and lessons are learned from

past experience.

Page 31: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

27

3.5. UNESCO’s comparative advantages

As the only United Nations agency responsible for the protection of cultural heritage, UNESCO

administers and promotes five international normative instruments. There is evidence of

enormous respect and goodwill towards UNESCO for its work internationally and in Member

States. UNESCO’s strengths are perceived to lie in its international stature, prestige,

infrastructure, and networks, which place it in a leadership position to develop policy and

practice and broker relationships and resources. According to the questionnaires, UNESCO is

well viewed by its partners and by its staff. Interviews also confirmed that UNESCO enjoys

significant comparative advantages, but is limited by its small regular budget.

UNESCO Culture staff expressed strong agreement or agreement to the Organization’s standing

as a leader in heritage protection, with 97% responding in the affirmative. Interestingly, some

75% strong agreed or agreed that UNESCO provides effective policy advice to States Parties.

This perception does not correspond to our analysis of activities. The vast majority (88%) also

agreed that the Organization has a comparative advantage in its cultural and natural heritage

protection and enhancement work, while 53% believed the Organization demonstrates a strong

comparative advantage in its work to safeguard intangible heritage. UNESCO’s comparative

advantage in regard to museums was weakly defended with 31% neither agreeing nor

disagreeing and 53% agreeing or strongly agreeing.

The partners’ responses gave a strong endorsement to UNESCO as a respected leader in

protecting cultural heritage, with 97% strongly agreeing. Strong positive reactions were also

given to questions concerning effective policy advice to States Parties (88%) and comparative

advantage in work with all the Conventions (92% for the protection of immovable cultural and

natural properties, 89% for intangible heritage, 84% for the protection of cultural objects and

the fight against illicit trafficking, and 73% for the development of museum, respectively,

strongly agreed or agreed).

The following views were expressed on UNESCO’s particular strengths and potential

contribution to conservation practice during the field visit to Accra and by implementing

partners and programme beneficiaries through the questionnaire:

– UNESCO is recognized as the UN agency for culture and has an official role in the

relevant Conventions

– UNESCO has a global and national perspective, helps broker international links and

partnerships, contributes to international networking, and opens experience of

otherwise distant countries

Page 32: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

28

– UNESCO’s collaboration with ICOMOS and the International Centre for the Study of

the Preservation and Restoration of Cultural Property (ICCROM) strengthens its

expertise in cultural heritage protection and promotion

– UNESCO has the back-up of National Committees which can serve as a conduit to

local level stakeholders

– UNESCO’s history of engagement with cultural conservation represents a strong

brand.

In summary, UNESCO’s comparative advantage with regard to the protection of cultural

heritage lies in its ability to assist States Parties to work on the Conventions. This especially

relates to helping States Parties integrate the provisions of the Conventions in their policies,

legislation and development plans (Level II). UNESCO’s involvement with regard to the

implementation of the Conventions at the programme / project level (Level III) is also relevant.

However, it should be undertaken strategically in order to complement the work at the policy

level (Level II) and not as stand-alone activities. Furthermore, more efforts should be made to

build strategic partnerships with other organizations, such as for instance NGOs or research

institutions, which are better positioned to conduct some of the kind of Level III work that

UNESCO is currently undertaking.

3.6. Africa priority

Although the Africa priority is well publicized, the Organization does not yet have a coherent

strategy for supporting Field Offices in Africa to develop cultural projects and to raise funds for

their implementation. In addition, staffing and the capacities of States Parties impede progress.

In the sub-Saharan Africa Field Offices there are only nine staff members of rank P3 and P4

assigned with a culture brief.

New institutions such as the Africa World Heritage Fund hold promise of improving the

implementation of the WH Convention and the representativeness of the World Heritage List.

Among Category 2 institutions in Africa are the Institute of African Culture and International

Understanding (IACIU) under the auspices of the Federal Government of Nigeria and the

Olusegun Obasanjo Presidential Library.

During the period under review, the Conventions have made some headway in ratification by

sub-Saharan African Member States. Five Member States have now ratified the World Heritage

Convention, 21 the Intangible Heritage Convention and two the Illicit Traffic Convention. To

date, no African Member States are signatories to the Underwater Convention. Since 2006, the

World Heritage Convention has added six sites in Africa; the Intangible Heritage Convention has

added 18 sub-Saharan African elements to its list of 90 Representative List.

Page 33: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

29

Budgetary allocations vary. The sample of ten Field Offices included two offices in Africa (refer

to Table 3). Bamako is a cluster office covering Burkina Faso, Guinea, Mali and Niger, while the

Maputo Office is a national office. In comparing the 33 and 34 C/5 budget allocations, the RP

budgets for Bamako more than doubled, while those for Maputo fell. On the other hand,

Maputo has been successful in mobilizing a considerable amount of extrabudgetary resources,

which Bamako has not.

Table 4 RP and EXB allocations to Bamako and Maputo, 33C/5 and 34C/5

33 C/5 34 C/5

RP budget EXB Budget RP budget EXB Budget

Bamako 62,350 74,470 146,800 0 Maputo 75,200 3,065,670 50,000 729,730

Source: FABS.

Questionnaires and interviews point to differing views as to UNESCO’s involvement in Africa:

some remarked that there was no overall strategy for delivering a coherent programme of

assistance to Africa and that activities were implemented on an ad-hoc basis where and when

staff members were ready to do so. There was no guidance for staff members to know which

countries or activities to prioritise and why. Others called for more money and staff for Africa,

which means accepting to dedicate less to other regions.

Culture staff were unconvinced about the Organization’s contribution to meeting the Priority

Africa expected results with only a third strongly agreeing or agreeing, although the majority

agreed that Priority Africa was relevant to the Culture Sector’s work to protect immovable and

natural properties, intangible heritage, illicit traffic and museums. The strongest agreement for

Priority Africa being relevant to the Sector’s work was recorded for cultural and natural

property and for intangible heritage.

3.7. Gender priority

Explicit activities to promote gender equality and women’s empowerment are rare in the

activities reviewed, nor has gender been systematically mainstreamed in policies, programmes

and projects supported by the sector. Overall, the evaluation observed a lack of gender

perspective in much of the sector’s work. There seems to be a lack of clear understanding on

the side of culture staff as to how gender could be integrated in the work on the Conventions,

especially when assisting countries integrate the provisions of the Conventions into national

policies and strategies (Level II).

Page 34: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

30

The gender-related questions in the survey sent to Culture staff were often left unanswered.

For those who responded, the strongest positive response (71% agreeing strongly or agreeing)

was that the Gender Equality priority is relevant to the Culture Sector’s work to safeguard

intangible heritage. Concerning the relevance of Gender Equality to the conservation of

immovable cultural and natural property, 58% agreed strongly or agreed. In contrast only 29%

believed the Gender Equality priority is relevant to the Culture Sector’s work to enhance the

protection of cultural objects and the fight against illicit trafficking in them. Of the respondents,

27.5% agreed that Gender analysis of the situation has been carried out to identify contextual

constraints and opportunities as it relates to the Culture programme activities managed by

their respective Office or Headquarters Division, while only 23% of respondents agreed that the

Gender Equality priorities were consistent with the priorities of the States Parties to the

Culture-related Conventions. Five respondents stated that gender was either not applicable or

had no successes to report.

Examples provided by Culture Staff concerning gender equality include:

– Projects designed and activities executed specifically during 2008-2009 biennium

integrated gender equality such as the workshops on Andean craft, meetings on the

1970 UNESCO Convention, and Expert meetings of the Cacao Route project

– At training programmes gender issues have been taken into account and data on the

participants for the first time has been sex-disaggregated

– The project on conducting master-classes on traditional carpet weaving for young

craftswomen from the Gala settlement, Azerbaijan, in September 2006

– In Armenia, the pilot project “Promoting Roads of Culture and Tourism in Armenia

for Sustainable Development and Dialogue”, was initiated in 2007 by the Moscow

Office in Partnership with the Armenian National Commission for UNESCO and

developed within the UCPD for Armenia, in order to mobilize cultural resources for

sustainable development. The follow-up project initiated in 2008 is aimed at

promoting sustainable cultural tourism at World Heritage and other sites with a view

to contributing to the economic and social development of local communities, in

particular youth and women, and promoting their participation in the management

of the sites and the coordinated conservation and promotion of the tangible and

intangible heritage with a special emphasis on rehabilitation of national cultural

centers near historical sites

– In Egypt, Mobilization of the Dahshur World Heritage for Community Development

aims at community economic and social development through the valorization of a

World Heritage Site. This development will be achieved through tourism and crafts

activities launched by the project, in particular women development, especially

through crafts training.

Page 35: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

31

Significantly, one Field Office respondent commented that “the implementation of the 2003

Convention is an occasion for communities and national authorities to discuss the cases where

ICH is harmful to gender equality.” Few Field Offices projects explicitly focus on woman’s

participation; in most of these women are mentioned in the context of handicraft promotion

and less often tourism development.

Suggestions from Culture Sector respondents to strengthen gender equality included:

– Culture programmes should highlight the benefits of gender mainstreaming, rather

than presenting them is a purely rhetorical manner.

– More staff awareness and more tools to use to mainstream gender in our day-to-day

work.

Slightly less than half of UNESCO partners considered gender to be either non-applicable or

absent. On the other hand, those who thought gender to be applicable, provided an interesting

range of examples of gender related efforts from participation in project design, staffing,

training, stakeholder consultation to provision of work space for women.

In 2003 a workshop was organized by UNESCO to discuss how to accommodate gender issues in

the safeguarding of intangible cultural heritage. This was an important initiative, which needs to

be followed up. The gender needs of the other four Conventions under review have not been

assessed so far and no Convention-specific tools exist that would help staff (and partners)

working in the Culture Sector better understand how gender could be mainstreamed when

working on Levels II and III of the Conventions.

3.8. Intersectoral and inter-disciplinary work

Despite UNESCO’s stated priority for intersectoral working, the evaluation found only marginal

intersectoral activity. None of the projects implemented by the Field Offices under review

demonstrate true intersectoral working which is unexpected given Field Offices bring together

staff from various disciplines in one office. This was also true of the Accra Office.

Culture staff were asked to give their views on the contribution of culture to UNESCO’s

Intersectoral Platforms. The strongest responses were recorded for the platform to support

countries in post-conflict and disaster situations (67%) and contributing to the dialogue among

civilizations and cultures and a culture of peace (87%). The most negative response was to

Science education (31% disagreeing), followed by UNESCO action to address climate change

(22%).

These responses indicate that the intersectoral platforms have yet to become a working tool for

joined up working, although they do point out issues that are of most concern to staff, namely

Page 36: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

32

post-conflict and disaster, dialogue among cultures, and Priority Africa. Some staff have

explained that because budgets are not attached to intersectoral platforms, there is little

incentive to design intersectoral activities. Several staff explained that they had indeed

attended meetings of the platforms, but found them to be unproductive.

It is striking that for the sector as a whole little intersectoral work is being carried out between

culture and education, notably in regard to museums and education. Similarly, only limited

interaction was mentioned in regard to science. The Social and Human Sciences Sector of

UNESCO, which works on urbanisation, migration etc. and is thus relevant for Expected Outome

2, is not evident in any joint working. It is also telling that within the Culture Sector, synergies

and intrasectoral work between divisions are minimal, for example between the World Heritage

Centre and the Division of Cultural Objects and Intangible Heritage.

Efforts are made, however, by the two Secretariats of the 1972 and 2003 Conventions to

increasingly strengthen their cooperation around the two Conventions. This is becoming more

and more necessary, because of the number of States Parties to the 2003 Convention who also

participate in statutory meetings of the 1972 Convention, and increasing awareness of the

challenges related to implementing both Conventions at the national level. The Culture Sector

also supported projects in Member States (Kenya and Tanzania) that are related to intangible

heritage present in World Heritage sites.

3.9. Monitoring and reporting

Despite results-based management training and the existence of self-help tools, more needs to

be done to strengthen RBM practice. A major challenge is the absence of an explicit programme

logic. For instance, the linkage between the expected results of successive C/5’s and the

achievement of the expected outcomes of the C/4 is rather ambiguous as is the relationship

between certain activities and the expected results.

The systematic monitoring of project progress is not consistently done. For example,

monitoring data is not systematically gathered from project beneficiaries through the use of

formal data collection tools such as interviews, surveys, etc. There is a strong emphasis on

monitoring and reporting at the output level. Hence, greater efforts will be needed to improve

the overall quality and reliability of monitoring data. Developing a solid evidence base for the

outcomes of UNESCO’s work is a pre-requisite for attracting additional support and resources

and for better understanding the value of UNESCO’s work.

Project management and monitoring systems now in effect do not capture necessary

information to allow for snapshots of the status of projects and learning about project results.

During the period under study, SISTER held insufficient information to be of real use for project

Page 37: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

33

management; it sheds little light on the achievement of C/4 expected outcomes and is

perceived as difficult to use by some Field Offices. In general, extrabudgetary projects – i.e.

project documents, mid-term progress reports, terminal reports - provide more complete

information than regular programme activities. Overall there is a need to re-examine the logic

and practice of reporting.

Knowledge management within UNESCO, within Field Offices and between Field Offices and

Headquarters has not fully benefitted from the advances brought about by the use of

information technology. Project documents in some FOs are largely paper based, institutional

memory is often a personal matter, and handover protocols are lacking. This leads to serious

inefficiencies and inadequate sharing of information and learning. The World Heritage Centre,

with its new website, has shown considerable improvement in information sharing. Overall,

however, there is little exchange of experience among Field Offices and Headquarters and

between sectors about lessons learned and good practice.

Page 38: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

34

4. KEY CONCLUSIONS AND RECOMMENDATIONS

Conclusion 1 The Culture Sector has made considerable efforts to support Member States with the ratification and implementation of the Culture Conventions. This also includes some examples of work specifically designed to help with the integration of the preservation of cultural heritage into national and local policies, as foreseen in Expected Outcomes 1 and 2. However, during the 34th biennium these examples do not abound. The evaluation has tried to show that work on the Conventions has to target various complementary levels in order to be comprehensive and sustainable. The Sector’s current approach to working on the Conventions lacks a clearly articulated framework that provides guidance as to the kind of technical assistance that is to be provided at a given stage of a State’s ratification and implementation process. Global trends such as climate change, globalization and migration are not being systematically addressed.

Recommendation 1.1 Develop a comprehensive, strategic and integrated approach to working on the Culture Conventions that guides culture staff in their efforts to develop an optimal mix between up-stream and down-stream activities, taking into account:

– The maturity of the respective Convention, and

– The level at which support should be provided. This could be support to the

ratification of a Convention, support to the implementation of a Convention at the

policy level (integration of the provision of a Convention in national legislation,

policies, development plans), and support to its implementation at the programme /

project level, or a combination thereof

Recommendation 1.2 Sharpen the focus of capacity development activities to those

most effective (such as specialized training, train-the-trainers, work through

national/regional training institutions, regional workshops etc.)

Recommendation 1.3 Support State Parties to the Conventions to include emerging

trends such as urbanization, climate change and migration in their national culture

conservation policies.

Conclusion 2 Reports from State Parties are one of the most important mechanisms and sources of information to monitor progress made in terms of integrating the provisions of the Conventions into national and local policies. This information should be increasingly used to work towards the Expected Outcomes of SPO 11 and to decide on the focus and type of technical assistance to be provided to State Parties, including any initiatives to strengthen their capacities to work on the Conventions. Due to capacity constraints of the Culture Sector, the

Page 39: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

35

analysis of the reports from State Parties on the Conventions is often outsourced to external consultants.

Recommendation 2 Systematically analyze the reports submitted by States Parties to the General Conference of UNESCO and/or the appropriate Committee, especially with regard to whether and how States Parties have adopted policies and taken the legal, scientific, technical and other measures necessary for the protection of their cultural heritage. Strategically use this information to decide on the focus and type of support to be provided to Member States. These initiatives should be in line with the overall strategic framework to be developed for working on the Conventions. In addition, consider whether the analysis of the reports from States Parties, which is carried out to a large extent by external experts, could be further brought into the core functions of the organization.

Conclusion 3 The budget and human resources allocated to the 1970 Convention show that, compared with other Culture Conventions, the Convention is not treated as a priority by UNESCO. Expected Outcome 3 calls for new forms of international cooperation to be developed to strengthen its application. Several initiatives demonstrate that efforts have been made to strengthen joint work at the international level and that new forms of cooperation have been initiated in some Member States. However, these initiatives are few and usually not part of a larger approach to support the work on the 1970 Convention. With the current level of funding, it is unrealistic to expect that they will produce any major outcomes on a large scale.

Recommendation 3 UNESCO needs to take a strategic decision with regard to the importance to be given in the future to the achievement of Expected Outcome 3, which relates to the development of new forms of international cooperation to strengthen the application of the 1970 Convention on Illicit Trafficking. Above all, this decision will involve a reflection about how UNESCO could better act as a catalyst for new forms of international cooperation to strengthen the 1970 Convention, and related to this, about possibilities for partnerships and the allocation of resources for the achievement of this outcome.

Conclusion 4 UNESCO’s museums programme has done considerable work with museums, including awareness-raising about the educational role of museums, undertaking initiatives to strengthen museums’ capacity to provide educational activities, improve museum management, develop museum policies, etc. Currently no explicit strategy exists to link the work with museums with the Education Sector, and only few activities are undertaken that target the policy level of the education sector, for instance by supporting Member States in their efforts to integrate the educational role of museums in relevant education policies, strategies or plans. This, however, would be important in order to ensure the educational role of museums in the long run. UNESCO should put increased emphasis on strengthening the policy level role of museums, while continuing to complement this work with programme level activities that enhance the capacity of museums to educate and to manage their work.

Page 40: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

36

Recommendation 4 Work more directly with the Education Sector of UNESCO and with education sectors and relevant non-formal training institutions in Member States to ensure that museums are officially recognized as part of formal and non-formal education programmes. This would result in the integration of the work with museums in relevant education policies, strategies and plans, and the joint implementation of programmes by formal and non-formal education mechanisms and museums.

Conclusion 5 UNESCO’s Africa priority has been well publicized and a list of expected results for Africa included in the current C/5 Culture Programme and Budget. However, this does not provide adequate guidance to the Culture Sector on how to focus on Africa, what African countries to primarily work with, how to support Field Offices in Africa, which Expected Outcomes to give special attention to in Africa, how to raise extrabudgetary funds for Africa. This lack of guidance makes strategic programming difficult if not impossible and leads to interventions that happen on an ad hoc basis and often without any links to other activities supported by the Sector.

Recommendation 5 Develop a coherent framework for the Culture Sector’s work in Africa, taking into account the recommendations contained in the World Summit Outcome document. The framework should give clear direction to the Culture Sector on, inter alia, how to implement UNESCO’s Priority Africa in the context of the Sector’s work. It should specifically provide guidance on geographic and thematic priorities, fund raising issues, and on how to support Field Offices in Africa etc.

Conclusion 6 Gender is beginning to become part of UNESCO’s way of thinking, as demonstrated by the inclusion of gender equality as a priority in UNESCO’s C/4 Mid-Term Strategy and C/5 Programme and Budget and UNESCO’s Gender Priority Action Plan 2008 – 1013, and there are some instances in which gender equality is being actively addressed at the programme/project level. However, neither the integration of gender issues at the policy level nor at the programme/project level is currently being pursued systematically. A more systematic approach to mainstreaming gender and the promotion of women empowerment is therefore needed, especially for the work on the five Culture Conventions.

Recommendation 6 Assess how gender equality issues could be addressed in the five Culture Conventions when helping States Parties work on the implementation of the Conventions at the policy and programme levels. Develop a practical culture sector-specific toolkit for how to mainstream gender in the portfolio of the Culture Sector, especially with regard to its work on the Conventions, and develop expertise in the Culture Sector on how to use the toolkit. Management in the Culture Sector must be held accountable for both gender mainstreaming and gender-specific programming in line with the commitments outlined in UNESCO’s Gender Priority Action Plan 2008 – 2013.

Conclusion 7 UNESCO Country Programming Documents provide a point of reference and tool of consensus on country priorities in relation to the Culture Sector and the implementation needs of the five Conventions under review. They help determine the direction and content of

Page 41: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

37

UNESCO support and facilitate policy dialogue with Member States and coordination with other bilateral and international stakeholders. In the absence of a country programming document it is difficult for culture staff in National Offices to participate in policy dialogue around the five Culture Conventions under review and to establish strategic partnerships with other international players who could contribute to and complement the work of UNESCO.

Recommendation 7 In the absence of mechanisms to encourage policy dialogue with Member States and donor coordination around cultural issues, UNESCO should further strengthen the development of UNESCO Country Programme Documents so that they always reflect the Culture Sector’s strategic priorities for a given country.

Conclusion 8 The Culture Sector does not systematically assess and report on progress made towards the Expected Outcomes pertaining to SPO 11. This often makes it nearly impossible for the Sector to demonstrate what has been achieved at the outcome level. It also does not allow for the Sector to use any data on outcomes to inform decision-making at the policy and implementation levels. While some information is available on the level of activities and expected results of the C/5 Programme and Budget, it is not always clear how these expected results contribute to the Expected Outcomes.

Recommendation 8 Systematically assess progress made towards the achievement of the Expected Outcomes of SPO 11. This involves clarifying the programme logic i.e. how the achievement of the Expected Results of the C/5 lead to the achievement of the Expected Outcomes of the C/4. Strengthen staff capacity for project design, monitoring and reporting.

Page 42: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

38

ANNEX I TERMS OF REFERENCE

Terms of Reference Evaluation of UNESCO’s Strategic Programme Objective (SPO) 11:

“Sustainably protecting and enhancing cultural heritage”

Background

Strategic Programme Objectives (SPOs) were first adopted in the UNESCO Medium Term Strategy for 2008 – 2013 (34 C/4) and programmed for implementation in the current biennium (2008 – 2009). The Medium Term Strategy includes a total of 14 SPOs for the entire programme of UNESCO which concretizes a number of overarching objectives in programme-relevant and thematic terms. SPO 11 is one of three SPOs implemented by UNESCO’s Culture Sector. The six-year Medium Term Strategy translates into three consecutive programme and budget documents, starting with the 2008-2009 period (document 34C/5), which contain expected results, performance indicators and benchmarks. SPO 11 is an example of the specific application of UNESCO’s overall strategy on culture which is driven by cultural diversity and its corollary, dialogue. Since protection and enhancement of cultural heritage represent a major part of Culture Sector’s work programme with regard to cultural diversity, SPO 11 is considered as a crucial Strategic Programme Objective. In addition, all aspects of cultural heritage – movable and immovable, tangible and intangible - have been addressed by UNESCO’s normative action in five culture-related standard-setting instruments

15, which provide a solid basis for the promotion of cultural diversity.

The expected outcomes for SPO11 as given in the 34 C/4 are as follows: The preservation of cultural heritage and its effects on development, social cohesion and peace integrated into national and local policies. National conservation policies and processes revised to take account of global trends such as climate change, urbanization and migration. New forms of international cooperation developed to strengthen the application of the 1970 Convention. Role of museums recognized by decision-makers as part of formal and non-formal education programmes. Programmatic activities are delivered from both Headquarters and UNESCO Field Offices. In the current 2008 – 2009 programme period, the main lines of action that contribute to SPO 11 include protecting and conserving immovable cultural and natural properties, safeguarding living heritage, enhancing the protection of cultural objects and the fight against illicit trafficking in them, and the development of museums. The budget allocated to programmatic activities contributing to SPO 11 is $42,552,000

16 (of which $32,082,600 in extrabudgetary funds

and $10,469,400 in regular programme funds).

Purpose of the Evaluation

Evaluations at the level of the SPOs were decided upon as a vehicle to respond to the Executive Board’s decision: “ensure provision for systematic evaluation of all programmes within the C/4 cycle” (175EX/Decision 26). The evaluation of SPO11 was programmed in the 34 C/5 Evaluation Plan. The purpose of all SPO evaluations is to assess progress towards achieving the expected outcomes of the SPO and to examine how progress might be enhanced through improving programme policy, design and delivery.

15 Safeguarding of the Intangible Cultural Heritage (2003), Protection of the Underwater Cultural Heritage (2001), Protection of the World Cultural and Natural Heritage (1972), Prohibiting and

Preventing the Illicit Import, Export and Transfer of Cultural Property (1970) and Protection of Cultural Property in the Event of Armed Conflict (1954)

16 UNESCO 34C/5, page 124

Page 43: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

39

The SPO11 evaluation should assist UNESCO’s Governing Bodies, the Governing Bodies of the five Conventions, Senior Management and the Culture Sector by making recommendations, based on clearly stated evidence, of the following nature: Whether the current level of funding is adequate for the programmes that contribute to the SPO; if possible, the evaluation will give indications as to whether funding should be increased or decreased for any projects or programmes Whether the current geographical spread of programmes and activities best meets the demands of the SPO Whether new programme delivery mechanisms or modalities need to be developed or existing ones diminished Which capacities need to be built in order to more effectively meet the expected outcomes of the SPO Whether changes need to be made to internal structures and organizational policies/procedures to more effectively meet the expected outcomes of the SPO Which relationships, both inside and outside UNESCO and the UN, need to be strengthened to meet the expected outcomes of the SPO. Evaluation Scope

The evaluation is expected to reach findings and draw lessons learnt17

on:

Progress made towards achieving the expected outcomes of the SPO Where UNESCO’s comparative advantages currently lie and where they potentially lie Evolving areas of strategic importance to which UNESCO may need to pay more attention The extent to which the two global programme priorities of Africa and gender equality have been addressed through the SPO The degree of intersectoral and interdisciplinary work The relevance, efficiency, effectiveness including cost-effectiveness, impacts and sustainability for a sample of projects and programmes An indicative list of questions to be answered by the evaluation is presented in Annex A. The evaluation team will be expected to further develop this list during the inception phase in consultation with the Reference Group. The questions will be presented in the first deliverable, the inception report, as part of the overall evaluation framework and methodology. The evaluation will focus on programmatic activity of the biennium in which the evaluation is taking place (2008-09). However, given the timing of this evaluation which is to occur in the first half of 2009, part of the evaluation will focus on programme activities planned in the previous biennium (2006 – 2007). It may be necessary to go back to even earlier biennia, particularly for capturing the key events in the evolution of the programmes under study. The evaluation will cover Regular Programme funding and extrabudgetary funding that are expected to contribute to the SPO. All of UNESCO’s programmatic work under SPO 11 takes place through the promotion and implementation of the five aforementioned normative instruments (footnote 1). A sample of programmes and projects, and the country(ies) to be visited, will be identified by IOS in consultation with the Reference Group. In view of the Africa priority, it is anticipated that one of the country visits will be to an African country. The sample will vary depending on the nature and distribution of programme activities. As a guideline, the sample should contain 20%–40% of the programmatic financial resources dedicated to the SPO, and take into account the following: High representation of programmatic activities that have not recently been subject to external evaluation Priority areas identified by the Evaluation Reference Group

17

Lessons learnt are generalizations based on evaluation experiences with projects, programmes, or policies that abstract from the specific circumstances to broader situations.

Page 44: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

40

Wide geographical coverage based on the financial allocations, with special consideration given to Africa Balance between programmes and projects managed by Headquarters and field offices Joint initiatives with other UN agencies.

Evaluation Methodology

The methodology will include: Desk study, comprising: (1) mapping of activities, projects and programmes to identify the Regular Programme Main Lines of Action and extrabudgetary projects that belong to the SPO; (2) summary of findings and recommendations of previous evaluations that relate to the SPO; (3) a listing of all normative instruments (declarations, recommendations and conventions) that relate to the SPO; (4) a listing of related evaluations undertaken by other organizations. Document review: Report of the Director-General on the activities of the Organization (document C/3); Report by the Director-General on the Execution of the programme (document EX/4); project documents, annual progress reports, final reports and evaluations of extrabudgetary projects; mission reports; internal think pieces; UNESCO Country Programme Documents; UNDAFs; evaluations, studies and research of other UN organizations and stakeholders on the subject being evaluated Data extracted from SISTER, a database containing all work plans and monitoring data Questionnaires and surveys Interviews, discussions and workshops Field office visits Roles and responsibilities

IOS is responsible for the overall management of each evaluation and quality assurance of the deliverables. The external consultant and IOS will form a team to conduct the evaluation. Where resources permit, IOS will participate in the field missions. IOS will work closely with the consultant in data collection and analysis, the drawing of conclusions and formulation of recommendations and drafting of the report. IOS has established a Reference Group for the evaluation comprising staff from the Culture Sector, the Bureau of Strategic Planning and IOS. The Reference Group will advise on the Terms of Reference and the selection of the external consultant, provide comments on the draft evaluation report and provide guidance on appropriate actions to be taken in response to evaluation recommendations.

Logistics

The evaluation team will commonly be responsible for their own logistics: office space, administrative and secretarial support, telecommunications, printing of documentation, etc. Suitable office space will be provided for the consultants when they are working from UNESCO offices (in Paris Headquarters or in the field). The evaluation team will also be responsible for dissemination of all methodological tools such as surveys, but IOS will facilitate this process to the extent possible by providing contact information such as email addresses. With regards to field visits, the relevant Field Office and IOS will assist the evaluation team in providing programmatic documentation, setting up meetings and providing security clearance documents, etc. The evaluation team is responsible for all travel related costs, including transport to and from the airport and transport to and from interviews. The travel costs should be itemized in the financial proposal. Deliverables and Schedule

The evaluation team will be required to deliver four key deliverables in English or in French. Any parts relating to Spanish-speaking countries (e.g. country reports, case studies, and project based reports) may be written in Spanish with summaries in English or French.

Page 45: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

41

Inception report: containing the evaluation framework, detailed evaluation methodology, project/programme sample, work plan and logistical arrangements. Workshop: to present findings and tentative recommendations to the Reference Group Evaluation report of between 25–35 pages (excluding annexes) to be structured as follows:

− Executive Summary (3–4 pages)

− Description of the SPO

− Evaluation purpose

− Evaluation methodology

− Main findings (structured against each of the points in paragraph 5 and presented in terms of achievements and challenges)

− Lessons learnt

− Recommendations

− Annexes (including interview list, detailed data, details of the data collection instruments, key documents reviewed, Terms of Reference, synthesis report from the review of past evaluations related to the SPO)

− The evaluation team will provide the deliverables according to the following indicative timetable:

Deliverables and Schedule Date

Start up meetings in Paris 11 – 15 May 2009 (tentative)

Inception report 15 May 2009

Workshop 1 July 2009

Draft evaluation report 7 July 2009

Final evaluation report 31 July 2009

Evaluation Team Qualifications

The core evaluation team will ideally be comprised of two international consultants. Depending on the evaluation approach developed by this core team, other national consultants, advisers and/or agencies with specific expertise in the culture field may be hired to contribute to the evaluation process. The team will include two staff members of the Internal Oversight Service who will provide methodological guidance and manage the evaluation process. The evaluation team should possess the following qualifications: The team leader will possess at least 10 – 15 years of professional experience in programme and project evaluation of relevance to policy making, to include international experiences. He/she will also have a strong record in leading and/or conducting evaluations (required). Advanced university degree in specialized fields of culture, social sciences, humanities, public policy, or related field (required). Professional experience/expertise in the field of tangible and intangible cultural heritage, including at the international level (required). Strong knowledge of the United Nations, including previous work experience or assignments for the UN (required). One team member will have experience in gender analysis or gender evaluation methodologies (required). Excellent oral communication and report writing skills in English or French (required). Other team members will also have professional experience in programme and project evaluation (preferred). Two samples of previous evaluation work, preferably relevant to the subject of this evaluation, must be submitted as part of the technical proposal. Preference will be given to evaluation teams that are multicultural with appropriate gender balance and geographic representation.

Page 46: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

42

Reference Documents

The following is a preliminary listing of relevant hyperlinked documents. The Culture Sector and IOS may add documents to this list as necessary. UNESCO Medium Term Strategy 2008-2013 - 34 C/4 UNESCO Evaluation Plan 2008-2009 - 34 C/5 UNESCO Approved Programme and Budget, 2008-2009 - 34 C/5 UNESCO Approved Programme and Budget, 2006-2007 - 33 C/5 UNESCO Approved Programme and Budget, 2004-2005 - 32 C/5 Report of the Director-General on the Activities of the Organization in 2006-2007 – 35 C/3 Detailed Report on the Activities of the Organization in 2006-2007: Major Programme IV – Culture - 35 C/3 Report by the Director-General on the Execution of the Programme adopted by the General Conference Major Programme IV – Culture - 180 EX/4 Report by the Director-General on the Implementation of the Programme and Budget (33 C/5) and on Results Achieved in the previous biennium (2006-2007) Major Programme IV – Culture -179 EX/4

Report by the Director-General on the Execution of the Programme Adopted by the General Conference Major Programme IV – Culture - 177 EX/4 Report by the Director-General on the Execution of the Programme Adopted by the General Conference Major Programme IV – Culture - 176 EX/4 Report by the Director-General on the Execution of the Programme Adopted by the General Conference Major Programme IV – Culture - 175 EX/4 Previous Evaluations, Audits and internal progress reports: Management Audit of the World Heritage Centre Report (WHC.07/31.com/19a.rev) Progress report on the implementation of the recommendations of the 2007 Audit (WHC.08/32.com/17) Performance indicators for World Heritage (WHC-06/30.COM/12) Result-Based Management Framework and Roadmap for World Heritage (WHC-06/30.COM/INF.12) UNESCO’s Action to help Member States Prevent Illicit Trafficking of Cultural Property (2005) Evaluation of the Slave Route Project (2005) Culture Heritage Management and Tourism: Evaluation and Mainstreaming (2005) Evaluation of the World Heritage Fund’s Emergency Assistance activities (2005)

Page 47: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

43

Normative instruments-related documents: Convention for the Safeguarding of Intangible Cultural Heritage Operational Directives for the implementation of the Convention for the Safeguarding of the Intangible Heritage Convention on the Protection of the Underwater Cultural Heritage Convention concerning the Protection of the World Cultural and Natural Heritage Operational Guidelines for the Implementation of the World Heritage Convention Report of the WH Committee on its activities 2006-2007 Report of the WH Committee on its activities 2004-2005 Convention on the Means of Prohibiting and Preventing the Illicit Import, Export and Transfer of Ownership of Cultural Property Convention for the Protection of Cultural Property in the Event of Armed Conflict with Regulations for the Execution of the Convention

Page 48: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

44

ANNEX II EVALUATION QUESTIONS

Progress made towards achieving the expected outcomes of the SPO

What has been the progress made towards the achievement of the expected outcomes of SPO 11? What are the main reasons for the achievement or non-achievement of expected outcomes? Where UNESCO’s comparative advantages currently lie and where they potentially lie, in particular UNESCO’s

ability to respond effectively to complex contemporary problems through intersectoral and interdisciplinary

action

What specifically are UNESCO’s comparative advantages as it concerns SPO 11? Is UNESCO making effective use of those comparative advantages? What impact, if any, are the recently introduced intersectoral platforms having on the delivery of SPO 11? What impact, if any, are other intersectoral and interdisciplinary actions/modalities having on programme delivery and the achievement of the SPO 11 expected outcomes? The extent to which the two global programme priorities of Africa and gender equality have e addressed

through the SPO

What progress has been made in the implementation of the gender mainstreaming strategy? How effectively are the specific needs of girls and women addressed through the SPO? To what extent does the SPO take into account Member States needs as articulated by the African Union, through its NEPAD programme? What progress has been made in addressing the outcomes and recommendations of the African Union on culture (Khartoum Summit)? Are these two global priorities consistent with the priorities of the States Parties to the Conventions, as spelled out in the conventions themselves, the operational guidelines, etc? Has addressing the two priorities in the relevant SPO 11 programmes proven to be feasible and useful in all cases? What lessons can be drawn for improvements in the future? The relevance, efficiency, effectiveness including cost-effectiveness, impacts and sustainability (for a sample of

projects and programmes)

Are the project/programme objectives addressing identified needs of the target group(s)? Could the activities and outputs been delivered with fewer resources without reducing their quality and quantity? What is the effect of internal administrative procedures on programme delivery in terms of cost, staff time and the quality of outputs (results)? Is the geographical distribution of permanent and temporary staff involved in programme execution adequate to ensure the delivery of planned activities and planned outputs? What has been the progress made towards achievement of the expected results? What are the reasons for the achievement or non-achievement of expected results? Is the project/programme cost-effective, i.e. could the outcomes and expected results have been achieved at lower cost through adopting a different approach and/or using alternative delivery mechanisms? What is the likelihood that the benefits from the programme will be maintained for a reasonably long period of time if the programme were to cease? Is the programme supported by local institutions and well integrated with local social and cultural conditions?

Page 49: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

45

ANNEX III EVALUATION PLANNING MATRIX

Key Evaluation Questions Data Sources Collection Methods Comments / Sampling

I. What progress has been made towards achieving the expected outcomes of SPO 11? Sub questions:

To what extent have the programmes that contribute to SPO 11

influenced national and local policies, in particular conservation

policies and policies aimed at preserving cultural heritage?

To what extent have national conservation policies and

processes been revised to take into account global trends such

as climate change, urbanization and migration? What new forms of international cooperation have been

developed to strengthen the application of the 1970

Convention?

How have UNESCO programmes contributed to having the role

of museums better understood and recognized by decision-

makers, in particular in formal and non-formal education

programmes in Member States?

How has UNESCO inter-sectoral action / cooperation contributed

to the expected outcomes?

What are the main reasons fro the achievement or non-

achievement the expected outcomes?

Programme implementing partners Programme beneficiaries Culture ADG Culture staff at HQ and Field Offices UNESCO results-based reporting documents (C/3, EX/4, SISTER, mission reports)

Document review Questionnaires Interviews Field visit

Criteria that will be used to assess outcomes include: Examples of how UNESCO programmes have influenced policy development processes. Examples of new policies adopted and/or existing policies improved as a result of UNESCO programmes. All Culture staff will either be interviewed or subject to questionnaire. The questionnaire will reach partners and beneficiaries in 10 countries, 2 per 5 regions. One field visit to Accra, Ghana.

Page 50: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

46

II. To what extent have the programmes that contribute to the SPO addressed the two global programme priorities of Africa and Gender Equality? Sub-questions:

What progress has been made toward the expected outcomes of

the Gender Equality Action Plan?

How effectively are the specific needs of girls and women

addressed through the SPO?

To what extent does the SPO take into account Member States

needs as articulated by the African Union, through its NEPAD

programme? What progress has been made in addressing the

outcomes and recommendations of the African Union on culture

(Khartoum Summit)?

Are these two global priorities consistent with the priorities of

the States Parties to the Conventions, as spelled out in the

Conventions themselves, the respective Operational Guidelines,

etc?

Has addressing the two priorities in the relevant SPO 11

programmes proven to be feasible and useful in all cases? What

lessons can be drawn for improvements in the future?

Programme implementing partners Programme beneficiaries ADG Culture ADG AFR BSP Director of Division for Gender Equality Culture staff at HQ and Field Offices UNESCO results-based reporting documents (submission to BSP on contributions to GEAP, C/3, EX/4, SISTER, mission reports, relevant UNESCO reporting to NEPAD and AU)

Document review Questionnaires Interviews Field visit

Criteria that will be used to assess the two priorities include: Performance indicators given in the Gender Equality Action Plan and 34C/5 (para 04007 and 04008) Expected results and indicators given in 34 C/5 (pages 136 – 137) Sample of project documents will be reviewed to see how gender and Africa have been mainstreamed

Page 51: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

47

III. Where do UNESCO’s comparative advantages currently lie and where do they potentially lie? Sub questions:

What specifically are UNESCO’s comparative advantages as it

concerns SPO 11?

How effectively is UNESCO making use of those comparative

advantages?

What effect, if any, are the recently introduced intersectoral

platforms and interdisciplinary actions/modalities having on

programme delivery and achievement of the SPO 11 expected

outcomes?

Programme implementing partners Programme beneficiaries Culture ADG Culture staff at HQ and Field Offices UNESCO results-based reporting documents (C/3, EX/4, SISTER, mission reports) Meta analysis of previous evaluations

Document review Questionnaires Interviews Field visit

Page 52: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

48

ANNEX IV WORK ON THE CONVENTIONS WITH EXAMPLES

Level The three stages of working on the

Conventions

Examples of technical assistance (that has been or

could be provided by UNESCO to support State

Parties’ work on the Conventions) RATIFICATION / ACCEPTANCE / APPROVAL /

ACCESSION

Awareness raising (with key policy makers) about provisions of the Conventions Support to countries to prepare for ratification Etc.

IMPLEMENTATION AT THE POLICY LEVEL

integration of the provisions of the Conventions into national legislation, regional / national policies, development plans

Awareness raising (with key policy makers) about the need to translate Conventions into concrete legislation, policies, development plans Leadership development programmes to foster policy makers’ commitment to integrate provisions of the Conventions into national legislation, regional / national policies, development plans Support countries through policy / legislation analysis (to establish how provisions of the Conventions could be integrated into national legislation, policies, development plans, or whether new legislation, policies, development plans ought to be developed) Distribution of model legislation and policies Help individual countries draft legislation / policies / development plans to implement provisions of Conventions Regional workshops to facilitate exchange of experience among countries with regard to the integration of provisions of Conventions into national legislation, policies, development plans (such as, for instance, how to integrate into national education policies that museums play a role in formal and non-formal education programmes) Regional workshops to discuss specific issues pertaining to the Conventions and how to integrate these into national legislation and policies (for instance the issue of mutual legal assistance in the context of combating illicit trafficking of cultural objects and of promoting the return of objects to their countries) Support State Parties when developing their reports to the respective Committees on the legislative, regulatory and other measures taken for the implementation of the Conventions. Training of trainers, such as for instance of teachers working at civil service colleges or in pertinent university departments, about the Conventions and their integration into regional / national legislation, policies, and development plans International events that bring together stakeholders from developed and developing countries to exchange experience with regard to the implementation of the Conventions and to foster international cooperation and assistance Distribution of guidelines, tool kits, and other publications that are designed to help policy makers understand the provisions of the Conventions and how to integrate these provisions into national legislation, policies, development plans Etc.

IMPLEMENTATION AT THE PROGRAMME /

PROJECT LEVEL

application of national legislation, national / regional policies, development plans once the provisions of Conventions have been included, and

Awareness raising among the general public and pertinent professions around the issues (pertaining to the Conventions) that have been integrated in national legislation, policies, development plans (for example, the need to safeguard intangible cultural heritage including oral traditions, performing arts, social practices, traditional craftsmanship,

Page 53: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

49

implementation of those provisions of the Conventions that directly address the programme / project level.

etc.) National / regional / international workshops to raise awareness of the importance of safeguarding of the cultural and natural heritage, of combating illicit trafficking, of preparing for the protection of cultural and natural heritage in the case of armed conflict, etc. Build State Parties’ capacities to draw up inventories of the cultural and natural heritage present in their respective territories Help State Parties (in cooperation with communities and other stakeholders) develop (and propose to the respective Committees) Lists of Cultural and Natural World Heritage; Lists of Intangible Cultural Heritage of Humanity; Lists of Intangible Cultural Heritage in the Need of Urgent Safeguarding; as well as programmes, projects and activities for the safeguarding of cultural and natural heritage; etc. Strengthen institutional capacities of State Parties for safeguarding cultural and natural heritage, for combating illicit trafficking, for raising awareness and building commitment around these issues etc. Training of experts (working in areas such as research, preservation, protection of cultural heritage) etc. Training of trainers working in national and local training institutions (for instance for cultural and natural heritage management, preservation issues, etc.) Training of judges to apply national legislation (related to cultural and natural heritage protection or to combating illicit trafficking or other issues) Regional workshops to foster commitment for the provision of mutual legal assistance in the context of combating illicit trafficking and of promoting the return of objects to their countries Support to individual museums that want to strengthen their role in formal and non-formal education programmes National / regional workshops to strengthen inter-sectoral capacities to address new challenges related to the protection and conservation of cultural and natural heritage Etc.

Page 54: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

50

ANNEX V TABLE OF PROJECTS ANALYZED

This table compiles the projects for the 10 Field Offices that constituted the sample provided / selected by IOS. The data extracted from FABS have then been reviewed according to the information available in SISTER (Qualitative monitoring reports and financial monitoring reports)

BAMAKO

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP BAM 34121310BAM Réunion sous-régionale de sensibilisation sur la convention 2003 pour la sauvegarde du patrimoine culturel immatériel

11,100

33C5 RP BAM 34122211BAM Inventaire du patrimoine culturel immatériel dans quatre régions pilotes du Mali (Sikasso, Ségou, Gao, Koulikoro) et au Burkina Faso (Ouagadougou et Bobo Dioulasso)

6,250

34C5 RP BAM 4412300010BAM Réalisation de l'inventaire du patrimoine culturel immatériel en Guinée

76,800

33C5 RP BAM 34131102BAM Appui à la protection des sites culturels au NIGER dans le contexte post-conflit

20,000

33C5 RP BAM 34141203BAM Elaboration de guides sur les collections permanentes de à l'intention du public scolaire au Mali, au Niger et au Burkina Faso.

10,000

34C5 RP BAM 4413100017BAM Atelier régional de renforcement des capacités du personnel du Musée à la documentation contre le trafic illicite des objets et la conservation préventive

25,000

33C5 RP BAM 34112205BAM Appui à la réhabilitation des plans de gestion des sites du patrimoine du Burkina Faso et du Niger

10,000

33C5 RP BAM 34113108BAM Appui à la réhabilitation des sites du patrimoine mondial au Mali.

5,000

34C5 RP BAM 4411200012BAM Appui à la finalisation des dossiers d’inscription des pays du Cluster sur la Liste indicative du Patrimoine Mondial

34,248

34C5 RP BAM 4411203012BAM Appui à la finalisation des dossiers d’inscription des pays du Cluster sur la Liste indicative du Patrimoine Mondial

10,752

33C5 XB BAM 553MLI4000 PLAN D'ACTION DE SAUVEGARDE DU YAARAL ET DU DEGAL (MALI) - A UNESCO MASTERPIECE OF THE ORAL AND INTANGIBLE HERITAGE OF HUMANITY 74,470

Page 55: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

51

BEIRUT

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP BEI 34122302BEI Soutient à la promotion par l'enseignement, et publication de CD de la musique savante ancienne dans le monde Arabe

15,000

34C5 RP BEI 4412200007BEI Safeguarding Intangible Heritage in Lebanon

2,954

34C5 RP BEI 4412260007BEI Safeguarding Intangible Heritage in Lebanon

4,073

33C5 RP BEI 34132202BEI Arab Regional Meeting on UNESCO Conventions for the Protection of Cultural Heritage

41,507

33C5 RP BEI 34141117BEI Training activity in preventive conservation for museum professionals in Lebanon

10,800

33C5 RP BEI 34141214BEI Workshop: Enhancing National Capacities for the Protection of Cultural Property

15,000

34C5 RP BEI 4413100029BEI Training Seminar on the application of the 1970 and 1995 Conventions

454

34C5 RP BEI 4413160029BEI Training Seminar on the application of the 1970 and 1995 Conventions

21,546

33C5 RP BEI 34113119BEI Capacity-building in State Parties 14,000

33C5 RP BEI 34113120BEI Promotion about World Heritage Preservation for the Young

10,000

34C5 RP BEI 4411200027BEI Workshop in World Heritage Education for School Teachers in Post-Conflict Areas

1,013

34C5 RP BEI 4411200069BEI National Workshop on "the 1954 Convention for the Protection of Cultural Heritage in the Event of Armed Conflict and its 2 Protocols"

1,454

34C5 RP BEI 4411260027BEI Workshop in World Heritage Education for YH

18,987

34C5 RP BEI 4411260069BEI National Workshop on "the 1954 Convention for the Protection of Cultural Heritage in the Event of Armed Conflict and its 2 Protocols"

18,546

33C5 XB BEI 222LEB4000 CAPACITY BUILDING OF HUMAN RESOURCES FOR DIGITAL DOCUMENTATION OF WORLD HERITAGE SITES AFFECTED BY 2006 WAR IN LEBANON 767,226

34C5 XB BEI 490GLO4001 Emergency safeguarding of the WH site of Byblos 100,000

CAIRO

Page 56: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

52

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP CAI 34121319CAI Support to the two-day workshop on "Education to Intangible Cultural Heritage in the Arab States"

3,000

33C5 RP CAI 34122220CAI Inventory-making and field research on endangered traditions of the Nubian communities of Sudan, and their representation in the intangible section of the new under construction Museum of Wadi Halfa.

12,000

34C5 RP CAI 4412200008CAI Promoting Intangible Heritage in Egypt 25,000

33C5 RP CAI 34141109CAI Preservation of endangered cultural assets of the traditional Egyptian storytellers heritage and its instruments and tools

30,000

33C5 RP CAI 34141213CAI Protection of endangered objects in the National Museum of Khartoum, the museum of Gebal Barkal, and the Future museum of Wadi Halfa

29,900

34C5 RP CAI 4413100030CAI Museums as knowledge gateways for Nubian Culture

31,500

34C5 RP CAI 4413100031CAI Symposium on illicit traffic of cultural objects (to be held in Sana'a-Yemen)

20,000

33C5 RP CAI 34113145CAI Strengthen the protection of the world heritage site endangered of Zabid in Yemen

20,000

34C5 RP CAI 4411200028CAI Development versus Conservation in Zabid

4,423

34C5 RP CAI 4411203028CAI Development versus Conservation in Zabid

15,577

34C5 XB CAI 549EGY4000 Cairo Safeguarding Egyptian Traditional Festivals 58,997

34C5 XB CAI 536EGY4000 Conservation of the Wall Paintings of the royal tomb of Amenophis III 437,468

34C5 XB CAI 225EGY4000 Mobilization of the Dahshur World Heritage for Community Development 772,005

HAVANA

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP HAV 34122106HAV Development of methodological tools to promote the participation of the communities in the safeguarding of their intangible heritage (included endangered languages).

45,000

33C5 RP HAV 34122310HAV Establishment of Living Human Treasures national systems in Cuba and the Dominican Republic

15,000

Page 57: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

53

33C5 RP HAV 34122509HAV The contribution of the Convention to sustainable developement: the use of ICTs

9,500

34C5 RP HAV 4412100007HAV Pilot Project: Route of the cultural heritage in the 3 Oriental Provinces of Cuba; a holistic safeguarding and coordinated preservation of the tangible and intangible heritage of communities

20,000

34C5 RP HAV 4412200013HAV Promoting and Safeguarding living heritage in LAC countries

37,585

33C5 RP HAV 34131402HAV Protection, management and restoration of endangered heritage sites in Haiti.

12,750

33C5 RP HAV 34141223HAV Enhancing the protection of endangered movable cultural properties of the region by coordinating the actions of the main concerned professionals

26,000

34C5 RP HAV 4413100051HAV Fostering technical and qualitative knowledge on creation and protection of museums and cultural objects at community level in Cuba and the Dominican Republic

39,250

34C5 RP HAV 4413100056HAV Prévention du transfert de propiété illicite des biens culturels en Amérique Latine et dans les Caraibes: le rôle des musées

44,100

33C5 RP HAV 34113114HAV Support to the implementation of the World Heritage Action Plan for Latin America and the Caribbean.

10,000

33C5 RP HAV 34113117HAV Inventory and study of the Cultural Landscapes related to the Slavery History in the Latin Caribbean countries (Havana Office Cluster)

2,500

34C5 RP HAV 4411200055HAV Support to local communities in managing sustainable tourism initiatives in cultural and natural sites, listed and non-registered in The World Heritage List specially using the framework of the Caribbean Capacity Building Programme(CCBP) or similar strategy

33,450

34C5 RP HAV 4411200058HAV Support to local communities in running sustainable heritage management initiatives in cultural and natural sites, inscribed in the World Heritage List, the indicative list, and/or recognized as national landmarks.

5,708

34C5 RP HAV 4411200059HAV Capacity building of community stakeholders (journalists and professionals in the field of education for the wider diffusion of UNESCO world cultural and intangible heritage programme.

20,000

Page 58: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

54

34C5 RP HAV 4411240058HAV Support to local communities in running… 14,292

MAPUTO

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP MAP 34121309MAP Providing Technical assistance to the government with view to undertaking steps for ratification of the UNESCO 2003 Convention

6,500

33C5 RP MAP 34122203MAP Capacity building on the elaboration of national inventory in intangible cultural heritage

18,700

34C5 RP MAP 4412300018MAP Contribution to inventory-making of the Mozambican ICH through capacity-building and piloting in selected province(s)

20,000

33C5 RP MAP 34131106MAP Organization of a youth camp in the Island of Mozambique

20,000

33C5 RP MAP 34141219MAP Assist national museums to establish networking and prepare virtual inventories

20,000

33C5 RP MAP 34113116MAP Strengthening the protection of world heritage properties and in particular properties in danger

10,000

34C5 RP MAP 4411200021MAP Conservation and Management Plan for Mozambique Island (World Heritage Site C 599)

30,000

33C5 XB MAP 553MOZ4000 SAFEGUARDING THE CHOPI TIMBILA TRADITION IN MOZAMBIQUE - A UNESCO MASTERPIECE OF THE ORAL AND INTANGIBLE HERITAGE OF HUMANITY 56,500

33C5 XB MAP 503MOZ4000 DEVELOPMENT OF CULTURAL INSTITUTIONS OF MOZAMBIQUE

3,009,170

34C5 XB MAP 519MOZ4000 Rehabilitation of the St. Sebastian Fortress, Mozambique. 729,730

MOSCOW

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP MOS 34122507MOS Strengthening capacities for the safeguarding of intangible cultural heritage in the cluster countries.

24,000

34C5 RP MOS 4412300031MOS Strengthening capacities of safeguarding and promotion of the intangible cultural heritage of the cluster countries

20,000

33C5 RP MOS 34131502MOS Promoting partnership for safeguarding and rehabilitation of heritage in the Chechen Republic and the South Caucasus.

24,000

Page 59: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

55

33C5 RP MOS 34132208MOS Strengthening legislative activity of the cluster countries for protection and safeguarding of their cultural property and heritage.

25,000

33C5 RP MOS 34141212MOS Fostering museum-to-museum partnerships in cluster countries.

20,000

34C5 RP MOS 4413100050MOS Promoting partnership of museums as places for access to knowledge and enhancing the protection of cultural objects in the cluster countries

47,520

33C5 RP MOS 34113105MOS Reinforcing capacity-building for the protection and safeguarding of world heritage in the cluster countries.

30,600

34C5 RP MOS 4411200051MOS Strengthening national capacities for protecting cultural heritage and effective implementation of the World Heritage Convention in the cluster countries

65,000

33C5 XB MOS 553ARM4000 SAFEGUARDING OF ARMENIAN DUDUK MUSIC - A UNESCO MASTERPIECE OF THE ORAL AND INTANGIBLE HERITAGE OF HUMANITY 91,383

34C5 XB MOS 570RUS4000 CAPACITY-BUILDING TRAINING FOR CIS COUNTRIES IN MUSEUM MANAGEMENT 114,695

NEW DELHI

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP NDL 34121305NDL Support for the implementation of Intangible Heritage Convention

37,000

34C5 RP NDL 4412300028NDL Technical support towards the development of national inventories on intangible heritage

94,392

33C5 RP NDL 34131308NDL Cultural heritage management in post-conflict /post-disaster situations in Kashmir.

10,000

33C5 RP NDL 34141106NDL Preservation of Tribal Arts Collections, India

30,000

33C5 RP NDL 34141107NDL Preservation of the endangered cultural assets of H'mong, Yao and T'ai people

19,238

33C5 RP NDL 34141204NDL Capacities for protection of moveable cultural properties strengthened through conservation of collections/ Museums

10,000

34C5 RP NDL 4413100046NDL Capacity building of the museums as pedagogical institute, with particular focus on the representation of tribal cultures

20,000

33C5 RP NDL 34113107NDL Follow up to WH periodic report 10,000

Page 60: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

56

34C5 RP NDL 4411200047NDL Support toward the integrated management plan of historical sites with particular focus on tourism development and heritage guide training (Support to WH site management plans; Heritage Passport, Heritage Guide Training)

63,046

33C5 XB NDL 553BHU4000 ACTION PLAN FOR THE SAFEGUARDING AND PROMOTION OF THE DRAMETSE NGACHAM, BHUTAN - A UNESCO MASTERPIECE OF THE ORAL AND INTANGIBLE HIERTAGE OF HUMANITY (2005 PROCLAMATION) 56,963

34C5 XB NDL 406IND4000 Network of Indian Cities of Living Heritage 25,745

PHNOM PENH

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP PNP 34122212PNP Capacity Building for Human Resources of the Ministry of Culture and Fine Arts of Cambodia

5,000

34C5 RP PNP 4412306029PNP Revitalization of Khmer folktales/legends through movies.

20,000

33C5 RP PNP 34132219PNP National Workshop on the protection of Cultural Property and fighting against illicit traffic in Cambodia

7,000

33C5 RP PNP 34141231PNP Computerized Network of Cambodian Museums' Databases

6,000

34C5 RP PNP 4413100047PNP capacity building and training of staff related to institutions implementing the convention for the protection of cultural heritage such as the Ministry of Culture and Fine Arts (MCFA),

48,348

33C5 RP PNP 34113121PNP Support to Standing Secretariat of International Coordinating Committee for Safeguarding and Development of Historic Site of Angkor (ICC Angkor) ensured by UNESCO

133,000

33C5 RP PNP 34113165PNP Strengthening capacities for the conservation and development of World Heritage Properties

17,000

33C5 RP PNP 34113202PNP Publication of reference book on World Heritage in Khmer

5,000

34C5 RP PNP 4411200048PNP ICC-Angkor (International Coordinating Committee for the Safeguarding and the Development of the Historic Site of Angkor):

156,000

34C5 XB PNP 584CMB4000 Digitization and display of ancient Cambodian manuscripts 40,000

34C5 XB PNP 520CMB4004 Sauvegarde et développement du site historique d'Angkor 24,830

Page 61: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

57

33C5 XB PNP 520CMB4002 SAUVEGARDE ET LE DEVELOPPEMENT DU SITE HISTORIQUE D'ANGKOR CIC 2006 23,816

33C5 XB PNP 520CMB4003 SAUVEGARDE ET LE DEVELOPPEMENT DU SITE HISTORIQUE D'ANGKOR CIC 2007 19,443

33C5 XB PNP 536CMB4012 SUPPORT TO THE FACULTIES OF ARCHAEOLOGY AND ARCHITECTURE, ROYAL UNIVERSTIY OF FINE ARTS (RUFA), 2006-2007 CAMBODIA 195,445

34C5 XB PNP 536CMB4013 INTERGOVERNMENTAL CONFERENCE ON THE SAFEGUARDING AND DEVELOPMENT OF THE HISTORIC SITE OF ANGKOR 47,545

34C5 XB PNP 534CMB4001 Safeguarding of the Angkor Wat Temple Cambodia 565,000

QUITO

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP QUI 34122101QUI Support for the creation of the International Marimba School in Esmeraldas, Ecuador

5,000

33C5 RP QUI 34122102QUI In connection with CAN and CLT/CPD, support and reinforce capacities of the project Recovery of the Ancestral Medicine and Prevention of Illness.

6,000

33C5 RP QUI 34122301QUI Creation of sub-regional and national systems of Living Human Treasures in the Andean sub-region.

10,400

33C5 RP QUI 34122501QUI Pilot project Survival of displaced population in Colombia and promotion of traditional knowledge in the socio-cultural and natural resources management.

5,000

34C5 RP QUI 4412200014QUI Workshop on inventories in the framework of the application of the 2003 UNESCO Convention in the Andean countries.

25,000

33C5 RP QUI 34132106QUI Heritage publication 19,395

33C5 RP QUI 34132201QUI Workshop for an State of the Art of the various conventions for the protection of Cultural heritage in the Andean countries

35,000

33C5 RP QUI 34141205QUI In connection with ICOM LAC and National Committees of ICOM, Workshop for museum specialist and curators on museum curation

25,750

34C5 RP QUI 4413100060QUI In coordination with UNESCO Havana Office, Andean workshop on application of 1970 UNESCO Convention on Illicit Traffic of Cultural Goods.

45,000

33C5 RP QUI 34113106QUI Training for specialists and managers of the Andean cultural-natural sites inscribed (specially in danger) and non-

12,350

Page 62: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

58

inscribed in the World Heritage List

34C5 RP QUI 4411200067QUI Workshop for specialists and managers of the Andean cultural and natural sites inscribed and non-inscribed in the World Heritage List (follow up of the Cuenca Workshop 2007).

40,500

33C5 XB QUI 553BOL4001 ACTION PLAN FOR THE SAFEGUARDING OF THE CARNIVAL OF ORURO, UNESCO MASTERPIECE OF THE ORAL AND INTANGIBLE HERITAGE OF HUMANITY, BOLIVIA 120,232

33C5 XB QUI 552ECU4000 CAPACITY-BUILDING AND SUPPORT FOR THE CONSOLIDATION OF INTEGRAL CULTURAL POLICIES IN ECUADOR 226,000

34C5 XB QUI 536BOL4002 PRESERVATION AND CONSERVATION OF TIWANAKU AND THE AKAPANA PYRAMID, BOLIVIA 300,000

Page 63: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

59

VENICE

Biennium RP/XB Div/FO Budget code Project title

Budget

Allocation

(USD)

33C5 RP VNI 34121301VNI Assistance to the SEE member states in ratification and implementation of the Convention

8,300

33C5 RP VNI 34122103VNI Assistance to the member states for identification of ITH in SEE

16,000

34C5 RP VNI 4412200012VNI Promotion and implementation of the provisions of the 2003 Convention in SEE

18,380

33C5 RP VNI 34131501VNI Safeguarding of cultural heritage in SEE 121,092

33C5 RP VNI 34141206VNI Assistance in development and management of museums in SEE

30,000

34C5 RP VNI 4413100052VNI Integrated protection of cultural objects through provisions of the 1970 Convention and current museum practices in Southeastern Europe

29,450

34C5 RP VNI 4413100054VNI Promotion and implementation of the 2001 Convention provisions in Southeastern Europe

30,000

33C5 RP VNI 34113104VNI Assistance in the preparation of tentative lists and preparation of management plans for WH sites in SEE

15,000

34C5 RP VNI 4411200052VNI Title of Activity / Southeastern Europe heritage conservation and management (SEE HCM)

50,000

34C5 RP VNI 4411200053VNI Safeguard of the Cultural Heritage in Kosovo

50,000

34C5 RP VNI 4411200054VNI Interaction between the concept of cultural tourism and national cultural policies in SEE

44,950

33C5 XB VNI 650RER0005 Office capacity building 420,058

33C5 XB VNI 553ALB4000 SAFEGUARDING ALBANIAN FOLK ISO-POLYPHONY - A UNESCO MASTERPIECE OF THE ORAL AND INTANGIBLE HERITAGE OF HUMANITY 91,033

34C5 XB VNI 234ALB4000 Safeguarding Albanian Folk Iso-Polyphony - "The cradle that grew up the polyphony" 25,000

33C5 XB VNI 570RER4003 REGIONAL CENTER FOR THE DIGITALIZATION OF THE CULTURAL HERITAGE 443,550

33C5 XB VNI 650RER4000 Cultural Activities in the Framework of the Cooperation within Europe 1,291,124

33C5 XB VNI 534INT4000 INTERNATIONAL CONFERENCE ON THE VALORISATION OF ARCHEOLOGICAL SITES FOR A MUTUAL DEVELOPMENT 85,586

Page 64: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

60

33C5 XB VNI 530KOS4000 SAFEGUARD OF CULTURAL HERITAGE IN KOSOVO THE RESTORATION OF BOGODORICA LJEVISKA CHURCH OF PRIZREN 121,065

33C5 XB VNI 531KOS4000 Safeguard of Cultural Heritage in Kosovo: the restoration of Bogodorica Ljeviska Church of Prizren 76,336

33C5 XB VNI 534KOS4000 Safeguard of Cultural Heritage in Kosovo 1,418,440

33C5 XB VNI 576SVI4011 4 paintings organ shutters Church S.Giovanni Crisostomo 31,412

33C5 XB VNI 576FRA4001 RESTORATION OF THE CEREMONIAL DINING ROOM AT THE FORMAL ROYAL PALACE ST MARKS SQUARE IN VENICE 388,577

33C5 XB VNI 576SVI4009 RESTORATION OF THE PAINTING "MADONNA CON IL BAMBINO E CHERUBINI" BY BARTOLOMEO VIVARINI, CHURCH OF SANT'EUFEMIA 22,453

33C5 XB VNI 576SVI4008 RESTORATION OF THE PAINTING MADONA CON BAMBINOIN TRONO 62,966

33C5 XB VNI 576AMI4000 VOTIVE MONUMENT UNDER PORTICO CASE NUOVE 24,020

34C5 XB VNI 576VNL4001 Restoration of the wooden pulpit Church San Lio 22,968

34C5 XB VNI 576SVI4018 Acceptance of the inclusion in the UNESCO - Private Committees Program for the Safeguarding of Venice of the restoration of paintings representing "Bonta" and "Figura femminile in volo" by Tintoretto at the Scuola Grande di San Rocco in Venice (Save Venice Inc.) 21,965

34C5 XB VNI 576VIP4005 Institution of three bursaries for participant of the ICCROM 2009 Stone Course to be held in Venice 15,929

34C5 XB VNI 576VIP4004 Institution of three bursaries for participant of the ICCROM 2009 Stone Course to be held in Venice (16 April-3 July 2009) 15,929

34C5 XB VNI 576SVI4012 RESEARCH GRANT FOR ENRICO LUCCHESE STUDY AND CATALOGING OF AN ALBUM BY ANTON MARIA ZANETTI AT THE FONDAZIONE GIRGIO CINI IN VENICE 19,065

34C5 XB VNI 576SVI4014 Restoration of the altar of S.Girolamo and tomb of Girolamo Priuli situated in the Church of San Salvador in Venice 31,873

34C5 XB VNI 576SNV4000 Restoration of the back of the polyptic of the Holy Virgin in the Chapel of San Tarasio in the Church of San Zaccaria Venice. 55,731

34C5 XB VNI 576VIP4007 Restoration of the Canova Monument in the Basilica of Santa Maria Gloriosa dei Frari (Frari Church) in Venice 15,915

Page 65: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

61

34C5 XB VNI 507KOS4000 Restoration of the cathedral Church of Christ the Saviour in Prizren 221,567

34C5 XB VNI 576SVI4013 PADRE ETERNO BY AGOSTINO DA LODI 5,410

34C5 XB VNI 576SVI4016 Palladian Gala in Venice 31,665

34C5 XB VNI 576SVI4015 SVI Journal 2008 46,376

33C5 XB VNI 576SVI4000 J. DEL FIORE GALLERIE DE L'ACCADEMIA VENICE 59,743

33C5 XB VNI 576COI4000 FIORIN ENRICO 56,602

33C5 XB VNI 576ACP4000 Annual General Meeting of the ACP 22,998

33C5 XB VNI 576VIP4001 ARCHEO CLUB D'ITALIE-SEDE: RESEARCH AND TRAINING RESTORATION OF THE INSCRIPTIONS ON WALLS OF THE TEZON GRANDE, ISLAND OF LAZZARETTO NUOVO 33,531

33C5 XB VNI 576VHI4000 Fund raising event - Biennale Architettura 23,077

33C5 XB VNI 576VIP4000 Recovery of the heavy-lift crane Amstrong Mitchell in the Arsenale - Phase I 165,141

33C5 XB VNI 576SWE4000 RESTORATION OF FOUR LIONS IN FRONT OF PORTA MAGNA OF THE ARSENALE IN VENICE 23,552

33C5 XB VNI 576FRA4000 Restoration of St. Mark's Horses 54,033

33C5 XB VNI 576SVI4005 Restoration of the altar of San Nicola - Church of S. maria del Carmelo 47,179

33C5 XB VNI 576SVI4006 Restoration of the four organ shutters by Gentile Bellini - Chiesetta of San Teodoro in Basilica of San Marco 151,270

33C5 XB VNI 576SVI4007 Restoration of the painting "Annunicazione" by Paole Veronese at the Gallerie dell'Accademia 44,170

33C5 XB VNI 576SVI4010 Restoration of the painting "Annunicazione" by Salviati, Church of San Lazzaro dei Mendicanti 17,721

33C5 XB VNI 576SVI4003 Restoration of the painting "Pala Marcel" at the Gallerie dell'Accademia 31,220

33C5 XB VNI 576SVI4002 RESTORATION OF THE PAINTING BY TINTORETTO -BENEDIZIONE DI SAN MARCO AL LUOGO DI FONDAZIONE DI VENNEZIA 30,104

33C5 XB VNI 576SVI4001 Restoration of the Wooden Crucifix, Church San Martino 20,352

33C5 XB VNI 576COI4001 Restoration of the wooden sculpture Madonna del Rosario - Museo Diocesano d'Arte Sacra 12,204

33C5 XB VNI 576VHI4002 RESTORATION OF THREE HISTORICAL MUSICAL INSTRUMENTS OF THE CINI FOUNDATION IN VENICE 19,156

33C5 XB VNI 576SVI4004 Scuola Grande di San Rocco - Restoration of the ceiling painting by J.Tintoretto 33,865

Page 66: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

62

33C5 XB VNI 576VHI4003 THE GREAT ROADS OF CULTURE A VALUE FOR EUROPE 11,079

33C5 XB VNI 576VHI4001 VENICE BIENNALE WEEKEND 358,750

34C5 XB VNI 218BIH4000 COMMUNITY RECONCILIATION THROUGH POVERTY REDUCTION 300,000

34C5 XB VNI 576VIP4002 Purchase of various musical instruments for La Fenice Theatre 61,654

34C5 XB VNI 576VHI4004 Restoration in the Scuola Grande di San Rocco 25,928

34C5 XB VNI 576VIP4003 Restoration of the relief sculpture of Cristo Morto sorretto da due Angeli 14,600

34C5 XB VNI 568KOS4000 The restoration of Gazi Mehmet Pasha Hammam of Prizren 300,000

34C5 XB VNI 933ALB4000 Restoration of the historical centre of Gjirokastra in Albania 1,367,014

34C5 XB VNI 576VHI4005 RESTORATION PRIULI MONUMENT SAN SALVADOR 99,211

Page 67: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

63

ANNEX VI QUESTIONNAIRE FOR UNESCO CULTURE STAFF

Introduction

This questionnaire is part of the external evaluation of UNESCO’s Strategic Programme Objective (SPO) 11: “Sustainably protecting and enhancing cultural heritage”. The overall purpose of the evaluation is to assess progress towards achieving the expected outcomes of the SPO and to examine how progress might be enhanced through improving programme policy, design and delivery. The evaluation will focus on regular and extrabudgetary programmatic activity from 2006 and completed by 2008. Please note that the programmatic work which relates to SPO 11 encompasses World Heritage, intangible heritage and movable heritage. Cultural expressions, cultural industries and intercultural dialogue are not part of the SPO 11. It is also important to note that all of UNESCO’s programmatic work under the SPO 11 takes place through the promotion and implementation of five normative instruments18. You will find more details regarding SPO 11 in the UNESCO Medium-Term Strategy for 2008-2013 (34 C/4).

Your responses to this questionnaire will be kept confidential and the results of all

respondents will be presented to UNESCO in summarised form only.

The questionnaire is a combination of multiple choice and open-ended questions. The

questionnaire should take approximately 30 minutes to complete.

Thank you for completing this questionnaire.

Respondent Information

Indicate where you are currently posted. (drop down menu)

□ UNESCO Field Office

□ Headquarters – WHC

□ Headquarters – ICH

□ Headquarters – MCO

□ Others

Indicate how long you have been posted there. (drop down menu)

18

Safeguarding of the Intangible Cultural Heritage (2003), Protection of the Underwater Cultural Heritage (2001), Protection of the World Cultural and Natural Heritage (1972), Prohibiting and Preventing the Illicit Import, Export and Transfer of Cultural Property (1970) and Protection of Cultural Property in the Event of Armed Conflict (1954)

Page 68: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

64

□ less than 1 year

□ 1 – 3 years

□ more than 3 years

Strategic Programme Objective 11

As described in the Medium-Term Strategy (34 C/4), SPO 11 is concerned with UNESCO’s

work to protect and enhance cultural heritage. UNESCO’s normative and standard setting

work is an important component of SPO 11.

Please indicate to what extent you agree with the following statements.

The Culture programme

activities managed by your

Office or Headquarters

Division focus on the

implementation of the

following Conventions:

• Strongly

Agree

• Agree • Neither

agree

or

disagr

ee

• Disagree • Strongly

disagre

e

• Safeguarding of the

Intangible Cultural

Heritage (2003)

• • • • •

• Protection of the

Underwater Cultural

Heritage (2001)

• • • • •

• Protection of the World

Cultural and Natural

Heritage (1972)

• • • • •

• Prohibiting and

Preventing the Illicit

Import, Export and

Transfer of Cultural

Property (1970)

• • • • •

• Protection of Cultural

Property in the Event of

Armed Conflict (1954)

• • • • •

SPO 11 identifies four Expected Outcomes to which UNESCO’s Culture activities are

intended to contribute during the 2008 – 2013 period.

Please indicate to what extent you agree with the following statements.

Page 69: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

65

The Culture programme

activities managed by your

Office or Headquarters

Division focus on the

following:

• Strongly

Agree

• Agree • Neither

agree

or

disagr

ee

• Disagree • Strongly

disagre

e

• Expected Outcome 1:

The preservation of

cultural heritage and its

effects on development,

social cohesion and

peace integrated into

national and local policies

• • • • •

• Expected Outcome 2:

National conservation

policies and processes

revised to take account of

global trends such as

climate change,

urbanization and

migration

• • • • •

• Expected Outcome 3:

New forms of

international cooperation

developed to strengthen

the application of the

1970 Convention

• • • • •

• Expected Outcome 4:

Role of museums

recognized by decision-

makers as part of formal

and non-formal education

programmes

• • • • •

Progress towards Expected Outcomes

For each example please write up to 150 words.

You are asked below to provide examples of how UNESCO’s work has contributed to the achievement of expected outcomes. In your response, identify as clearly as possible the activity (e.g. undertaking research, facilitating workshop, holding conference), implementing partners (e.g. National Archeological Survey, Ministry of Culture, Ministry of Tourism), beneficiaries of the activity, outputs produced (i.e. publications, trained staff) and, most importantly, how the beneficiaries have used the outputs thus contributing to the outcomes. Remember to distinguish between the outputs (e.g. publication on heritage and urban development produced, 100 heritage specialists

Page 70: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

66

trained in sub-Saharan Africa, advice on intangible heritage convention provided in five countries) and outcomes (e.g. enhanced knowledge on heritage and urban development, capacities raised in sub-Saharan Africa, stronger legal framework for intangible heritage protection in five countries).

Provide an example(s) of how your Office’s or Headquarters Division’s work has contributed

to Expected Outcome 1. Please include information on policy changes and indicate if the

example (s) is financed under the regular budget or is extrabudgetary

Provide an example(s) of how your Office’s or Headquarters Division’s work has contributed

to Expected Outcome 2. Please provide information on policy changes and indicate if the

example (s) is financed under the regular budget or is extrabudgetary

Provide an example(s) of how your Office’s or Headquarters Division’s work has contributed

to Expected Outcome 3. Please provide details on the agencies that are involved in this

cooperation, budgets and implementation mechanisms.

Provide an example(s) of how your Office’s or Headquarters Division’s work has contributed

to Expected Outcome 4. Please give examples of educational activities that are linked to

museums.

What are the main reasons for the achievement and non-achievement of the Expected

Outcomes? Please cite specific opportunities or constraints for each of the examples you

have provided

Page 71: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

67

UNESCO’s comparative advantages

Please indicate to what extent you agree with the following statements:

• • Strongly

Agree

• Agree • Neither

agree

or

disagr

ee

• Disagree • Strongly

disagre

e

• UNESCO is a respected

leader in support of

protecting cultural

heritage

• • • • •

• UNESCO provides

effective policy advice to

States Parties in support

of protecting and

enhancing cultural

heritage

• • • • •

• UNESCO demonstrates a

strong comparative

advantage in its work to

protect and conserve

immovable cultural and

natural properties

• • • • •

• UNESCO demonstrates a

strong comparative

advantage in its work to

safeguard intangible

heritage

• • • • •

• UNESCO demonstrates a

strong comparative

advantage in its work to

enhance the protection of

cultural objects and the

fight against illicit

trafficking in them

• • • • •

• UNESCO demonstrates a

strong comparative

advantage in its work in

the development of

museums

• • • • •

Page 72: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

68

• UNESCO is an effective

builder of States Parties’

capacity to protect and

enhance cultural heritage

• • • • •

• UNESCO’s strength is

working at the global? or

international level in

support of protecting

cultural heritage

• • • • •

• UNESCO’s strength is

working at national and

local levels in support of

protecting cultural

heritage

• • • • •

Please indicate UNESCO’s main strengths in comparison to other partners and / or providers of expertise in the area of protecting cultural heritage. Please consider its role in policy development.

Please indicate areas where UNESCO should be more active due to a comparative advantage or strength it possesses.

Please indicate areas where UNESCO should be less active due to a comparative disadvantage or weakness it possesses.

Indicate what are the other institutions/partners that play a key role, and what are their

advantages/ weaknesses compared to UNESCO

Intersectoral work

Please indicate to what extent you agree with the following statements:

Page 73: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

69

The Culture programme

activities managed by my

Office or Headquarters

Division contribute directly

to the platform on:

• Strongly

Agree

• Agree • Neither

agree

or

disagr

ee

• Disagree • Strongly

disagre

e

Science education • • • • •

HIV and AIDS • • • • •

Education for sustainable development

• • • • •

Contribution to the implementation of the Mauritius Programme of Action for the Sustainable Development of Small Island Developing States (SIDS)

• • • • •

Languages and multilingualism

• • • • •

Contributing to the dialogue among civilizations and cultures and a culture of peace

• • • • •

Support to countries in post-conflict and disaster situations

• • • • •

Priority Africa: coordinating and monitoring the plan of action to benefit Africa

• • • • •

UNESCO action to address climate change

• • • • •

• • • • •

Please indicate to what extent you agree with the following statements:

• • Strongly

Agree

• Agree • Neither

agree

or

disagr

ee

• Disagree • Strongly

disagre

e

• I participate as a member of

one of the UNESCO

Intersectoral Platforms

• • • • •

• UNESCO Intersectoral • • • • •

Page 74: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

70

Platforms are relevant

and useful to the Culture

sector’s work to protect

and conserve immovable

cultural and natural

properties

• UNESCO Intersectoral

Platforms are relevant

and important to the

Culture sector’s work to

safeguard intangible

heritage

• • • • •

• UNESCO Intersectoral

Platforms are relevant

and important to the

Culture sector’s work to

enhance the protection of

cultural objects and the

fight against illicit

trafficking in them

• • • • •

• UNESCO Intersectoral

platforms are relevant

and important to the

Culture sector’s work in

the development of

museums

• • • • •

• The Culture programme

activities managed by my

Office or Headquarters

Division benefit from

forms of UNESCO

intersectoral action /

cooperation other than

the Intersectoal Platforms

• • • • •

• The Culture programme

activities managed by my

Office or Headquarters

Division have achieved

results that could have not

been achieved without

the work done via the

Intersectoral Platforms

• • • • •

There are adequate incentives to work intersectorally

• • • • •

There are structures in place to facilitate intersectoral work

• • • • •

Page 75: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

71

Provide an example(s) of intersectoral work that has successfully contributed to achieving

the Expected Outcomes of SPO 11 and explain the reasons for its success.

What lessons can be drawn from the experience with Intersectoral Platforms?

Provide your suggestions on how to improve intersectoral action and cooperation, in particular through the Intersectoral Platforms.

Gender Equality and Africa priorities

Please indicate to what extent you agree with the following statements as it relates to SPO

11 – related programmatic work:

• • Strongly

Agree

• Agree • Neither

agree

or

disagr

ee

• Disagree • Strongly

disagre

e

The Gender Equality priority is relevant to the Culture sector’s work to protect and conserve immovable cultural and natural properties

• • • • •

• The Gender Equality

priority is relevant to the

Culture sector’s work to

safeguard intangible

heritage

• • • • •

• The Gender Equality

priority is relevant to the

Culture sector’s work to

enhance the protection of

cultural objects and the

• • • • •

Page 76: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

72

fight against illicit

trafficking in them

• The Gender Equality

priority is relevant to the

Culture sector’s work in

the development of

museums

• • • • •

The Culture programme activities managed by my Office or Headquarters Division contribute to the achievement of the Gender Equality Action Plan expected outcomes

• • • • •

Specific needs of girls and women are addressed in the Culture programme activities managed by my Office or Headquarters Division

• • • • •

Gender analysis of the situation has been carried out to identify contextual constraints and opportunities as it relates to the Culture programme activities managed by my Office or Headquarters Division

• • • • •

The Gender Equality priorities are consistent with the priorities of the States Parties to the Culture-related Conventions

• • • • •

Monitoring data is collected in a sex-disaggregated manner

• • • • •

Provide an example(s) of how the Culture programme activities managed by you Office or

Headquarters Division has successfully contributed to achieving the Expected Outcomes of

the Gender Equality priority and explain the reasons for its success.

What lessons can be drawn from the experience to date in addressing the Gender Equality priority?

Page 77: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

73

Provide your suggestions on how the Culture programme activities can better contribute to the Gender Equality priorities in the future.

Please indicate to what extent you agree with the following statements:

• • Strongly

Agree

• Agree • Neither

agree

or

disagr

ee

• Disagree • Strongly

disagre

e

Priority Africa is relevant to the Culture sector’s work to protect and conserve immovable cultural and natural properties

• • • • •

• Priority Africa is relevant

to the Culture sector’s

work to safeguard

intangible heritage

• • • • •

• Priority Africa is relevant

to the Culture sector’s

work to enhance the

protection of cultural

objects and the fight

against illicit trafficking in

them

• • • • •

• Priority Africa is relevant

to the Culture sector’s

work in the development

of museums

• • • • •

The Culture programme activities managed by my Office or Headquarters Division address Member States needs as articulated by the African Union, through its NEPAD programme

• • • • •

The Culture programme activities managed by my Office or Headquarters Division contribute to meeting the Priority Africa expected results

• • • • •

Page 78: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

74

Priority Africa is consistent with the priorities of the States Parties to the Culture-related Conventions

• • • • •

Provide an example(s) of how the Culture programme activities managed by you Office or

Headquarters Division has successfully contributed to achieving the expected results of

Priority Africa and explain the reasons for its success.

What lessons can be drawn from the experience to date in addressing the Priority Africa

Provide your suggestions on how SPO 11 related work can better contribute to Priority Africa in the future

Page 79: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

75

ANNEX VII QUESTIONNAIRE FOR EXTERNAL PARTNERS

SPO 11 Evaluation Questionnaire

UNESCO Partners and Beneficiaries

Introduction You have been selected by the UNESCO Field Office to participate in this questionnaire because of your involvement in and knowledge of the cultural heritage field and your strong collaboration with UNESCO. This questionnaire is part of the external evaluation of UNESCO’s Strategic Programme Objective (SPO) 11: “Sustainably protecting and enhancing cultural heritage”. The overall purpose of the evaluation is to assess progress towards achieving the expected outcomes of the SPO and to examine how progress might be enhanced through improving programme policy, design and delivery. Please note that the work which relates to the Strategic Programme Objective encompasses World Heritage, intangible heritage, and movable heritage. Cultural expressions, cultural industries and intercultural dialogue are not part of the Strategic Programme Objective. .

Your responses to this questionnaire will be kept confidential and the results of all

respondents will be presented to UNESCO in summarised form only.

The questionnaire is a combination of multiple choice and open-ended questions. The

questionnaire should take approximately 20 minutes to complete.

Thank you for taking your time to complete this questionnaire. UNESCO and the evaluators

consider the perspective of its partners very important.

Respondent Information

Which of the following categories best describes the organisation you work for?

• Government ministry or agency (national, state or local-level) responsible

for culture

• Other government ministry or agency •

• National or international development agency •

• Non-governmental organisation •

• University or research institution •

• Museum •

• Community-based organisation •

Page 80: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

76

• Private sector •

• Other (please specify) •

UNESCO Activities and Results Achieved For each question please write up to 150 words.

Briefly describe your collaboration with UNESCO in support of protecting cultural

heritage in the period 2006 to 2008. What activities have you been involved in with

UNESCO, i.e. either as an implementing partner or as a beneficiary of UNESCO

activities? Please describe the projects including objectives, time frame, budget, and

achievements

Please indicate to what extent you agree with the following statements:

• • Strongly

Agree

• Agree • Neither

agree

or

disagr

ee

• Disagree • Strongly

disagre

e

• UNESCO’s activities were

consistent with the country

priorities and needs

• • • • •

• UNESCO’s activities

addressed the needs of the

beneficiaries

• • • • •

• UNESCO’s activities

achieved their objectives

and expected results

• • • • •

• UNESCO’s activities have

had an impact on national

and local policy

development aimed at

preserving cultural heritage,

in particular the integration

of its effects on

development, social

cohesion, and peace

• • • • •

• UNESCO’s activities have

had an impact on policy

development, in particular

• • • • •

Page 81: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

77

national conservation

policies that take account

of global trends such as

climate change,

urbanization and

migration

• UNESCO’s activities have

strengthened the application

of the 1970 Convention on

Prohibiting and Preventing

the Illicit Import, Export and

Transfer of Cultural Property

in your country

• • • • •

• UNESCO’s activities

have resulted in an

increased recognition by

decision-makers of the

role of museums in

education

• • • • •

What do you consider to be the three most significant achievements as a result of your

collaboration with UNESCO in support of protecting and enhancing cultural heritage from

2006 to 2008?

When project activities were successful in meeting their objectives and expected results,

what were the main reasons for the achievement?

When project activities were not successful in meeting their objectives and expected results,

what were the main reasons for the non-achievement?

Over the past 3 years have you noticed any changes in project activities developed together

with UNESCO? Please discuss any trends and innovations.

Page 82: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

78

Has the UNESCO programme addressed gender equality? Please give examples

UNESCO’s comparative advantages

In the following statements, we use the term “comparative advantage” to mean a particular

strength which UNESCO possesses when compared with other agencies working in the field

of cultural heritage (national or international).

Please indicate to what extent you agree with the following statements:

• • Strongly

Agree

• Agree • Neither

agree

or

disagr

ee

• Disagree • Strongly

disagre

e

• UNESCO is a respected

leader in support of

protecting cultural

heritage

• • • • •

• UNESCO provides

effective policy advice to

States Parties in support

of protecting and

enhancing cultural

heritage

• • • • •

• UNESCO demonstrates a

strong comparative

advantage in its work to

protect and conserve

immovable cultural and

natural properties

• • • • •

• UNESCO demonstrates a

strong comparative

advantage in its work to

safeguard intangible

heritage

• • • • •

• UNESCO demonstrates a

strong comparative

advantage in its work to

enhance the protection of

• • • • •

Page 83: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

79

cultural objects and the

fight against illicit

trafficking in them

• UNESCO demonstrates a

strong comparative

advantage in its work in

the development of

museums

• • • • •

• UNESCO effective

builder of States Parties’

capacity to protect and

enhance cultural heritage

• • • • •

• UNESCO’s strength is

working at the global level

in support of protecting

cultural heritage

• • • • •

• UNESCO’s strength is

working at national and

local levels in support of

protecting cultural

heritage

• • • • •

Please indicate UNESCO’s main strengths in comparison to other partners and / or providers of expertise in the area of protecting cultural heritage.

Please indicate areas where UNESCO should be more active due to a comparative advantage or strength it possesses.

Please indicate areas where UNESCO should be less active due to a comparative disadvantage or weakness it possesses.

Please compare UNESCO to other international agencies active in the heritage

field.

Page 84: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

80

Please compare your experience of Field Office and Headquarters working

relationships

Final comments

Please provide any additional comments about UNESCO’s achievements in support of protecting and enhancing cultural heritage, either at the global or national level.

Page 85: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

81

ANNEX VIII ASSESSMENT OF ACCRA FIELD OFFICE INTANGIBLE HERITAGE

ACTIVITIES

Progress towards SPO11 outcomes – site visit to Ghana Cluster Field Office, 16th

– 19th

August 2009 The Accra Office serves the regional cluster of Benin, Cote d’Ivoire, Ghana, Liberia, Nigeria, Sierra Leone and Togo. Of these, Cote d’Ivoire, Nigeria and Toga are signatories to the 2003 Convention, with a total of three expressions of ICH included in the Representative List (one of which, the Gelede oral tradition, is a trans-border expression covering Benin, Togo and Nigeria). The mission focused on progress in Ghana towards the safeguarding of ICH, explored in the course of

Meetings with government officials, academics and technical experts, and representatives of community organizations Discussions with UNESCO field office staff Consultation of written reports of projects completed in the period 2006-2008 Site visits to Cape Coast, Elmina and Usher Forts and their museums

In addition, documentation on actions towards the implementation of the Convention in cluster countries was consulted for the period in question. The aim of the evaluation mission was to establish progress in respect of the following priority areas:

Relevance, effectiveness, efficiency and sustainability of activities in support of the Intangible Heritage Convention (2.1, 2.2) Preservation of cultural heritage and its effects on development, social cohesion and peace integrated into national and local policies (2.3) National conservation policies and processes revised to take account of global trends such as climate change, urbanization and migration (2.4) Evidence of gender mainstreaming and intersectoral approaches in the implementation the Intangible Heritage Convention (2.5) UNESCO’s comparative advantage in relation to the Intangible Heritage Convention (2.6)

2.1 Activities in support of the Intangible Heritage Convention

This report focuses on the following initiatives in support of the Convention during 2006-2008: 2.1.1 Education/awareness raising for the Convention: (Budget: $7,000) In 2007 UNESCO convened a sub-regional meeting on ICH in order to encourage more Member States to ratify the Convention and to discuss and spread good safeguarding practice. (Report

unavailable) 2.1.2 Inventories:

Reinforcing and publishing inventories: support the cluster States party to the 2003

Convention in articulating, understanding and signing of the convention (Expenditure: $39,939.88) Planned outcomes: strengthening international cooperation and safeguarding capacities of communities and Member States; produce ICH inventories and strategy for safeguarding ICH Collection and listing of ICH in Benin, Ghana and Togo (Budget: $15,000) Planned outcomes: production of inventories; documentation and dissemination of good practice. The relationship between these two inventory projects, and allocation of funds

between them, is unclear.

Page 86: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

82

The inventory for Ghana was commissioned from Prof. Sutherland Addy at Institute of African Studies at the University of Ghana, Legon, and published in December 2008. The inventory drew in part on the national Folklore Board’s study on regional folklore profiles19. The inventory for Togo was reviewed and returned because the report referred only to the Gelede oral tradition (from the Convention’s Representative List). A new draft was expected but funds may no longer be available for completing the project until the next biennial. The inventory for Benin was commissioned from the École du Patrimoine Pan Afrique, but no inventory was delivered. Funds allocated for the Benin inventory have now been withdrawn by HQ and lost to the budget.

Protection, preservation and conservation of traditional woven textiles: project funded by the Getty foundation (Funds-In-Trust) and implemented between May and December 2007. (Budget: $226,000) The project catalogued Ghana’s antique textile heritage, including items in private ownership, and worked with traditional custodians and weaver communities to spread awareness of the cultural value of the textiles and traditional production processes, to provide training and to build capacity in the conservation and curating of traditional textile collections. (Draft

Report April 2009; published report pending) 2.1.3 Transmission Two projects aimed to support the establishment of systems for the transmission of ICH through ‘living human treasures’ in Togo (Budget: $6,000), and in Ghana and Benin (Budget: $13,000). The projects established working committees in the Ministries of Culture of the countries concerned to establish criteria for selection, and produced lists of ‘Living Human Treasures’ along with their modes of transmission. Twenty-five nominees have been selected for Ghana. An unedited film, The Bonesetters Clinic, on the subject of traditional healing, and an interview with the late Mr. Saka Acquaye, have been lodged with the UNESCO office in Accra. (Report detailing the process in the three countries covered by the projects

unavailable) 2.1.4 Other initiatives during this period: Slave Routes Project: In 2007 the UNESCO Director General opened an International Colloquium on the Slave Trade to coincide with the opening of the Usher Fort Museum in Accra. This was followed by a UNESCO sponsored Slave Heritage Seminar at the Journalists’ Conference Centre in Accra in 2008. Both of these events built on ten years of research and development through the UNESCO’S International Slave Route Project, with activities co-sponsored by the French and Dutch Embassies. Outputs of this work include a substantial book: Anquandah (ed.) The Transatlantic

Slave Trade: Landmarks, Legacies, Expectations Accra: Sub-Saharan 2007, with chapters by international contributors presenting current research on the slave routes; commemoration; and heritage tourism development. A report on the 2007 seminar is lodged with the UNESCO office in Accra, and sets out a programme for developing heritage tourism or pilgrimage routes based on the slave routes, including: an inventory of the tangible and intangible cultural heritage of the slave

19 The National Folklore Board is a department of Ghana’s Cultural Commission within the Ministry of Chieftaincy and Culture, and carries out listing activities through its network of regional centers.

Page 87: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

83

routes; a network of museums related to the slave trade; and the development of itineraries. Beads Projects: UNESCO sponsored research on bead production in Ghana has been on-going for a number of years. A detailed research report by Professor Anquandah and Kati Torda Dagadu was submitted in 2002,20 but no evidence of dissemination or follow up was discovered. A new book, commissioned by a previous Director of the UNESCO office, is currently in production. This is intended as a ‘coffee table’ type publication, illustrated with lavish photographs and lyrical text, to popularize and inform about contemporary bead making and its place in Ghana. The book is to be published and distributed by UNESCO.

2.2 Relevance, effectiveness, efficiency and sustainability of activities 2.2.1 Relevance of activities: The above activities, with their aims of raising awareness, encouraging ratification, and starting the implementation process through the creation of inventories and the establishment of mechanisms for transmission, are all relevant to the support of the ICH Convention. There is, however, little evidence so far of progress towards documenting best practice for recording, listing, or safeguarding strategies. 2.2.2 Effectiveness and efficiency: The initiatives on the Living Human Treasures and the Traditional Woven Textiles Project appear to have been effective in achieving their aims and reasonably efficient on their use of resources. Work on the Slave Routes Project up to the seminars of 2007 and 2008 also appear to have been effective in furthering a research agenda, identifying potential for income generation through heritage and cultural tourism opportunities, and dissemination through high quality outputs and international meetings – although this progress seems currently to be suffering from lack of follow-through. In other cases, the lack of detailed published reports, benchmarks or tangible outcomes of other project activities is a cause for concern. There is evidently scope for increasing the effectiveness and efficiency of activities, for example:

Setting of Terms of Reference. There is little evidence of a strategic direction for the projects in the current approach to the setting of terms of reference, nor is attention given to the need for research and reflection to build appropriate methodologies for the recording and safeguarding of ICH. For example, the ToR for the Inventory for Ghana commissioned from Prof. Sutherland Addy were so broad that the usefulness of the resulting inventory was necessarily extremely limited, and largely duplicated the inventories compiled by the Folklore Board (see 2.3.2 below). Togo’s inventory, on the other hand, was limited to its existing listed ICH expression, suggesting a need to raise awareness amongst UNESCO’s interlocutors of the role and purpose of ICH listing within the terms of the Convention’s Representative Lists. Failure of commissioned bodies to deliver appropriate inventories on time resulting in the return and subsequent loss of funds – suggests need to address commissioning (tendering) and monitoring procedures Publication and dissemination budgets and strategies. Currently these do not appear to be built in to the terms of reference or implementation strategies of ICH related activities, meaning that much valuable work is not getting out into the public domain (e.g. research on bead production commissioned from Prof. Anquandah, unedited film on the bonesetters clinic for the Living Treasures project), thus limiting the scope for an incremental approach to developing strategies for the safeguarding and

20 UNESCO project on improved traditional bead production and marketing in W. Africa. Report on Phase One Survey (Ghana) for UNESCO/NCRC, Accra

Page 88: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

84

management of ICH. The effectiveness of projects such as the Getty Foundation funded Protection, Preservation and Conservation of Traditional Woven Textiles is also compromised by the long delay in the production and approval of the final report (nearly two years since project completion), and creates knock-on delays in implementing follow-up action. Effectiveness of networks. The sub-regional meeting on ICH (see 2.1.1) which was intended to raise awareness of the Convention and its provisions did not include representatives from the Folklore Board. Interviews at the Folklore Board revealed very limited knowledge of the Convention, despite the considerable overlap between the aims of the Convention and the work of the Folklore Board, which has an established and effective research and dissemination infrastructure in place. The effectiveness of meetings could be enhanced by revisiting the protocol for the invitation of delegates to ensure the presence of a range of multi-disciplinary experts and practitioners in the field, including NGOs and representatives of civil society, with the capacity for rolling out initiatives and disseminating knowledge and experience beyond the narrow range of those attending the meetings.

2.2.3 Sustainability: Without taking active and conscious steps to build in sustainability, there is a danger that ICH initiatives will remain at the level of disparate ad hoc activities. Field office staff in Accra report that the initiatives outlined above have had sustainable results in establishing mechanisms in the cluster countries for the management and safeguarding of ICH:

A functioning ‘Living Human Treasures’ system in Ghana – which ensured, for example, that Saka Acquaya, a repository of knowledge in sculpture, drama and literary arts, was brought out of obscurity and enabled to pass on his knowledge to a younger generation before his recent death. Togo has established an action plan for safeguarding ICH UNESCO sponsored research on the International Slave Routes project has been followed up with international conferences, colloquia and book publication (see 2.1.4 above).

A number of cases show evidence of a lack of follow-through and missed opportunities for embedding of knowledge and experience gained:

Inventory initiatives seem to have restricted themselves to the production of lists, rather than to establishing methodologies and criteria linked to rationales and plans for safeguarding. The lack of availability of published reports of some of the meetings and projects, even within the Accra cluster office, suggests a missed opportunity in terms of accumulating best practice knowledge and learning from experience. The sustainability of long-term initiatives such as the Slave Routes Project and work on bead production in Ghana has been impaired by (respectively) a change in government priorities (see below) and lack of continuity between different phases of work, linked to problems of handover within the Accra office. The on-going research on slave routes and heritage has not been reflected in the interpretation of the museums housed in the WHS forts, which follow a standard narrow narrative. No evidence was found of schools or educational outreach. There is scope for developing community outreach, and UNESCO Accra has already had experience of working with community development agency GAMADA, which is based in Ga

Page 89: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

85

Mashie, a densely inhabited historic urban neighborhood of Accra, which is also the location of Ussher Fort (see further 2.4, below).

2.3 Integration into national and local policies (Ghana) 2.3.1 The reorganization of Ghana’s Ministry of Culture to become the Ministry of Chieftaincy and Culture implicitly recognizes importance of ICH in terms of ‘traditional’ culture (of which the Chiefs are the traditional custodians), but has created some problems of duplication of structure and bottlenecks which are reportedly blocking progress on Convention ratification and its effective implementation. Numerous interlocutors reported difficulty in getting ‘culture’ onto the political agenda under present circumstances. A draft bill for the regulation of National Living Human Treasures in Ghana was tabled in 2007, establishing categories covered, selection process, and the rights and obligations of bearers of the title. The regulations establish a ministerial oversight committee, ad hoc committee of experts, and a research committee to substantiate the qualification of nominees. However, the Bill is still awaiting enactment. (Verify) 2.3.2 The establishment of the National Folklore Board by Act of Parliament (Copyright Act 2005) responded to the need to establish a mechanism for the registering and protection of the Intellectual Property attaching to folklore (ICH) expressions, following the increasing exploitation of intellectual property by external entrepreneurs without payment or permission, e.g. the use of the sacred Akan gye nyame symbol on boxes of matches manufactured in India; and the commercial production of kente cloth in China, undercutting Ghanaian producers. The National Folklore Board has an ongoing programme of research in the field through its regional centers, and which it disseminates via its regular Folklore

Magazine and occasional research reports. The growing priority of this field is evident in the introduction of Folklore Studies in the History Departments at the Universities of Ghana, Legon, and Cape Coast. 2.3.3The Ministry of Tourism embraced the Slave Route Project as an important plank of a tourism strategy, directed at the African Diaspora, and based on the heritage of slavery and the WHS listing of the coastal forts. However, the Ministry appears to have restricted its role to the commercial exploitation of a narrowly defined heritage product, rather than to further research or conservation, and the proposals for further research and education, proposed at the 2007 International Colloquium (see 2.1.4) appear to be currently in abeyance. 2.3.4 Although the Minister of Education chairs Ghana’s national UNESCO Commission, it appears that the Ministry is not ready to embrace an educational role in relation to culture. 2.4 Revision of conservation policies and processes to take account of climate change,

urbanization and migration

Page 90: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

86

Migration and urbanization are widely seen as posing a threat to ICH, by undermining systems of transmission (with the removal of younger generations to urban locations), and devaluing the traditional in favor of modern, global cultural forms. This view largely informs the National Folklore Board’s ‘salvage work’ approach to the recording and dissemination of ‘authentic’ (largely rural) traditions. Conservation policies and processes do not yet appear to have registered the significance of urban neighborhoods (such as Ga Mashie) as locales of ICH, despite the recognition, in a recent UNESCO sponsored publication, of the significance of cultural factors such as language in migration and regional integration 21 and the potential to link cultural safeguarding practices to income generation. 2.5 Evidence of gender mainstreaming and intersectoral approaches in the

implementation the Intangible Heritage Convention

There is little evidence so far of a systematic approach to gender and intersectoral mainstreaming in the implementation of the ICH Convention, nevertheless there have been a couple of examples in Ghana: 2.5.1 Heritage of Slavery and contemporary child trafficking: Research on the historic heritage of slavery by Prof Anquandah (ed. Transatlantic Slave Trade) has fed into knowledge of contemporary slavery issues, specifically the trafficking of children in Ghana as forced labor in the Lake Volta fishing industry, and women and children for the sex trade. Prof. Anquandah reports that both the UNHCR and the Christian Council of Ghana have drawn on the project’s published research on slave routes for information about contemporary slavery. 22 2.5.2 Health dimensions of a contemporary ICH practice: a project by the National Folklore Board addressed the practice among the Dagaba, Sisala and Lobi of exposing and handling of corpses over a period of several days, which is linked to the spread of diseases. The project used mass media, and drama playlets and sketches at public functions, market places, and churches, to educate people about the health hazards, and encourage changes in behavior and shorter mourning period.

21 Ninsin, K. A. (ed.) Nation-States and the Challenges of Regional Integration in West Africa – The case of Ghana Paris: Éditions Karthala – Projet UNESCO-MOST 22

http://www.unhcr.org/refworld/country,,,,GHA,456d621e2,4a4214b9c,0.html http://www.voanews.com/english/archive/2009-06/2009-06-18-voa48.cfm?moddate=2009-06-18

The district of Ga Mashie, a densely inhabited historic destination and transit zone for migrants to Accra, is described on the website of international development agency CHF as follows: ‘Living off fishing and trading, Ussher Town and James Town, collectively known as Ga Mashie, have been at the heart of the History of Ghana and of the Ga People for centuries. Despite its

impoverishment and actual poverty, the area still maintains its cultural skills and expressions: Ga Mashie continues to serve as the conservatoire of Ga culture, traditions, beliefs and ethical values. The poor are the most active and dedicated custodians and promoters of the living cultures and Ga Mashie remains the heart, spirit and seat of Ga culture.’ This aspect of Ga Mashie remains largely unexplored, in terms of its ICH value. http://www.chfinternationalghana.org/index.php?option=com_content&view=article&id=64&Itemid=76

Page 91: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

87

ANNEX IX OPERATIONAL PROCEDURES AND PRACTICES IN RELATION TO

EXPECTED OUTCOMES

Operational procedures and practices in the Field Offices have a direct impact on progress towards the Expected Outcomes. The field visit (to the Accra Regional Office where Ghana is a signatory to World Heritage Convention only), pointed to the following Project design, Terms of Reference and monitoring. Programme staff and managers have not been adequately trained in project design, monitoring, and evaluation using the log frame concept. Terms of Reference lack clear statements about such considerations as: link between outputs and outcomes, audience for publications, dissemination plans for publications, approval protocols for written outputs, consultant qualifications. At present activities are approved without clear objectives, activities related to objectives, indicators etc. Monitoring of project progress is uneven. The distinction between outputs, achievements, and outcomes does not seem to be well understood by staff. No performance indicators were provided. Conventions and their implementation. What is involved in the implementation of Conventions, especially the Safeguarding of Intangible Heritage, is not yet clear to culture sector stakeholders and government departments. The World Heritage Convention, now utilizing a revised Operational Guidelines and Periodic Reporting, is perhaps the most effectively implemented of the Conventions although it faces many challenges. The 1970 Illicit Traffic Convention has a low profile. Intersectoral working. True intersectoral activities are the exception. Incentives to do more are not evident. Urbanization, migration, climate change, and other thematic issues provide opportunities for such intersectoral work. Project scale. There have been numerous micro-activities, under $20,000, that do not seem to be part of a programmatic approach and do not have clear follow up. This is especially the case during the 33C/5, less for the 34C/5. Gender equality. Few activities in the culture sector have an explicit gender focus although some projects specify that women and girls should receive training. Administrative procedures. Field offices currently spend considerable time on administrative functions and can be hampered by IT problems (including generators with sufficient power where power supply is erratic). At present, valuable staff time is lost due to power outages, lack of access to needed documentation, and inadequate handover procedures. Procurement procedures do not seem adequate to ensure qualified tenderers. Information systems. Project management and monitoring systems now in effect do not capture necessary information to allow for snapshots of the status of projects. The SISTER system is neither widely used nor understood. It is not uncommon that Field Office staff avoid using it. In its present form, SISTER holds insufficient information to be of real use for project management. Similarly the FABS system does not reflect the progress of projects with the result that there is currently an absence of reliable and thorough information about projects, particularly about project objectives and outcomes. Knowledge management. Knowledge management within UNESCO, within Field Offices and between Field Offices and Headquarters has not fully benefitted from the advances brought about by the use of information technology. Project documents are largely paper based,

Page 92: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

88

institutional memory is often a personal matter, and handover protocols are not observed. This leads to serious inefficiencies and inadequate sharing of information and learning. The World Heritage Centre, with its new website, has shown considerable improvement in information sharing. Partnerships with non-governmental organizations. New partnerships, especially with civil society organizations and local government, show promising results. An example is the Ghana Traditional Textiles project where traditional leaders, civil society, the EC, Norwegian government and Getty Foundation all played a role. Donor coordination. At present, at least in the case of Ghana, coordination amongst donors in the culture sector seems to be very weak. At the country level, UNESCO could enhance its position by encouraging donor coordination fora to share information and encourage planning for the culture sector. Such donor fora are often convened by the World Bank in other sectors and have proven to be of use.

Page 93: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

89

ANNEX X DOCUMENTS CONSULTED

- UNESCO Approved Programme and Budget 2008-2009 34C/5 - UNESCO Approved Programme and Budget 2006-2007 33C/5- UNESCO Medium Term

Strategy 2008-2013 34 C/4 - Report of the Director General of the Organization in 2006-2007- 35C/3 - Report by the Director General on the Execution of the Programme adopted by the General

Conference Major Programme IV - Culture 180 EX/4 - Report by the Director General on the Implementation of the Programme and Budget (33C5)

and on results achieved in the previous biennium (2006-2007) Major Programme IV - Culture 179 EX/4

- Report by the Director General on the Execution of the Programme adopted by the General Conference Major Programme IV - Culture 177 EX/4

- Report by the Director General on the Execution of the Programme adopted by the General Conference Major Programme IV - Culture 176 EX/4

- Report by the Director General on the Execution of the Programme adopted by the General Conference Major Programme IV - Culture 175 EX/4

- Management Audit of the World Heritage Centre (Deloitte) (2007) - UNESCO’s action to Help Member States Prevent Illicit Trafficking of Cultural Property (2005) - Evaluation of the Slave Route Project (2005) - Culture Heritage Management and Tourism: Evaluation and Mainstreaming (2005) - Evaluation of the World Heritage Fund’s Emergency Assistance Activities (2005) - Evaluation of the Nordic World Heritage Foundation (NWHF) (2008) - Evaluation of JFIT-funded projects of Intangible Cultural Heritage (2009) - Evaluation of Norwegian Support to Protection of Cultural Heritage (2009) - Convention for the Safeguarding of the Intangible Cultural Heritage (2003) - Operational Directives for the implementation of the Convention for the Safeguarding of the

Intangible Cultural Heritage (2008) - Convention concerning the Protection of the World Cultural and Natural Heritage (1972) - Operational Guidelines for the Implementation of the World Heritage Convention (2008) - Report of the World Heritage Committee on its activities (2006-2007) - Report of the World Heritage Committee on its activities (2004-2005) - Convention on the Means of Prohibiting and Preventing the Illicit Import, Export and

Transfer of Ownership of Cultural Property (1970) - Convention for the Protection of Cultural Property in the Event of Armed Conflict with

Regulations for the Executions of the Convention (1954) - Convention on the Protection of Underwater Cultural Heritage (2001) - Évaluation des actions de l’UNESCO en matière de lutte contre le trafic illicite de biens

culturels (2005) - Evaluation of UNESCO's Action in the Preservation of Cultural Heritage Damaged by Conflict:

Bosnia and Herzegovina and Angkor, Cambodia (2003) - SISTER 33C/5 Qualitative monitoring reports - SISTER 34C/5 Qualitative monitoring reports - SISTER 33C/5 Financial monitoring reports - SISTER 34C/5 financial monitoring reports

The Evaluation Team has also reviewed extensively the Database of Laws in UNESCO, as well as the reports and documents provided by the 10 Field Offices.

Page 94: Evaluation of UNESCO Strategic Programme Objective (SPO…unesdoc.unesco.org/images/0018/001875/187504e.pdf · Evaluation of UNESCO Strategic Programme Objective (SPO) ... this document

90

ANNEX XI LIST OF INTERVIEWEES

Interviews with UNESCO staff:

Culture Sector: Francoise RIVIERE, Assistant Director-General for Culture

Paola LEONCINI-BARTOLI, Chief, Executive Office

Culture Sector: Section of Intangible Cultural Heritage: Cécile DUVELLE, Chief Franck PROSCHAN, Programme Specialist

Fernando BRUGMAN, Programme Specialist

Culture Sector: Section of Museums and Cultural Objects: Christian MANHART, Chief Sahar AL TABBAL, Assistant Programme Specialist Ulrike GUERIN, Assistant Programme Specialist Nao HAYASHI, Assistant Programme Specialist Jan HLADIK, Programme Specialist

Vanessa KREDLER, Programme Specialist Karalyn MONTEIL, Assistant Programme Specialist Edouard PLANCHE, Programme Specialist Suzanne OGGE, (position unlisted) Tatiana VILLEGAS, Programme Specialist

World Heritage Centre: Francesco BANDARIN, Director Guy DEBONNET, Chief, Special Projects Unit Marc PATRY, Programme Specialist, Special Projects Unit Ronald VAN OERS, Programme Specialist, Special Projects Unit

Lazare ELOUNDOU ASSOMO, Chief, Africa Unit Anne LEMAISTRE, Chief, Policy and Statutory Implementation Unit Mechtild ROSSLER, Chief, Europe and North America Unit

Africa Department: Ana Elisa SANTANA ALFONSO, Chief, Section for Coordination and Promotion of Intersectoral Activities

Robertine RAONIMAHARY, Chief, Section for Cooperation with Member States

Bureau of Strategic Planning: Jean-Yves LE SAUX, Director, Division of Programme Planning, Monitoring and Reporting Ann-Belinda PREIS, Senior Planning Officer, Division of Programme Planning, Monitoring and Reporting

Gulser CORAT, Director, Division for Gender Equality

Interviews with External Experts:

Mounir BOUCHENAKI, Director General, ICCROM Joseph KING, World Heritage Advisory Body representative, ICCROM Tim BADMAN, IUCN, World Heritage Advisor

Robert KNOX, Museum expert and UNESCO consultant Benedicte SELFSLAGH, Secretary General, ICOMOS