Measuring the impact of education development work in the field

11
bond.org.uk Improve it Framework – education theme Prepared by BOND and adapted by Gabriela Dib for presentation at the Good Practice in Education conference – Edinburgh, April 27 th , 2012.

description

 

Transcript of Measuring the impact of education development work in the field

Page 1: Measuring the impact of education development work in the field

bond.org.uk

Improve it Framework – education theme

Prepared by BOND and adapted by Gabriela Dib for presentation at the Good Practice in Education conference – Edinburgh, April 27 th, 2012.

Page 2: Measuring the impact of education development work in the field

bond.org.uk 2

The Bond Effectiveness Programme (BEP)

1. Developing agreement and supporting implementation of a sector wide framework of shared indicators and data collection tools (Improve it Framework); and an online effectiveness self-assessment and resource portal (organisational health check).

2. Building knowledge and skills to support members to measure and manage effectiveness and value for money

3. Creating an enabling environment that encourages and supports organisations to deliver improvements in their effectiveness

…a three year process of supporting UK NGOs in improving how they assess and demonstrate their contribution to social development; this involves

Page 3: Measuring the impact of education development work in the field

bond.org.uk 3

Contributors to the BEP

Partners of the BEP:

Page 4: Measuring the impact of education development work in the field

bond.org.uk

The Improve it Framework

What is it?• A framework grounded in the distinctive contributions that UK NGOs make

to international development that will support organisations to measure and communicate their effectiveness robustly and consistently.

• Across ‘thematic areas’ and ‘ways of working’ it asks: What should we assess? How should we assess? And, what should we communicate?

Why are we developing it?1. Developing robust, cost effective methods to measuring effectiveness is a

collective challenge for UK NGOs

4

2. UK NGOs need to start telling a more robust story at sector level as well as at organisational level about the contribution they make to international development

Who is involved?•155 people from 77 organisations (bond, NIDOS & CADA members, PPA agencies, Comic Relief grantees)

Page 5: Measuring the impact of education development work in the field

Influencing decis

ion

makers in th

e North,

South and globally

Delivery of essential

goods & services to

the poorStrengthening civil

society and

comm

unity action in

the South

Developing organisation and institutions in the

South

Bui

ldin

g Pu

blic

supp

ort f

or

deve

lopm

ent i

n th

e

Nort

h

Principles of assessing effectiveness

Voice Inclusion

TransparencyUtility

TriangulationContribution

Appropriateness

Page 6: Measuring the impact of education development work in the field

1) All children access quality

education where they learn useful knowledge and

skills

2

Governments and other mandated bodies

ensure all children access quality

education

3

Schools are well managed, safe and well

resourced

4

All children receive their full allocation of high quality teaching

6

Communities actively support the education

of all children

Outcomes

a) Mothers, fathers and other caregivers support all their children to access education

b) Communities actively support and participate in children’s education

c) CSOs support and advocate for improved education for all

Outcomes

a) School management committees exist and manage schools effectively

b) School managers access, manage, and deploy resources in an effective and transparent way

c) Teachers, resources and infrastructure are in place to support educationd) Schools are safe and healthy environments for girls and boys

Outcomes

a) Teaching is high quality, child-centred and child-friendlyb) Teachers deliver a full allocation of lessons

c) Teachers are trained and supported to deliver high quality teachingd) The curriculum is relevant and appropriate

e) Teaching supports equality and empowerment

Domains of Change Framework for Education

Outcomes

a) Children participate in a meaningful way in decisions that affect their education

b) Children participate in their own and others’ learning

c) Children have a positive attitude towards education

Outcomes

a) Laws, policies and practices are in place that support quality education that is accessible for all children

b) Adequate resources are allocated and adequate teachers recruited and trained for the provision of quality education for all

c) Performance in education is monitored at a national and local level

5

All children participate in their education and

in school life

Page 7: Measuring the impact of education development work in the field

Domain 3: Schools are well managed, safe and well resourced

Outcome 3a: School management committees exist and manage schools effectively

Indicators Tools

School committees exist and function# and % of schools with a Parent Teacher Association (PTA)Level of activity of the Parent Teacher Association (PTA)# and % of schools with a School management committee (SMC)Level of activity of the School management committee (SMC)# and % of schools where the roles and responsibilities of school committees are clearly defined# and % of schools where school management have played their roles and fulfilled their tasks effectivelyEvidence that the participation of parents in the PTA/SMC is meaningfully changing the policies and practice of the school

School management is representative# and % of schools with women in the composition of school management (principal and/or deputy principal)Improvement in teacher participation and voice in school management % of members of the Parent Teacher Association (PTA) from marginalised groups (including women) % of members of the School management committee (SMC) from marginalised groups (including women)

Use of School Development Plans# and % of School Development Plans developed # and % of School Development Plans in use# and % of School Development Plans that have achieved x% of their targets

Capacity of education managersImproved capacity of head teachers and other education managers to supervise and support teachers School records are kept# and % of schools with student attendant lists # and % of schools with follow-up records on student performance

The Right to Education indicators and form for section 9: right to transparent and accountable schools covers the functioning and representativeness of the PTA, the functioning and representativeness of the SMC, the monitoring of the school budget and the inspections and review of the school’s performance. The Plan UK child friendly tool Section 1: School management The VSO quality scale for education services quality areas on education management and community engagement includes scales on: teacher participation and voice; gender equality in education management; school improvement plans; collaboration with education authorities and other education bodies; representation and inclusion in PTAs/SMCs; and participation and voice in education management.

The VSO quality scale for education services quality area on education management: scale on adequate supervision/support for teachers.

Page 8: Measuring the impact of education development work in the field

bond.org.uk

Steps in assessing, learning from and communicating your effectiveness

Focus of Improve it Framework

Collect and analyse the

data

Identify the problem & underlying causes

Describe your vision of change

Identify who you will work

with & influence

Identify how you will work

with them

Identify what you want to

change (outcomes)

Identify the evidence

that you will collect and

how

Reflect and learn from the data

Communicate results to key stakeholders

Page 9: Measuring the impact of education development work in the field

bond.org.uk 9

Improve it Framework: what it is and is not

• …about creating a single way of

assessing effectiveness –it’s about

encouraging greater harmonisation

and consistency where appropriate

• …going to offer an off the shelf

answer to measuring effectiveness,

but it will provide a common starting

point

• …going to produce an encyclopaedia

of indicators and tools. There will be

an element of prioritisation.

• …an organisation specific tool;

seeing 60% of your organisation in it

is good enough

• …about providing a collective resource

that UK NGOs can draw on when

developing their own context specific

M&E frameworks

• …about developing shared approaches

where we can

• ….about providing organisations with

the tools to be able to tell a more

robust story of how they are

contributing to change

• …going to be practical & simple

• …going to be dynamic & will continue

to evolve

It is not… It is…

Page 10: Measuring the impact of education development work in the field

bond.org.uk

Way forward

Jan– May 2012: thematic task groups work with Bond to revise and finalise the background papers, agree the Domains of Change Frameworks and identify the indicator and data collection methods to be included in the final Improve It Framework.

Jan – May 2012: Consultation with UK NGOs on each of the five ways of working and the development of background papers on assessing effectiveness in each area.

July – Launch of the Improve It Framework as an online tool. Save the Children UK will include the framework on its internal Education Update advising country offices to use it when relevant for their programming.

Page 11: Measuring the impact of education development work in the field

bond.org.uk

Thank you!