Network Strategy – Working Group CPerformance measurement:“Measuring network impact and effectiveness”

Working Group C – Team members

China Mde GuRick ZouYimei McCabe

CEO, Youth Business ChinaProject Director, Youth Business China

India Lakshmi Venkatesan

CEO, BYST

South Africa

Mzwabantu Ntlangeni

Director International Relations & Partnerships, National Youth Development Agency

Sri Lanka Harin Malwatte Youth Business Sri Lanka

Our project hypothesis

• Being able to demonstrate the global impact of the network is one of the key mechanisms for adding network value to individual YBPs

• Historically, the quality of the data collected at network level has not been sufficient for two reasons:

1. Low visibility for YBPs that the data was used in a way that added value to them – providing data to YBI not a priority

2. The process for collecting and aggregating the data was not adequate

We decided to focus on how we measure network impact & effectiveness

Requirements for effective global data capture

Do we have a consistent

understanding of what a YBP does and therefore of

the impact we are trying to measure?

Do we have consistent and

appropriate definitions and

metrics for impact and effectiveness?

Do we have a process in each

YBP that can reliably collect,

analyse and report the data?

1 2 3

• Our global data set must cover the impact of our programmes and also our effectiveness

• What is measured must be common, core and consistent

• Our project will use our Working Group as a sample test the following:

KPI Definition Process for collection

Freq Usage Installation

status*Youth businesses supported

Number of qualifying business started or supported in period

• Standard format data request sent to regions week after quarter end

• Regions complete and return within 5 working data

• Data compiled by Ops Director in Excel spreadsheet of historical data

Quarterly

• Data used to report to Board (every 6 months)

• Data submitted to YBI Ops team quarterly

2

Jobs created

Number of people directly employed by YBP-supported businesses

• Questionnaire sent to all clients on our database asking them about their business

• Responses compiled by Ops director

Annually • Input to annual review and annual report

• Data also used in marketing materials

3

Etc...

Data evaluation template

We will capture the following data for each key KPIs we track today focussing on what we measure, how we collect the data and how we use the information

* see below

6

Installation status score

Score Criteria

0 Not measured/tracked

1 Gathered if requested

2 Regularly gathered and recorded

3Routinely gathered with clear process, responsibilities, format and analysis

4Routinely gathered and used as standard input into programme management process

As well as identifying what KPIs are measured, we will also assess the robustness of the process that collects the data using the scoring system below:

7

Project implementation

Agree project

objective and

approach

Conduct individual

assessments

& compare findings

Design common KPI framework

& pilot implementation

process

Conduct pilot implementation

s

• Do we track the same KPIs?• Do we track the right KPIs?• Are the processes we use to

generate our data robust?• What do we need to have in

place to efficiently produce reliable data?

• What KPI’s best allow us to demonstrate network impact?

• How are they defined?• How are they

measured?• How can data be

gathered?• How do we support pilot

implementation?

• Implement in pilot YBPS with focus on:― Data accuracy― Implementing for

sustainability― Fit with/development

of OMS• capture and feedback

learnings

*London School of Economics

Working Group

Working Group

YBI /LSE*

Working GroupYBI

Learnings from this project (so far)

• Our team has struggled to create momentum in this project for lots of good reasons

• But we will always be able to find “good reasons” for not being able to work on this sort of project

• We need to change the current paradigm if we are to create more value for ourselves