Using Dashboards to Manage Beneficiary Pathways

Understanding & Managing Beneficiary Pathways

Using dashboards within M&E management systems for youth programs

John SkeltonResults, Learning and Research Manager,

Youth Programs Mercy Corps Liberia

Prospects is implemented by Mercy Corps, and funded by generous support from the Swedish Embassy in Liberia and Chevron

Prospects program and our info needs

Apprenticeships

Business Skills training

NetworksCash grant support to entrepreneurs

Soft Skills training

Career guidance

Job application training

Info on job vacancies

Info needs:Beneficiary-centered output indicators• User behavior and engagement – how does this vary by age and sex?• User satisfaction – what do people like, not like?Timely outcome indicators:• Both immediate and longer-term outcomes


Information management at scale: Prospects’ case management system

DATA USAGE & PROGRAM ADAPTATION


Prospects dashboard and beneficiary-centered output indicators (1)

Session 1 Session 2 Session 3 Session 4 Session 5 Session 60

50

100

150

200

250

300

350

400

332

289309 297

337

247

Soft Skills attendance by session

X


1 Session At -tended

2 Sessions Attendend

3 Sessions Attended

4 Sessions Attended

5 Sessions Attended

6 Sessions Attended

0%5%

10%15%20%25%30%35%40%

10%

38%

8%4%

10%

30%

12% 13%

27%

20% 19%

9%

Soft Skills by number of sessions attended by individuals

Grand BassaMontserrado

Prospects dashboard and beneficiary-centered output indicators (2)

1 Service Accessed

2 Services Accessed

3 Services Accessed

4 Services Accessed

5 Services Accessed

0%10%20%30%40%50%60% 51%

25%16%

7%0%

Returning Customer Rate: No. Different Services Accessed by Youth

Effective Job Applications

Business Skills Soft Skills Career Planning0

5

10

15

20

25

How did you rate the usefulness of your training? (by training)

Very usefulPartially usefulNot useful

No.

of r

espo

nden

ts

Measurement not just of ‘reach’ but depth of beneficiary engagement

Measurement of quality of beneficiary engagement


Prospects dashboard and timely outcome indicators (1)

Apprentices

hip

Cash Gran

t

Business

Skills

Train

ing

Apprentices

hip + Soft Sk

ills Tr

aining-1000

010002000300040005000

RCT Results: Net income change (LD/week)

X• RCTs: Gold

standard but too late for program management.

..Immediate outcomes may be more identifiable earlier/more useful for management.

Batch 1 Batch 2 Batch 3 Batch 4 Subtotal0%

10%

20%

30%

40%

50%

60%

70%

80%

% of apprentices being offered jobs

Male Female


How is the information used?

DATA USAGE & PROGRAM ADAPTATION


Batch 1 Batch 2 Batch 3 Batch 40

10

20

30

40

50

60

3229

5

50

1

9 7

30

Apprenticeship Drop-Outs (by

batch)

Apprenticeship Completed

Dropped Out

Data-driven decision types in Prospects

Decision type 1:Intervention-level feedback loops

Decision type 2: Individual-level feedback loops


?

Enabling factors for decision-making

Devolved responsibilities

Building analysis capacity & culture

Intuitive presentation of data

Incentives for data completeness


Learning points

• Consider what information is truly actionable: may require changing an M&E hat for a management hat and /or conceptualising different sizes of feedback loops.

• Develop dashboards within broader human centered design information systems: consider incentives, sanctions and opportunities for staff for collecting, analysing and acting on data.

• Consider merits of in-house development/using easily adaptable technology over outsourcing.

Thank you

Contact:John Skelton

[email protected]

More information:www.prospectsliberia.com

http://www.prospectsliberia.com/

Using Dashboards to Manage Beneficiary Pathways

Data & Analytics

Transcript of Using Dashboards to Manage Beneficiary Pathways