Centre for Research on Children and Families

Centre for Researchon Children and Families

National Outcomes Matrix:

Evidence of Intervention Effectiveness

Nico Trocmé

with Tony Esposito, Martin Chabot & Lorry Coughlin

Theory & Wisdom: Promoting Evidence Based Decision MakingEdmonton, AB , May 28th

Centre for Research on Children and Families

Financial Based Management

Reactive Practice

Client Tracking System Using Proxy Measures

Outcome Based Case-Planning +

Measures for Clinical Practice

Integrated Outcomes

Tracking System

An Incremental Multi-Level Outcomes Approach


Selecting indicators:

• Can indicators be clearly linked to seminal child welfare service objectives?

• Are they easily understood?

• Can they be measured using existing information systems?


Competing objectives of child welfare

Child Protection

Child Well-Being

Family and Community

Support


Safety1.Recurrence& 2.Injury

Well-Being

3.School delay& 4.YCJA

Permanence

5.Placement6. Moves in care & 7.Time in care

Family & Community Support

8. Court 9. Housing stability &

10. Community-based placements


NOM & Pilot Test Indicators

NOM Dashboard: Pilot Test 02-0802-03 03-04 04-05 05-06 06-07 07-08

Recurrence Cases served re-substantiated within 12 months of closing 15% 16% 15% 15% 13% 9%

School DelayAgency children who are at least 1 year behind age appropriate grade compared to norm

24% 5%

32%6%

30%5%

27% 4%

25%4%

Youth Criminal Justice Rate Investigated children (12 to 15 years old) who experienced youth criminal justice services within 36 months of initial investigation

15% 22% 17% 12% NA NA

Placement Rate Investigated children who experience at least one placement (>3 days) within 36 months of initial investigation

21% 24% 23% 22% NA NA

Moves in carePlacement changes (>3 days) or reunification breakdowns within 36 months of initial placement

2.5 2.1 2.4 1.90 NA NA

Time in care (% current status / median days per current status)

Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA

Court InvolvementChildren who experience at least one court event within 36 months of initial investigation

40% 42% 40% 33% NA NA

SDC AM

Recurrence cohort: All closed Cases

served, tracked for 12 months

ITSDNC

Recurrence Cohort

AM / IT

N Mean Age

2002 580 8.1

2003 495 8.0

2004 575 7.8

2005 530 8.3

2006 522 8.4

2007 395 8.2

6 year average 8.1




24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

Recurrence by reason for report

Closed cases 373 44 12 92 8 529

Non recurring 322 40 7 72 8 449

Recurring 51 4 5 20 0 80

Recurrence rate

13% 9% -- 21% -- 15%

Total

Recurrence by age at service start

Closed cases 82 102 134 122 89 529

Non recurring 75 89 118 98 69 449

Recurring 7 13 16 24 20 80

Recurrence rate

8% 12% 11% 19% 22% 15%

Total




24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

School Delay Rate Proportion of agency children who are at least 1 year behind age appropriate grade by placement type (all years combined)

7 to 17 years of age TOTAL (N)

63% 26% 24% 5000

School delay by age & sex: All years




24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

SDC AMITSDNC

Service CohortN Mean Age

2002 950 7.8

2003 870 7.8

2004 750 7.6

2005 890 7.7

4 year average 7.8

Service cohort: all retained cases, up to 36

months after report





24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

Youth Criminal Justice involvement by reason for the report

Children in cohort

73 34 7 67 3 184

No YCJA 62 31 7 49 3 152

YCJA 11 3 0 18 0 32

YCJA Rate 15% 8% *--% 26% *--% 17%

Total

* Too few cases to calculate a meaningful rate

Youth Criminal Justice involvement by age

Children in cohort 57 48 79 184

No YCJA 50 37 65 152

YCJA 7 11 14 32

YCJA Rate 12% 22% 17% 17%

Total





24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

Placement rate by reason for the report

Children in cohort

524 110 29 92 6 761

No placement 407 95 26 49 3 580

Placement 117 15 3 43 3 181

Placement Rate 22% 13% --% 46% --% 23%

Total

Placement rate by age

Children 117 170 190 205 79 761

No Placement 77 150 162 149 42 580

Placement 40 20 28 56 37 181

Placement Rate

34% 11% 14% 27% 46% 23%

Total





24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

Placement cohort: all placed children, up to 36 months after initial placement

SDC AMITSDNC

Placement CohortN Mean Age

2002 330 10.4

2003 325 11.6

2004 294 10.5

2005 320 11.5

4 year average 11.1





24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

Moves in Care

Number of moves (# of children)

0 28% 37% 19%

1 21% 20% 25%

2-3 28% 23% 30%

4+ 23% 20% 26%

Total children 332 100% 322 100% 289 100%

Total Moves 767 641 723

Average moves 2.5 2.1 2.4

Moves in Care: by reason for report

Total

Number of moves

0 22% 13% 25% 14% 22% 54 19%

1 27% 29% 25% 23% 44% 76 26%

2-3 30% 20% 25% 31% 23% 85 29%

4+ 21 38% 25% 32% 11% 74 26%

Total children 155 100% 24 100% 4100% 97

100% 9 100% 289 100%

Total Moves 338 68 8 293 16

Average moves 2.2 2.8 2.1 3.1 1.7

Moves in Care by age at entry

Total

Number of moves

0 32% 19% 17% 11% 20% 54 19%

1 16% 47% 39% 21% 21% 76 26%

2-3 44% 25% 27% 31% 26% 85 30%

4+ 8% 9% 17% 37% 33% 74 25%

Total children 38 100% 32 100% 41 100% 67 100% 111 100% 289 100%

Total Moves 58 47 72 227 319

Average moves 1.5 1.4 1.6 3.5 2.8




24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

Time in Care by age at entry

Outcome after 36 months

percentage by outcome (median in days) Total Children %(N)

Return Home 41% (225) 34% (27) 47%(58) 41% (66) 65%(106) 52%(167)

Adoption 10% (502) 0 0 0 0 1%(3)

Other 28% (437) 26% (558) 14%(29) 22% (107) 27%%(250) 24%(77)

Still in Care 21% (1005) 40% (1008) 39%(999) 37% (1105) 8%(1017) 23%(1022)

Total Children 29 35 42 71 145 322




24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

Court Involvement by reason for report

Children in cohort 524 110 29 92 6 761

No Court Involvement

295 86 22 47 2 452

Court Involvement 229 24 7 45 4 309

Court Rate 43% 21% --* 48% --* 40%

Total

* Too few cases to calculate a meaningful rate




24% 5%

32%6%

30%5%

27% 4%

25%4%


15% 22% 17% 12% NA NA


21% 24% 23% 22% NA NA


2.5 2.1 2.4 1.90 NA NA


Return homeAdoption

OtherStill in care

260

56% / 1072% / 850

19% / 18322% /1025

255

52% / 701% / 502

24% / 22423% /1011

385

55% / 2013% / 805

16% / 31326% /1095

NA NA NA


40% 42% 40% 33% NA NA

For more information:

[email protected]

[email protected]

www.cecw-cepb.ca


www.cecw-cepb.ca

Centre for Researchon Children and Families

http://www.cecw-cepb.ca/

Centre for Research on Children and Families

Documents

Transcript of Centre for Research on Children and Families