Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC)...
-
Upload
gerard-hodges -
Category
Documents
-
view
215 -
download
1
Transcript of Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC)...
![Page 1: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/1.jpg)
Measuring Child Outcomes
Christina KasprzakRobin Rooney
(ECO) Early Childhood Outcomes(NECTAC) National Early Childhood TA Center
Delaware COSF Training, March 10, 2010
1The National Early ChildhoodTechnical Assistance Center
![Page 2: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/2.jpg)
Review of key information
2
![Page 3: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/3.jpg)
Government Performance and Results Act (GPRA)
Program Assessment Rating Tool (PART)
Individuals with Disabilities Education Act (IDEA)
3
![Page 4: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/4.jpg)
Results not demonstrated:“While the program has met its goal
relating to the number of children served, it has not collected information on how well the program is doing to improve the educational and developmental outcomes of preschool children/infants and toddlers served.”
Read more at ExpectMore.gov 4
PART Review Findings for Part C and 619
![Page 5: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/5.jpg)
5
![Page 6: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/6.jpg)
How Office of Special Education (OSEP) Responded
to PART
• Required states to submit outcome data in their State Performance Plan (SPP) and Annual Performance Report (APR)
• Funded the Early Childhood Outcomes (ECO) Center in October 2003 to gather input, conduct research, make recommendations, and assist states
6
![Page 7: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/7.jpg)
“…To enable young children to be active
and successful participants during the
early childhood years and in the future
in a variety of settings – in their homes
with their families, in child care, in
preschool or school programs, and in
the community.”
(from Early Childhood Outcomes Center,http://www.fpg.unc.edu/~eco/pdfs/eco_outcomes_4-13-05.pdf)
7
Goal of early intervention/early childhood
special education
![Page 8: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/8.jpg)
Three Child Outcomes
– Positive social emotional skills (including positive social relationships)
– Acquisition and use of knowledge and skills (including early language/ communication [and early literacy])
– Use of appropriate behaviors to meet their needs
8
![Page 9: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/9.jpg)
OSEP Reporting Categories
Percentage of children who:
a. Did not improve functioningb. Improved functioning, but not sufficient to move
nearer to functioning comparable to same-aged peers
c. Improved functioning to a level nearer to same-aged peers but did not reach it
d. Improved functioning to reach a level comparable to same-aged peers
e. Maintained functioning at a level comparable to same-aged peers3 outcomes x 5 “measures” = 15 numbers 9
![Page 10: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/10.jpg)
Where We Are Now
• February 2007 – states began reporting data on child outcomes indicators
• February 2010 – states set targets
• February 2011 – states begin reporting local data to the public
10
![Page 11: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/11.jpg)
11
Why Collect Outcomes Data? At the State and
Local Levels
To respond to federal
reporting requirements
To have data for program
improvement and
to respond to federal reporting
requirements
Purpose
![Page 12: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/12.jpg)
At both state and local levels:
• To document program effectiveness• To improve programs• Identify strengths and weaknesses• Allocate support resources, such as TA
12
Need for Aggregated Data
![Page 13: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/13.jpg)
13
Prof’l Development•Preservice•Inservice
System for Producing Good System for Producing Good Child and Family OutcomesChild and Family Outcomes
Good Federal policies
and programs
Good State
policies and
programs
High quality services
and supports for children 0-5
and their families
Good outcome
s for children
and families
Good Local
policies and
programs
Adequate funding
Strong Leadership
![Page 14: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/14.jpg)
Keeping our eyes on the prize:High quality services for children and families that will lead to good outcomes.
![Page 15: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/15.jpg)
15
State Approaches to Measuring Child
Outcomes
• Possible state approaches to collection of child data– Child Outcomes Summary Form (COSF)
• About 70% of state Part C programs• About 60% of state 619 programs
– Single assessment statewide– Publishers’ online assessment systems– Other approaches
![Page 16: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/16.jpg)
16
What states are doing now
• Working on data quality
• Meeting with stakeholder groups to interpret data, generate improvement activities
![Page 17: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/17.jpg)
17
What we’re learning about child outcomes measurement
The process of training for child outcomes data collection has uncovered other areas of significant need related to professional development.
![Page 18: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/18.jpg)
18
Providers Need to KnowMore About…
Assessment Functional outcomes Typical child development Working as a team Working with families
![Page 19: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/19.jpg)
19
Things that help…
Collaboration with other programs – preschool and Part C
Feedback loops, like focus groups scheduled throughout the year for teachers and providers
Training module to include DVD, individual assistance if needed
![Page 20: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/20.jpg)
20
Online training modules Integrating COSF training in
ongoing staff development Use of Early Learning Guidelines
Things that help…
![Page 21: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/21.jpg)
21
Benefits!!
Opportunities to collaborate with other staff, other programs
More functional IFSP/IEP goals
Improved communication with families about child’s functioning
![Page 22: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/22.jpg)
22
What the data look like:Nationally
![Page 23: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/23.jpg)
23
Part C and PreschoolAverage Percentage of Children in Each
CategoryOutcome 1: Social/Emotional
![Page 24: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/24.jpg)
24
Part C and PreschoolAverage Percentage of Children in Each
CategoryOutcome 2: Knowledge/Skills
![Page 25: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/25.jpg)
25
Part C and PreschoolAverage Percentage of Children in Each
CategoryOutcome 3: Getting Needs Met
![Page 26: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/26.jpg)
26
![Page 27: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/27.jpg)
27
![Page 28: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/28.jpg)
Child Outcomes Summary Form
(COSF) Refresher!
28
![Page 29: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/29.jpg)
29
Essential Knowledge: Between them, COSF team members
must…
Know about the child’s functioning across settings and situations
Understand age-expected child development
Understand the content of the three child outcomes
Know how to use the rating scale
Understand age expectations for child functioning within the child’s culture
![Page 30: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/30.jpg)
30
Outcomes Jeopardy
Pointing to the cabinet for
cereal
Reading the letter “S” on the Stop sign
Washes hands before lunch
BitingPlays by himself in the classroom
Plays with rhyming words
Building a castle from
blocks with a friend
Problems sleeping
Sharing a cookie at lunchtime
$100
$200
$100
$300
$200
$300
$200
$100
$300
![Page 31: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/31.jpg)
31
Rating Scale Jeopardy
Age appropriate functioning – no
concerns
Mix of age appropriate and
not age appropriate functioning
No age appropriate functioning – not
yet showing immediate
foundational skills
Some age appropriate
functioning but very little
No age appropriate
functioning – lots of immediate
foundational skills
Age appropriate functioning –
some concerns
Rarely shows age appropriate functioning
No age appropriate functioning –
some immediate foundational skills
Age appropriate functioning
$100
$200
$100
$300
$200
$300
$200
$100
$300
![Page 32: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/32.jpg)
32
7 – Completely
• Child shows functioning expected for his or her age in all or almost all everyday situations that are part of the child’s life
• Functioning is considered appropriate for his or her age
• No one has any concerns about the child’s functioning in this outcome area
![Page 33: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/33.jpg)
33
6 – Between completely and somewhat
• Child’s functioning generally is considered appropriate for his or her age but there are some significant concerns about the child’s functioning in this outcome area
• These concerns are substantial enough to suggest monitoring or possible additional support
• Although age-appropriate, the child’s functioning may border on not keeping pace with age expectations
![Page 34: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/34.jpg)
34
5 – Somewhat
• Child shows functioning expected for his or her age some of the time and/or in some settings and situations
• Child’s functioning is a mix of age-appropriate and not age-appropriate behaviors and skills
• Child’s functioning might be described as like that of a slightly younger child
![Page 35: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/35.jpg)
35
4 – Between somewhat and nearly
• Child shows occasional age-appropriate functioning across settings and situations
• More functioning is not age-appropriate than age-appropriate
![Page 36: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/36.jpg)
36
3 – Nearly
Child does not yet show functioning expected of a child of his or her age in any situation
Child uses immediate foundational skills, most or all of the time across settings and situations
Immediate foundational skills are the skills upon which to build age-appropriate functioning
Functioning might be described as like that of a younger child
![Page 37: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/37.jpg)
37
2 – Between nearly and not yet
Child occasionally uses immediate foundational skills across settings and situations
More functioning reflects skills that are not immediate foundational than are immediate foundational
![Page 38: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/38.jpg)
38
1 – Not yet
Child does not yet show functioning expected of a child his or her age in any situation
Child’s functioning does not yet include immediate foundational skills upon which to build age-appropriate functioning
Child functioning reflects skills that developmentally come before immediate foundational skills
Child’s functioning might be described as like that of a much younger child
![Page 39: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/39.jpg)
The set of skills and behavior that occur developmentally just prior to age-expected functioning
Are the basis on which to build age-expected functioning
Functioning looks like a younger child
39
Immediate Foundational Skills
![Page 40: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/40.jpg)
Age-expected functioning
Immediate foundational skills Foundational skills
Foundational skills40
How Foundational Skills Lead to Age-Expected Functioning
![Page 41: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/41.jpg)
Exercise:For a 30 month-old child, identify• age-expected • immediate foundational and• foundational skills and
behaviors
41
Immediate Foundational Skills
![Page 42: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/42.jpg)
Functional assessment for outcomes measurement
42
![Page 43: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/43.jpg)
• Not domains-based, not separating child development into discrete areas (communication, gross motor, etc.)
• Refer to behaviors that integrate skills across domains
• Emphasize how the child is able to carry out meaningful behaviors in their natural environment
43
Functional Outcomes
![Page 44: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/44.jpg)
What does the child usually do?
Actual performance across settings and situations
How the child uses his/her skills to accomplish tasks
Not the child’s capacity to function under unusual or ideal circumstances
Not necessarily the child’s performance in a structured testing situation
44
Assessing Functional Outcomes
![Page 45: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/45.jpg)
• Identify relationships between assessment instruments and the three child outcome
• Display how content on a given assessment instrument is related to each outcome
• Are not meant to be used as a “checklist” or “score sheet” for measuring child outcomes
• Find crosswalks on http://www.fpg.unc.edu/~eco/pages/crosswalks.cfm
45
Crosswalks
![Page 46: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/46.jpg)
Exercise:What are functional skills and behaviors?
46
![Page 47: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/47.jpg)
47
Quality Indicators of a Good COSF Discussion
All team members participate
Parent input respectfully considered Multiple sources of assessment
information considered (observation, family report, formal ‘testing’)
![Page 48: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/48.jpg)
48
More Quality Indicators of a Good COSF Discussion
The team describes the child’s functioning (not just test scores)
Discussion includes the child’s full range of functioning
The team documents the rationale for the rating
![Page 49: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/49.jpg)
Exercise:Evaluate a COSF team discussion
49
![Page 50: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/50.jpg)
50
Involving Families
![Page 51: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/51.jpg)
51
Involving families in a conversation about their child’s
functioning
• Avoid jargon• Avoid questions that can be
answered with a yes or no– “Does Anthony finger feed himself?”
• Ask questions that allow parents to tell you what they have seen– “Tell me about how Anthony eats”
![Page 52: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/52.jpg)
52
What We Should Expect from Family Involvement
• That they can provide rich information about their child’s functioning across settings and situation – YES!
• That they will know whether their child is showing age appropriate behavior? Maybe… but not necessarily!
![Page 53: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/53.jpg)
Exercise:Evaluate theparticipation ofthe family in a COSF
team discussion53
![Page 54: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/54.jpg)
How COSF data will be
used ?
54
![Page 55: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/55.jpg)
OSEP Reporting Categories
Percentage of children who: a. Did not improve functioningb. Improved functioning, but not sufficient to move
nearer to functioning comparable to same-aged peers
c. Improved functioning to a level nearer to same-aged peers but did not reach it
d. Improved functioning to reach a level comparable to same-aged peers
e. Maintained functioning at a level comparable to same-aged peers3 outcomes x 5 “measures” = 15 numbers
55
![Page 56: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/56.jpg)
Functioning
56
![Page 57: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/57.jpg)
Entry
57
![Page 58: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/58.jpg)
Entry Exit
58
![Page 59: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/59.jpg)
Entry Exit
59
![Page 60: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/60.jpg)
Key point
The OSEP categories describe types of progress children can make between entry and exit
Two COSF ratings (entry and exit) are needed to calculate what OSEP category describes a child progress
60
![Page 61: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/61.jpg)
How changes in ratings on the COSF correspond to reporting categories a
- e
e. % of children e. % of children who who maintainmaintain functioning at at a level a level comparable to comparable to same-aged same-aged peerspeers
• Rated 6 or 7 at Rated 6 or 7 at entry; ANDentry; AND
• Rated 6 or 7 at Rated 6 or 7 at exitexit
61
![Page 62: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/62.jpg)
Entry Exit
62
![Page 63: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/63.jpg)
Entry Exit
63
![Page 64: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/64.jpg)
Entry Exit
64
![Page 65: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/65.jpg)
How changes in ratings on the COSF correspond to reporting
categories a - e
d. % of children d. % of children who improve who improve functioning to functioning to reachreach a level a level comparable to comparable to same-aged same-aged peerspeers
• Rated 5 or Rated 5 or lower at lower at entry; ANDentry; AND
• Rated 6 or 7 Rated 6 or 7 at exitat exit
65
![Page 66: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/66.jpg)
Entry Exit
66
![Page 67: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/67.jpg)
How changes in ratings on the COSF correspond to reporting
categories a - e
c. % of children c. % of children who improved who improved functioning to functioning to a a level nearernearer to same aged to same aged peers, but did peers, but did not reach itnot reach it
• Rated higher Rated higher at at exit than than entry; ANDentry; AND
• Rated 5 or Rated 5 or below at exitbelow at exit
67
![Page 68: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/68.jpg)
Entry Exit
68
![Page 69: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/69.jpg)
Entry Exit
69
![Page 70: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/70.jpg)
How changes in ratings on the COSF correspond to reporting categories a
- e
b. % of children b. % of children who who improvedimproved functioning, , but not but not sufficient to sufficient to move nearer to move nearer to same aged same aged peerspeers
• Rated 5 or lower at entry; AND
• Rated the same or lower at exit; AND
• “Yes” on the progress question (b) 70
![Page 71: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/71.jpg)
Entry Exit
71
![Page 72: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/72.jpg)
Entry Exit
72
![Page 73: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/73.jpg)
Entry Exit
73
![Page 74: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/74.jpg)
Entry Exit
74
![Page 75: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/75.jpg)
How changes in ratings on the COSF correspond to reporting categories a
- e
a. % of children who did not improve functioning
• Rated lower at exit than entry; OR
• Rated 1 at both entry and exit; AND
• Scored “No” on the progress question (b) 75
![Page 76: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/76.jpg)
Entry Exit
76
![Page 77: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/77.jpg)
Entry Exit
77
![Page 78: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/78.jpg)
Note: Calculating the progress categories from COSF data happens at the state level
78
![Page 79: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/79.jpg)
Assuring the Quality of your Data
79
![Page 80: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/80.jpg)
80
Why it’s Important
If you conclude the data are not (yet) valid, they cannot be used for program effectiveness, program improvement or anything else.
What do you do if the data are not as good as they should be?
Answer: Continue to improve data collection through ongoing quality assurance
![Page 81: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/81.jpg)
81
Many Steps for Ensuring Quality Data
Before•Good data collection/Training•Good data system and data entry procedures
During
•Ongoing supervision of implementation•Feedback to implementers•Refresher training
After•Review of COSF records•Data analyses for validity checks
![Page 82: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/82.jpg)
82
Promoting Quality Data
Training and support before and during data collection
Analysis of the data after data collection
Data system and verification after data collection
![Page 83: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/83.jpg)
83
Many Steps for Ensuring Quality Data
Before•Good data collection/Training•Good data system and data entry procedures
![Page 84: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/84.jpg)
84
Promoting Quality Data
Through training and communication related to: – Assessment– Understanding the COSF process– Age expectations– Data entry
![Page 85: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/85.jpg)
85
Promoting Quality Data
Through training materials, such as– Video team and child examples– Written child examples– “Quizzes” for ensuring learning
Refresher trainings –Beware of Drift!!
![Page 86: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/86.jpg)
86
Many Steps for Ensuring Quality Data
During
•Ongoing supervision of implementation•Feedback to implementers•Refresher training
![Page 87: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/87.jpg)
87
Ongoing Supervision
Review of the process– Is the process high quality?– Are teams reaching the correct rating?
Methods– Observation– Videos
![Page 88: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/88.jpg)
88
Ongoing Supervision
Feedback to teams is criticalRefresher trainingBeware of:
– Auto pilot– Drift
![Page 89: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/89.jpg)
Ongoing Supervision
Does anyone at the site check the COSFs for accuracy? Quality?
Do sites review the COSF process for quality?– Through observation of video?– Do teams receive feedback?
![Page 90: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/90.jpg)
90
Quality Review throughProcess Checks
Provider surveys– Self assessment of competence– Knowledge checks– Process descriptions (who
participates?)– Identification of barriers
![Page 91: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/91.jpg)
91
Many Steps for Ensuring Quality Data
After•Review of COSF records•Data analyses for validity checks
![Page 92: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/92.jpg)
92
Quality Indicators of a Well-Completed COSF
The COSF is complete The evidence matches the
appropriate outcome area There is adequate evidence for the
basis of the rating
![Page 93: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/93.jpg)
93
Quality Indicators of a Well-Completed COSF
• The evidence is based on functional behaviors
• Evidence reflects the child’s functioning across settings and situations considered
• Ratings are consistent with the evidence
![Page 94: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/94.jpg)
Exercise:Evaluating a completed COSF
94
![Page 95: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/95.jpg)
◦ What evidence led to the selected rating, evidence of ….. Age expected functioning? Immediate foundational skills Skills and behaviors that will
lead to foundational skills◦ Who participated in the
conversation and the decision95
On the form, you will need to document:
![Page 96: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/96.jpg)
• Evidence can be reviewed to see whether people are using the system properly (i.e., rating similar children in the same ways)
• Documentation helps identify needs for future training and technical assistance
• Documentation may be useful for new team members reviewing the file 104
Why Document?
![Page 97: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/97.jpg)
Exercise:Documenting a rating
97
![Page 98: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/98.jpg)
Next Steps: Putting it
all together
98
![Page 99: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/99.jpg)
Program Improvement: Where and How
– At the state level – TA, policy
– At the site level – supervision, guidance
– Child level -- modify intervention
99
![Page 100: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/100.jpg)
100
Plan (vision) Program characteristics
Child and family outcomes
Implement
Check (collect and
analyze data)
Reflect (are we where we
want to be?)
Continuous Program Improvement
![Page 101: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/101.jpg)
Examining and Tweaking the Service System
Plan (vision) Program characteristics
Child and family outcomes
Implement
Check(Collect and analyze data)
ReflectAre we where we
want to be?
Is there a problem?
Why is it happening?
What should be done?
Is it being done?
Is it working?
101
![Page 102: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/102.jpg)
Keeping our eye on the prize: High qualityservices for childrenand families that willlead to good outcomes.
102
![Page 103: Measuring Child Outcomes Christina Kasprzak Robin Rooney (ECO) Early Childhood Outcomes (NECTAC) National Early Childhood TA Center Delaware COSF Training,](https://reader036.fdocuments.us/reader036/viewer/2022062517/56649f185503460f94c2ec9b/html5/thumbnails/103.jpg)
For More Information
www.the-eco-center.org
103