Www.engageNY.org 1 An Overview of the 6 Shifts in ELA Literacy.
Www.engageNY.org 1 New York State Education Department Using Growth Measures for Educator Evaluation...
-
Upload
clinton-dennis -
Category
Documents
-
view
217 -
download
0
Transcript of Www.engageNY.org 1 New York State Education Department Using Growth Measures for Educator Evaluation...
www.engageNY.orgwww.engageNY.org1
New York State Education Department
Using Growth Measures for Educator Evaluation
August 2012
www.engageNY.orgwww.engageNY.org2 www.engageNY.orgwww.engageNY.org2
By the End of This Presentation…. You should be able to:
–Explain how growth ratings (HEDI) and scores will be obtained from educator overall MGPs and confidence ranges based on 2011-12 State-provided growth measures
www.engageNY.orgwww.engageNY.org3 www.engageNY.orgwww.engageNY.org3
Evaluating Educator Effectiveness 2011-12
www.engageNY.orgwww.engageNY.org4 www.engageNY.orgwww.engageNY.org4
Key Points about NYS Growth Measures
–We are measuring student growth and not achievement
Allow teachers to achieve high ratings regardless of incoming levels of achievement of their students
–We are measuring growth compared to similar students
Similar students: Up to three years of the same prior achievement, three student-level characteristics (economic disadvantage, SWD, and ELL status)
Every educator has a fair chance to demonstrate effectiveness on these measures regardless of the composition of his/her class or school.
www.engageNY.orgwww.engageNY.org5 www.engageNY.orgwww.engageNY.org5
Review of Terms SGP (student growth percentile):
–the result of a statistical model that calculates each student’s change in achievement between two or more points in time on a State assessment or other comparable measure and compares each student’s performance to that of similarly achieving students
Similar students: –students with the similar prior test scores,(up to three years),
and ELL, SWD, and economic disadvantage status
Unadjusted and adjusted MGP (mean growth percentile):
–the average of the student growth percentiles attributed to a given educator
–For evaluation purposes, the overall adjusted MGP is used. This is the MGP that includes all a teacher or principal’s students and takes into account student demographics.
www.engageNY.orgwww.engageNY.org6 www.engageNY.orgwww.engageNY.org6
MGPs and Statistical Confidence
8787
Confidence Range
Upper
Limit
Lower
Limit
MGP
• NYSED will provide a 95% confidence range, meaning we can be 95% confident that an educator’s “true” MGP lies within that range. Upper and lower limits of MGPs will also be provided.
• An educator’s confidence range depends on a number of factors, including the number of student scores included in his or her MGP and the variability of student performance in the classroom.
www.engageNY.orgwww.engageNY.org7 www.engageNY.orgwww.engageNY.org7
Growth Ratings and Score Ranges 2011-12
Growth Rating Description Growth Score Range
(2011–12)
Highly Effective
Well above state average for similar students
18–20
Effective Results meet state average for similar students
9–17
Developing Below state average for similar students
3–8
Ineffective Well below state average for similar students
0–2
The growth scores and ratings are based on an educator’s combined MGP.
www.engageNY.orgwww.engageNY.org8 www.engageNY.orgwww.engageNY.org8
HEDI Classification Approach: Teachers and Principals
Highly Effective (Well Above Average) requires:–An educator’s MGP is greater than 1.5 standard deviations above the State
mean.
–For 2011-12 this means MGP’s greater than or equal to 69 for teachers.
Effective (Average) requires:–An educator’s MGP is between 1 standard deviation below the State mean
and 1.5 standard deviations above the State mean.
–For 2011-12, MGPs of 42 through 68 for teachers.
Developing (Below Average) requires:–An educator’s MGP is between 1 and 1.5 standard deviations below the
State mean.
–For 2011-12, MGPs of 36 through 41 for teachers.
Ineffective (Well Below Average) requires:–An educator’s MGP is more than 1.5 standard deviations below the State
mean.
–For 2011-12 this means MGPs less than or equal to 35 for teachers.
www.engageNY.orgwww.engageNY.org9 www.engageNY.orgwww.engageNY.org9
From MGPs to Growth Ratings: TeachersRules on last slide result in these HEDI criteria for 2011-12
Yes
No
Is your MGP ≥ 69?
Is your Lower Limit > Mean of
52?
Highly Effective: Results are well
above state average for
similar students
Is your MGP ≤ 35?
Is your Upper Limit
< 44?
Ineffective: Results are well
below state average for
similar students
Developing: Results are below state average for similar students
No
Effective: Results equal
state average for similar students
Mean Growth Percentile Confidence Range HEDI Rating
Is your MGP 42-
68?
Any Confidence
Range
Yes
No
Is your MGP 36-
41?
Is your Upper Limit < Mean of
52?
Yes
Yes
Yes
Yes
Yes
Yes
No
No
No
www.engageNY.orgwww.engageNY.org10 www.engageNY.orgwww.engageNY.org10
From MGPs to Growth Ratings: PrincipalsFor principals the rules lead to these HEDI criteria for 2011-12
Yes
No
Is your MGP ≥ 61?
Is your Lower Limit > Mean of
51?
Highly Effective: Results are well
above state average for
similar students
Is your MGP ≤ 41?
Is your Upper Limit
< 46?
Ineffective: Results are well
below state average for
similar students
Developing: Results are below state average for similar students
No
Effective: Results equal
state average for similar students
Mean Growth Percentile Confidence Range HEDI Rating
Is your MGP 45-
60?
Any Confidence
Range
Yes
No
Is your MGP 41.5-
44?
Is your Upper Limit < Mean of
51?
Yes
Yes
Yes
Yes
Yes
Yes
No
No
No
www.engageNY.orgwww.engageNY.org11 www.engageNY.orgwww.engageNY.org11
Illustrating Teacher Growth Ratings: (Another Way) (2011-12 cut scores)
MGP 1 MGP 99
MGP
MGP
MGP
MGP
MGP
MGP
MGP
Below Average
(41)
Below Average
(41)
Well Below
Average (35)
Well Below
Average (35)
Average (52)
Average (52)
Upper limit CR for
Ineffective(44)
Upper limit CR for
Ineffective(44)
Well Above
Average (69)
Well Above
Average (69)
www.engageNY.orgwww.engageNY.org12 www.engageNY.orgwww.engageNY.org12
Illustrating Teacher Growth Ratings: (2011-12 cut scores)
MGP 1 MGP 99Below Average
(41)
Below Average
(41)
Well Below
Average (35)
Well Below
Average (35)
Average (52)
Average (52)
Upper limit CR for
Ineffective(44)
Upper limit CR for
Ineffective(44)
Well Above
Average (69)
Well Above
Average (69)
MGP
Ineffective
MGP
Highly Effective
www.engageNY.orgwww.engageNY.org13 www.engageNY.orgwww.engageNY.org13
Illustrating Teacher Growth Ratings (2011-12 cut scores)
MGP 1 MGP 99Below Average
(41)
Below Average
(41)
Well Below
Average (35)
Well Below
Average (35)
Average (52)
Average (52)
Upper CI for
Ineffective(44)
Upper CI for
Ineffective(44)
Well Above
Average (69)
Well Above
Average (69)
MGP
MGP
Developing
Effective
Effective
MGP
Developing MGP
Effective
MGP
IneffectiveMGP
Highly Effective
MGP
www.engageNY.orgwww.engageNY.org14 www.engageNY.orgwww.engageNY.org14
NYS Growth Subcomponent Results for 2011-12: Teachers
Rating &Points (2011–12 )
Number of Teacher MGPs
Percent of Teacher MGPs
Highly Effective18–20
2206 7%
Effective9–17
25,578 77%
Developing3–8
3341 10%
Ineffective0–2
2004 6%
Total 33,129
www.engageNY.orgwww.engageNY.org15 www.engageNY.orgwww.engageNY.org15
NYS results for 2011-12: Principals
Rating &Points (2011–12 )
Number of Principal
MGPs
Percent of Principal
MGPs
Highly Effective18–20
223 6%
Effective9–17
2821 79%
Developing3–8
269 8%
Ineffective0–2
243 7%
Total 3556
www.engageNY.orgwww.engageNY.org16 www.engageNY.orgwww.engageNY.org16
Assignment of Points with HEDI Category
HEDI Points
Min MGP
Max MGP
N of Teacher
s
0 3 28 660
1 29 32 651
2 33 35 693
3 29 35 241
4 36 37 826
5 38 38 495
6 39 39 535
7 40 40 561
8 41 41 683
9 36 44 2661
10 45 46 2001
11 47 49 3376
12 50 51 2432
13 52 54 3648
14 55 56 2415
15 57 59 3144
16 60 62 2624
17 63 68 3277
18 69 70 662
19 71 73 666
20 74 96 878
HEDI Points
Min MGP
Max MGP
N of School
s
0 16 36.5 71
1 37 39 75
2 39.5 41 97
3 34.5 41 22
4 41.5 42 65
5 42.5 42.5 40
6 43 43 37
7 43.5 43.5 41
8 44 44 64
9 41.5 46 270
10 46.5 48 350
11 48.5 49 209
12 49.5 50.5 328
13 51 52 313
14 52.5 53.5 324
15 54 55 316
16 55.5 57 353
17 57.5 63.5 358
18 61 61.5 65
19 62 63 70
20 63.5 74 88
Point value of 3 includes educators with MGPs in the Ineffective category but CRs above 44 (for teachers) and above 46 (for principals)
Point value of 3 includes educators with MGPs in the Ineffective category but CRs above 44 (for teachers) and above 46 (for principals)
Point value of 9 includes educators with MGPs in the Developing category but CRs above state average
Point value of 9 includes educators with MGPs in the Developing category but CRs above state average
Point value of 17 Includes educators with MGPs in the Highly Effective category but CRs below state average
Point value of 17 Includes educators with MGPs in the Highly Effective category but CRs below state average
Teachers Principals
Teachers Principals
www.engageNY.orgwww.engageNY.org17 www.engageNY.orgwww.engageNY.org17