SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1....
Transcript of SLO Results Analysis - EngageNY...At the end of this video, you will be able to: EngageNY.org 1....
EngageNY.org
SLO Results Analysis
For District Leaders, Principals, and Teachers
2
At the end of this video, you will be able to:
EngageNY.org
1. • Consider systems for scoring summative
assessments used with SLOs.
2. • Use the SLO calculator tool to support the
calculation of HEDI ratings.
3. • Reflect on SLO Results to Inform
Instructional Decisions and Approaches
2
3
Four phases of the SLO Process
1. Preparation
2. Development
3. Implementation
4. Results Analysis
3 EngageNY.org
3
4
SLOs at the end of a school year…
• Thinking strategically about the Results Analysis phase of the
SLO process offers important benefits for instructional
planning.
4
Results Analysis
Close-out
1. Administer the summative assessments.
2. Gather summative assessment results (score and record).
3. Calculate outcomes and translate to HEDI scores.
4. Report results.
Reflection
5. Organize, review, and reflect on data to inform classroom, school-wide,
and district-wide decisions around student academic goals and
instructional decisions.
EngageNY.org
4
5
Scoring Summative Assessments
EngageNY.org 5
6
Close-out: Scoring Summative
Assessments
• Please see Section G of the APPR Guidance for
information regarding the vested interest rule:
http://engageny.org/sites/default/files/resource/attac
hments/appr-field-guidance.pdf
• Remember: Teachers and principals cannot score
assessments in which they have a vested interest.
6 6 6 EngageNY.org 6
7
Close-out: Scoring Summative
Assessments
Sample SLO scoring options:
1. Expert Panel
2. Blind Distribution
3. Strategic Rotation
EngageNY.org 7
8
Close-out: Scoring Summative
Assessments, “Expert Panel”
8
Example of a Review Team:
Teacher from Middle School 1
Teacher from Middle School 2
District Central Office Personnel
Content Expert from BOCES
EngageNY.org 8
9
Close-out: Suggestions for Training
Individuals for “Expert Panels”
• Develop scoring guides, rubrics, and protocols.
• Articulate expectations for submission in
advance (especially important for work products
and “real-time” summative assessments)
• Practice scoring real student work using the
developed materials.
• Arrange for inter-rater agreement and reliability.
EngageNY.org 9
10
Close-out: Scoring Summative
Assessments, “Blind Distribution”
10
Blind Distribution
Random portion of
summative assessments
Random portion of
summative assessments
Random portion of
summative assessments
Random portion of
summative assessments
EngageNY.org 10
11
Close-out: Scoring Summative
Assessments, “Strategic Rotation”
11
Sample rotation
EngageNY.org 11
12
Calculating Outcomes and
Translating Results to HEDI Scores
EngageNY.org 12
13
Close-out: Calculating Outcomes
A: Student
Names
B: Baseline
Scores C: Targets
D:
Summative
Assessment
Scores
E: (D minus
C)
Student U 17 80
Student V 10 70
Student W 12 75
Student X 18
Student Y 14
Student Z 22
13
Student Teacher Course/Period
Code
Student V A 1234
Student W A 1234
Student X A 1234
Student Y A 1234
Student Z A 1234
EngageNY.org 13
14
Close-out: Calculating Outcomes
A: Student
Names
B: Baseline
Scores C: Targets
D:
Summative
Assessment
Scores
E: (D minus
C)
14 EngageNY.org 14
15
Close-out: Calculating Outcomes
A: Student
Names
B: Baseline
Scores C: Targets
D:
Summative
Assessment
Scores
E: (D minus
C)
15 EngageNY.org 15
16
Close-out: Calculating Outcomes
A: Student
Names
B: Baseline
Scores C: Targets
D:
Summative
Assessment
Scores
E: (D minus
C)
Student V 30 70 81 11
Student W 52 75 68 -7
Student X 60 80 94 14
Student Y 48 75 77 2
Student Z 65 80 80 0
4/5 (80%)
16 EngageNY.org 16
17
Close-out: Calculating Outcomes
Weighting Multiple SLOs
Sample teacher with three SLOs:
1.An SLO with 50 students earning 14 points on the district-approved HEDI scale
2.A second SLO which earned 16 points with 39 students, and
3.A third SLO which earned 11 points with 18 students.
17 17 EngageNY.org 17
18
Close-out: Calculating Outcomes
Weighting Multiple SLOs
Sum the number of students.
50+39+18 = 107
Compute proportion of students covered by each SLO.
50/107 =.4673 39/107 =.3645 18/107 =.1682
Multiply the proportion by the HEDI points for three partial
HEDIs that will be added together.
.4673 * 14 = 6.5422 (SLO 1)
.3645 * 16 = 5.832 (SLO 2)
.1682 * 11 = 1.8502 (SLO 3)
Overall HEDI = sum of these partial HEDI values.
6.5422 + 5.832 + 1.8502 = 14.2244 Rounded = 14
(Effective)
Note:
SLO 1 = 14 points with 50 students
SLO 2 = 16 points with 39 students
SLO 3 = 11 points with 18 students
18 EngageNY.org 18
19
Close-out: Weighting Multiple SLOs
EngageNY.org 19
20
Close-out: Weighting Multiple SLOs
EngageNY.org 20
21
Close-out: Weighting Multiple SLOs
EngageNY.org 21
22
Close-out: Weighting Multiple SLOs
EngageNY.org 22
Close-Out: SLO Database
EngageNY.org 23
24
Reflecting on SLO Results to Inform
Instructional Decisions and Approaches
EngageNY.org 24
25
Reflection: Formal
Visit engageny.org for sample agenda items as
you plan for final conferences with educators.
24 EngageNY.org 25
26
Reflection: Organize and Review
0
1
2
3
4
5
6
Arts
Kinderg
arte
n
Grade 1 EL
A
Grade 1 M
ath
Grade 2 EL
A
Grade 2 M
ath
Highly Effective
Effective
Developing
Ineffective
25 EngageNY.org 26
27
Reflection: Formal
Remember to include SLO analysis with teachers
as a part of that final conference.
26 EngageNY.org 27
28
Reflection: Organize and Review
EngageNY.org 28
Standard:
Assessment Item:
29
Four phases of the SLO Process
1. Preparation
2. Development
3. Implementation
4. Results Analysis
28 EngageNY.org 29
30
Search: www.engageNY.org
29 EngageNY.org 30