NWEA 2011 - RIT Scale Norms
-
Upload
todd-coffey -
Category
Documents
-
view
17 -
download
1
description
Transcript of NWEA 2011 - RIT Scale Norms
NWEA 2011 - RIT Scale Norms
Some Things You Should Know About the 2011 RIT Scale Norms
Prepared by:Dan Henderson, NWEA Partner Relations Region ManagerJohn Woodin, NWEA Partner Relations State Representative
Introduction“No, your students’ performance
didn’t change from last spring.”The norm group and
methodology did changeSimply creates a different
comparisonA 215 RIT is still a 215 RIT –
means the same thing related to performance
Key Differences from 2008Methodology: set of norms more
representative of school age population
Everyone will see some changes: status and growth norms
Norms have been applied to both past and current scores (for consistency and growth projections)
What will be “fixed” in the 2011 Norms…Asterisks * will be replaced with 1 or
99 (percentiles)Kindergarten growth norms will be
reinstated for fall to springKindergarten status norms will be
reinstated for fall and winter11th grade norms will be reinstated as
soon as possible
Sampling student test records “Students” were randomly sampled from a pool of test event records. (all test records of the student from the study period in the subject of
interest)
• Pool represented about 5.1 million students,• from 13,000 schools • located in more than 2,700 school
districts• from over 50 states and • contained about 35 million test
events.
Smallest grade level sample was about 20,000 students.
Post-stratification procedures •Based on school-level variables commonly associated with challenges and opportunities
•School–level variables: Mix of student ethnicity, percent free/reduced lunch eligibility, Title 1 eligibility, ALL Title 1, grade range served, charter status, magnet status, enrollment at each grade, total enrollment, school level, school type, school locale, pupil-teacher ratio.
•Combined to form a School Challenge Index (SCI) for each state – using ALL schools in the state, not only NWEA schools
•SCI was used as a post-stratification weight for all analyses
Differences in Status NormsMinor changes in status normsPercentiles changed very littleLarger changes for grades 1 & 2 for
high and low achieving students◦ Difference in partner base (more schools
and students than 2008)◦ Different methodology for selection which
results in more representative norms
130 140 150 160 170 180 1900
102030405060708090
100
Reading - Grade 1 - Fall
20082011
RIT Score
Perc
enti
le R
ank
140 150 160 170 180 190 200 2100
102030405060708090
100
Reading - Grade 1 - Spring
20082011
RIT Score
Perc
enti
le R
ank
155 165 175 185 195 205 215 2250
102030405060708090
100
Reading - Grade 3 - Fall
20082011
RIT Score
Perc
enti
le R
ank
165 175 185 195 205 215 225 2350
102030405060708090
100
Reading - Grade 3 - Spring
20082011
RIT Score
Perc
enti
le R
ank
170 180 190 200 210 220 230 2400
102030405060708090
100
Reading - Grade 5 - Fall
20082011
RIT Score
Perc
enti
le R
ank
175 185 195 205 215 225 235 2450
102030405060708090
100
Reading - Grade 5 - Spring
20082011
RIT Score
Perc
enti
le R
ank
175 185 195 205 215 225 235 2450
102030405060708090
100
Reading - Grade 7 - Fall
20082011
RIT Score
Perc
enti
le R
ank
180 190 200 210 220 230 240 2500
102030405060708090
100
Reading - Grade 7 - Spring
20082011
RIT Score
Perc
enti
le R
ank
140 150 160 170 180 190 200 2100
20
40
60
80
100
Mathematics - Grade 1 - Spring
20082011
RIT Score
Perc
enti
le R
ank
130 140 150 160 170 180 190 200 2100
102030405060708090
100
Mathematics - Grade 1 - Fall
20082011
RIT Score
Perc
enti
le R
ank
160 170 180 190 200 210 2200
102030405060708090
100
Mathematics - Grade 3 - Fall
20082011
RIT Score
Perc
enti
le R
ank
170 180 190 200 210 220 2300
20
40
60
80
100
Mathematics - Grade 3 - Spring
20082011
RIT Score
Perc
enti
le R
ank
180 190 200 210 220 230 2400
102030405060708090
100
Mathematics - Grade 5 - Fall
20082011
RIT Score
Perc
enti
le R
ank
180 190 200 210 220 230 240 2500
20
40
60
80
100
Mathematics - Grade 5 - Spring
20082011
RIT Score
Perc
enti
le R
ank
Difference in Growth NormsLess difference in the middle of
achievement continuumLarger differences at the two ends of
achievement (especially extremes)High or low achievers may see larger
differences in growth projectionsLow Achievers: lower grow
projections than in the pastHigh Achievers: higher growth
projections
Growth in 2008 Norm study
Pt. AFALL
Pt. BSpring
Growth within the grade only
How growth is conceptualized Previous
grade Grade of Interest Next grade
S F W S F
1 36 54 8272
Instructional weeks
*
1
2
3
4
5
6
students
.
.
.
All scores included
All scores included
Flat Growth RatesGrowth projections tend to be
flatter in 2011 than the 2008 norms◦Grades 5, 6, 8 show flat growth in Math◦In a large national sample, students in
these grades tended to show similar growth regardless of where they were on the RIT scale
Due to sampling methods – overly large impact of extreme scores in 2008
155 165 175 185 195 205 215 225 2350
5
10
15
Reading - Grade 3 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
160 170 180 190 200 210 220 230 2400
5
10
15
Reading - Grade 5 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
160 170 180 190 200 210 220 230 2400
5
10
15
Reading - Grade 7 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
165 175 185 195 205 215 225 235 24502468
1012141618
Reading - Grade 8 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
155 165 175 185 195 205 215 225 235 24502468
10121416
Mathematics - Grade 3 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
160 170 180 190 200 210 220 230 240 25002468
10121416
Mathematics - Grade 4 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
165 175 185 195 205 215 225 235 245 25502468
10121416
Mathematics - Grade 5 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
170 180 190 200 210 220 230 240 250 2600
2
4
6
8
10
12
14
Mathematics - Grade 6 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
170 180 190 200 210 220 230 240 250 26002468
101214
Mathematics - Grade 7 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
170 180 190 200 210 220 230 240 250 2600
2
4
6
8
10
12
14
Mathematics - Grade 8 - Fall to Spring
20082011
Starting RIT Score
Gro
wth
in R
ITs
Applying Growth to Past Terms
Since NWEA uses growth norms that overlap from year to year – had to apply the norms backward
Cannot compare 2008 growth norms to 2011 growth norms – not comparable