School Accountability No Child Left Behind & Arizona Learns.

30
School Accountability No Child Left Behind & Arizona Learns

Transcript of School Accountability No Child Left Behind & Arizona Learns.

Page 1: School Accountability No Child Left Behind & Arizona Learns.

School Accountability No Child Left Behind

& Arizona Learns

Page 2: School Accountability No Child Left Behind & Arizona Learns.

We Have Two Accountability Systems

Page 3: School Accountability No Child Left Behind & Arizona Learns.

Schools Receive 2 Ratings/Classifications

Page 4: School Accountability No Child Left Behind & Arizona Learns.

The NCLB Accountability System

Page 5: School Accountability No Child Left Behind & Arizona Learns.

NCLB: AYPBased On Three Measures

1. % Proficient: mastery rates on AIMS

2. % Tested: percent of students tested

3. K-8 additional measure: attendance rate

OrHigh school additional measure: graduation rate (4-Year)

Page 6: School Accountability No Child Left Behind & Arizona Learns.

NCLB:AYP Test Objectives

• Based on percent mastering AIMS standards

• There is 1 target across the state for each subject/grade (AMO)

• Applies to all schools

• The school as a whole--including out of level student--and each of the school’s subgroups must make AYP – ethnicity

– English language learners

– Low SES

– special education

• Mobile students and subgroups less than 30 are not included

Page 7: School Accountability No Child Left Behind & Arizona Learns.

Test Objectives (cont.): Confidence Intervals

• AZ will err on the side of saying a school made AYP when it didn’t, to ensure a school isn’t wrongly given a negative label.

• Confidence intervals:

– Needed due to random error in measuring performance (i.e. lucky, had a bad day, etc.)

– The 99% confidence interval means that 99 times out of 100 an observed score is X would get a score within a band of scores above and below X [e.g., if the score is 42, it might be 28 to 56 for a small group]

• Only schools whose scores fail to meet the target test objective even after a 99% confidence interval is applied will not make AYP.

Page 8: School Accountability No Child Left Behind & Arizona Learns.

Test Objective (cont.): Target goals/AMO

100% AIMS Mastery by 2013-14

Mas

tery

Ra

te o

n A

IMS

Baseline Year-computed from all AZ schools

Page 9: School Accountability No Child Left Behind & Arizona Learns.

NCLB:AYP Percent Tested and Additional Measures Basics

• Percent Tested– 95% of students enrolled on the 1st day of testing– Applies to school and each subgroup– Safe Harbor - 10% increase

• Additional Measures– K-8: attendance

• Average attendance rate for first 100 days of school year• Applies to all subgroups• Goal is 94%• Safe Harbor - ½ percent increase

– High school: graduation rates• 4-year cohort

*Mobile students and subgroups less than 30 are not included

Page 10: School Accountability No Child Left Behind & Arizona Learns.

NCLB:AYP Summary

Annual Measurable Objectives (AMO)

Reading Math3rd 5th 8th HS

White

Hispanic

Native American

Asian / PI

Limited English Prof

Low SES

Stds w/ Disabilities

African American

95% Testing Rates

High School

Grad Rate Increase

Elem./Mid. School

Attend. Rate Increase3rd 5th 8th HS

Y Y Y Y Y Y Y Y Y Y Y

Y Y Y Y Y Y Y Y Y Y Y

Y Y Y Y Y Y Y Y Y Y Y

Y Y Y Y Y Y Y Y Y Y Y

Y Y Y Y Y Y Y Y Y Y Y

Y Y Y Y Y Y Y Y Y Y Y

Y Y Y Y Y Y Y Y Y Y Y

Y Y Y Y Y Y Y Y Y Y Y

Additional Indicators

Page 11: School Accountability No Child Left Behind & Arizona Learns.

What Happens If You Don’t Make AYP?

After initial data correction opportunity:Appeal Process:

–Statistical Appeal•ELL or SpEd tested•High Schools for % Tested

–Substantive Appeal•Mold at Davidson•Tribal population attendance

Page 12: School Accountability No Child Left Behind & Arizona Learns.

AYP Consequences

Page 13: School Accountability No Child Left Behind & Arizona Learns.

Title I AYP ConsequencesSchool Improvement-Year 1

– after 2 consecutive years of not making AYP• receive technical assistance

• develop and implement an ASIP

• offer school choice/transportation after informing parents of school status

School Improvement-Year 2– after 3 consecutive years of not making AYP

• district sets aside Title I funds to offer supplemental services (i.e. tutoring)

Corrective Action– after 4 years of not making AYP

• District takes corrective action (i.e. replacing staff or new curriculum)

Restructuring– after 5 years of not making AYP

• District plans for alternative governance action (i.e. hiring a private management firm, converting to a charter or significant staff restructuring

Page 14: School Accountability No Child Left Behind & Arizona Learns.
Page 15: School Accountability No Child Left Behind & Arizona Learns.

New School Classifications

Make The Labels More Understandable

ExcellingHighly PerformingPerformingUnder performingFailing

AZ Learns classification and AYP ratings will be printed on AZ School Report Cards.

Page 16: School Accountability No Child Left Behind & Arizona Learns.

AZ LEARNS Model

0 to 770 to 77+ =0 or 1 Points

Up to 40% of Max Points

+ 0 - 2 Points

OR0 or 6 Points for Each Subject Grade Level

AIMS

Baseline /Growth Total Points

Adequate Yearly

Progress

Added Evidence: MAP (St 9 OYG) &

Ext Writing (Elem/Middle)

Added Evidence: Dropout & Grad Rates

(HS)

Total School Points

Final school classification depends on percent of students exceeding the standards on the AIMS.

Initial school classification based on total points accumulated from:

Page 17: School Accountability No Child Left Behind & Arizona Learns.

YesYes

NoNo

22

11

00

40%40%

30%30%

20%20%

10%10%

0%0%

OR

Growth

Basel

ine

66

55

44

33

22

11

66

55

44

33

22

11

66

55

44

33

22

11

66

55

44

33

22

11

66

55

44

33

22

11

66

55

44

33

22

11

++1 to 6 Rdg

Growth

Basel

ine

Growth

Basel

ine

AIMS

Baseline /Growth Total Points

Adequate Yearly

Progress

Added Evidence: MAP (St 9 OYG) & Ext Writing

(Elem/Middle)

Added Evidence: Dropout & Grad

Rates (HS)

Total School Points

0 to 770 to 77+ =0 or 1 Points

Up to 40% of Max Points

+ 0 - 2 Points

OR0 or 6 Points for Each Subject Grade Level

1 to 6 Math

1 to 6 Wrtg

AZ LEARNS Model

Page 18: School Accountability No Child Left Behind & Arizona Learns.

66

55

44

33

22

11

Baseline Points

Percent of students Meeting or Exceeding AIMS Standards

Two Year AIMS Mastery Rates

AIMS Mastery Rate 99-00 46%

Two Year Average = 50%

AIMS Mastery Rate 00-01 54%

State Average

BELOW State Average

ABOVE State Average

For example

Baseline Group

3rd Grade Math for School A

10th-24th

25th-49th

50th-74th

75th-89th

Cuts based on State percentile

ranks

1st, 2nd, 3rd, 4th, 5th or 6th Baseline Group for Each Subject/Grade Combination

90th+

Below 10th

Page 19: School Accountability No Child Left Behind & Arizona Learns.

66

55

44

33

22

11

Growth Points

State Average

Growth Points BELOW State Average

Growth Points ABOVE State Average

Average last three years – (2yr Baseline)

FFB Meet/Exceed03-04 15% 76%

02-03 17% 68%

01-02 20% 54%

Mean 17.33 66

2yr Base 24.00 50

Change 6.66 16

Growth Group

3rd Grade Math School A

Growth Points: 6.66+16 = 22.67

Cut Scores Based on .5 Std. Dev.,

which correspond to percentile ranks

For example

Below 16th

16th-30th

31st-49th

50st-68th

69th-83rd

84th+

1st, 2nd, 3rd, 4th, 5th or 6th Growth Group for Each Subject/Grade Combination

Page 20: School Accountability No Child Left Behind & Arizona Learns.

Determine Points For Baseline & Growth

Calculations completed for each

subject/grade combination

70%/30% Float Weight

Weighting the higher group 70% an the lower 30%

- -

Growth Point

Grouping

6

5

4

3

2

1

0 Missing Data

Baseline

Grouping

5

4

3

2

1

0 Missing Data

6

calculate points for each grade and subject:

Our 3rd grade math example: 3 baseline, 5 growth

70% of 5 = 3.530% of 3 = 0.93.5 + 0.9 = 4.4 pointsof the 6 possible points

Page 21: School Accountability No Child Left Behind & Arizona Learns.

AZ LEARNS Model

0 to 770 to 77+ =0 or 1 Points

Up to 40% of Max Points

+ 0 - 2 Points

OR0 or 6 Points for Each Subject Grade Level

AIMS

Baseline /Growth Total Points

Adequate Yearly

Progress

Added Evidence: MAP (St 9 OYG) &

Ext Writing (Elem/Middle)

Added Evidence: Dropout & Grad Rates

(HS)

Total School Points

Final school classification depends on percent of students exceeding the standards on the AIMS.

Initial school classification based on total points accumulated from:

Page 22: School Accountability No Child Left Behind & Arizona Learns.

Adequate Yearly

Progress (AYP)

Whole School Measure

1Made AYP

0Missed AYP

Determine Points For AYP

Reminder:

Test Objectives (AMO)

Percent Tested

Attendance or Graduation RatesAccounts for only 1 point of AZ LEARNS total.

Only affects AZ LEARNS label for borderline schools.

Adequate Yearly Progress (AYP)

Page 23: School Accountability No Child Left Behind & Arizona Learns.

Last 3 years % OYG (Stanford 9) in Reading

A single percentage is computed from: OYG/Ext Writing

40%40%

30%30%

20%20%

10%10%

0%0%

Added Evidence for K-8MAP (St9 OYG) and AIMS extended writing

Last 3 years % OYG (Stanford 9) in Math

Last 3 years % Students with scores of 24 or Higher on Extended Writing

60-69%

70-79%

80-89%

90-100%

%

Cut-scores and a table are used to determine the percent of Added Evidence Credit based on the number of subject/grade combinations

Stanford 9 OYG worth 75% and AIMS extended writing worth 25%

Page 24: School Accountability No Child Left Behind & Arizona Learns.

22

11

00

Dropout/ Grad Rates

H. S.

Added Evidence for High Schools Dropout and Graduation Rates

Baseline Dropout Rate

Baseline Graduation Rate

Target

6-9% 1% Decrease

Target

>9% 2% Decrease

74-90% 1% Increase

< 74% 2% Increase

Both Targets Met = 2 points

One Target Met = 1 point

Neither Targets Met = 0 points

Page 25: School Accountability No Child Left Behind & Arizona Learns.

AZ LEARNS Model

0 to 770 to 77+ =0 or 1 Points

Up to 40% of Max Points

+ 0 - 2 Points

OR0 or 6 Points for Each Subject Grade Level

AIMS

Baseline /Growth Total Points

Adequate Yearly

Progress

Added Evidence: MAP (St 9 OYG) &

Ext Writing (Elem/Middle)

Added Evidence: Dropout & Grad Rates

(HS)

Total School Points

Final school classification depends on percent of students exceeding the standards on the AIMS.

Initial school classification based on total points accumulated from:

Page 26: School Accountability No Child Left Behind & Arizona Learns.

1 3 6 9

Underperforming <4 <12 <24 <36

Performing 4 12 24 36

Highly Performing 4.6 13.8 27.6 41.4

Excelling 5.4 16.2 32.4 48.6

1 3

Underperforming <3.2 <9.6

Performing 3.2 9.6

Highly Performing 5 15

Excelling 5.4 16.2

Initial School ClassificationElementary / Middle Schools

High Schools Sub/Grade Combinations

Sub/Grade Combinations

Page 27: School Accountability No Child Left Behind & Arizona Learns.

Threshold Criteria for Excelling and Highly Performing Schools To maintain classification, the school must have a three-year average percent of students Exceeding standards on AIMS of:

Sub/Grade School TypeHighly

Performing Excelling

3 3 or 5 22.6% 28.7%

3 8 6.5% 10.7%

6 3 and 5 30.9% 38.8%

6 5 and 8 19.9% 31.7%

9 3, 5 and 8 19.3% 25.7%

3 H. School 9.3% 12.7%

Reading, Writing, and Mathematics percentages are combined.

Page 28: School Accountability No Child Left Behind & Arizona Learns.

State Accountability System Consequences

Did students maintain high levels of performance or make good growth and your school got points from AYP or added evidence (St9 OYG or graduation and dropout rates)?

Page 29: School Accountability No Child Left Behind & Arizona Learns.

AZ LEARNS Consequences/Sanctions

• Notify all residents, not just parents• The School Board [or designee] must hold a

public meeting at the school• The school must develop a School

Improvement Plan [SIP]• The School must implement the SIP

Schools labeled Underperforming again in 2004 will be

labeled Failing, which will trigger additional state sanctions

Schools that are designated as Underperforming on the Achievement Profile must::

Page 30: School Accountability No Child Left Behind & Arizona Learns.

School Accountability: The Important Points

• We have two accountability systems, NCLB & AZ Learns, with two sets of labels.

• NCLB requires schools to demonstrate Annual Yearly Progress [AYP], which means that 95% of every group [ethnic, Sp. Ed. ELL, poor] is tested, all groups reach a state-established criterion of mastery of the standards or 10% more students master the standards each year, and the attendance rate is 94% or has improved ½ percent.

• The AYP accountability measure will result in ratings for all schools, but federally-imposed consequences will only be applied to Title I schools.

• AZ Learns labels have changed and so have the calculations used to determine them

• AIMS is still the primary focus of AZ Learns, but additional points may be earned for making AYP and added evidence (MAP—St9 OYG and AIMS extended writing or graduation and dropout rates)

• There are still significant sanctions for schools that do not make progress under NCLB (Title I schools only) and AZ Learns (all schools).