Adapted from Texas Education Agency 2015.. PBM ProductDate of 2014 release Projected date of 2015...

Performance-Based Monitoring Proposal for Fall 2015

Adapted from Texas Education Agency 2015.

PBM Product

Date of 2014 release

Projected date of 2015 release

PBMAS(Unmasked reports)

LEA reports posted on TEASE ACCT 08/13/14

LEA reports posted on TEASE ACCT 08/07/15

PBMAS(Masked reports)

LEA reports posted on TEA web site 09/17/14

LEA reports posted on TEA web site 09/18/15


2

2015 PBM Calendar (blue = current projection)

Note: PBM products always use the most current data available.

The development of the 2015 PBMAS is currently underway.

There are important changes proposed for 2015.


3

2015 PBMAS

4

2015 PBMAS Manual rule adoption is underway. TEA is in the process of preparing the rule packet for adoption.◦Proposed Amendment to 19 TAC Chapter 97,

Planning and Accountability, Subchapter AA, Accountability and Performance Monitoring, §97.1005, Performance-Based Monitoring Analysis System

◦Summary: The proposed amendment would adopt the Performance-Based Monitoring Analysis System 2015 Manual.


2015 PBMAS Manual

◦ 30-Day Public Comment Period: TEA Anticipated Dates May 8, 2015 – June 8, 2015.

◦ Note: Not yet posted (as of 5/19/2015 a.m.) The rule will likely be effective in mid July. For current information on the rule adoption

process: ◦ Visit

http://tea.texas.gov/About_TEA/Laws_and_Rules/Commissioner_Rules_(TAC)/Commissioner_of_Education_Rules_-_Texas_Administrative_Code/ and/or

◦ Subscribe to the Rules Listserv at https://public.govdelivery.com/accounts/TXTEA/subscriber/new


5

2015 PBMAS Manual (continued)

http://tea.texas.gov/About_TEA/Laws_and_Rules/Commissioner_Rules_(TAC)/Commissioner_of_Education_Rules_-_Texas_Administrative_Code/




https://public.govdelivery.com/accounts/TXTEA/subscriber/new

https://public.govdelivery.com/accounts/TXTEA/subscriber/new

6

Once the rule becomes effective, the Manual will be posted on the TEA web site, followed by a listserv notification of the posting.

At that time, hard-copy versions will also be available from TEA’s Publications Office (see order form at the back of the posted Manual).


2015 PBMAS Manual (continued)

Reminder on Acronyms◦ PL Performance Level◦ RI Required Improvement◦ SA Special Analysis◦ PJSA Professional Judgment Special Analysis*◦ YAE Year-After-Exit◦ MSR Minimum Size Requirements

*Note: PJSA will no longer be available beginning with the 2015 PBMAS.

Copyright © Texas Education Agency 2015. All rights reserved.

7

2015 PBMAS Indicator Preview

8

2015 PBMAS Indicator Preview: SPEDProgram Area and Indicator Number

Indicator Name 2014 PBMAS 2015 PBMAS

SPED #1(i-v) SPED STAAR 3-8 Passing Rate(M, R, S, SS, W)

PLs were assigned based on Phase-In 1 Level II performance.Added RI.No SA or PJSA.Two years of data available for analysis (except social studies).Social studies PL assignment was reinstated.

Add STAAR A and STAAR Alternate 2 results.Assign math PL based on the performance standards from the previous STAAR math assessments.One year of data.No RI or SA.


9

STAAR 3-8 Subject-Area PL 0 Cut Points

STAAR 3-8 Passing Rate Indicators (BE/ESL, NCLB, and SPED)

Mathematics 2014 = 70%-100%2015 = 70%-100%

Reading 2014 = 70%-100%2015 = 70%-100%

Science 2014 = 65%-100%2015 = 65%-100%

Social Studies 2014 = 65%-100%2015 = 65%-100%

Writing 2014 = 70%-100%2015 = 70%-100%


10

2015 PBMAS Preview:Other System Components (continued)

Program Area Description 2014 PBMAS 2015 PBMAS

Other System Components

PL 1, PL 2, and PL 3 cut points for STAAR 3-8 Performance Indicators

No changes. For SPED Indicator #1(i-v):

Lower the PL 1, PL 2, and PL 3 cut point ranges for all subject areas.

Add a PL 4. Implement a

targeted hold harmless provision.

See next slide for details.


2015 PBMAS Preview:

11Adapted from Texas Education Agency 2015.

SPED Indicator PL 0 PL 1 PL 2 PL 3 PL 4

1(i):Mathematics 70.0% - 100% 55.0% - 69.9% 40.0% - 54.9% 25.0% - 39.9% 0% - 24.9%

1(ii):Reading 70.0% - 100% 55.0% - 69.9% 40.0% - 54.9% 25.0% - 39.9% 0% - 24.9%

1(iii):Science 65.0% - 100% 50.0% - 64.9% 40.0% - 49.9% 25.0% - 39.9% 0% - 24.9%

1(iv):Social Studies 65.0% - 100% 50.0% - 64.9% 40.0% - 49.9% 25.0% - 39.9% 0% - 24.9%

1(v): Writing 70.0% - 100% 55.0% - 69.9% 40.0% - 54.9% 25.0% - 39.9% 0% - 24.9%

Stipulates that any district that received a PL 0 or 0 RI on the SPED STAAR Modified Participation Rate indicator in the 2014 PBMAS that would otherwise receive a PL 3 or PL 4 on SPED Indicator #1(i-v) in the 2015 PBMAS will receive a PL 3 HH or PL 4 HH, as applicable for that subject area(s).

For 2015 PBMAS interventions purposes, the count of PL 3 HH or PL 4 HH under SPED Indicator #1(i-v) will not be considered in a district’s total PL 3 or PL 4 count in the special education program area.

12

2015 PBMAS Indicator Preview: Targeted Hold Harmless for SPED #1 (i-v):


13

2015 PBMAS Indicator Preview: SPED (continued)Program Area and Indicator Number


SPED #2(i-v) SPED YAE STAAR 3-8 Passing Rate(M, R, S, SS, W)

PLs were assigned based on Phase-In 1 Level II performance.No RI, SA, or PJSA.Two years of data available for analysis (except social studies).Social studies PL assignment was reinstated.

Two years of data available for social studies; three years of data available for reading, science, and writing; and one year of data available for math.Assign math PL based on the performance standards from the previous STAAR math assessments.No RI or SA.



BE/ESL, NCLB, and SPED YAE Indicators

PL 0 PL 1 PL 2 PL 3

Mathematics 70.0% - 100% 60.0% - 69.9% 50.0% - 59.9% 0% - 49.9%

Reading 70.0% - 100% 60.0% - 69.9% 50.0% - 59.9% 0% - 49.9%

Science 65.0% - 100% 55.0% - 64.9% 45.0% - 54.9% 0% - 44.9%

Social Studies 65.0% - 100% 55.0% - 64.9% 45.0% - 54.9% 0% - 44.9%

Writing 70.0% - 100% 60.0% - 69.9% 50.0% - 59.9% 0% - 49.9%

14Copyright © Texas Education Agency 2015. All rights reserved.

15



SPED #3(i-iv) SPED STAAR EOC Passing Rate(M, S, SS, ELA)

PLs were assigned based on Phase-In 1 Level II performance for math (A1) and science (BI).A new combined reading/writing indicator (E1 and E2) and a new social studies indicator (US) were added as RO.One year of data.No RI, SA, or PJSA.

Add STAAR A and STAAR Alternate 2 results.Change PL cut-point ranges for math and science.Add PL assignment for U.S. History and align PL cut-point ranges with math and science.Continue ELA indicator as RO.One year of data.No RI or SA.



All EOC Indicators, Except SPED #3 and CTE #4

PL 0 PL 1 PL 2 PL 3

Mathematics 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 0% - 39.9%Science 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 0% - 39.9%Social Studies 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 0% - 39.9%ELA Report Only Report Only Report Only Report Only

16Copyright © Texas Education Agency 2015. All rights reserved.

SPED #3 & CTE #4 PL 0 PL 1 PL 2 PL 3 PL 4Mathematics 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 30.0% - 39.9% 0% - 29.9%Science 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 30.0% - 39.9% 0% - 29.9%Social Studies 60.0% - 100% 50.0% - 59.9% 40.0% - 49.9% 30.0% - 39.9% 0% - 29.9%ELA Report Only Report Only Report Only Report Only Report Only

17

STAAR EOC Subject-Area PL 0 Cut Points

STAAR EOC Passing Rate Indicators (BE/ESL, CTE, NCLB, and SPED)

Mathematics 2014 = 50%-100%2015 = 60%-100%

Science 2014 = 50%-100%2015 = 60%-100%

Social Studies 2014 = Report Only2015 = 60%-100%

English Language Arts 2014 = Report Only2015 = Report Only


18


Program Area Description 2014 PBMAS 2015 PBMAS

Other System Components

PL 1, PL 2, and PL 3 cut points for STAAR EOC Performance Indicators

PL 4 was discontinued.

For SPED Indicator #3(i-iv) and CTE Indicator #4(i-iv):

Implement PL 1 and PL 2 cut points that are aligned with other EOC indicators.

Add a PL 4. Implement a

targeted hold harmless provision.

For all other EOC indicators, implement PL cut points as shown on next slide.


What is the targeted hold harmless provision for SPED Indicator #3(i-iv) and CTE Indicator #4(i-iv)?◦ It stipulates that any district that received a PL 0 or 0 RI

on the SPED STAAR Modified Participation Rate indicator in the 2014 PBMAS that would otherwise receive a PL 3 or PL 4 on SPED Indicator #3(i-iv) or CTE Indicator #4(i-iv) in the 2015 PBMAS will receive a PL 3 HH or PL 4 HH, as applicable for that subject area(s).

◦ For 2015 PBMAS interventions purposes, the count of PL 3 HH or PL 4 HH under SPED Indicator #3(i-iv) or CTE Indicator #4(i-iv) will not be considered in a district’s total PL 3 or PL 4 count in the special education or career and technical education program area.

19

2015 PBMAS Indicator Preview: Targeted Hold Harmless for SPED #3 (i-iv):


20

2015 PBMAS Preview: EOC Test Administrations Included)

2014 PBMAS 2015 PBMAS

Results from the summer 2013, fall 2013, and spring 2014 administrations were included, except the new ELA indicator only included results from the spring 2014 administration.

Results from the summer 2014, fall 2014, and spring 2015 administrations will be included, including for the ELA indicator.


21

2015 PBMAS Indicator Preview: SPED (continued)

Program Area and Indicator Number


SPED #4 SPED STAAR Participation Rate

PLs were assigned based on two years of data.Added RI.No SA or PJSA.Methodology revisions were incorporated to reflect the changes HB 5 made to the EOC assessments.

Discontinue this indicator.


22




SPED #5 SPED STAAR Modified Participation Rate

PLs were assigned based on two years of data.Added RI.No SA or PJSA.Methodology revisions were incorporated to reflect the changes HB 5 made to the EOC assessments.



23



SPED #6 SPED STAAR Alternate Participation Rate

PLs were assigned based on two years of data.Added RI.No SA or PJSA.AR (Agency Review) PL assignment was replaced with new PL 1 – PL 3 cut points.

Rename the indicator STAAR Alternate 2 Participation Rate.Three years of data available for analysis.Students qualifying for a Medical Exception or a No Authentic Academic Response designation are not included in the calculation.No SA or PJSA.


24




SPED #7 SPED Regular Early Childhood Program Rate (Ages 3-5)

Implemented as a new Report Only indicator.

Assign performance levels:PL 0 = 30.0% to 100%PL 1 = 20.0% to 29.9%PL 2 = 10.1% to 19.9%PL 3 = 0% to 10.0%(2014 State Rate = 25.4%)

No RI or SA.One year of data.


25




SPED #8 SPED Placements in Instructional Settings 40/41 Rate (Ages 3-5)

PLs were assigned with RI and SA.



26




SPED #9 SPED Regular Class ≥80% Rate (Ages 6-11)

PLs were assigned.No RI, SA, or PJSA.One year of data.

Two years of data available for analysis.Add RI.No SA.


27




SPED #10 SPED Regular Class <40% Rate (Ages 6-11)




28




SPED #11 SPED Regular Class ≥80% Rate (Ages 12-21)




29




SPED #12 SPED Regular Class <40% Rate (Ages 12-21)

PLs were assigned.No RI, SA, or PJSA.One year of data



30




SPED #13 SPED Annual Dropout Rate (Grades 7-12)

PLs were assigned with RI and SA.New PL 0 – PL 3 cut points were implemented.

No changes.


31




SPED #14 SPED RHSP/DAP Diploma Rate


Add new RHSP/DAP Grad Types (31 and 32) to numerator.

SPED #15 SPED Graduation Rate

PLs were assigned with RI but no SA or PJSA.

Implement new PL 1 – PL 3 cut points:PL 0 = 75.0% to 100%PL 1 = 70.0% to 74.9%PL 2 = 50.0% to 69.9%PL 3 = 0% to 49.9% (2014 State Rate = 77.8%)


32




SPED #16 SPED Representation

PLs were assigned with RI but no SA or PJSA.

No changes.

SPED #17 SPED African American (Not Hispanic/Latino) Representation


No changes.


33




SPED #18 SPED Hispanic Representation


No changes.

SPED #19 SPED LEP Representation


No changes.


34




SPED #20 SPED Discretionary DAEP Placements

PLs were assigned with RI, SA, and PJSA.Reason Codes 22, 51, and 52 were deleted.Reason Code 02, if reported with Behavior Location Code 04 or 05, was added.

Begin transition to a new PL structure by reporting disproportionality rates (as Report Only) in addition to percentage point differences.


35

2015 PBMAS Indicator Preview: SPED (continued)Program Area and

Indicator NumberIndicator Name 2014 PBMAS 2015 PBMAS

SPED #21 SPED Discretionary ISS Placements

PLs were assigned with RI, SA, and PJSA.


SPED #22 SPED Discretionary OSS Placements

PLs were assigned with RI, SA, and PJSA.



Why are we transitioning to a new PL structure for the discipline indicators?◦ The original expectation was that focusing on

percentage point differences (DIFF) would encourage districts, regardless of PL assignment, to address issues of disproportionality, but this has not typically been the case.

◦ Focusing on percentage point differences may have given some districts the impression they do not have disproportionate discipline placements, when they actually do.

36



Unlike other PBMAS indicators, the rate of progress for the three discipline indicators has been slower than expected considering the indicators have been in place for more than a decade.

Percentage point differences can mask very high rates of disproportionality.

Focusing on districts’ rate of disproportionality is a more meaningful and reliable way to evaluate disproportionality.

Unlike percentage point differences, disproportionality rates will enable us to implement more consistent PL cut points across all three discipline indicators.

37



Disproportionality rates are much easier to understand and will provide more transparent information.

Disproportionality rates are not a significantly different methodology from what’s currently used; they basically take the current calculations one step further and tell us how much higher the special education rate is compared to the all students rate, e.g., 50% higher, 10% higher, 200% higher.

38



This will, however, be a significant change for some districts who may not have undertaken a detailed enough data analysis to understand what their percentage point differences were actually telling them about the extent of disproportionality in their discipline placements.

The new PL structure is scheduled to be implemented with the 2017 PBMAS.

39


Adapted from Texas Education Agency 2015. All rights reserved.

40



SPED Discretionary OSS Placements

(DIFF) 6.2 SPED OSS SPED Students

SPED OSS Placements

12.2 170 1,388

OSS All Students

All OSS Placements

6.0 672 11,224

How to Calculate the Disproportionality Rate:

= 103%

41



SPED Discretionary OSS Placements

(DIFF) 8.0 SPED OSS SPED Students

SPED OSS Placements

20.8 735 3,531

OSS All Students

All OSS Placements

12.8 5,129 40,165

How to Calculate the Disproportionality Rate:

= 63%

Questions?

Adapted from Texas Education Agency 2015

42

Adapted from Texas Education Agency 2015.. PBM ProductDate of 2014 release Projected date of 2015...

Documents

Transcript of Adapted from Texas Education Agency 2015.. PBM ProductDate of 2014 release Projected date of 2015...