Final Quarterly Update Blue Ribbon Commissionʼs Recommendations of the 2009 Criterion Referenced Competency Test (CRCT) Erasure Investigation

Dr. Beverly L. HallSuperintendentAtlanta Public Schools

May 9, 2011

1

Monday, May 9, 2011

#

2

Introductory Slide that demonstrates our understanding of the work that continues and our commitment students

Students, Parents, Community

2

Monday, May 9, 2011

#

Our Commitment

3

Eliminate opportunities for testing irregularities

Ensure 2010 and future test results are beyond reproach

Foster a heightened sense of awareness around testing security, accountability and a culture of ethical behavior

3

Monday, May 9, 2011

#

Ensure the best security possible

Enhance existing processes and protocols for all test administrations

Drive a culture of personal accountability, ethical behavior and positive peer support

Leverage lessons learned from each test administration for continuous improvement

Goals

44

Monday, May 9, 2011

Security Recommendations

ProcessRecommendations

LeadershipRecommendations

ComparisonRecommendations

Background• August 2, 2010 – BRC presented the BRC CRCT Erasure

Investigation Report

• Blue Ribbon Commissionʼs report included 29 recommendations that were grouped into four broad categories:

5

Monday, May 9, 2011

#

Background

• Recommendation owners

- Each recommendation assigned to a division and individual owner- Each owner is a member of the senior leadership team- Each recommendation owner developed action plans outlining how each

recommendation would be achieved

• Project management methodology implemented

6

GETTING PLAN DO CHECK ACT REPEAT

Monday, May 9, 2011

7

• Maintain a well defined test security program, including

- Updated protocols

- Reinforcement and communication of testing policies

- Ethics compliance procedures

Security Recommendations BRC Security Improvements Summary

7

Monday, May 9, 2011

8

• Enhanced test security plan

• Conducted pre-administration testing workshops and training sessions

• Conducted face-to-face policy training to encourage professional conduct, ethics and accountability

• Strengthened protocols and best practices

• Upgraded safe rooms with cameras and limited documented secure badge access

• Enhanced chain of custody procedures for test materials

• Conduct regular audits for each test administration

Security Recommendations BRC Security Improvements

8

Monday, May 9, 2011

9

• Follow up on the results of the investigation, including providing immediate assistance to potentially impacted students

• Enhance existing protocols for future CRCT administrations and audit routines

Process Recommendations BRC Process Recommendations Summary

9

Monday, May 9, 2011

10

• 12 Week Accelerated Academic Recovery Program to provide additional support to students implemented

• Ongoing support to students provided

• Audit routines and process to investigate testing irregularities enhanced

Process Recommendations BRC Process Highlights

10

Monday, May 9, 2011

11

Leadership Recommendations BRC Leadership Recommendations Summary

• Leadership improvements by driving culture change throughout the organization by placing personal accountability, ethical behavior and positive peer support as the expected guiding principle of the districtʼs work

11

Monday, May 9, 2011

12

Leadership Recommendations BRC Leadership Highlights

• APS employees provided information regarding external hotline to report misconduct

• Hotline brochures and posters placed in all schools• Principals reassigned from the Category 1 schools• Training provided on tools used as part of the 12 Week Accelerated

Academic Recovery Program• Online ethics portal created to place additional emphasis on leadership,

integrity and ethics• Self-assessment tool developed to prepare staff for annual performance

evaluation process• School climate survey and process developed to provide anonymous

feedback on peers or leadership• Principal reviews conducted to inform annual school leader evaluations• District-wide balanced scorecard modified to include ethics objectives

12

Monday, May 9, 2011

13

Comparison Recommendations BRC Comparison Recommendations Summary

• Additional recommendations focused on the findings related to the comparison of the 2009 and 2010 CRCT results

13

Monday, May 9, 2011

14

Comparison Recommendations BRC Comparison Highlights

• Assessment completed on schools that showed a decline in math from 2009 to 2010

• Mathematics curriculum aligned to the Georgia Department of Education scope and sequence

• Data analysis process documented

• Intervention strategies, professional development and school improvement plans updated

14

Monday, May 9, 2011

Recommendations

15

Monday, May 9, 2011

16

CAVEON Recommendations CAVEON Recommendations Summary

• Maintain a single comprehensive security plan, implement a formal security management structure, enhance test administration processes and procedures, as well as implement a formal security incident response plan

16

Monday, May 9, 2011

17

CAVEON Recommendations CAVEON Highlights

• Enhanced and published test security plan to the district web site

• Incorporated school test coordinators role into the APS test security plan

• Utilized a three-tier test monitoring process

• Strengthened chain of custody protocols for test materials

• Enhanced testing, ethics and assessment overview training

• Utilized a cross-divisional process to investigate testing irregularities for all test administrations

17

Monday, May 9, 2011

On Hold Recommendations

Work Beyond June 30

Dependent on approval from the Governorʼs Office/Special Investigators:

• Process Recommendation 3• Leadership Recommendation 11

Dependent on Governorʼs Office of Student Achievement

• Security Recommendation 2

• Leadership Recommendation 2

Summary

18

Monday, May 9, 2011

Final Quarterly Update Blue Ribbon Commissionʼs Recommendations of the 2009 Criterion Referenced Competency Test (CRCT) Erasure Investigation

Dr. Beverly L. HallSuperintendentAtlanta Public Schools

May 9, 2011

1

Monday, May 9, 2011