Office Of Standards, Assessment, & Office Of Standards, Assessment, & Reporting UpdateReporting Update

David AbramsAssistant Commissioner For

Standards,Assessment and Reporting

S/CDN September 23, 2004

Utilization of Data

CIO Approach: Design of Internal Data Team to Collect & Certify District/Building Data-LEAP/STEP (Database Personnel and Administrators)Review Data for Accountability Purposes: Musser Accountability PowerPointData Analysis to Inform Curriculum, Instruction, & Assessment: RICS, BOCES & RSSCs for data analysts to assist & train district staff

Actions To Ensure High Quality Regents Exams

Formation of State Assessment Cabinet: Senior Managers from EMSC, VESID, OMS, ITS, Communications, & Office of CounselImplemented Senior Management ReviewImplemented Final Eyes Review

Actions To Ensure High Quality Regents Exams

Increased Staffing in OSA: 5 Content Specialists, 6 Editors, & 4 Support. Revised Structure & Role for Technical Advisory Group (TAG)Implemented Exam Quality IndictorsDesigning Standard-Setting Revistation MethodologyImplemented Annual Score Collection Process for Statistical Research (June 04: Math B & Chemistry)

Actions To Ensure High Quality Regents Exams

Updated Psychometric Validation Procedures: All psychometric work is checked and replicated by multiple groupsImplemented Revised Field Testing Procedures: 6 Year MatrixIssued RFPs to Increase Capacity: 3-8 Testing, NYSESLAT, Scaling & Equating, & Scoring & Reporting

Actions To Ensure High Quality Regents Exams

Designed & Implemented Electronic State Testing Tracking SystemImplemented Consultant Inventory DatabaseDesigning Electronic Test Ordering SystemImplemented Regents Testing Cycle Review MeetingsRevising Technical Report Manuals

Actions To Ensure High Quality Regents Exams

Implemented Math A Panel RecommendationsCommissioner Convened Math Standards CommitteeImplemented Physics Work Group SuggestionsTechnical Analysis & Comparison of Examination Development Process

Actions To Improve Public Communication

Implemented Automated Phone System & Dedicated E-Mail BoxImplemented Regents Examination WebsiteDistrict Superintendents’ Curriculum & Assessment Committee Testing WorkshopsAssistant Commissioner Outreach to Educational Organizations

GRADE-BY-GRADE ASSESSMENTS GRADE-BY-GRADE ASSESSMENTS REQUIRED UNDER NCLBREQUIRED UNDER NCLB

Contract awarded to CTB/McGraw-Hill for development of English Language Arts and Mathematics tests in Grades 3-8

First administrations in 2006

GRADE-BY-GRADE ASSESSMENT GRADE-BY-GRADE ASSESSMENT CONTRACT WILL ENCOMPASS THREE CONTRACT WILL ENCOMPASS THREE

CONNECTED ACTIVITIESCONNECTED ACTIVITIES

Test development

Test administration

Research and psychometric support

TEST DEVELOPMENT PROCESSESTEST DEVELOPMENT PROCESSES

Test specifications and frameworks

with input from NYS teachers

Test construction writing, editing and revising test items

Field testing

Content Review

TEST DEVELOPMENT PROCESSESTEST DEVELOPMENT PROCESSES(continued)

Every effort will be made to limit length of tests, while ensuring that they are valid and reliable.

Test designs will reflect knowledge of childhood development.

TEST ADMINISTRATION PROCESSESTEST ADMINISTRATION PROCESSES

Forms preparation – including manuals, scoring guides, translations and informational materialsScoring trainings – DVDs and turnkey trainingRescoring of 10% sample of operational tests

TEST ADMINISTRATIONTEST ADMINISTRATION: POINTS OF INTEREST

All ELA tests will be given the same week; all math tests will be given the same week.

We are still exploring several scoring models – to maximize effectiveness / timeliness, while minimizing loss of instructional time.

TEST ADMINISTRATION: TEST ADMINISTRATION: POINTS OF INTERESTPOINTS OF INTEREST

(continued)

SED will consult with school/district representatives when developing the testing schedule and scoring models.

Informational materials for parents and the public will be produced, in addition to those for teachers and administrators

CURRICULAR IMPLICATIONSCURRICULAR IMPLICATIONS

English Language Arts tests will be based on existing Core Curriculum.

A new Core Curriculum for Mathematics will be developed by Winter 2004-05 based on the recommendations of the Math Standards Committee.

MATH STANDARDS COMMITTEEMATH STANDARDS COMMITTEE

Summary of Proposed ChangesSummary of Proposed Changes

Standard 3 (Mathematics) currently contains seven Key Ideas

Proposed Standard 3 would contain

- five Content Strands, and - five Process Strands

MATH STANDARDS COMMITTEEMATH STANDARDS COMMITTEESummary of Proposed ChangesSummary of Proposed Changes

(continued)

Content Strands

- Number Sense and Operations - Algebra - Geometry - Measurement - Statistics and Probability

MATH STANDARDS COMMITTEEMATH STANDARDS COMMITTEESummary of Proposed ChangesSummary of Proposed Changes

(continued)

Process Strands

- Problem Solving - Reasoning and Proof - Communication - Connections - Representation

MATH STANDARDS COMMITTEEMATH STANDARDS COMMITTEESummary of Proposed ChangesSummary of Proposed Changes

(continued)

“Less is more” – content at each grade level will include fewer topics, allowing for more depthConsistent with recent TIMSS recommendationsWhile each grade level will focus on a limited number of topics, previous grades’ process and content will be infused

KEY DATESKEY DATES

Regional Forums: Fall 2004 through Spring 2005

Field tests: Spring 2005

Sample tests available: Fall 2005

First operational tests in ELA: January/February 2006

First operational tests in Math: March 2006

Ongoing updates will be provided at:

www.emsc.nysed.gov/osa/

and at

A Math Standards website to be created by early October 2004

Questions can be sent to:

emscassessinfo@mail.nysed.gov