What are States Doing to Prepare for the Next Generation of Assessments?
description
Transcript of What are States Doing to Prepare for the Next Generation of Assessments?
What are States Doing to Prepare for the Next Generation of
Assessments?
Planning for 2014-2015 and Beyond
West Virginia Department of EducationOffice of Assessment, Accountability, and Research
Background
• Standards (2009)• Revised Assessment (2009)• Cut Scores (2010)• CCSS Adoption (WV Next Generation
Standards, Summer 2010)• CCSS Implementation (2013) • Restrictions to policy led to interim CC support
(2013)
A State of Transition
• Current Assessment System– Formative, interim, and summative in grades 3-11– Math, ELA, science and social studies
• Future Assessment System– Smarter Balanced in math and ELA– Legacy assessment (and future augmentation) in
science and social studies – Interim assessments and formative (Smarter and
custom)– Diagnostics in all (custom)
Current Year Concerns
• Historically mixed-mode testing• 2013-2014 was the first year with 100%
online testing• Concerns exist with legacy assessment
comparability• Further concerns with comparability
Impact on System
• Instructional Responsiveness & Actionable Data– Summative Assessments: least instructionally responsive
but greater depth of coverage (Math & ELA)– Complete Interim Assessments: monitoring status of
students– Interim Assessment Blocks: more granular understanding
of student learning– Diagnostic Assessments: loss of the most instructionally
responsive and granular assessment events (Acuity)– Major questions on ability to support costs for the latter
Cost Implications
• West Virginia Current Operating Budget– ~182,000 students assessed – Approximately $54/student to support 4 content-
based balanced assessment system– Using estimate of $27/student for Smarter Balanced
(for summative, interim, and digital library)– Remaining budget for science and social studies
administration and development for summative, interim, and diagnostic
Accountability Implications
• WV awarded flexibility from ESEA in 2012• Currently in 2nd year of flexibility request• Executive order from governor to switch to A-F
system concurrent with Smarter Balanced implementation
• Both systems require use of growth (SGPs), inclusive of growth to standard
• Goal of including science for accountability by 2017-2018 (including growth)
Accountability Implications
• Current year’s online transition requires a comparability study (science and social studies)
• Observed growth is slated to be included 2014-2015 calculations, but not growth to standard
• Science and social studies baseline may be the 2013-2014 data
• Potential linking studies using a third set of items and scales may mitigate challenging cross-year comparisons
Impact on Practice
• Key to successful implementation is about systemic capacity building– Fortunate to have historical awareness of a balanced
assessment system– Too much focus on assessment events – Shift in focus toward an assessment process– Previous system (post-hoc alignment) – buy-in challenges– Smarter approach (aligned by design) – bringing along
both assessment and instructional community
Impact on Practice
• Key to successful implementation is about systemic capacity building– Substantial revision to our PD delivery in 2013-2014
• Formerly supported by SEA because of small state size• Too much professional assistance, insufficient professional
development– Regional Education Service Agencies
• Increased funding• Increased professional development personnel• Ongoing increase in the collaboration with SEA leadership and
content and technical staff
Impact on Practice
• Small state benefit—monitoring equity of distributed PD quality– Statewide R&E study has focused on implementation of our latest
Educator Enhancement Academics (EEA) – focused on standards and instructional practices to understand key areas of high quality PD• Content and pedagogy focus• Coherence• Active learning• Collective participation • Duration
– Subsequent study will focus on assessment process Dissemination of results
Contact Information
Juan M. D’BrotExecutive DirectorOffices of Assessment, Accountability, and ResearchBuilding 6, Room 8251900 Kanawha Blvd EastCharleston, WV [email protected] 304-554-2546