California Spanish Assessment Test Administration Manual · CALIFORNIA Assessment of Student...

C A L I F O R N I A Assessment of Student Performance and Progress

California Spanish Assessment Online Test Administration Manual

Posted August 2017.Prepared by Educational Testing Service ®

2017–18 Pilot Administration

CAASPP System

– ii –

Table of Contents Chapter 1. California Spanish Assessment Pilot Test Overview .................................................. 1 Introduction to the California Spanish Assessment ............................................................................................... 2

About This Manual.............................................................................................................................................. 2 Student Eligibility and Participation in the California Spanish Assessment (CSA) Pilot Test ................................ 3

Student Eligibility ................................................................................................................................................ 3 Student Participation .......................................................................................................................................... 3 Student Pilot Test Assignment ........................................................................................................................... 3

Pilot Test Administration Features ......................................................................................................................... 5 Test Design ........................................................................................................................................................ 5 Technical Requirements ..................................................................................................................................... 5 Directions for Administration (DFA) .................................................................................................................... 6 Test Scheduling .................................................................................................................................................. 6

Roles and Responsibilities ..................................................................................................................................... 7 LEA CAASPP Coordinator ................................................................................................................................. 7 CAASPP Test Site Coordinator .......................................................................................................................... 8 Test Administrator ............................................................................................................................................ 10

Chapter 2. Test Administration Preparation and Planning ......................................................... 13 Preparing for the California Spanish Assessment (CSA) Pilot Test Administration ............................................ 14

Using the Test Operations Management System (TOMS) to Prepare for the CSA Pilot Test ......................... 14 Technology Requirements ............................................................................................................................... 16

Accessibility Resources ....................................................................................................................................... 18 Overview ........................................................................................................................................................... 18 Availability of Universal Tools ........................................................................................................................... 18 Availability of Accommodations ........................................................................................................................ 19 Availability of Designated Supports .................................................................................................................. 19

Training Resources .............................................................................................................................................. 21 Using the CSA Pilot Test Administration Training Video.................................................................................. 21 Using the Testing Interface Tutorial Video ....................................................................................................... 21

Chapter 3. Test Security ................................................................................................................ 23 Test Security for the California Spanish Assessment (CSA) Pilot Test ............................................................... 24

Test Security Incidents ..................................................................................................................................... 24 Security and Test Administration Incident Reporting System (STAIRS) .......................................................... 24 Appeals ............................................................................................................................................................. 27 Retake Opportunity........................................................................................................................................... 29

Chapter 4. Administering the California Spanish Assessment to Students .............................. 31 Use the Directions for Administration ................................................................................................................... 32 Administer an Online Test Session ...................................................................................................................... 34

General Rules ................................................................................................................................................... 35 Beginning the Test............................................................................................................................................ 36 Monitoring Student Progress ............................................................................................................................ 43 Ending a Test Session ..................................................................................................................................... 45

Chapter 5. Appendixes .................................................................................................................. 49 Appendix A: California Spanish Assessment (CSA) Item Types ......................................................................... 50 Support for the California Spanish Assessment Pilot Test .................................................................................. 52

CAASPP System

– iii –

List of Tables Table 1. List of Key Dates ...................................................................................................................................... 6 Table 2. Available Accessibility Supports in the CSA Pilot Test .......................................................................... 16 Table 3. Universal Tools Available for the CSA Pilot Test ................................................................................... 19 Table 4. Designated Supports Available for the CSA Pilot Test .......................................................................... 20 Table 5. STAIRS Incident Types .......................................................................................................................... 25 Table 6. Description of Appeals ........................................................................................................................... 28

List of Figures Figure 1. Assigning students to the CSA in TOMS .............................................................................................. 15 Figure 2. Handling improprieties .......................................................................................................................... 26 Figure 3. Handling irregularities ........................................................................................................................... 26 Figure 4. Handling breaches ................................................................................................................................ 27 Figure 5. Select Special Character window ......................................................................................................... 35 Figure 6. Monitoring student progress in the Test Administrator Interface .......................................................... 44 Figure 7. Single Sign-On system banner ............................................................................................................. 46

Acronyms and Initialisms in the California Spanish Assessment Online Test Administration Manual: 2017–18 Pilot Administration

Term Meaning CAASPP California Assessment of Student Performance and Progress CALPADS California Longitudinal Pupil Achievement Data System CalTAC California Technical Assistance Center CCR California Code of Regulations CCSS Common Core State Standards CDE California Department of Education CSA California Spanish Assessments DFA directions for administration LEA local educational agency STAIRS Security and Test Administration Incident Reporting System SSID Statewide Student Identifier TOMS Test Operations Management System

Chapter 1. California Spanish Assessment Pilot Test Overview

California Spanish Assessment Pilot Test Overview | Introduction to the California Spanish Assessment

2 2017–18 CAASPP CSA Pilot Online Test Administration Manual August 2017 Customization Copyright © 2017 by the California Department of Education

Introduction to the California Spanish Assessment The California Spanish Assessment (CSA) is an online, linear (nonadaptive), summative, grade-level assessment for students in grades three through eight and high school who are Spanish-speaking English learners or students seeking a measure that recognizes their Spanish reading, writing, and listening skills. The CSA is a part of the California Assessment of Student Performance and Progress (CAASPP) system and will replace the Standards-based Tests in Spanish. The CSA is aligned to the Common Core State Standards (CCSS) en Español, which were developed as a joint effort between the San Diego County Office of Education, the Council of Chief State School Officers, and the California Department of Education. The CCSS en Español are a translated and linguistically augmented version of the English-language CCSS for English Language Arts & Literacy.

About This Manual This California Spanish Assessment Online Test Administration Manual: 2017–18 Pilot Administration provides information and instructions about test preparation and the administration of the CSA Pilot Test. The intended users of this manual are staff who play a role in the administration of the CSA Pilot Test, including local educational agency (LEA) CAASPP coordinators, CAASPP test site coordinators, and test administrators. This manual is specific to the CSA Pilot Test and should not be used for any other assessment. For specific questions not addressed in this manual, test administrators can contact their CAASPP test site coordinator; CAASPP test site coordinators can contact their LEA CAASPP coordinator; and LEA CAASPP coordinators can contact the California Technical Assistance Center (CalTAC). The LEAs that have been selected to participate in the CSA Pilot Test have received direct communication and confirmation regarding participation by the CSA program management team at Educational Testing Service. If you plan to administer the CSA Pilot Test and you are not one of the selected CSA Pilot Test LEAs, your LEA CAASPP coordinator should contact CalTAC by phone at 800-955-2954, by e-mail at [email protected], or by using the chat function linked on the CAASPP Portal.

mailto:[email protected]

http://www.caaspp.org/

California Spanish Assessment Pilot Test Overview | Student Eligibility and Participation in the California Spanish Assessment (CSA) Pilot Test

August 2017 2017–18 CAASPP CSA Pilot Online Test Administration Manual 3 Customization Copyright © 2017 by the California Department of Education

Student Eligibility and Participation in the California Spanish Assessment (CSA) Pilot Test

Additional Resources: • California Assessment of Student Performance and Progress (CAASPP)

California Spanish Assessment (CSA) Web page—http://www.caaspp.org/administration/about/csa/

• Test Operations Management System (TOMS) Pre-Administration Guide for CAASPP Testing Web document—http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS-pre-admin-guide.2017-18.pdf

Student Eligibility Students in grades three through eight and high school who are Spanish-speaking English learners or students seeking a measure that recognizes their Spanish reading, writing, and listening skills are eligible to take the CSA.

Student Participation Student participation in the CSA is voluntary. In addition to taking the optional CSA Pilot Test in fall 2017, students enrolled in or assigned to grades three through eight and high school must also take the required English language arts/literacy and mathematics assessments during the 2017–18 CAASPP administration. Additionally, students in grade five, eight, and high school must take the California Science Test field test. The guidelines that a test administrator or a local educational agency (LEA) should use to determine if a student should consider taking the CSA Pilot Test are:

• The student is receiving instruction in Spanish in the state of California; and/or • The student is seeking a measure that recognizes his or her Spanish reading, writing,

and listening language arts skills.

Student Pilot Test Assignment

Note: Although the CSA Pilot Test will be administered in the fall of 2017, the CSA is meant to be a summative test. Therefore, students will take the grade-band test that reflects the grade level in which they were enrolled for the 2016–17 school year (e.g., students currently enrolled in grade six will take the grade three through five grade-band test; students currently enrolled in grade nine students will take the grade six through eight grade-band test; etc.).

Student demographic information, including grade level, are automatically loaded into TOMS on a daily basis. This information is extracted from the student records in the California Longitudinal Pupil Achievement Data System.

http://www.caaspp.org/administration/about/csa/

http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS-pre-admin-guide.2017-18.pdf

California Spanish Assessment Pilot Test Overview | Student Eligibility and Participation in the California Spanish Assessment (CSA) Pilot Test


Students must be assigned to take the CSA Pilot Test in TOMS by the LEA CAASPP coordinator or CAASPP test site coordinator using the procedures described in the TOMS Pre-Administration Guide for CAASPP Testing. More information about assigning students to take the CSA can be found in the subsection Student Test Assignment in TOMS.



California Spanish Assessment Pilot Test Overview | Pilot Test Administration Features


Pilot Test Administration Features

Additional Resources: • Technical Specifications and Configuration Guide for California Assessment of

Student Performance and Progress (CAASPP) Online Testing Web document—http://www.caaspp.org/rsc/pdfs/CAASPP.tech-specs-and-config-guide.2017-18.pdf

• Secure Browsers Web site—http://ca.browsers.airast.org/

The California Spanish Assessment (CSA) Pilot Test is designed for administration between multiple students and a test administrator. A test administrator must be an employee of a local educational agency (LEA) or an employee of a nonpublic, nonsectarian school who has been trained to administer the CSA Pilot Test. Individual student scores, school-level scores, and score reports will not be available to the LEAs for the CSA Pilot Test.

Test Design The CSA Pilot Test uses a linear (nonadaptive) design that assesses the three domains of reading, writing, and listening. There are three grade-band forms: grades three through five, grades six through eight, and high school.

Goal The goal of the CSA Pilot Test is to evaluate the functionality of the new technology-enhanced items. Student responses to the item types will be collected and reviewed to examine whether students can understand and respond as expected. Once the item types have been evaluated, feedback from the pilot test will be used to update and inform item writing guidelines and future item development.

Test Items and Standards Test items are designed to be engaging for students and represent a variety of types and approaches. A description of item types can be found in Appendix A: CSA Item Types. All items are aligned to the Common Core State Standards en Español and are consistent with the goals of California’s testing program. Items assess the three domains of the CSA: listening, reading, and writing. Because the CSA is a linear assessment, the test will not adapt to a student based on his or her responses to the items.

Technical Requirements The CSA Pilot Test is administered online and requires two Internet-connected devices: a student testing device and a separate device that the test administrator uses to start a test session through the Test Administrator Interface. Test administrators also may use their device to open the CAASPP CSA Pilot Online Test Administration Manual to access the directions for administration (DFA).

http://www.caaspp.org/rsc/pdfs/CAASPP.tech-specs-and-config-guide.2017-18.pdf


http://ca.browsers.airast.org/

California Spanish Assessment Pilot Test Overview | Pilot Test Administration Features


The CSA requires the installation of CAASPP secure browsers on student testing devices. These are the same secure browsers that are used for the other online CAASPP assessments. Secure browsers are available for download on the Secure Browsers Web site. The general technical requirements and supported devices are identical to those for the other online CAASPP assessments. These are described in the Technical Specifications and Configuration Guide for CAASPP Online Testing.

Note: The CSA Pilot Test contains listening items that require students to use headphones or headsets.

Directions for Administration (DFA) The Administer an Online Test Session subsection of this manual, which contains the directions for administration of the CSA, must be used by the test administrator to administer tests to students. The DFA includes the script for the test administrator to use at the beginning of testing and provides administration guidance on the day of testing. The script is provided in Spanish.

Test Scheduling Window and Test Times The CSA Pilot Test testing window will be open from September 18 through October 6, 2017. LEAs may schedule CSA testing according to local preference within this window and do not need to inform the California Department of Education or Educational Testing Service. All CSA testing must take place within this window. More information about selecting the CSA testing window can be found in the subsection Student Test Assignment in TOMS. The anticipated time it will take for a student to complete the test ranges from 70–90 minutes for grades three through eight and 110–150 minutes for high school. Schools should consider these estimated times when scheduling test sessions. Although the assessments are untimed, the amount of time each student needs can vary. Tests may be administered to a student over as many testing sessions and days within the testing window as needed.

Key Dates The following table lists key dates for the 2017–18 CSA pilot test administration:

Table 1. List of Key Dates Date Activity

September 1, 2017 CSA Pilot Test Administration Video available for on-demand viewing September 1, 2017 CSA Testing Interface Tutorial Video (for test takers) available for

viewing on: (add link once tutorial video is created) September 5, 2017 CSA Pilot Test student assignment available September 5, 2017 CSA Pilot Test window selection available September 18, 2017 CSA Pilot Test testing window opens October 6, 2017 CSA Pilot Test testing window closes (last day testing may occur)




California Spanish Assessment Pilot Test Overview | Roles and Responsibilities


Roles and Responsibilities

Additional Resources: • California Assessment of Student Performance and Progress (CAASPP) Online

Test Administration Manual Web document—http://www.caaspp.org/rsc/pdfs/CAASPP.online_tam.2016-17.pdf

• CAASPP Security and Test Administration Incident Reporting System (STAIRS) Process for Summative Assessments Web page—http://www.caaspp.org/stairs/

A successful administration of the California Spanish Assessment (CSA) Pilot Test requires identifying the appropriate staff to fulfill specific roles and work together. The three main roles involved with the administration of the CSA Pilot Test are the: 1. local educational agency (LEA) CAASPP coordinator, 2. CAASPP test site coordinator, and 3. test administrator.

Note: Test administrators are responsible for administering the CSA Pilot Test.

The subsection that follows outlines the various responsibilities of each role.

LEA CAASPP Coordinator The LEA CAASPP coordinators were designated by the district superintendent at the beginning of the 2017–18 school year and must meet the requirements and fulfill the duties outlined in the CAASPP Online Test Administration Manual.

LEA CAASPP Coordinator Responsibilities For the CSA Pilot Test, LEA CAASPP coordinators are responsible for the following activities:

• Adding CAASPP test site coordinators, and test administrators into the Test Operations Management System (TOMS)

• Coordinating with the CAASPP test site coordinator to assign students in TOMS • Selecting the fixed testing window (September 18 through October 6, 2017 only) and

assigning schools to it • Viewing the CSA Pilot Test Administration Training video and ensuring that CAASPP

test site coordinators in their LEA also have viewed this video • Reporting all test security irregularities and/or breaches (including social media

discussion or posting photos of test materials) that occur before, during, or after test administration to the California Department of Education (CDE) within 24 hours of discovery, using the Security Test Administration Incident Reporting System (STAIRS) available on the CAASPP STAIRS Web page (California Code of Regulations, Title 5 [5 CCR], Section 859[e])

http://www.caaspp.org/rsc/pdfs/CAASPP.online_tam.2016-17.pdf

http://www.caaspp.org/stairs/


http://www.caaspp.org/stairs/index.html



• Assuming general oversight responsibilities for all administration activities in their LEA schools and ensuring that students have a positive test experience

LEA CAASPP Coordinator Checklist LEA CAASPP Coordinator Activities Target Completion Date

Coordinate the scheduling of testing for all eligible students with the CAASPP test site coordinators at each school, taking factors into consideration that include the following: • The number of available testing devices and testing stations • The time required to take a content area • The number of students being tested

As soon as possible

Learn about the CSA Pilot Test: • Watch the training video. • Review this manual.

As soon as possible after materials are available

Ensure that students are assigned for testing in TOMS. As soon as possible after TOMS is available on September 5, 2017

Ensure that the fixed testing window (September 18 through October 6, 2017 only) has been selected and that schools are assigned to it.

As soon as possible after TOMS is available on September 5, 2017

Ensure that test site coordinators have installed supported Web browsers and CAASPP secure browsers on student testing devices.

2 weeks before testing

Communicate with the CAASPP test site coordinators and test administrators to identify the number of headsets needed in order to take the listening portions of the assessment.


Ensure that CAASPP test site coordinators have familiarized themselves and their test administrators with the four components they need for CSA testing:

1. CAASPP secure browser (through which students will access the testing interface)

2. CAASPP Test Administrator Interface 3. Directions for administration in subsection Administer an

Online Test Session 4. CSA Pilot Test Training Video

3–5 days before testing

Assume general oversight responsibilities for all CSA Pilot Test administration activities in LEA schools.

September 18–October 6, 2017

CAASPP Test Site Coordinator The CAASPP test site coordinator is designated by the LEA CAASPP coordinator and must meet the requirements and fulfill the duties outlined in the CAASPP Online Test Administration Manual.

CAASPP Test Site Coordinator Responsibilities For the CSA Pilot Test, the CAASPP test site coordinator is responsible for the following activities:





• Identifying test administrators, ensuring that they view the test administration training video, and ensuring that they have reviewed and signed the CAASPP Test Security Affidavit (5 CCR Section 850[w])

• Adding test administrators into TOMS (optional) and ensuring that they have received and tried using their logon credentials

• Verifying that student demographic information from the California Longitudinal Pupil Achievement Data System is appearing correctly in TOMS

• Creating or approving testing schedules and procedures for the school (consistent with state and LEA policies)

• Working with technology staff to ensure that devices are configured for testing and that any technical issues are resolved

• Addressing testing problems, as needed • Mitigating and reporting all test security incidents in a manner consistent with state and

LEA policies • Assuming general oversight responsibilities for all administration activities in their

schools and for all test administrators

Note: LEA CAASPP coordinators, who also serve the role of the CAASPP test site coordinators, should be familiar with tasks and responsibilities of the CAASPP test site coordinator.

CAASPP Test Site Coordinator Checklist CAASPP Test Site Coordinator Activities Target Completion Date

Inform staff at your test site about CSA Pilot Test. As soon as possible

Coordinate the scheduling of testing for all eligible students with the LEA CAASPP coordinator, taking in consideration factors that include the following: • The number of available testing devices and testing stations • The time required to take the assessment • The number of students being tested

As soon as possible

Learn about the CSA Pilot Test: • Watch the test administration training video. • Review this manual.


Identify test administrators at each school: • Prepare test administrators. • Collect and review CAASPP Test Security Affidavits. • Provide test administrators with TOMS user accounts. • Direct test administrators to this manual and training

resources, including the test administration training video. • Require test administrators to view the test administration

training video.


Identify student testing devices and ensure the installation of the CAASPP secure browser. Identify an equal number of devices that test administrators are to use to start test sessions using the Test Administrator Interface.




CAASPP Test Site Coordinator Activities Target Completion Date

Communicate with the test administrators to identify the number of headsets needed in order to take the listening portions of the assessment.


Ensure that you and your test administrators have familiarized yourselves with the four components you need for the CSA Pilot Test:

1. CAASPP secure browser 2. CAASPP Test Administrator Interface 3. Directions for administration in subsection Administer an

Online Test Session 4. CSA Pilot Test Training Video


Assume general oversight responsibilities for all CSA Pilot Test administration activities at the school.

September 18–October 6, 2017

Test Administrator A test administrator is an employee of an LEA or an employee of a nonpublic, nonsectarian school who has been trained to administer the CSA Pilot Test. Test administrators must review the test administration directions, view the CSA Pilot Test Administration Training video, and read and sign the CAASPP Test Security Affidavit.

Test Administrator Responsibilities Test administrators are responsible for the following activities:

• Reading and submitting signed CAASPP Test Security Affidavits (5 CCR Section 850[w]) to their CAASPP test site coordinator

• Viewing the test administration training video • Administering the CSA Pilot Test in accordance to the guidelines outlined in this manual

Test Administrator Checklist Test Administrator Activities Target Completion Date

Read and sign the CAASPP Test Security Affidavit; return to the CAASPP test site coordinator.

As soon as possible

Learn about the CSA Pilot Test: • Watch the training video. • Review this manual.

1–2 weeks before testing

Work with your CAASPP test site coordinator or LEA CAASPP coordinator to obtain a username and password for TOMS, which will enable you to access the Test Administrator Interface.


Become familiar with the CSA Pilot Test testing systems and tools: • CAASPP secure browser • Test Administrator Interface (to administer test sessions) • Watch the CSA Pilot Test Administration Training video.


Verify that students have access to headsets needed in order to take the listening portions of the assessment.


Confirm the students you will test are correctly assigned in the Test Administrator Interface.




Test Administrator Activities Target Completion Date

Ensure devices are turned on and the testing system is working. Day of testing (before sitting student for testing)

Start a test session in the Test Administrator Interface and ensure that students are logged on using the CAASPP secure browser on the testing device.

Day of testing (before sitting student for testing)

Begin the test administration with students. Day of testing, with student present.



This page is left blank intentionally.

Chapter 2. Test Administration Preparation and Planning

Test Administration Preparation and Planning | Preparing for the California Spanish Assessment (CSA) Pilot Test Administration


Preparing for the California Spanish Assessment (CSA) Pilot Test Administration


Bandwidth Checker Web page—linked on http://www.caaspp.org/about/bandwidth-checker.html

• CAASPP California Spanish Assessment Web page—http://www.caaspp.org/administration/about/csa/

• California Department of Education (CDE) California Longitudinal Pupil Achievement Data System (CALPADS) Web page—http://www.cde.ca.gov/ds/sp/cl/

• CDE Smarter Balanced Technology Readiness Resources Web page—http://www.cde.ca.gov/ta/tg/sa/sbac-itr-index.asp

• Secure Browsers Web site—http://ca.browsers.airast.org/ • Technical Specifications and Configuration Guide for CAASPP Online Testing

Web document—http://www.caaspp.org/rsc/pdfs/CAASPP.tech-specs-and-config-guide.2017-18.pdf

• Test Operations Management System (TOMS) Pre-Administration Guide for CAASPP Testing Web document—http://www.caaspp.org/rsc/pdfs/CAASPP.TOMS-pre-admin-guide.2017-18.pdf

Prior to administering the test, there are a number of steps that local educational agencies (LEAs) must take to prepare for a successful CSA Pilot Test administration. This section provides an overview of the various tasks and actions LEAs should complete to prepare for administering the CSA Pilot Test.

Using the Test Operations Management System (TOMS) to Prepare for the CSA Pilot Test TOMS is a secure Web site that permits authorized users from LEAs to perform a number of tasks for the CAASPP System. For the CSA Pilot Test, TOMS will be used to select the testing window, assign schools to it, and assign students to the assessment. Student demographic data from CALPADS are uploaded into TOMS on a nightly basis. The CSA should only be administered to students who fit the target population description—that is, students who are Spanish-speaking English learners or seeking a measure that recognizes their Spanish reading, writing, and listening skills.

Testing Window Selection in TOMS The LEA must first select the fixed CSA testing window in TOMS to allow students to be assigned to take the CSA and then assign schools to it. Information about selecting a testing window in TOMS can be found in the TOMS Pre-Administration Guide for CAASPP Testing.

http://www.caaspp.org/about/bandwidth-checker.html



http://www.cde.ca.gov/ds/sp/cl/

http://www.cde.ca.gov/ds/sp/cl/

http://www.cde.ca.gov/ta/tg/sa/sbac-itr-index.asp









Student Test Assignment in TOMS LEA CAASPP coordinators and/or CAASPP test site coordinators must use TOMS to ensure all appropriate students are assigned to take the CSA Pilot Test. The LEA must indicate all of the students who will take the CSA Pilot Test in TOMS. The CSA Pilot Test assignment can be configured on a student-by-student basis within the TOMS user interface or for multiple students through a .csv file upload process. Figure 1 shows the student [Test Mode] tab in TOMS through which the assignment can be made. Information about making student test assignments in TOMS can be found in the TOMS Pre-Administration Guide for CAASPP Testing.

Figure 1. Assigning students to the CSA in TOMS

Student Test Settings in TOMS One accommodation and select embedded and non-embedded designated supports are available for students taking the CSA Pilot Test. The accessibility supports listed in Table 2 must be assigned in the test settings section in TOMS.





Table 2. Available Accessibility Supports in the CSA Pilot Test

Non-embedded Accommodation Embedded Designated Support Non-embedded

Designated Supports • Print-on-Demand • Turn Off Any Universal Tools • Color Contrast

• Color Overlay • Magnification • Noise Buffers • Read-aloud Items • Scribe Items • Separate Setting

Configuring online student test settings in TOMS ensures that students receive the assigned embedded accessibility resources for the online assessments. Non-embedded resources also must be recorded in TOMS and provided to the student locally. There are two methods LEA CAASPP coordinators can use to set embedded and non-embedded designated supports for students in TOMS:

1. Spreadsheet upload: Use when multiple students in the LEA or at the test site are having test settings assigned.

2. One by one: Use when a few students in the LEA or at the test site are having test settings assigned.

Note: CAASPP test site coordinators can set test settings in TOMS using the one-by-one method only.

Technology Requirements All online CAASPP assessments, including the CSA Pilot Test, have the same technological requirements. Prior to assessment administration, LEA CAASPP coordinators, CAASPP test site coordinators, and/or technology coordinators should review the technology infrastructure at their schools to ensure it meets the minimum requirements for administering the CSA Pilot Test. The Technical Specifications and Configuration Guide for CAASPP Online Testing provides the technical specifications for online testing. This includes information about Internet and network infrastructure requirements, hardware and software requirements, and secure browser installation.

Bandwidth Checker The bandwidth checker, linked on the Bandwidth Checker Web page on the CAASPP Portal, can assist technology coordinators to assess network readiness by performing a real-time check of a school’s network bandwidth. Note that technology coordinators may want to run this test more than once and at different times of the day because estimates change as the network conditions change and can vary from run to run. The CDE also hosts a Smarter Balanced Technology Readiness Resources Web page, which includes links to tools, requirements, and topics that LEAs will find useful in planning for the 2017–18 online CAASPP testing.



http://www.cde.ca.gov/ta/tg/sa/sbac-itr-index.asp



Test Operations Management System Usernames and passwords are generated in TOMS after an LEA CAASPP coordinator or CAASPP test site coordinator has submitted users for access. For the CSA Pilot Test, test administrators can use this username and password to log on to the Test Administrator Interface, which is necessary to generate a test session ID and approve students for testing. For more information about the different user roles in TOMS, see Chapter 1 of the TOMS Pre-Administration Guide for CAASPP Testing.

Secure Browsers All students must use a CAASPP secure browser to access the CSA Pilot Test. All testing devices must have the correct secure browser installed prior to assessment. The secure browser is designed to support test security by prohibiting access to external applications or navigation away from the assessment.

School technology coordinators are responsible for ensuring that each device to be used for testing at the school is properly secured by installing the most current secure browser. Secure browsers are available for download on the Secure Browsers Web site. Information about installing and configuring the secure browsers is available in the Technical Specifications and Configuration Guide for CAASPP Online Testing.






Test Administration Preparation and Planning | Accessibility Resources


Accessibility Resources

Additional Resources: • Accessibility Guide for California Assessment of Student Performance and

Progress (CAASPP) Online Testing Web document—http://www.caaspp.org/rsc/pdfs/CAASPP.accessibility-guide.2016-17.pdf

• CAASPP Student Accessibility Resources and Test Settings Web page—http://www.caaspp.org/administration/accessibility/

• CDE 2016–17 CA Student Assessment Accessibility Web page—http://www.cde.ca.gov/ta/tg/ca/accesssupportitems.asp

• Smarter Balanced Usability, Accessibility, and Accommodations Guidelines Web document—linked on the CAASPP Student Accessibility Resources and Test Settings Web page at http://www.caaspp.org/administration/accessibility/

Universal tools, select designated supports, and a select, non-embedded accommodation are the only types of general accessibility resources available during California Spanish Assessment (CSA) pilot testing. Students may use the embedded universal tools within the test delivery system but also have the option to use non-embedded universal tools. The accommodation and designated supports must be assigned in the Test Operations Management System (TOMS).

Overview Accessibility resources are access features or supports of the assessment that are either provided as digitally delivered components of the CAASPP secure browser (embedded supports) or separate from it (non-embedded supports). Accessibility supports allow students to participate in an assessment that can generate results that are a fair and accurate estimate of each student’s achievement. For the CSA Pilot Test, students will have access to the same universal tools available for other CAASPP assessments, as appropriate for the CSA test items.

Availability of Universal Tools Universal tools are available to all students by default, although they can be disabled if they are distracting for a student. Each universal tool falls into one of two categories: embedded and non-embedded. Embedded universal tools are provided through the student testing interface (through the CAASPP secure browser), although they can be turned off by a test administrator. Non-embedded universal tools are provided at the test site–level and must be coordinated and delivered by a CAASPP test site coordinator or test administrator.

http://www.caaspp.org/rsc/pdfs/CAASPP.accessibility-guide.2016-17.pdf

http://www.caaspp.org/administration/accessibility/

http://www.cde.ca.gov/ta/tg/ca/accesssupportitems.asp

http://www.caaspp.org/administration/accessibility/



Table 3 lists the available universal tools for the CSA Pilot Test.

Table 3. Universal Tools Available for the CSA Pilot Test

Universal Tool Embedded Non-

embedded Breaks x x Digital notepad x Expandable passages x Expandable items (to be turned on by the test administrator in the Test Administrator Interface)

x

Highlighter x Keyboard navigation x Mark for review x Scratch paper x Spanish dictionary (for use with full-write items) x Spanish thesaurus (for use with full-write items) x Strikethrough x Writing tools (e.g., bold, italic, bullets, undo/redo) (for use with full-write items) x Zoom (in/out) x

Note: These supports are intended for use in the operational administration pending regulatory approval by the Office of Administrative Law.

Availability of Accommodations Accommodations are changes in procedures or materials that increase equitable access during the CAASPP assessments. Assessment accommodations generate valid assessment results for students who need them; they allow these students to show what they know and can do. Accommodations do not compromise the learning expectations, construct, grade-level standard, or intended outcome of the assessments. The print-on-demand non-embedded accommodation is provided at the test site–level and must be coordinated and delivered by a CAASPP test administrator.

Note: These resources are intended for use in the operational administration pending regulatory approval by the Office of Administrative Law.

Availability of Designated Supports Designated supports are available to all students through the test settings in TOMS. The designated supports each fall into one of two categories: embedded and non-embedded. Embedded designated supports are provided through the student testing interface (through the CAASPP secure browser). Non-embedded designated supports are provided at the test site–level and must be coordinated and delivered by a CAASPP test site coordinator or test administrator.



Table 4 lists the available designated supports for the CSA Pilot Test.

Table 4. Designated Supports Available for the CSA Pilot Test

Designated Supports Embedded Non-

embedded Turn Off Any Universal Tool(s) x Color Contrast x Color Overlay x Magnification x Noise Buffers x Read-Aloud Items x Scribe Items x Separate Setting (Special lighting/acoustics, adaptive furniture, time of day) x

Note: These resources are intended for use in the operational administration pending regulatory approval by the Office of Administrative Law.

Test Administration Preparation and Planning | Training Resources


Training Resources


California Spanish Assessment (CSA) Web page—http://www.caaspp.org/administration/about/csa/

Prior to administering the test, there are a number of steps that local educational agencies (LEAs) must take to prepare for a successful CSA Pilot Test administration. This section provides an overview of the various tasks and actions LEAs should complete to prepare for administering the CSA Pilot Test.

Using the CSA Pilot Test Administration Training Video A CSA Pilot Test Administration training video will be available on the CAASPP CSA Web page. This training video will help LEA CAASPP coordinators, test site coordinators, and test administrators become familiar with the necessary requirements for administering a successful CSA Pilot Test administration. The training video, which will be available starting September 1, can be accessed through a standard Internet browser by visiting the CAASPP CSA Web page.

Using the Testing Interface Tutorial Video A testing interface tutorial video will be available on the CAASPP CSA Web page. This tutorial video can help both test administrators and students become familiar with the testing format, interface, functionalities, and universal tools available for the CSA Pilot Test in order to establish the most optimal testing environment for students. The tutorial video, which will be available starting in August 2017, can be accessed through a standard Internet browser by visiting the CAASPP CSA Web page.






Test Administration Preparation and Planning | Training Resources



Chapter 3. Test Security

Test Security | Test Security for the California Spanish Assessment (CSA) Pilot Test

24 2016–17 CAASPP CSA Pilot Online Test Administration Manual September 2017 Customization Copyright © 2017 by the California Department of Education

Test Security for the California Spanish Assessment (CSA) Pilot Test

Additional Resources: • Security Incidents and Appeals Procedure Guide Web document—

http://www.caaspp.org/rsc/pdfs/CAASPP.stairs-appeals-guide.2016-17.pdf • California Assessment of Student Performance and Progress (CAASPP)

Security and Test Administration Incident Reporting System (STAIRS) Applicable Testing Issues Chart Web document—http://www.caaspp.org/rsc/pdfs/CAASPP.STAIRS-issues.2016-17.pdf

• CAASPP STAIRS Process for Summative Assessments Web page—http://www.caaspp.org/stairs/index.html

The California Spanish Assessment (CSA) is a secure test. All test administrators are required to read and sign the CAASPP Test Security Affidavit prior to testing, which is then kept on file with the CAASPP test site coordinator. The CAASPP test site coordinator should be contacted if test administrators have not received the CAASPP Test Security Affidavit.

Test Security Incidents Test security incidents, such as improprieties, irregularities, and breaches, are behaviors prohibited because they either give a student an unfair advantage or compromise the secure administration of the assessments. Whether intentional or unintentional, failure by staff or students to comply with security rules constitutes a test security incident. Local educational agency (LEA) CAASPP coordinators and CAASPP test site coordinators must ensure that all test security incidents are documented by means of the CAASPP STAIRS form. After the form is submitted, an e-mail containing a case number and next steps will be sent to the submitter (and to the LEA CAASPP coordinator, if the form is submitted by the CAASPP test site coordinator) via e-mail. Ensure that communications generated by the e-mail address [email protected] are not automatically sent to a junk mail or spam folder. The California Department of Education (CDE) will review your form to determine whether your testing issue requires additional action by the LEA. There are three types of test security incidents that must be reported using the CAASPP STAIRS form: improprieties, irregularities, and breaches.

Security and Test Administration Incident Reporting System (STAIRS) LEA CAASPP coordinators and CAASPP test site coordinators must ensure that all test security incidents are documented using the CAASPP STAIRS form, which is available on the STAIRS Process for Summative Assessments Web page on the CAASPP Portal. The form includes the opportunity to securely upload a spreadsheet containing Statewide Student Identifiers (SSIDs) of the students involved in the irregularity in cases involving 11 or more students. Do not upload student names, only SSID numbers.

http://www.caaspp.org/rsc/pdfs/CAASPP.stairs-appeals-guide.2016-17.pdf

http://www.caaspp.org/rsc/pdfs/CAASPP.STAIRS-issues.2016-17.pdf





The LEA CAASPP coordinator or CAASPP test site coordinator (with a copy sent to the LEA CAASPP coordinator) submitting the form will receive an e-mail that includes the details that were entered into the CAASPP STAIRS form and instructions for the next steps to take (submit an appeal, file the e-mail, or wait to be contacted). These instructions will also be presented on the CAASPP STAIRS form when the incident is submitted. You cannot file an appeal in the Test Operations Management System (TOMS) without first submitting the CAASPP STAIRS form because the case number included in the confirmation e-mail is necessary to complete the submission of an appeal. A copy of the e-mail may be sent to the CDE for the following incident types: • There was a student cheating. • There was a security breach (where either a student or an adult exposed secure

materials). • The live student testing interface or Test Administrator Interface was used for practice

instead of the training or practice tests. (Accidental summative access) • The test administrator provided the student with access to another student’s

work/responses. (Accidental SSID swap) Table 5 depicts the STAIRS incidents that apply to the CSA Pilot Test. A CAASPP STAIRS form should be submitted for any of the test security incidents in the table below. Please refer to Appendix B in the CAASPP Security Incidents and Appeals Procedure Guide for descriptions and post-form action for each of the STAIRS incidents in the table below.

Table 5. STAIRS Incident Types CSA Pilot Test STAIRS Incidents Impropriety Irregularity Breach

Administration Error x

Cheating/Accessing Unauthorized Devices x

Disruption or Technical Issue x

Exposing Secure Materials x

Incorrect Statewide Student Identifier Used x

Student Disruption x

Impropriety An impropriety is an unusual circumstance that has a low impact on the individual or group of students who are testing and has a low risk of potentially affecting student performance on the test or of impacting test security or test validity. (Example: Student[s] leaving the testing room without authorization, or related instructional materials were left on the walls in the testing room.) Steps for handling improprieties are outlined in Figure 2.




Local administrators/staff take corrective action

and notify the site coordinator.

Incident is mitigated as necessary by school staff,

and LEA CAASPP coordinator is notified for assistance with mitigation

as necessary.

The CAASPP test site coordinator or LEA CAASPP

coordinator records the impropriety using the online

CAASPP STAIRS formwithin 24 hours.

Figure 2. Handling improprieties

Irregularity An irregularity is an unusual circumstance that impacts an individual or group of students who are testing and may potentially affect student performance on the test or impact test security or test validity. These circumstances can be contained at the local level. (Example: Disruption during the test session such as a fire drill, or student[s] cheated or provided answers to each other.) Steps for handling irregularities are outlined in Figure 3.

Local administrators/staff take corrective action and notify the site coordinator.

Incident is mitigated as necessary by school staff,

and the LEA CAASPP coordinator is notified for

assistance with mitigation.

The CAASPP test site coordinator or LEA

CAASPP coordinator reports the irregularity using the online CAASPP STAIRS

form within 24 hours.

The submitter (and the LEA CAASPP coordinator, if the submitter was a CAASPP

test site coordinator) receives an e-mail

summarizing the submittal and a description of the next steps.

The coordinator takes the next steps described in the STAIRS response e-mail,

which may include filing an appeal request that includes the STAIRS case number.

The CDE approves the appeal, if applicable, and the coordinator retains the

STAIRS response e-mail for his or her records.

Figure 3. Handling irregularities

Breach A breach is a test administration event that poses a threat to the validity of the test. Breaches require immediate attention and escalation to the CDE, via telephone at 916-445-8765. Following the call, the CAASPP test site coordinator or LEA CAASPP coordinator must report the breach using the online CAASPP STAIRS form within 24 hours.

Examples may include such situations as exposure of secure materials or a repeatable security/system risk. These circumstances have external implications. (Example: Test administrators modifying student answers, or test items shared in social media.) Steps for handling breaches are outlined in Figure 4.



Local administrators/staff

mitigate the incident as necessary and report

the breach to the CAASPP test site

coordinator and/or LEA CAASPP coordinator

immediately.

LEA staff investigate the security risk and alert

CalTAC for social media breaches and the CDE for all other breaches,

and stand ready to receive further guidance on the dispensation of

the event.

The LEA CAASPP coordinator immediately

calls the CDE to report the breach. Following the call,

the CAASPP test site coordinator or LEA

CAASPP coordinator reports the breach using

the online CAASPP STAIRS form within

24 hours.

The submitter (and the LEA CAASPP coordinator,

if the submitter was a CAASPP test site

coordinator) receives an e-mail summarizing the

submittal and a description

of next steps.

The coordinator takes the next steps described in the STAIRS response e-mail, which may include filing an appeal request

that includes the STAIRS case number.

The CDE approves the appeal, if applicable, and the coordinator retains the STAIRS response

e-mail for his or her records.

Figure 4. Handling breaches

Appeals After a test security incident has been reported, using the CAASPP STAIRS form, an e-mail containing a case number and instructions for next steps is to be sent to the CAASPP test site coordinator and/or the LEA CAASPP coordinator who submitted the form. In some cases, the CAASPP test site coordinator and/or LEA CAASPP coordinator are instructed to file a specific appeal in TOMS that results in resetting, reopening, invalidating, or restoring an individual student’s assessment(s). Note that an appeal cannot be filed without first documenting an incident in STAIRS. Appeals must be submitted in time for the student to complete the test before October 6, 2017. Refer to the CAASPP Security Incidents and Appeals Procedure Guide for complete instructions on how to file an appeal.

Filing Appeals LEA CAASPP coordinators or CAASPP test site coordinators should take the following steps to file an appeal. (Note that an appeal must be filed before the end of the selected testing window): 1. Document and submit an irregularity or test security incident for a summative

assessment using the CAASPP STAIRS form; instructions for access can be found on the STAIRS Process for Summative Assessments Web page on the CAASPP Portal. You will be prompted for information.

2. Review the instructions on the CDE Review Decision screen before you select the [Complete Decision] button to complete the STAIRS process in the CAASPP STAIRS form, or read the e-mail you receive as a result of the submittal. If you are instructed to





file an appeal in TOMS, you will receive instructions that include the necessary appeal type.

3. To file the appeal itself, access TOMS by visiting the CAASPP Portal Web page and selecting the [Test Operations Management System (TOMS)] button.

4. Follow the instructions in the Security Incidents and Appeals Procedure Guide. You must enter the case number you received in the e-mail when you request an appeal in TOMS.

5. The CDE will make a decision on the appeal within four business days of its receipt.

Types of Appeals A description of the types of appeals and conditions for their use is described in Table 6.

Table 6. Description of Appeals Type of Appeal Description Conditions for Use RESET Resetting a student’s summative

test removes that test from the system and enables the student to start a new test from the beginning.

The CDE may reset a test if: 1. A student is provided access to another

student’s work/responses due to the test administrator providing the incorrect SSID.

INVALIDATION Invalidated tests will be scored and scores will include a note that an irregularity occurred.

The CDE may invalidate a test if: 1. There is a test security breach. 2. The test is administered in a manner

inconsistent with the CSA Test Administration Manual, for example.

Note: After reviewing the circumstances of an incident, the CDE may elect only to document the above conditions as testing irregularities, rather than to invalidate the test.

RE-OPEN Reopening a summative test allows a student to access a test that has already been submitted or has expired. If an expired test is reopened, the test will resume at the last unanswered item on the assessment that could, in some cases, be different from where the student left off (if, for example, the student went back to review prior items).1 The student will be able to review items within the current segment of the assessment. If a submitted test is reopened, the test will reopen at the last page of the test. The student cannot review items, even in the current segment.

The CDE may reopen a test if: 1. A student is unable to complete a test due

to a technological difficulty that results in the expiration of the test.

2. A student is unable to complete the test before it expires due to an unanticipated excused absence or unanticipated school closure.

3. A test is unintentionally submitted before the student has completed it.

1 A test that is reopened following an expiration will remain open for 10 calendar days from the date it was reopened.





Type of Appeal Description Conditions for Use RESTORE Restoring a summative test

returns a test from the Reset status to its prior status. This action can only be performed on tests that have been previously reset through a reset appeal request.

Requests to restore a test if a test was inadvertently or inappropriately reset because an LEA wrongly requested a reset in a test appeal request must be made by an LEA CAASPP coordinator who contacts CalTAC. Note that it is not possible to restore an invalidated test.

Retake Opportunity Students are not permitted to retake the CSA Pilot Test unless given direct permission by the CDE as part of the appeals process.

Chapter 4. Administering the California Spanish Assessment to Students

Administering the California Spanish Assessment to Students | Test Security for the California Spanish Assessment (CSA) Pilot Test


Use the Directions for Administration



Overview

Caution: These instructions apply to administration of the California Spanish Assessment (CSA).

RECOMMENDATION: Consider printing this section to be used on the day of testing.

Before you administer a test session, check to see if the following has been completed:

Verify the security of the testing environment prior to beginning a test session. (See the Security of the Test Environment subsection in the CAASPP Online Test Administration Manual.)

Student seats are arranged in a way so they cannot see each other’s answers. All displayed instructional materials (e.g., vocabulary charts, etc.) are covered or

taken down. Post “TESTING IN PROGRESS—DO NOT DISTURB” signs outside of the testing

room. Ensure that students do not have access to digital, electronic, or manual devices (e.g.,

cellphones, smart watches) during testing.

Make sure each testing device or workstation has headphones.

Recommended: Launch secure browsers on all testing devices before students sit down to test.

To ensure that all students are tested under the same conditions, the test administrator should adhere strictly to the script for administering the test. These instructions can be found in the boxes in bold on the following pages. When asked, the test administrator should answer questions raised by students but should never help the class or individual students with specific test items. No test items can be read to any student. Please remember that the script must be followed exactly and used each time a test is administered. If the class is resuming a test and the test administrator is sure that all students are able to log on without hearing the logon directions again, the test administrator may skip the italicized portions of the directions. All directions that a test administrator needs to read to students are indicated by the word “SAY” and are in boxes so they stand out from the regular text. They should be read exactly as they are written, using a natural tone and manner. If the test administrator makes a mistake in reading a direction, then he or she should stop and say, “He hecho un error. Eschuche de nuevo. (I made a mistake. Listen again.)” Then the direction should be reread.



Administering the California Spanish Assessment to Students | Test Security for the California Spanish Assessment (CSA) Pilot Test


The test administrator should try to maintain a natural classroom atmosphere during the test administration. Before each test begins, he or she should encourage students to do their best. Any time a student logs on to the testing system, the test administrator should follow this script.

Administering the California Spanish Assessment to Students | Administer an Online Test Session


Administer an Online Test Session



WARNING

The California Department of Education recommends that test administrators exercise extreme caution when selecting an assessment for a test session. To help with differentiating the tests, the assessments each have a differently colored background with a white-text label. Online Assessments: • Red—Smarter Balanced Summative Assessments • Indigo—California Alternate Assessments (CAA) • Brown—California Science Test (CAST) • Green—Smarter Balanced Interim Assessments • Mint—California Spanish Assessment (CSA)

Online Practice and Training Tests: • Pink—Smarter Balanced practice tests • Purple—Smarter Balanced training tests • Teal—CAA training tests • Blue—CAA practice tests • Orange—CAST training tests

You must create a test session before students can log on to the Student Testing Site. In order for a student to take a specific test, it must be included in your test session. This section contains information on how to start a test session, add tests to the session, verify students’ test settings, approve students for testing, and monitor their progress.

Warning: Check students’ information, especially their grade level, before test sessions. If you have a student whose information is incorrect, do not approve him or her for testing. Contact your local educational agency (LEA) CAASPP coordinator or CAASPP test site coordinator (as appropriate) to have the student’s information updated in the Test Operations Management System (TOMS).




General Rules Entering Student Responses into the System A student may enter his or her responses into the testing device using a mouse, keyboard, or other assistive technology. The CSA includes constructed-response items that require a student to enter Spanish characters. In order to assist the student with entering Spanish characters, the test delivery system will include a shortcut to a table that displays the necessary Spanish characters to allow a student to accurately provide their response. This is shown in Figure 5.

Figure 5. Select Special Character window

Pause Rules The pause rules that follow apply regardless of whether the student or the test administrator pauses the test or there was a technical issue (e.g., power outage or network failure) that resulted in the student being logged off. The CSA may be paused and resumed as many times as necessary to elicit the student’s best testing performance. The student also may choose to pause and resume over the course of a day, week, or throughout the testing window as follows:

• When a test is paused, the student must log back on to resume testing. Upon resumption, the student is automatically directed to the first page that has an unanswered item.

• In the event of a technical issue (e.g., power outage or network failure), students’ tests are paused and the students are logged off.

Test Timeout (Due to Inactivity) As a security measure, students/test administrators are automatically logged off after 30 minutes of test inactivity. This timeout also results in the test being paused automatically. Activity is defined as selecting an answer or navigation option in the test (e.g., selecting [Next] or [Back] or using the Questions drop-down list to navigate to another item). Selecting an empty space on the screen is not considered activity.



Before the secure browser logs the student off of the test, a warning message will be displayed on the screen. If [OK] is not selected within 30 seconds after this message appears, he or she will be logged off.

Beginning the Test Follow these instructions to administer the CSA Pilot Test. The test administrator must create a test session before students can log on to the Student Testing System (but no more than 30 minutes prior or the system will time out). When a test administrator creates a test session, a unique session ID is randomly generated. This session ID must be provided to the students before they log on and should be written down. The basic workflow for administering online tests is as follows: 1. The test administrator selects tests and starts a test session. 2. Students sign in and request approval for tests. 3. The test administrator reviews students’ requests and approves them for testing. 4. Students complete and submit their tests. 5. The test administrator stops the test session and logs off.

For information about the testing process from a student’s perspective, see the subsections Signing In to the Student Testing Site and Features of the Student Testing Application in the CAASPP Online Test Administration Manual.

Test Administrator Student 1. Navigate to the CAASPP Portal at

http://www.caaspp.org/ on a Web browser.

2. Select the [Test Administrator Interface] button.

3. Log on to the Test Administrator Interface using your sign in credentials.

4. If you are associated with multiple institutions, an “Important!” message appears when you log on. You must select the appropriate institution from the drop-down list in this message and select the [Go] button. You may only select one institution at a time.






Test Administrator Student You will only be able to administer tests available for the selected institution. In order to select a different institution, you must log off and then log back on.

5. The Test Selection window color-codes testsand groups them into various categories. A testgroup, such as “Smarter Balanced InterimAssessments,” may include one or moresubgroups. All test groups and subgroupsappear collapsed by default.

6. To select tests for the session, do one of thefollowing:• To expand a collapsed test group, select the

[Plus] plus-sign [ ] icon (or [Expand All])• To collapse a test group, select the [Minus]

minus-sign [ ] icon (or [Collapse All]).

• To select individual tests, mark the checkboxfor each test you want to include.

• To select all the tests in a test group, markthe checkbox for that group.

7. Select the [Start Operational Session] button.



Test Administrator Student

8. Inform students of the test session ID.The session ID is automatically generated upon selecting [OK] in the previous step. Write the session ID on a place where all students can clearly see.

9. Read the following SAY box.

SAY: Hoy, tomará la prueba piloto California Spanish Assessment en la banda de grados [insertar banda de grado]. Yo les daré el número de identificación de la sesión de prueba que se requiere para iniciar la prueba. Antes de iniciar la sesión, revisemos algunas reglas de prueba. Debe responder a cada pregunta en la pantalla antes de seleccionar SIGUENTE. Si no está seguro de una respuesta, proporcione lo que usted piensa que es la mejor respuesta. Si desea revisar la respuesta más adelante, marque el ítem para su revisión antes de pasar a la siguiente pregunta. Puede regresar y cambiar la respuesta durante esta sesión de la prueba. Puede hacer pausa en cualquier punto de la prueba seleccionando [PAUSA] en lugar de siguente después de contestar una pregunta. Levante su mano si necesita un descanso y pida permiso antes de seleccionar [PAUSA].



Test Administrator Student 10. Read the following SAY box and all subsequent

SAY boxes to everyone.

SAY: Sus respuestas deben ser su propio trabajo. Por favor, mantenga sus ojos en su propia prueba y recuerde, no debe hablar durante la prueba. Si tiene su teléfono celular o smartwatch, debe guárdalo y mantenerlo apagado.

Si termina su prueba temprano, por favor levante su mano y siéntese en silencio.

11. Logon tickets may be provided to each student. The logon tickets should provide the students’ Statewide Student Identifier (SSID). Note that logon tickets are secure testing materials and should be securely destroyed after testing.

12. Log on to the Student Testing Site through the secure browser.

13. Direct students to sign in using the Student Sign In Web form. You do not need to read the italicized sentences to students testing over multiple days who have already heard these instructions at least once.

SAY: Ahora estamos listos para iniciar la sesión. Una vez que haya iniciado la sesión, tendrá que esperar a que yo inicie la prueba antes de comenzar. Estaré comprobando que ingresaron correctamente la identificación de sesión de prueba y otra información. Ingrese su nombre legal, no su apodo, seguido de su número SSID. A continuación, introduzca la identificación de sesión. Levante su mano si necesita ayuda para escribir esta información en su teclado.

SAY: Ahora seleccione [SIGN IN]. Una vez que haya iniciado la sesión correctamente, verá una pantalla con su nombre y otra información. Si toda la información en la pantalla es correcta, seleccione SÍ para continuar. Si alguna de la información es incorrecta, levante su mano y muéstreme lo que es incorrecto.



Test Administrator Student 14. Ensure that all students have successfully

entered their information. 14. Verify identity by selecting [No] or [Yes].

15. Inform students of the test type (for example,

CSA Pilot Test) in which they are participating today.

15. Select the test to take.

SAY: En la siguiente pantalla, seleccione CSA Pilot Test [insertar banda de grado] y, a continuación, seleccione [START TEST]. Una vez que haya seleccionado su prueba, verá una pantalla con una barra en movimiento y un mensaje diciendo que está esperando la aprobación del administrador de la prueba. Espere tranquilamente mientras compruebo y apruebo cada una de sus pruebas.

Note: Only the tests that the test administrator selected for the test session for which students are eligible are selectable by students.

16. Wait for the test administrator’s approval.




Note: If a student’s test settings are incorrect, deny the student access to the test, contact the LEA CAASPP coordinator or CAASPP test site coordinator to correct the test settings in the Test Operations Management System, and test the student on another day.

17. Approve students to test by selecting the [Approve] check mark [ ] icon in the Actions column for individual students or the [Approve all Students] button. Select [Details] eye [ ] icon to view and adjust the student’s settings (universal tools) for the current test opportunity. “Custom” in the Details column indicates the student has been assigned test settings.

SAY:

Después que apruebo el comienzo de la prueba, verá una pantalla que le pedirá que compruebe la prueba y su configuración. Si toda la información es correcta, puede seleccionar [SI, COMENZAR LA PRUEBA]. Si algo es incorrecto, levante su mano.

18. Verify test information and settings.




19. Select [Si, comenzar la prueba] to begin testing.

20. Have students run the sound check. SAY:

A continuación, debe ver una pantalla que le pide que compruebe que el sonido en su computadora está funcionando. Coloque los audífonos y seleccione el icono del altavoz para escuchar el sonido. Si oye el timbre, seleccione [SÍ, PUDE REPRODUCIR EL VIDEO Y SU SONIDO]. Si no, levante su mano.

20. If beginning a test with a test with listening item, complete the audio checks with headphones.

Test with listening items audio/video check:

If audio issues occur, do the following: • Ensure headphones are securely plugged

in to the correct jack or USB port. • If the headphones have a volume control,

ensure the volume is not muted. • Ensure that the audio on the device is not

muted (often via a control panel or settings window).

If the student is still experiencing issues, contact your CAASPP test site coordinator or school technology coordinator.



Test Administrator Student 21. Tell students how to take the test. SAY:

Antes de que aparezca la prueba, aparecerá una página de tutorial en la que se enumeran las herramientas de prueba y los botones que puede utilizar durante la prueba o que aparecerán en la prueba. También puede encontrar esta información durante la prueba seleccionando el botón help en la esquina superior derecha. Cuando esté listo para comenzar su prueba, seleccione [COMENZAR LA PRUEBA AHORA] en la parte inferior de la página.

21. Select [Comenzar la prueba ahora] to begin testing.

22. Continue with the instructions in the next subsections, Monitoring Student Progress and Ending a

Test Session.

Monitoring Student Progress Test Selection It is very important that test administrators monitor student progress throughout the test session. This includes verifying that students are participating in the appropriate content area and type of test (CSA Pilot Test). The test administrator monitors the test each student is taking by referring to the Students in Your Operational Test Session table in the Test Administrator Interface, shown in Figure 6. Note that the list of student names can be sorted by linked (underlined) column headings. In the event a student is taking an incorrect test, the test administrator should pause the student’s test. The test administrator should then instruct the student to log off and log on again to select the correct test. The Test column is called out in Figure 6.



Figure 6. Monitoring student progress in the Test Administrator Interface

Note: To reset a test, the LEA CAASPP coordinator or CAASPP test site coordinator must submit the CAASPP STAIRS form. Then, if warranted, the coordinator will need to file an appeal The CDE will determine the impact of resetting a test and will either approve or deny a request to reset within two business days of receiving the request.

Test Security Once students have started their CSA Pilot Test, the test administrator should circulate the room to ensure that all conditions of test security are maintained. If the test administrator or test examiner witnesses or suspects the possibility of a test security incident, the CAASPP test site coordinator and LEA CAASPP coordinator should be contacted immediately in accordance with the security guidance provided in this manual.

Student Directions During Testing While the Test Administrator Interface is designed to refresh automatically every minute, the test administrator can refresh it manually at any time by selecting the [Refresh Now] button at the top left of the page.

Warning: Do not use the Web browser’s [Refresh] button to refresh the Test Administrator Interface.

If the test administrator notices that a student is off task, the test administrator may say the following statement to the student, verbatim, to keep him or her focused.



SAY: Es importante que hagas lo mejor que puedas. ¿Necesita pausar la prueba y tomar un descanso?

If a student is concerned about an item, you may direct the student to review a tutorial by reading the script below verbatim.

SAY: Has lo mejor que puedas y elige la respuesta que tiene más sentido. Si no estás seguro de cómo funciona una pregunta, puedes revisar un tutorial seleccionando en el botón "i" en el lado derecho de la pantalla.

Allowing the students to review the CSA Testing Interface tutorial video is strongly encouraged to attempt to ensure that students are able to manipulate each item type and use the various tools and supports during testing.

Warnings: Always write down the session ID for possible future use: • If the Test Administrator Interface is accidentally closed while students are

still testing, the session will remain open until it times out after 30 minutes. The test administrator can open the Web browser and navigate back to the Test Administrator Interface. The test administrator will be prompted to enter the active session ID.

• As a security measure, test administrators are automatically logged off of the Test Administrator Interface after 30 minutes of test administrator user inactivity and student inactivity in the test session, which will result in closing the test session. If this occurs, the test administrator will have to create a new session and the students will have to log on to the new session to resume testing. When starting a new session, the test administrators should give the students the new session ID so they can log on and resume testing.

Ending a Test Session When there are approximately 10 minutes left in the test session, the test administrator should give students a brief warning.

SAY: Nos estamos acercando al final de esta sesión de prueba. Por favor revise las preguntas completada o seleccionada para revisión ahora. No envíe su prueba a menos que haya contestado todas las preguntas. SAY: Si está trabajando en un conjunto de preguntas para un pasaje de lectura, por favor termine todas las preguntas en ese conjunto.



SAY: Déjeme saber si necesita más tiempo.

After answering the last item in each segment, each student is presented with a screen prompting him or her to review answers (marked and unmarked) for all items available to the student or prior to submitting the test. Mark for Review is provided as a reminder to a student that he or she had a question or concern about a particular item, but he or she is permitted to review all items—marked or unmarked—within the constraints of the pause rule. After answering the last question, students must submit their tests. If students would like to review their answers before submitting their test, they can do so before selecting [FINALIZAR PRUEBA]. Once a student selects [FINALIZAR PRUEBA], the student will not be able to review answers.

SAY: Esta sesión de prueba se ha terminado. Si no ha terminado la prueba, seleccione PAUSA y podrá terminarlo en otra sesión. [Para la Prueba Piloto CSA: Podrá regresar y cambiar sus respuestas cuando regrese a la prueba, siempre y cuando regrese a la prueba dentro de la ventana fija de Prueba Piloto CSA]. Si ha contestado todas las preguntas y ha terminado de revisar sus respuestas, seleccione [FINALIZAR PRUEBA]. Ahora recojeré cualquier papel u otros materiales.

Test administrators should select [Stop Session] to end the test session and pause any student test in the session that is still in progress. When finished, test administrators can log off the Test Administrator Interface by selecting the [Logout] button at the top right. Test administrators should also collect any scratch paper.

Logging Off Use caution when logging off the Test Administrator Interface as this will log you off of other related systems (e.g., Completion Status, Interim Assessment Hand Scoring, and TOMS). To log off the Test Administrator Interface, select the [Logout] button in the top-right corner of the screen on the Single Sign-On system banner (shown in Figure 7).

Figure 7. Single Sign-On system banner

Your session will be closed, and you will be directed to the CAASPP Portal after you log off. You will not be able to resume the test session.



Alert: This scenario also occurs when a test administrator navigates to another site from the Test Administrator Interface. If you need to access TOMS or another application, you are encouraged to open a separate browser window and use that window for other applications. If a test administrator unintentionally logs off the Test Administrator Interface while students are still testing, all in-progress tests will be paused and the students will be logged off. You cannot resume the original session. You will need to log back on, start a new session, and provide the new session ID to students who need to log back on and resume testing.

Administering the California Spanish Assessment to Students |



Chapter 5. Appendixes

Appendixes | Appendix A: California Spanish Assessment (CSA) Item Types


Appendix A: California Spanish Assessment (CSA) Item Types The California Spanish Assessment (CSA) features many new item types, which include innovative and technology-enhanced items. The list below gives details about these new items, describing the type of functionality the student and test examiner will see.

1. Set Leader—This is a stimulus such as a passage or an image. The Leader has one or more questions assigned to it, based on its content.

2. Multiple Choice—These items consist of question and list of choices; they may also include a stimulus or subset of a passage as the stimulus. a. Single Select—The student must select the one correct choice to receive credit. b. Multiple Select—The student must select all correct choices to receive credit.

3. Inline Choice List—These items consist of questions with a drop-down list of choices to fill in the blank. a. Single Select—The student must fill a single blank from a drop-down list for credit. b. Multiple Select—The student must fill multiple blanks from a drop-down list for

credit. 4. Numeric—The student responds by selecting a single entry box with a numeric value.

The numeric value may contain decimals or a slash line to represent a fraction. 5. Grid—These items consist of a table with descriptions or characteristics, from which

the student then selects a box in a column or row for true-and-false or yes-or-no type of questions. a. Single Select—The student marks a single cell in a table for credit. b. Multiple Select—The student marks two or more cells in a table. The question

might only allow one selection per row or column but it might also have no restrictions in the number of cells a student can mark.

6. Zones—These items have answer choices that are predefined “hotspots” on an image, word, or phrase within a sentence. When the student selects a spot, the selection is highlighted, shaded, or outlined in red. a. Single Select—The student selects one zone for credit. b. Multiple Select—The student selects two or more zones for credit.

7. Composite—These items contain two or more item parts from the machine-scored list; the item score, as a whole, is based on the test taker’s response to each individual part (machine scored). This item type is to be used for any multipart items that are expected to have two or more responses selected from two sets of options.

8. Composite Constructed Response—These items are similar to the Composite item type, except that one part contains an item type from the machine-scored list and another from the hand-scored list. The item score, as a whole, is based on the test taker’s responses to each individual part.

Appendixes | Appendix A: California Spanish Assessment (CSA) Item Types


9. Match (drag-and-drop)—These items require the student to move objects such as words or images by selecting and dragging the objects into a specific order or to a specific location in a table, passage, or image. a. Single Select—The student drags and drops a single choice into the appropriate

location. b. Multiple Select—The student drags and drops two or more choices into the

appropriate locations. 10. Extended Text—These items consist of a stem in which the test taker must provide a

written response, usually in the form of an essay. 11. Fill-in-blank—These items consist of a stem in which the test taker must provide a

written response, such as a word, phrase, or short sentence, within one blank text-entry box.

12. Multiple Fill-in-blank—These items are similar to Fill-in-blank, except they use two or more blank text-entry boxes.

Appendixes | Support for the California Spanish Assessment Pilot Test


Support for the California Spanish Assessment Pilot Test

Additional Resources: • California Assessment of Student Performance and Progress (CAASPP) Portal

Web site—http://www.caaspp.org/ • CAASPP California Spanish Assessment (CSA) Web page—


The CAASPP Portal is the home for all CAASPP assessment administration information, including the CSA. All information and nonsecure materials needed to administer the CSA Pilot Test are or will be available on the CAASPP CSA Web page. For questions regarding the CSA or for additional assistance:

• LEA CAASPP coordinators should contact the California Technical Assistance Center (CalTAC) by phone at 800-955-2954, by e-mail at [email protected], or by using the chat function linked on the CAASPP Portal.

• CAASPP test site coordinators should contact their LEA CAASPP coordinator. • CSA test administrators should contact their CAASPP test site coordinator.





mailto:[email protected]


California Spanish Assessment Test Administration Manual · CALIFORNIA Assessment of Student...

Documents

Transcript of California Spanish Assessment Test Administration Manual · CALIFORNIA Assessment of Student...