Post on 14-Feb-2016
description
Test Security & AccommodationsSpring 2014
2Louisiana Believes
2014-2015 Assessment PlanGrade Subject 13-14 Assessment 14-15 Assessment
Grades 3 to 8
ELA LEAP and iLEAP PARCC
Math LEAP and iLEAP PARCC
Science LEAP and iLEAP LEAP and iLEAP
Social Studies LEAP and iLEAP LEAP and iLEAP
High School
All subjects ACT Advanced Placement
ACT Advanced Placement
ELA English II EOCEnglish III EOC
English II EOCEnglish III EOC
Math Algebra I EOCGeometry EOC
Algebra I EOCGeometry EOC
Science Biology EOC Biology EOC
Social Studies US History EOC US History EOC
Alternate Assessments
ELA, Math, Science (varies by grade level)
LAA1 LAA1
ELA, Math, Science, Social Studies (varies by grade level)
LAA2 LAA2 for eligible re-testers (high school)
English Language ELDA ELDA
3Louisiana Believes
TODAY’S OBJECTIVE
To understand, plan, and implement practices that ensure test security during statewide assessment administration, as well as understanding, planning, and implementing practices that ensure proper accommodation provisions to students, as required by the IEP, 504, or LEP accommodations plan, during statewide assessment administration, including:
• Policy guidelines• Action required• Training and support
Test Security
SBESE Bulletin 118
Chapter 3: Test Security All persons involved in assessment programs must abide by the security policies and procedures.
Procedures for • investigating testing irregularities• maintaining security of test materials• maintaining security of student data• handling of emergencies during testing
5Louisiana Believes
6Louisiana Believes
LEA Test Security Policy
Noteworthy:• To the extent practicable, districts must establish
procedures to assign a different test administrator for a class than the teacher of record for the class, except for teachers testing students with accommodations and younger students, grades 3 through 8. • Districts must establish procedures for monitoring of
test sites to ensure that appropriate test security procedures are being followed and to observe test administration procedures.
Alternate Environment Form
Form is required if not testing in• Class-sized groups (Bulletin 741)• The usual classroom environment
Form is not required if • Environment is provided as an approved accommodation
(i.e., IEP, Section 504 IAP, or LEP plan)• Testing EOC in computer lab or classroom
DTC submits to LDOE 30 days prior to testing
7Louisiana Believes
Alternate Environment Form (cont.)
Must describe testing environment • Adequate spacing between students
• Sufficient space for students to handle materials
• If in multipurpose spaces (e.g., cafeteria, library, teacher’s lounge), describe procedures for controlling interruptions.
• May not schedule different assessments in same room at same time
• May not test more than one small group in same room at same time
8Louisiana Believes
9Louisiana Believes
Violations of Test Security
Administer tests in a manner that is inconsistent with the administrative instructions provided by the LDOE that would give examinees an unfair advantage or disadvantage• modification or deletion of or additions to the test
administration manual directions• reading aloud a word, phrase, or question on any test
without the proper required accommodations• change in test schedule• inappropriate accommodations• improper monitoring
10Louisiana Believes
• Give examinees access to test questions prior to testing• Examine any test item at any time (except for
students during the test or test administrators while providing specified accommodations)• Fail to report any testing irregularities to the DTC
who must report such incidents to the LDOE, Division of Assessments and Accountability
Violations of Test Security
Proper Security
Prevention
• DTC and STC should use the before, during, and after testing checklists in TCM and TAM
• The school’s plan for handling disruptions during testing should be reviewed, and all personnel should be informed of how to handle various situations.
• Ensure proper training in test security and administration of all school personnel, including LEA staff assigned to campuses during testing
12Louisiana Believes
Chain of CustodyOnly the STC or designated backup should sign for and receive boxes of testing materials. • Upon receipt, testing materials should immediately inventoried
and placed in the locked, secure area. • The locked, secure storage area for checking out/in test materials
must be designated—one that is only accessible to the STC, backup, and test administrators.
• Only personnel trained in test security should have access to the locked, secure area.
• Using the electronic security checklists, the STC and backup should count and verify all contents of all boxes.
• If additional materials are ordered, the STC must add the materials to the electronic security checklist.
13Louisiana Believes
PreventionCoordinate with various school personnel, including site administration, teachers, counselors, special education teachers/staff, SBLC team members, and data entry clerks to verify:• students are participating in the appropriate assessment• appropriate accommodations for all special education, Section 504,
and ELL students.
Provide each test administrator testing students with accommodations a list of those students and their approved accommodations.
Verify that the test administrators know how to administer the accommodations.
14Louisiana Believes
Prevention
• Verify that all materials related to the content areas being tested are covered or removed before testing. Check locations used for extended time or makeup testing.
• Verify that rooms are arranged for students to be seated with enough space between them to minimize the possibility of copying. For online testing, verify that students cannot see other students’ monitors.
• Provide classroom seating charts to record student attendance and seating location for each day of testing.
15Louisiana Believes
Prevention
• Verify that all personnel and students are aware of the district’s policies regarding cell phones or other devices with imaging or text-messaging capability. If allowed in the school, all such devices must be in the off position during testing and any other time secure materials are in the vicinity.
• Throughout the school, post Testing—Do Not Disturb signs that prohibit entry into testing locations.
16Louisiana Believes
Prevention
• Verify that procedures are in place for handling makeup testing, breaks (short and extended), and students requiring extra time and that all test administrators are aware of the procedures.
• Verify that all test administrators are aware of the testing schedule.
• Verify again that anyone who could access test materials (test administrators; proctors; administrative staff including principals, paraprofessionals, secretaries; security personnel; maintenance personnel; custodial personnel; interpreters; etc.) have been trained in test security.
17Louisiana Believes
Prevention
• The School test Coordinator (STC) or backup should • be available for questions and for signing out and signing in
materials at all times,• verify that each test administrator has and knows which
materials are required for each day,• check and document all materials as they are being signed
out and in each day, • monitor to verify that test administrators are appropriately
administering the tests and periodically walking among students during testing, and• document and submit any testing irregularities immediately
to the District Test Coordinator. 18
Louisiana Believes
Prevention
• Test administrators should • use the checklists in the administration manual that
specify the tasks to be performed before, during, and after testing,
• follow the procedures in the manuals as written, • personally distribute test materials to students. (Students
are not allowed to pass materials to each other.), • verify they have all test materials before dismissing
students, and• document and notify the STC of any testing irregularities
immediately.
19Louisiana Believes
Prevention
• Every answer document and test booklet must be accounted for. The STC and backup must check that all materials are returned before students are dismissed each day.• For students with transferred answers as an
accommodation, verify that all student responses have been transferred to the scorable answer document or to online test.
20Louisiana Believes
Prevention
• Testing boxes must be kept in the locked, secure area until pickup. • The # of boxes to be shipped must be verified
against the UPS scanned # of boxes.• The signed security oaths, seating charts, and
security checklists should be collected and stored in the locked, secure area. • Do not shred or dispose of any materials until all
have been checked and after the release of scores.
21Louisiana Believes
Violations by Student
Student Oath
23Louisiana Believes
Violations of test security by a student as outlined by the Student Oath of the Test Booklet or Test Session (EOCT), shall include, but are not limited to:• giving or receiving help during the test;• copying another student’s answers or allowing another student
to copy one’s answers;• looking ahead or returning to previous test sessions;• using notes, books, or other aids, including cell phones and
other electronic devices;• causing a disturbance of any kind;• removing test materials or notes from the room; or• discussing the test questions at any time with anyone.Any suspected incident of cheating must be reported to the STC for further investigation.
Violations by Test Administrator
Oath of Security & Confidentiality Statement
25Louisiana Believes
I, [STC], affirm the following:• I was provided this District/School TCM to review on________• I participated in professional development in test security and
administration provided for this test administration on ______• I read and followed all testing procedures in accordance with those
outlines in the Spring 2014 TCM, TAM for each testing program, and all other guidelines and instructions provided by my DTC• I provided professional development on test security and
administration prior to this test administration to all individuals who have access to, monitor, or administer the test• I kept all secure materials in the locked, secure storage area before
and after testing
Oath of Security & Confidentiality Statement cont
26Louisiana Believes
• I followed security regulations for distribution and return of secure test booklets, answer documents, and supplementary secure materials• I provided a list of students approved for accommodations, with the
accommodations they are to receive, to the appropriate test administrators• I verified that all testing environments were prepared for testing,
including sufficient space between students, removal or covering of all academic content materials, and placement of Testing- Do Not Disturb signs on doors• I did not at any time copy, reproduce, record, store electronically,
discuss, or use in a manner inconsistent with test regulations all or part of any secure test booklet, answer documents, or supplementary secure materials
Oath of Security & Confidentiality Statement cont
27Louisiana Believes
• I did not prepare or administer any test items/questions from parallel, previously administered, or current forms of statewide assessments as practice tests or study guides (does not include LDOE released test items).• I verified that testing was not conducted in environments that
differ from the usual classroom environments without prior written permission from the LDOE• I reported any testing irregularities to the DTC• I was informed of the new State Board policy in Bulletin 746
regarding denial, suspension, and/or the revocation of a Louisiana Teaching, Administrator, or Ancillary Certification due to cheating.
Certificates that have been denied, suspended, and/or revoked by the State Board may not be reinstated.
Administrative Error
Process
If high-stakes tests are voided by the district due to an administrative error that results in questions regarding the security of the test or the accuracy of the test data, the LEA superintendent or the parent or legal guardian of the affected student may request (in writing) an opportunity to administer a retest to the affected student(s) prior to the next scheduled test administration.
29Louisiana Believes
Types of Administrative Errors
• Cueing students during testing or providing assistance in answering questions
• Providing study materials prior to testing that included actual test items
• Students were not provided accommodations or the appropriate accommodations.
• Test administrator read aloud the Reading and Responding session to students with the accommodation Tests Read Aloud.
• Students were not provided a Mathematics Reference Sheet or calculator. 30
Louisiana Believes
31Louisiana Believes
Retests
Retests available for students at the expense of the LEA ($350 per test) prior to next scheduled testing administration.• LEAP grades 4 and 8, ELA and Mathematics• GEE and LAA 2 grades 10 and 11• EOC tests
Scores from the administrative error retests may be used only at the student level – not for school accountability.
ProceduresIf LDOE determines that the retest is allowable, the original test will be voided by LDOE.
LEA must provide a description of what occurred, a corrective plan of action, and acknowledgement of fee for retest.
A score memo will be produced with student’s scores.
Retest scores will not be included in reporting, including accountability.
32Louisiana Believes
Violations of Test Security
DetectionDuring scoring, the testing company/LDOE detect testing irregularities (e.g., plagiarism, excessive wrong-to-right erasures). Other analysis may detect unusual gains in scores and unusually similar patterns in responses.
Erasure Analysis• Students whose wrong-to-right erasures exceed the state
average by more than 4 standard deviations are identified for further investigation.
Unauthorized access to electronic devices• Common responses discovered in same format and language. • In some cases, sources outside of the test session were
referenced directly.34
Louisiana Believes
Reporting of Irregularities (R.S. 17:81.6)
Allows public school employees to report irregularities or improprieties in the administration of standardized tests directly to LDOE who then investigate the allegations
Misdemeanor offenses:• Obstructing reporting• Retaliating against an employee who participates in an
investigation or reports an irregularity• Submitting a false report
35Louisiana Believes
36Louisiana Believes
Electronic Devices
State policy –Bulletin 118, Chapter 3 • §316. Cell phones and Other Electronic Devices
A. If district and school policy allows for students and personnel to carry cell phones or other similar technological devices with imaging or text-messaging capability, test administrators must make certain that the devices are in the off position while test booklets and answers documents are in the vicinity.
37Louisiana Believes
Online Assessments
Online Assessment Environment• At least two people in the room at all times.• All written materials must be collected and shredded.• STC must check each testing room for best placement of
students within the testing environment. • Partitions obstructing monitor screen from view• Recommended: seating chart
State Monitoring
Monitor’s Role• Observing testing• Documenting observations• Notifying LDOE of issues requiring immediate attention
NOT Monitor’s Role• Assisting in testing, including supervision of students or materials• Answering questions regarding testing• Providing immediate feedback to schools
Monitoring forms are posted on the LDOE website prior to testing.
38Louisiana Believes
ACT Test Security Reminders
39Louisiana Believes
ACT Cell Phone PolicyIf they find a student brought a timer, cell phone, media player, or any other electronic device into the test room, or it was used during a break, the student will be dismissed, the device may be confiscated, and the answer document will not be scored.
Monitors for ACT Testing• Only ACT observers or LDOE monitors with an ACT
authorization letter are allowed to monitor ACT testing.
ACCOMMODATIONS
41Louisiana Believes
TAMsRefer to the Test Administrator Manual (TAM) by test program for detailed guidance on test security and administration to ensure procedures for proper administration of accommodations including, • Braille• Large Print• Answered Recorded• Assistive Technology• Extended Time• Communication Assistance • Transferred Answers• Individual/Small Group Administration• Tests Read Aloud• Other
42Louisiana Believes
Key Features • DTCs refer to the Key Dates for ordering additional
materials, including accommodated forms such as Braille, Large Print, and Communication Assistance Scripts• Small group limit up to 8 students• Documenting accommodations in SER• Emergency IAPs • Text-to-Speech accommodated forms orders
LEAs using Kurzweil text-to-speech will receive detailed guidance from Office of Assessments on procedures for ordering additional materials
43Louisiana Believes
Extended Time
• All students, including those with the accommodation Extended Time, must complete the ELA Writing Session on the same day it is administered.
44Louisiana Believes
Tests Read Aloud
• Students receiving the Test Read Aloud accommodation must have been provided it in classroom assessment. The students must be tested individually or in a small group. These students should have the tests read aloud with the exception of the Reading and Responding session of the ELA, which cannot be read aloud. TAs must not read aloud the passages, introductions, items/questions, or answer options on this session of the test; however, the directions of the session should be read aloud.
• The tests must be read aloud exactly as written. When reading, the TA must exercise caution to avoid providing signs of cues that convey answers or to read aloud the Reading and Responding session, which results in an invalid score.
45
Assessment Accommodations
http://www.louisianabelieves.com/resources/library/assessment
FAQs
46Louisiana Believes
If a student has a calculator, can they use it for the parts of the test that do not allow calculator for other students?• Yes. Not providing it is considered an administrative error.
What should we do if a student refuses accommodations during testing?• Stop testing. Notify parent of situation. If decision is for
the student to continue without accommodations, have student and parent/guardian sign form indicating the decision.
FAQs
47Louisiana Believes
What should we do if we discover the day of testing that the student has not received his accommodations?
Notify the STC and DTC immediately and document as a testing irregularity. • If the student can be brought in THAT same day prior to having the
opportunity to discuss the test items, the student can return to those items with the accommodations.
• If the student has left for the day or there has been discussion of items, the student cannot return to the items and it is considered an administrative error.
FAQs
48Louisiana Believes
What if an EOC tester with Tests Read Aloud or Large Print notifies the test administrator after he starts testing that he doesn’t have those accommodations?
Stop testing, notify the STC and DTC immediately, and document as a testing irregularity. • Follow the detailed procedures in the EOC administration manual on how to
handle these situations.
Helpful Links
50Louisiana Believes
Assessment Resources• Non-secure access for resources and materials • Secure access- student information • District and school test coordinators signed Security Agreement,
in accordance with FERPA regulations and updated annually
DRC eDirect
https://la.drcedirect.com
52
Louisiana EOC
https://www.louisianaeoc.org
53
ACT Test Series
http://www.act.org/aap/louisiana/act
54
Pearson Access(Spring 2014 Field Test)
http://www.pearsonaccess.com/cs/Satellite?pagename=Pearson/QuickLink/pc
Webinar Archives
www.louisianabelieves.com/resources/library/assessment
LDOE Weekly Newsletter Archives
Screenshot
www.louisianabelieves.com/newsroom/newsletters