S OUTH C AROLINA ELDA S PRING 2014 P RETEST W ORKSHOP FOR O NLINE AND P APER / PENCIL T ESTING This...

SOUTH CAROLINA ELDA SPRING 2014

PRETEST WORKSHOP FORONLINE AND

PAPER/PENCIL TESTING

This presentation is available on eDIRECT: under Documents/Presentations, ELDA Spring 2014.

WEBEX HOUSEKEEPING

2

Participant phone lines will be muted. Use the “raise hand” or “chat” features to ask questions during the presentation.

“Question and answer” sessions will be held throughout the workshop and at the end of the presentation.

TAM and DTC Supplement references are located in the bottom-left corner of applicable slides.

CONTACTING DRC

3

Direct Line: 1-800-451-7834

For technical questions related to online testing, STCs, TAs, or Technical Coordinators may contact DRC, with the DTC’s approval.

Fax: 1-866-237-9314

E-mail: [email protected]

eDIRECT: https://sc.drcedirect.com/

mailto:[email protected]

https://sc.drcedirect.com/

SPRING 2014 KEY DATES

4

January 7 K-2 and 3-12 Test Administration Manuals arrived in districts. DTC Supplement was posted to eDIRECT.

January 21 & 22 Pretest Workshops

January 23 Technology Coordinator Training

January 29 Online Tools Training (OTT), Tutorial, and installation software available via eDIRECT.

February 3 Secure materials arrive in districts.

February 3 Test Setup available via eDIRECT.

February 10 Precode Labels and Single Document Labels arrive in districts.

February 17–April 11 Testing Window

March 31–April 18 Return materials to DRC.

May 30 ISRs, data files, and reports posted to eDIRECT.

June 10 ISRs and student labels arrive in districts.

Note: Data cannot be altered due to district coding errors.

NEW FOR ELDA SPRING 2014

5

All public school LEP students who are in attendance for any part of the ELDA testing window must participate in the assessment.

All students in grades K–12 who are determined to be limited English proficient (LEP) must be tested. This includes those students whose parents have waived direct ESOL services.

Student Participation

Online Testing Browser-based system Same software as EOCEP fall/winter – new version. Regular and Oral Administration (HVA) software available via

one installer. A new version of the Local Caching Service (LCS) is now part

of the Testing Site Manager (TSM). Human Voice Audio (HVA) for test directions, where

applicable.

6


Online Testing New online accommodations available:

Large-Print Large-Print + Oral Administration (Writing only) Loose-Leaf Loose-Leaf + Oral Administration (Writing only) Oral Administration (Writing only) Sign Language Test Booklet (Writing only)

All students will be loaded into test setup with accommodations that were designated in the January precode file.

Rosters have been updated to show accommodations and sign out/sign in fields.

Test tickets have been updated to show accommodations.7


Online Testing Speaking test has been updated to include pictures and audio.

Students will see the pictures and hear the audio first. TAs may use scoring sheets to mark down the students’ inventory scores. Response screens will be shown after the pictures and audio where TAs can enter the inventory scores.

ELA teachers will not be loaded into test setup. Test invalidation available by subject.

If a student tests in one mode and the subject is invalidated, that subject will be considered invalidated, even if the student tests the same subject in the other mode. It is a security violation to administer the same test twice to a student.

Character count increased for constructed-response items. Online test directions are in the 3-12 Test Administration

Manual.

8


Paper/Pencil Testing Online Testing Test Administration Manual has been

combined with the K-2 and 3-12 Test Administration Manuals.

Sign language ASL DVDs are available for Writing, Listening, and Speaking.

Test invalidation bubble by subject has been added to answer documents.If a student tests in one mode and the subject is

invalidated, that subject will be considered invalidated, even if the student tests the same subject in the other mode. It is a security violation to administer the same test twice to a student. 9


Paper/Pencil Testing Students that are designated in the January Precode File

as an online tester in all four subjects, will not receive precode labels.

Return envelopes will be provided for security checklists, online testing rosters, and scoring sheets.

UPS labels will have a tear-off tab that lists the tracking number. ESC430 is DRC’s internal number for ELDA.

10


RESOURCES AVAILABLE

11

K-2 and 3-12 Test Administration

Manuals (January 7)

DTC Supplement

(January 7)

INSIGHT Technology User Guide

(January 29)

Electronic Security Checklists and Packing Lists (February 3)

STC/TA Training Tool

(January 24)

Listed below are documents and posting dates. They will be posted to either eDIRECT, the SCDE Web site, or both.

TEST ADMINISTRATION

12

Paper/pencil and online testing administration directions for grades 3-12 are in the 3-12 Test Administration Manual.

Grades K-2 are administration directions are in the K-2 Test Administration Manual.

Kindergarten and grades 1-2 inventories (Teacher Support Materials in K-2 Test Administration Manual).

Kindergarten and grades 1-2 Exemplar Guides are posted on the SCDE ELDA site.

TEST ADMINISTRATION TIME REQUIREMENTS

(APPROX.)

13

3-12 TAM pgs. 49-98

Cluster Reading Writing Listening Speaking*3-5 45 min. 1-3 hrs. 45 min.-1 hr. 20 -25 min.6-8 45 min. 1-3 hrs. 45 min.-1 hr. 20 -25 min.9-12 45 min. 1-3 hrs. 45 min.-1 hr. 20 -25 min.

• Recommend giving the speaking test last.

• Please allow 10-15 minutes to prepare for test administration prior to beginning the assessment.

KINDERGARTEN AND GRADES 1-2

INVENTORIES

14

Example

A “0” means the student did not meet the requirements of the inventory.

MATCHING RULES

15

An all or nothing match will be made to the student using the following criteria:

1. District Code (SIDN)2. School Code (SIDN)3. Student ID Number (PS#)4. Grade5. Student Last Name6. Student First Name

All fields must be identical and not blank for a match to occur.

Please note that online testing is optional. Students can be tested with a combination of online testing and paper/pencil.

Students’ online and paper/pencil records will be matched as follows:

QUESTIONS

16

ONLINE TESTING

17

Jan. 29: Online Tools Training (OTT)TutorialSoftware InstallersINSIGHT Technology User Guide

Feb. 3: Test Setup, including permissions, available

TRAINING & SUPPORT

Tutorial (with audio) Guides test administrators and students through the

testing experience including testing tools and navigation.

Available via eDIRECT (login not required). Link also downloads with test engine installer.

May be used in a large-group session.

18

TRAINING & SUPPORT, CONT.

Online Tools Training (OTT) Opportunity for test administrators and students to become

familiar with online testing tools. Review as many times as desired. Practice test items should not be considered representative of

an actual test; correct answers and scores not available. Available via computer desktop (once software installed). Oral administration (HVA) OTT available for Listening.

When audio is playing (stop/starting points/pause): When audio is not playing (stop/starting points/play): Must use a Testing Site Manager (a new version of the LCS is part of

the TSM) in order to access OTT with HVA.19

PREPARING FOR ONLINE TESTING Read the Test Administration Manuals and INSIGHT

Technology User Guide.

Download software and prepare workstations. Check audio for Oral Administration (if applicable).

Schedule sessions for students and test administrators to view the Tutorial.

Schedule sessions for students to use the Online Tools Training (OTT).

20

PREPARING FOR ONLINE TESTING Access Test Setup via eDIRECT

Provide necessary permissions to STCs and TAs. SC Project Team will send list of permissions assigned to

DTCs on February 3. Ensure all students testing online are in a Test Session.

Add students as needed. Update student demographics and accommodations as

applicable.

Print Student Test Tickets and Test Ticket Rosters.

21

ONLINE TESTING INFORMATION

22

Grades Form Subject(s) NotesK

1-2A Reading

Writing Listening Speaking

• 0-3 point inventory scores for all subjects will be entered by Test Administrators into INSIGHT using each student’s test ticket.

• Test Administrators will be able to select a subject and enter inventories for a student multiple times using the same test ticket by clicking Pause and Exit the test.

• If the Test Administrator has successfully completed all subjects of the inventory for the student, click the Review/End Test button to submit the test.


23

Grades Form Subject(s) Notes

3-56-8

9-12

A Reading Writing

• Writing test has multiple-choice, constructed-response (CR) and extended-response (ER) items. Students will type CR/ER responses in text boxes.

• Reading test consists of multiple-choice items only.• INSIGHT allows students with the appropriate IEP

accommodation to take different parts of a single subject over multiple days; select Pause and then Exit to prevent the test from locking. Students begin the next part of the test the following day by logging into the test using the same test ticket. If a student has completed part of the test, the student cannot go back to access the test for that subject again.

• Once the student has successfully completed all parts of the test, students must submit their tests by clicking Review/End Test.


24


3-56-8

9-12

A Listening • The Listening test consists of multiple-choice items only.

• Each item has a corresponding (human voice) audio file; the use of headphones and a Testing Site Manager (the LCS is part of the TSM) is mandatory to use this feature.

• The computer volume should be set at 60% or above when testing.

• Once a student has completed a part of the Listening test, the student cannot go back to access the test for that subject again.


25


3-56-8

9-12

A Speaking • This inventory is administered one-on-one teacher to student. All students will see pictures and hear (human voice) audio and answer questions.

• The Testing Service Manager (TSM) is mandatory to use this feature. The LCS is part of the TSM. Headphones are not needed for this inventory.

• The 0-2 point scores will be entered by Test Administrators into INSIGHT using each student’s test ticket. TAs may use Scoring Sheets to record student scores.

• Scores can be entered into INSIGHT for students multiple times using the same ticket by clicking Pause and exiting the test.

• Test Administrators must submit the test by clicking Review/End Test once all scores have been entered.

PRECODE

26

All student records from the January precode file will be loaded into eDIRECT as online testers. Students are automatically assigned to a test session with

designated accommodations. It is not necessary to update demographic information in

eDIRECT; updates from the March precode file will be applied after testing is completed.

PRECODE

One Test Session per grade cluster (K, 1-2, 3-5, 6-8, 9-12) will be created for each school. Tests will be set as modules under one content area–“ELA”; one module per subject (Reading, Writing, Listening, and Speaking). • Modules are defined as: Module 1 = Reading; Module 2 =

Writing; Module 3 = Listening; Module 4 = Speaking.

A generic teacher name Sample Teacher will be assigned to each test session. Districts and schools will have the opportunity to modify

the teacher name, as appropriate, or add a new teacher. ELA teacher names from the precode file will not be

loaded into eDIRECT. 27

ONLINE ACCOMMODATIONS

28

Online Accommodation FeaturesOral Administration (Writing Only)

• Human Voice Audio (HVA) for directions, items, and passages.• Schools must provide headphones.

Loose-Leaf • Students may test online.

Loose-Leaf + Oral Administration (Writing Only)

• Same features as Oral Administration above, but students also have loose-leaf accommodation.

• Schools must provide headphones.

Large-Print • Fully scalable, so students can view items in a larger format by testing on a workstation with a larger monitor.

• Text and graphics approximately 30% larger than regular test booklet. This would also depend on the size of monitor and screen resolution being used.

• An online test-taker would receive same scaling of items using a 20 inch monitor as a 15 inch monitor.

Large-Print + Oral Administration (Writing only)

• Same features as Oral Administration, but students also have large-print accommodation.

• Schools must provide headphones.

Sign Language Test (Writing only)

• Available for students testing sign language.

TEST SETUP

Available via eDIRECT on February 3 User accounts must have the appropriate permissions.

Used for the following functions: Manage Test Sessions Access and modify student demographic data Print Test Ticket Rosters Print Student Test Tickets

One Test Ticket for each student to access all subjects (same as in spring 2013).

Monitor Testing29

TEST SETUP – PERMISSIONS

30

Permission: Allows Users To: Online Testing – Secured Resources Allows user to access online testing software.

Students – Add/Edit Add/edit students and student data for the purposes of testing online.

Students – Download Students Download a list of student information for all students in a school.

Students – Search/View Search/view student data and download search results.Teachers – Add/Edit Add/edit teachers who have students testing online.Teachers – Search/View Search/view teacher data and download search results.Test Session – Add/Edit Add, edit, and delete test sessions.Test Session – Search/View Search/view test sessions and download search results.Test Session – Status Summary View testing status summary information.Test Setup – View Student Status View Student status.Test Tickets – View/Print Allows user to print student test tickets and view

individual ticket statuses.Test Tickets – View Questions Attempted

Allows user to see questions attempted against total number of questions.

DRC will assign permissions to DTCs on February 3. DTCs will then assign permissions to STCs and TAs.

TEST SETUP – TICKETS Student Test Tickets with login information are

generated automatically; contain all information needed to begin test.

STC or TA prints tickets and rosters prior to testing session.

TAs verify that each student has the correct ticket. Only one ticket is needed per student to access all subjects.

Tests are activated once a student logs in with username and password provided on ticket.

Please note it is not acceptable to use a student test ticket to test that the software is working. OTT logins should be used.

31

TEST SETUP – TICKETS Student Test Tickets are secure; must be distributed,

collected and accounted for, and securely destroyed following testing.

Tips for helping with login issues: Stagger logins

User IDs and passwords will not work if there is insufficient bandwidth to authenticate the test ticket.

32

TEST SETUP – TICKETS & ROSTERS

33

Rosters and Test Tickets can be printed beginning February 3.One Test Ticket will be used for all subjects for each student.

REGENERATING A TEST If a student’s online accommodation is changed, test must be

regenerated to ensure the correct test form is assigned: Oral Administration (Writing only) Loose-Leaf Loose-Leaf + Oral Administration (Writing only) Large-Print Large-Print + Oral Administration (Writing only) Sign Language Test Booklet (Writing only)

Regenerate permission will be available to DTCs from February 3-14.

Contact the SC Project Team before student tests, if change is made after February 14. 34

PAUSE FUNCTIONALITY

35

Allows TAs to re-enter a test multiple times without the need to reset the student’s test ticket (Pause, then Exit).

Allows students with IEPs, who have an accommodation to complete different parts of a single subject over multiple days, to log in and resume testing the next day without having to unlock the test ticket (Pause, then Exit).

Allows students who need to leave the computer lab/classroom for a short break (e.g., restroom break, office visit, fire drill, etc.) to continue their test (Pause, then Resume).

If a student submits a test by mistake, contact the SC Project Team to have the student’s test unlocked.

PREPARING FOR TESTS WITH AUDIO

Prior to testing: Use of the Testing Site Manager (the LCS is part of the

TSM) is required for Listening and Speaking tests and oral administration of the Writing test.

Ensure the audio works by completing a System Readiness Check on each student workstation: Start – Programs – SC Online Assessments – System

Readiness Check Ensure headphones are available for each student. Adjust the volume on each machine so that it is at a

comfortable level for students.36

PREPARING FOR TESTS WITH AUDIO

During testing: When a student logs on, the student should see these

audio buttons on the Welcome Student screen: A human voice will be heard for the directions and test

items. If a student needs to adjust the volume during testing

they should click the Options button on the test screen and select Audio Settings.

37

QUESTIONS

38

PAPER-AND-PENCIL TESTING

39

Record ANY missing materials

Note on security checklist Fax or email discrepancies to DRC

Verify materials receivedPacking lists Security ranges to security

checklists

Retain Original Shipping BoxesDistrict Boxes: White School Boxes: Brown

INVENTORY MATERIALS

40

3-12 TAM pg. 33-34

ADDITIONAL MATERIALS

41

DTCS pg. 3

Districts will order additional materials via eDIRECT beginning on January 8. Districts will not be charged for additional materials.

Consider whether any materials—Oral Administration Scripts Audio CDs, and DVDs —can be reused before ordering additional materials.

Use the Intra-district Transfer Form to transfer materials between schools in your district.

Orders received before 4:00 p.m. Eastern time will be processed on the same day and shipped via 3-day ground delivery.

SECURITY CHECKLISTS

42

3-12 TAM pgs. 10-11

Security Checklists are used to track and monitor the distribution and receipt of secure materials.

Security Checklists contain spaces to:• Sign out and sign in materials to STCs and TAs.• Indicate the date materials were packaged for return.• Record notes (to indicate if materials were damaged,

destroyed, etc.).

FORM A TEST MATERIALS

43

For grades 3-5, 6-8, and 9-12, students mark answers for all questions in answer documents.• Test booklet and answer document security numbers do not need

to correspond. • Students may mark or write in the test booklets, but final answers

must be marked or written in the answer document.• Test booklets and answer documents are secure.

For kindergarten and grades 1-2, teachers mark answers for all questions in the scannable inventory booklet.

Loose Leaf• Printed on single-sided paper with one test item per page• Reading/Writing and Listening/Speaking Test Packs

Large-Print• Enlarged version (130%) of the regular test booklet and is

designed for students who have difficulty reading text in a standard format.

• Reading/Writing and Listening/Speaking Test Packs

For both large-print and loose-leaf, students must record answers in an answer document or the TA must transcribe.Answer documents are not included in test packets.


44

3-12 TAM pg. C-10

Audio CDs• Produced for listening and speaking grade clusters 3-5, 6-8,

and 9-12.

Oral Administration Script (Writing)

• TAs may read scripted directions, item stimuli, questions, and answer options. All materials should be read directly as it is printed in the TAM and script. Use when an oral administration is specified in a student’s IEP.

Speaking Scoring Guide

• Used to score the speaking portion of the test for grade clusters 3-5, 6-8, and 9-12.


45

3-12 TAM pgs. 16, 49-52, 55, C-6-C-7, C-23, 70

FORM C TEST MATERIALS

46

3-12 TAM pg. C-9

Braille (Reading/Writing)• For students who are blind or visually-impaired.

Available for the reading and writing tests. • Braille package includes:

• Braille test booklet• Print version test booklet• Braille TA notes

• TAs transcribe answers into the student’s answer document.

Sign Language Test Booklet (Writing)

• For students who are deaf of hard of hearing.• Students must record answers in an answer document

or the TA must transcribe.

Signed Administration Scripts (Listening/Speaking)

• For students who are deaf or hard of hearing.• Use with Listening/Speaking Test Booklet and audio CDs

when IEP specifies signed administration.


47

3-12 TAM pgs. C-21

Sign Language TA Notes (Reading/Writing)

Sign Language ASL DVDs (Writing, Listening and Speaking)


48

3-12 TAM pgs. C-8

• For students who are deaf of hard of hearing.

• For students who are deaf of hard of hearing.• To be used to supplement the Reading/Writing test booklet.• Signed Administration TA Notes are secure.

ANSWER DOCUMENTS

49

3-12 TAM pgs. 21-25, A-3-A-4

Apply a precode label or single document label to the answer document (3-5, 6-8, 9-12) before distributing to students.

Apply a precode label or single document label to the kindergarten and grades 1-2 inventory booklets before administering the inventories.

ANSWER DOCUMENTS

50

3-12 TAM pgs. 21-25, A-3-A-4

Answer documents and inventory booklets that are not labeled properly will NOT be scored.

• Precode label• Single document label• Home school single document label

Districts will be responsible for paying the fee for scoring any improperly returned answer documents.

PRECODE LABELS

51

3-12 TAM pgs. 21-25, A-3-A-4

SINGLE DOCUMENT LABELS

52

3-12 TAM pgs. 21-25, A-3-A-4

For students who do not have a precode label or received one with incorrect information.• White – 10 labels per sheet

Handcoding is required on the cover and page 2 of the answer document.• Home school version (DTC use only)

SINGLE DOCUMENT LABELS

53

3-12 TAM pgs. 21-25, A-3-A-4

Single Document Label

Home School Single Document Label

Apply to used answer documents that DRC should NOT score.

DO NOT SCORE LABELS

54

3-12 TAM pg. A-4

Unused overage answer documents do NOT require a label.

CODING ANSWER DOCUMENTS

PRECODE LABELS

55

3-12 TAM pgs. 21-25

Hand-coding is optional, but recommended.

Precode label goes here.

Hand-codingoptional, but recommended.


PRECODE LABELS

56

3-12 TAM pgs. 21-25

Coding the TA Initials is required.

Must be hand-coded, if applicable.


NON-PRECODED

57

3-12 TAM pgs. 21-25, A-3-A-4

Hand-coding is mandatory.

Single document label goes here.

Hand-codingoptional, but recommended.


NON-PRECODED

58

3-12 TAM pgs. 21-25, A-3-A-4

Coding the TA Initials is required.

Hand-coding is mandatory (O, P, Q, R, S, and T only if applicable.

Verify every answer document or inventory booklet to be scored is identified with a precode or single document label.

Place a Do Not Score label on any used answer document or inventory booklet that should not be scored.

Check answer document/inventory booklet coding.

STC RETURN PROCEDURES

59

3-12 TAM pgs. 33-36, 39

STC RETURN PROCEDURES

60

3-12 TAM pgs. 33-36, 39

Return all secure materials, which include:• Customized materials• Speaking Scoring Guides• Listening and speaking CDs• Test booklets• Answer documents/inventory booklets

Grades and subjects may be mixed within

boxes (along with customized booklets).

Scorable and non-scorable materials can be returned in same

boxes.

Return home school materials to DTC

separately (if applicable).

DTC RETURN PROCEDURES

61

Return materials March

31–April 18.

Contact UPS to schedule pick-up by April 15.

Apply UPS return shipping

label(s)

Apply DRC return shipping

label(s)

Return materials from every school

RETURN SHIPPING LABELS

62

DTCS pg. 5

District Return Shipping Label

School Return Shipping Label

Place test materials in the DRC box.

PACKAGING PROCEDURES

63

3-12 TAM pgs. 35-36; DTCS pgs. 7-8

Fill any empty space in the box(es) with crumpled paper or bubble wrap ensuring that testing material does not shift during transit. Make sure you fill voids to the top

of the box.


64

3-12 TAM pgs. 35-36; DTCS pgs. 7-8

Fold the outer flaps (with old shipping labels) in, exposing the A and B flaps.


65

3-12 TAM pgs. 35-36; DTCS pgs. 7-8

Place the colored DRC label on Flap A.

Place UPS ground label on Flap B.


66

3-12 TAM pgs. 35-36; DTCS pgs. 7-8

Tape boxes securely using three pieces of packaging tape on BOTH the top and

bottom.

Overlap the tape, and make sure it wraps around the sides at least two

inches.


67

3-12 TAM pgs. 35-36; DTCS pgs. 7-8

QUESTIONS

68

CONTACTING DRC

69

Direct Line: 1-800-451-7834

For any technical questions related to online testing, STCs, TAs, or technical coordinators may contact DRC, with the DTC’s approval.

Fax: 1-866-237-9314

Email: [email protected]

eDIRECT: https://sc.drcedirect.com/

mailto:[email protected]

https://sc.drcedirect.com/

70

THANK YOU FOR ATTENDING!

S OUTH C AROLINA ELDA S PRING 2014 P RETEST W ORKSHOP FOR O NLINE AND P APER / PENCIL T ESTING This...

Documents

Transcript of S OUTH C AROLINA ELDA S PRING 2014 P RETEST W ORKSHOP FOR O NLINE AND P APER / PENCIL T ESTING This...