AzMERIT Pre-Test Training

Spring 2015

1

INTRODUCTIONS

Arizona Department of Education (ADE)American Institutes for Research (AIR)Measurement Incorporated (MI)

2

AZMERIT OVERVIEW

Testing: Who & WhenRoles & ResponsibilitiesThe AzMERIT Portal

3

• Students to be tested– Grades 3 – 8

• English Language Arts• Mathematics

– Students enrolled in high school courses:• English Language Arts Grades 9 – 11• Mathematics

– Algebra I, Geometry, Algebra II

CBT/PBT

4

Computer-Based Testing Window Paper-Based Testing Window

March 30, 2015–May 8, 2015*Writing must be completed by April 24 April 13, 2015–April 24, 2015

CBT/PBT

5

– Correct administration of testing, assumes ultimate responsibility

– Train all Test Administrators and Proctors

– Receive and inventory materials

– Test Security Agreements

– Arrange for equipment and materials necessary for testing

– Schedule testing activities

– Monitor testing activities6

CBT/PBT

District Test Coordinator Responsibilities

– Manage users and student data – Include Large Print or Braille test booklets in

order

7

CBT/PBT

Additional District Test Coordinator Responsibilities

• District Test Coordinator Important Tasks Checklist– 12 Important Tasks

• For both CBT and PBT • From today to May 8th

8

CBT/PBT

THE AZMERIT PORTAL

AzMERIT PortalSecure BrowserTechnology Information

9

10

TASK 1 CBT/PBT

http://azmeritportal.org/

11

CBT/PBT

• To access Technology Resources, click on the Technology Resources icon on the portal home page

• Then click on the Technology Resources icon on the Technology Resources page

12

CBT

13

CBT/PBT

14

CBT

• Secure Browsers– Provides secure student access to the Test Delivery

System– Must be installed on all student testing machines

15

CBT

Detailed installation instructions can be found in the Secure Browser Installation Manual on the AzMERIT Portal

16

TASK 2 CBT

AIR SYSTEMS OVERVIEW

• Test Information Distribution Engine (TIDE) Overivew• Test Delivery System (TDS) Overview• Online Reporting System (ORS) Overview

17

District Test Coordinator

District Administrator

School Teacher Test Administrator

School Test Coordinator

18

CBT/PBT

User Roles

19

Task* DTC DA STC ST TA

Working with Student Information (coming soon)

Administer Computer-Based Tests Managing Users

Retrieving User Accounts

Adding User Accounts

Adding, Editing, or Deleting Users through File Uploads

Viewing and Editing User Details

Deleting User Accounts

Working with Test Improprieties (coming soon)

Working with Orders for Test Materials (coming soon)

Working with Rosters of Students (coming soon)

Voice Packs (coming soon)

Contact and Shipping Information

Reviewing Contact and Shipping Information * DTC—District Test Coordinator; DA—District Administrator; STC—School Test Coordinator; ST—School Teacher, TA—Test Administrator

CBT/PBT

20

CBT/PBT

TIDE OVERVIEWTest Information Distribution Engine (TIDE)

21

• TIDE is used to:– Manage user accounts– View/manage student data– Indicate CBT accommodation and test setting

information– Manage orders for paper test materials– Print On-Demand student ID labels

22

CBT/PBT

TDS OVERVIEWTest Delivery System (TDS)

23

• Test Delivery System– Two Interfaces

• Test Administrator (TA) Interface• Student Interface (Secure Browser)

– Two Sites• Operational• TA Training Site/Sample Tests

24

CBT/PBT

• The TA Interface is accessible to authorized users via the Educators & Test Administrators page of the portal.

25

CBT

ORS OVERVIEWOnline Reporting System (ORS)

26

• Online Reporting System Overview

27

CBT

TIDE

• Manage Users• Student Information• Updating Student Data• Order Large Print Paper and Braille Tests

28

29

MANAGE USERS

30

• Verify your district contact information

• If changes are necessary, please contact AzMERIT@azed.gov directly

31

CBT/PBT

32

TASK 3 CBT/PBT

• Manage Users Tab– Edit users– Add one user– Upload many users

Upload Users in TIDE

Starting January 21, 2015

33

TASK 3 CBT/PBT

STUDENT INFORMATION

Verify Student Data in TIDERevise EnrollmentsLarge Print Paper and Braille Tests

34

• For CBT and PBT schools, log into TIDE to view students associated with your district and/or schools.

35

TASK 4 CBT/PBT

View Students in TIDE

Starting January 28, 2015

36

TASK 4 CBT/PBT

• Student Information Tab

37

TASK 4 CBT/PBT

38

TASK 4 CBT/PBT

UPDATING STUDENT DATA

39

• Grade 3 – 8 – Students are pulled directly from SAIS

• End of Course– Students are pulled directly from Student

Teacher Course Connection

40

CBT/PBT

Important Dates for Student Data Updates

41

CBT/PBT

Student Data File (file used for)

Deadline to Enter Data in SAIS or Student Teacher Course Connection

Date when Data is Visible in TIDE

Intermediate (used for packing test materials)

2/11/15 2/17/15

Final (used for producing Pre ID labels)

2/25/15 3/2/15

LARGE PRINT PAPERBRAILLEPAPER BASED TESTS

42

• Large Print Orders – CBT – only students who require a large print

paper or a regular paper test per IEP – PBT – all students who require a large print

paper test per IEP

43

TASK 5 CBT/PBT

• Braille Order– All students who require a Braille test per IEP – All Braille tests are paper-based tests only

44

TASK 5 CBT/PBT

Denote Special Print Versions for students in TIDE

Starting January 28, 2015

• Paper Print Orders – CBT – only students who require a paper-

based test (print paper version) per IEP

45

CBT

Denote Special Print Versions for students in TIDE

Starting January 28, 2015

PRIOR TO TESTING

• Computer-Based Testing• Paper-Based Testing• Item Types

46

District Test Coordinator Before Testing List • Complete TIDE tasks • Complete & submit all required Security Agreements• Schedule & communicate all testing activities within the

district or charter schools• Receiving test materials• Inventorying test materials upon arrival and, if needed,

ordering additional materials• Arrange for supplies for testing• Communicate questions from Test Administrators by

contacting either the AzMERIT Helpdesk or ADE. 47

CBT/PBT

– All test administrators must complete the TA Certification Course with TIDE.

– Administer AzMERIT Sample Tests to all students

– Continue to verify that all students are listed in TIDE as data is updated.

48

TASK 6 CBT

• Test Administrator Certification Course– Users must log into TIDE – TAs will receive a completion certificate

49

TASK 6 CBT

• Sample Tests will be:– Available in mid February– Available to everyone

50

TASK 6 CBT/PBT

51

CBT/PBT

• AzMERIT is a computer-based test and has the following item types: – Multiple-choice items– Multi-select items– Editing tasks– Hot text items– Grid items– Equation items– Open Response items

52

CBT/PBT

• AzMERIT Guide to the Sample Tests– How to access the Sample Tests– Overview of Sample Test features and tools– Computer-Based item types – Paper-Based item types– ELA Writing Guides– Answer Keys for all Sample Tests

53

CBT/PBT

UPLOADING STUDENTS TO TIDE

54

– Student must be manually enrolled in TIDE• For CBT

– no further action is needed

• For PBT– additional students manually added will need have to

have a print-on demand label

55

TASK 7 CBT/PBT

Upload Missing Students in TIDE

Starting March 10, 2015

RECEIVE TEST MATERIALS

MaterialsInventory MaterialsAdditional Orders

56

• CBT School Test Materials: – Test Coordinator Manual – Test Administration Directions– Large print, Braille, and/or paper version test

booklets, this includes:• Student ID labels• Return shipment materials

57

CBT

• PBT School Test Materials: – Test Coordinator Manual – Test Administration Directions– Paper test booklets

• Large Print and/or Braille test booklets– Student ID labels – Return shipment materials

58

PBT

Test Material will arrive April 6 or 7, 2015.• Boxes are from Measurement Inc.

– Braille and Large Print and Pre-ID labels will be in a separate shipment

CBT/PBT

• Shipments packaged by District and School • District Box(es)

– All white boxes – Contains overage materials– Test Coordinator Kit

• Test Coordinator Manual• Materials for returning shipments

– Packing Documents• District Receipt Form• District Packing List • Individual School(s) Packing List• District Return Form

CBT/PBT

• School Boxes – All brown boxes– School Test Coordinator Kit

• Test Coordinator Manual• Materials for returning test booklets• Special Handling Envelopes

– Test Booklets– Test Administration Directions– Packing Documents:

• School Packing List• School Security Checklists

CBT/PBT

• Verify Shipment• Sign and return the District Packing List• Report missing or extra boxes immediately

to AzMERIT Helpdesk – 1-844-560-7812 – azmerithelpdesk@air.org

• KEEP ALL BOXES for returning test booklets to Measurement Inc.

CBT/PBT

• Inventory your entire shipment – Open all boxes

• Verify receipt of Pre-ID labels• Verify all materials received against packing list• Verify sufficient materials received for number of

students expected to test

63

TASK 9 PBT

Materials in District

April 6 – April 7, 2015

Additional Order Window• If a school needs more test materials

– Check district overage– If district overage is not sufficient place an

additional order• Only District Test Coordinator can place an

additional order• Place only 1 additional order per district

64

TASK 10 PBT

Additional Order Window in TIDE

April 6 – April 10, 2015

TEST ADMINISTRATION

65

• District Test Coordinator Responsibilities– monitoring assessment activities

• PBT Additional Responsibilities– maintaining an accurate inventory of all test

materials – checking in/out test booklets to Test

Administrators during testing

66

CBT/PBT

• Each school must maintain a copy of the test administrators list of students– For security purposes this list must be

maintained with security agreements

67

PBT

PBT

SCHEDULING

69

Grades 3 – 8Test Days

Content Area Approximate Time

Day 1 ELA – Writing 45-90 minutes

Day 2 ELA – Reading, Part 1 Mathematics, Part 1

45-75 minutes 60-85 minutes

Day 3 ELA – Reading, Part 2 Mathematics, Part 2

45-75 minutes 60-85 minutes

70

CBT/PBT

End-of-CourseTest Days

Content Area Approximate Time

English Language Arts (ELA) – End-of-Course (EOC) – Can be administered in 2 or 3 days

Day 1 ELA Writing 45-90 minutes

Day 2 ELA Reading Part 1 45-75 minutes

Day 2 or Day 3 ELA Reading Part 2 45-75 minutes

Mathematics – End-of-Course (EOC) – Can be administered in 1 or 2 days

Day 1 Mathematics Part 1 50-85 minutes

Day 1 or Day 2 Mathematics Part 2 50-85 minutes71

CBT/PBT

• Test Administration Schedules – Day 1, Day 2, and Day 3 must be scheduled in

order but do not have to be consecutive days.– Must be a break between test sessions

scheduled on the same day– AzMERIT is untimed.

• 95% of students should finish in estimated time– Test Session must be completed by the end of

the day72

CBT/PBT

Computer-Based Scheduling– Day 1 (ELA Writing)

• Must be completed by April 24 including make-up tests.

– Last day of testing must be scheduled no later than May 6.

– All make-up testing must be completed no later than May 8.

– Students within the same school are not required to test on the same day.

73

CBT

• Paper-Based Scheduling – Day 1 (ELA Writing)

• Must be scheduled April 13 or April 14– Last day of testing must be scheduled no later

than April 22– All make-up tests must be completed no later

than April 24.– Students in the same grade (gr 3-8) or taking the

same EOC test within the same school must test on the same day.

74

PBT

PREPARE FOR TESTING

75

• All students take Sample Tests (Task 6) prior to testing

• Practice answering different types of items• Practice using online tools (CBT only)

• Verify all students are registered in TIDE

76

CBT/PBT

CBT ADMINISTRATION

77

78

TASK 8 CBT

Computer-Based Testing Window

March 30, 2015–May 8, 2015*Writing must be completed by April 24

• Test Administrators will need:– the TA Interface

• Found on the AzMERIT Portal• Select Educators & Test Administrators icon

• Select the AzMERIT Test Administration icon• Log into the system

79

CBT

• The TA Interface

80

CBTs

• The TA Interface

81

CBT

PBT ADMINISTRATION

82

83

TASK 11 PBT

Paper-Based Testing Window

April 13, 2015–April 24, 2015

PBT

TEST IMPROPRIETIES

85

• Incident report

86

PBT

AFTER TEST ADMINISTRATIONReturning Test Materials to Measurement Incorporated

87

District Test Coordinators Responsibilities• Ensuring the secure disposal of scratch/graph paper• Reporting any testing improprieties to ADE• Ensuring the disposal of all the Test Administration Directions and Test

Coordinator’s Manual for both the district and schools

Additional Responsibilities for Computer-Based Testing• Monitoring test completion rates in the Plan and Manage Testing

section of the Online Reporting System

Additional Responsibilities for Paper-Based Testing• Boxing materials for return shipping as instructed in this manual• Ensuring all scorable and nonscorable test materials are prepared for

return by the scheduled retrieval date88

CBT/PBT

MATERIAL RETURNPacking and Returning Test Materials

• Return testing materials to Measurement Incorporated.– Collect and inventory all scorable and non-

scorable materials.– Follow the packing and return shipment

instructions in the Test Coordinator Manual.

90

TASK 12 PBT

First Day to Call UPS to Schedule Pick Up

Last Day for Material Pick Up from District

April 20, 2015 April 30, 2015

PBT

Scorable Packing Diagram

Non-Scorable Packing Diagram

Prepare Boxes for Shipment• Number ALL boxes in shipment 1 of X, 2 of X, etc.

– Start with used (SCORABLE) materials• Sign the District Packing List and return to MI in pre-paid

envelope from Return Kit• Place a UPS return label on each box, being sure to cover the

original shipping label• DO NOT remove or cover colored barcoded label identifying

your district/school• Contact UPS at 1-800-742-5877 or at www.ups.com 24 hours

in advance to schedule pick-up of your test materials

PBT

AZMERIT TESTING CONDITIONS, TOOLS, AND ACCOMMODATIONS GUIDANCE FOR SPRING 2015

95

American Institutes for ResearchAzMERIT Help Desk Tel 1.844.560.7812 Email: azmerithelpdesk@air.orgChat: http://azmeritportal.org/chat/

Arizona Department of EducationMary Pat WoodState Test CoordinatorAzMERIT@azed.gov

Contact Information

96

THANK YOU

97