OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE)...

59
Assessment Update SY 15-16 UPDATE #6 FEBRUARY 2, 2016 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 1

Transcript of OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE)...

Page 1: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Assessment Update

SY 15-16 UPDATE #6

FEBRUARY 2, 2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

1

Page 2: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Today’s Topics

New Item-level Reports

Connections Between Interim Assessments and the Digital Library

Spring Administration News

Professional Opportunities

Nitty-Gritty Details (TIDE, TDS, etc.)

Technology Updates

WA-AIM Update

Collections of Evidence Updates

ELPA21 Updates

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

2

Page 3: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

New Item-level Reports Now Available

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION3

Page 4: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Reports: ORS Question/Item-Level DataWhat key information is included?◦ Question/item number, general description, PT question/item

identification, points possible◦ Math – general description is cluster or assessment target◦ ELA – general description is assessment target

◦ What data is reported?◦ At the District, School, and Classroom levels – percent of students

earning 0 points, 1 point, etc.◦ At the Individual Student level – points earned on each question

2/10/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

4

Page 5: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

ORS Question/Item-Level Data: ELA Report – District ICA

2/10/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

5

Order of question/item on the interim

Target: can be assessed in

more than one question/item

Data is presented as percentages

Page 6: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

ORS Question/Item-Level Data: Math Report – School IAB

2/10/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

6

Data is presented as percentages

Cluster

Assessment target

Page 7: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

ORS Question/Item-Level Data: ELA Report – Student ICA

2/10/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

7

Order of question/item on the interim

Target: can be assessed in

more than one question/item

Data is presented as points earned

Page 8: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

ORS Question/Item-Level Data: Math Report – Student IAB

2/10/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

8

Data is presented as points earned

Cluster

Assessment target

Page 9: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

ORS Question/Item-Level Data: Possible Data Uses

Evaluate student data on groups of questions: by assessment claim, target, or by Performance Task

Use the general description of each item to identify skills for further student development

Identify groups of student with similar development needs

Identify specific areas of development needed for a student whose performance falls in the “At/Near Standard” category

Identify questions/items to explore, discuss, and clarify the intended learning via Assessment Viewing Application

2/10/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

9

Page 10: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Connections BetweenInterim Assessment Blocks and Digital Library

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION10

Page 11: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

2/10/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

11

Page 12: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

2/10/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

12

Page 13: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Spring Administrations

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION13

Page 14: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

But first: Winter Testing/Submission Reminders

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

14

EOC Retakes are paper/pencil only (TIDE). The test administration window is January 4 through February 5.

ELPA21 is online only (TIDE). The test administration window is February 2 through March 31.

WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

COE is online only (e-COE). COE submissions were due by January 27.

Page 15: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Spring Test Administration Reminders Classroom Activities (CAs) are not required. CAs continue to be available, if teachers choose to use them, for either or both interim and summative assessments.

The high school online test administration window has changed from the last seven weeks to the last 12 weeks of the district’s school year. The tests are available from March 7 through June 10.

Smarter Balanced ELA should be administered to 10th graders as it is the State’s exit exam requirement. If a student does not receive a College and Career Ready (CCR) score level of 3 or 4, s/he must take the test again in the 11th grade for accountability.

Smarter Balanced math may be administered to 10th graders (preferably only to students completing Alg 2/Int 2). While it is not yet the State’s exit exam, it may be used to fulfill the exit exam requirement. If a student does not receive a College and Career Ready (CCR) score level of 3 or 4, s/he must take the test again in the 11th grade for accountability.

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

15

Page 16: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Test Material Return To meet this reporting timeline, MI will need some materials returned earlier than anticipated. ◦ HSPE materials will need a small sampling to be returned early. This early return will include a

special Return Shipping label‒ Assessment Operations will reach out to districts within the next week for support

◦ EOC materials need a large sampling to be returned early‒Materials are required to be returned at the end of each school’s testing schedule‒Most scorable materials need to be returned to MI on or before June 10. ‒ A survey will be available soon to collect the last day schools will be administering EOC exams‒ Depending on the results from the survey, a Statistical Sampling may need to be implemented for

some schools, to identify an earlier return schedule than the communicated five working days.‒ Scorable materials for late testers (through June 10), will need to be returned by no later than June

15.◦ The need for an early return of MSP is still under discussion

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

16

Page 17: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Guidelines on Tools, Supports, & Accommodations

This guide includes information on tools, supports, and accommodations for all students taking state assessments. Some supports in this manual will differ from ELPA21 Guidelines. In such cases, the current version of the state assessment guidelines will take precedent.

What’s New?

◦ Guidelines include ELPA21 supports and accommodations ◦ Scratch paper log that is required for ELPA21

◦ Descriptions are provided for each support that are broken out by ELPA21 vs other assessments

◦ Read-Aloud, Test Reader Guidelines—English and Translation are combined

◦ Translated Mathematics Style Guide to further support test readers

◦ Scribing and Transcribing Guidelines are combined

Appendices:◦ Policies, Laws, and Practices

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

17

Page 18: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Accommodated Forms OrderingOrdering Large Print, Braille, and Translated Accommodated Forms◦ For ELPA21, HSPE, Smarter Balanced, and MSP administrations, districts will place orders for

accommodated forms through TIDE’s Additional Order (A/O) application

◦ Accommodated forms ordered through A/Os arrive in district later than the initial material arrives

◦ We understand that this delayed delivery may impact testing schedules. We are working with AIR to enhance TIDE in 2017 so that materials ship at the same time

◦ For EOC, OSPI is opening an application within WAMS to collect information on accommodations forms.

◦ This will allow EOC accommodated materials to ship with the EOC initial order test materials

◦ Detailed instructions on the WAMS application will be included in the WAW newsletter within the next week or two

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

18

Page 19: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Data and Score Releases: EDS (repeat)HSPE, SBA, and Science Off-Grade Fall Retake:

◦ Final data to OSPI February 2, Posted throughout EDS by February 5 (Friday)

◦ Reports Due in District Feb 29 and March 1

Winter EOC:

◦ All TBD, but scores must get to OSPI prior to the Spring EOC Pre-ID extract (March 4) to prevent production of Spring materials

Spring testing:

◦ Early electronic HS scores release around Memorial Day as usual

◦ Primary Goal: Make sure there is no point at which you do not have access to data (e.g., Query will be up when ORS is down)

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

19

Page 20: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Online Reporting System (ORS) –‘Preliminary’ ScoresStudent scores reported in ORS are considered preliminary, due to procedures designed to monitor human scorers during the scoring process.

To ensure score reliability and validity, scorers are monitored/verified throughout all scoring of student items. Very rarely, a scorer will submit a score that is subsequently verified and deemed inaccurate. In a few instances, the students’ scores might have been submitted through ORS, since scoring is now considered almost real time. In these instances, the score is corrected and resubmitted in ORS.

Any scorer that submits a score that is not accurate is retrained and 100% monitoring of scores submitted resumes.

OSPI releases final scores in July, including EOCs scores.

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

20

Page 21: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

WCAP-Portal Updates and LayoutWhat is New!

◦ ELPA21 User Card ◦ Addition of a Card to support materials available by assessment (Smarter Balanced, ELPA21, MSP, EOC,

HSPE)◦ Adding levels to the existing User Cards (User Guides and Manuals, General Information, and Modules)

to support filtering

Materials Being Finalized for Posting◦ Smarter Balanced Glossaries (translations)◦ HSPE TAM◦ MSP Online Tool Button Sheet◦ ELPA21 TA and Coordinator Training PPT◦ HSPE TA and Coordinator Training PPT◦ Updated Guidelines on Tools, Supports, & Accommodations (clarifying information)

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

21

Page 22: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Request to View and Score AppealsThe Request to View and Score Appeal process was implemented to make available to parents/legal guardians the opportunity to view their child’s test, as provided by the Family Educational Rights and Privacy Act (FERPA).

◦ Parent reviews are permitted for all state tests

◦ OSPI processes parent requests and works with AIR to provide the student’s tests and accompanying support documentation

◦ Guidelines are being finalized and will post to the WCAP-Portal. Information includes:

◦ Protocols for reviewing of state assessment records

◦ Supporting safeguarding of the integrity of state assessments and assuring confidentiality of students educational records

◦ Roles of the school district

◦ Requests for high school score appeals

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

22

Page 23: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Request to View and Score AppealsOnline versus Paper Pencil RequestsOSPI is now able to provide requested tests electronically rather than in a paper format. This is for tests taken online.

◦ Process for Tests Administered via Online Platform◦ AIR has created a system to deliver student’s tests online

‒ AIR will provide DCs with a secure login and passcode that will allow access to the electronic RTV system

‒ DCs will have access only to the child’s test(s) that the parent has requested to view.

◦ Paper-Pencil Process for Tests Administered ◦ For 2016 parent reviews of students taking the paper-pencil version of tests will be provided in hard copy format

◦ AIR will ship a review packet that includes a copy of the students test/response booklet

◦ Things DCs need to keep in mind◦ Parent sessions and the logistics of the location for online and/or paper-pencil reviews

◦ Security of materials and who will be designated as the point of contact within the district

◦ Return of secure materials, follow the standard return process. DC makes arrangements with the identified carrier and applies the vendor provided Return Shipping label

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

23

Page 24: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Professional Opportunities

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION24

Page 25: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Upcoming Educator Involvement OpportunitiesSmarter Balanced item writing for mathematics and English language arts, Summer 2016◦ Dates and locations to be determined

◦ Information will be disseminated via the WAW and the math and ELA email update listservs

Pilot Rangefinding for Science, Summer 2016◦ Dates and locations to be determined

◦ Information will be disseminated via the WAW and the science email update listserv

Bias and Sensitivity Reviews for Science Items, Summer 2016◦ Dates and location to be determined

◦ Contact [email protected] for further information

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

25

Page 26: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Nitty-Gritty Details

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION26

Page 27: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Extract Dates for Hard Copy MaterialsDates that data are extracted from TIDE to create labels and hard copy test booklets for paper/pencil tests -

◦ Spring EOC: March 4 (WAMS registration deadline to be adjusted to close March 1)

◦ Will reflect CEDARS and CAA/CIA data as of the end of the prior day

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

27

Page 28: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Running Start Alternate Testing RegistrationApplication to register sites open now in WAMS:

◦ Register ONLY the sessions open to ‘Guest Testers’

◦ You define whether or not a session is open to students from outside district

◦ Connect with Assessment Operations directly re: modified testing schedule

Student registration open ASAP◦ Need some sites registered before students can register

◦ Students register themselves OR district/school staff register students

◦ Community/Tech college staff willing to help with communications but not registration

Full details of status in the Jan 28 WAW

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

28

Page 29: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

A Jargon Moment: “Guest Testers”Enrolled vs Non-Enrolled“Enrolled Guest Testers” – students WITH active CEDARS records in the current school year somewhere in the state that are testing at a site other than their primary enrolled school being reported to CEDARS

◦ ALE students testing at an alternate site

◦ Homebased and private school students with AT LEAST PARTIAL FTE REPORTED TO CEDARS

◦ Running Start Students

“Non-Enrolled Guest Testers” – students WITHOUT active CEDARS records in the current school year anywhere in the state that are ONLY showing up to participate in testing

◦ Full-Time Private School or home-based student with NO FTE REPORTED TO CEDARS

◦ “Super-Seniors” not taking classes (no active enrollment) but assessing towards grad requirements

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

29

Page 30: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Guest Testers and CEDARS and TIDEEnrolled Guest Testers:

◦ Don’t use SSID Issuance move them in TIDE – they have enrollment somewhere and it should stay there.

◦ Moving these students in TIDE moves their scores to your district for accountability purposes regardless of CEDARS enrollment (and nobody wants that)

◦ Homebased/Private school FTE information (as applicable) captured in CEDARS◦ Recording through TIDE is redundant but possible

◦ Enrolled school is responsible for providing hard-copy assessment materials to test site

Non-Enrolled Guest Testers:◦ Need a record created through SSID Issuance (CEDARS) in order to test

◦ During SSID Issuance, if the student already has an SSID, that SSID should be the SSID selected◦ Essentially ‘reactivating the assessment record without enrolling the student’

◦ Homebased/Private information MUST be recorded in TIDE◦ …because that information is NOT captured in CEDARS

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

30

Page 31: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

TIDE Status: Back To Normal (by now)December 14: Change to student input layout

◦ Accurately capture paper vs online testing needs and add Grad Req Year for reporting

…And that broke the update process◦ No updates were being processed from nightly files

◦ Nobody noticed because the districts were on break and OSPI can’t do a statewide extract from TIDE

…And the fix to the update process broke the update process differently◦ AIR changed from an ‘Edit/Append’ nightly process to a ‘Full Replace’ nightly process without notifying OSPI

◦ Causing TIDE records to be dropped

By this webinar, things ought to be back to normal◦ OSPI now handling delta file creation

◦ No record deletes ever… maybe next year based on exit dates, but the priority is access

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

31

Page 32: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

TIDE Tweaks: February 5ELPA21 filter available (better late than never…)

◦ Filter by students flagged for ELPA21 to print test tickets

Test Incident Codes, L2-Basic, and Foreign/Private/Homebased for Spring Administration◦ Foreign/Private/Homebased captured at student level rather than ‘test portion’ (if not captured in

CEDARS already…)

◦ L2 Basic will be captured at the ‘subject’ level rather than ‘test portion’ in TIDE (not CEDARS… Special Ed status recorded in CEDARS)

◦ Attempt Code: no change in documentation

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

32

Page 33: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

How To Not Need Record ReconciliationLessons Learned from Last Year:

1) Fix student grade and special ed flag issues IN CEDARS PRIOR TO TESTING

2) Test scores for accountability tests come to OSPI associated with the school where the student was enrolled when they started the first portion of a test according to TIDE

◦ Move Students to new school in TIDE (via CEDARS) PRIOR TO TESTING ◦ This is true for hard-copy reports as well

3) “Enrolled Guest Testers” that have active enrollment somewhere in the state (online/ALE or any FTE anywhere) SHOULD NOT BE MOVED IN TIDE TO THE TESTING SITE

◦ Testing is ‘site free’, meaning the record needs to live in TIDE where the student is enrolled◦ This keep things synced per #2 above as well

4) Report students testing under incorrect SSID to AIR Help Desk as soon as known, prior to June 15

5) TIDE goes Read-Only on June 30.

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

33

Page 34: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

A brief history of attempt codesWA’s attempt code scheme was built for single test days mandated by the state (except HS writing)

AYP Participation was built to treat not testing as participating by ‘generating a valid score of zero’

◦ Participation is defined as generating a valid score

◦ Students earn a score by demonstrating ability

◦ Not demonstrating ability cannot generate an estimate of ability

◦ Therefore not testing is not participating

There are only 2 federally approved exemptions:◦ “Medical Exempt” – must be approved at the state level

◦ “NNEP” – CEDARS contains 1st day of school in US and LEP status

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

34

Page 35: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Attempt Codes: Rationale for changesIt no longer matters why a student doesn’t participate (unless they are exempted), just that they don’t.

“Excused Absent” is no longer relevant in a 12 week test window that includes makeup testing.

Non-Participation (Excused and Unexcused absence, Refusal) all get lumped together in all data reporting. Absence is effectively ‘tacit refusal’.

“Partially Enrolled” exemption – enters or exits during testing window – would be modified:◦ If student enrolls in the last 3 weeks of school, attempt is ‘PE’ and student is exempted based on date of

enrollment.

NNEP can be calculated (CEDARS element B32)◦ “one time exemption” so if student entered 12 months prior to the start of the testing window, the exemption

would have been used in previous year

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

35

Page 36: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Attempt Codes: What changes for the field?Most remaining attempt codes for non-tested students would be calculated by OSPI:

◦ “Partially Enrolled” exemption – enters or exits during testing window – would be modified:

◦ If student enrolls in the last 3 weeks of school, attempt is ‘PE’ and student is exempted based on date of enrollment.

◦ NNEP can be calculated (CEDARS element B32)

◦ “one time exemption” so if student entered 12 months prior to the start of the testing window, the exemption would have been used in previous year

Medical Exemption is the ONLY attempt code requiring special handling

◦ Process is the same – still reported to Assessment Operations for approval

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

36

Page 37: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

CAA/CIA Database – Link on SSID Only!In CAA/CIA database, scores are currently linked to student by SSID, full last name, and first five characters of first name

◦ Practice dates back to a time when SSIDs were of poorer quality (many were shared; students had multiple).

◦ Pro: prevents ‘false positives’ when wrong SSID was bubbled on booklet or SSIDs are shared

◦ Con: link is broken with every name change

Change planned for roll-over to 2016-17 CEDARS data◦ New online test and printable label eliminates poor booklet bubbling as an issue

◦ SSID quality in CEDARS is greatly improved since database was developed… 10 years ago…

◦ BUT we don’t want to fiddle with it during spring grad cycle in case we break something

◦ SSID Merges will automatically relink data in grad database

◦ SSID Splits will generate alerts for Assessment Analysts to manually link scores

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

37

Page 38: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

CAA/CIA Database – Link on SSID Only!What will be different as a result:

◦ Districts will need to track ‘false positives’ more closely – both students who share SSIDs will show best scores earned by either student until the SSID is split.

◦ Scores will ‘disappear’ in grad database almost never

◦ Cleaner links to grad alternatives data

◦ Much less paperwork for you and us and our temperamental fax machine (we prefer SFTP anyway)

What doesn’t change:◦ If student tests with wrong SSID and that is not caught prior to TIDE closing for Spring for early correction, still

needs to be manually reported to OSPI for correction downstream

◦ Still only HS scores in grad database are impacted

◦ CAA/CIA Database is still the only place where ‘downstream links’ can be made to correct for SSID changes◦ CEDARS assessments tab, LEP application, WA Query unaffected. Maybe someday… no promises

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

38

Page 39: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Handy Operational Documents: getting students to TIDE from CEDARSSSID Issuance process updated (for CEDARS admins): http://www.k12.wa.us/CEDARS/TrainingMaterials/SSIDUserGuideandPolicy.pdf

Data Flow from TIDE to CEDARS (for CEDARS admins and DACs): http://wa.portal.airast.org/wp-content/uploads/TIDE-Student-Records-Pull-Logic-Update.docx

Pre-ID Details (for DACs): http://wa.portal.airast.org/wp-content/uploads/ PreIDdetailsSpring2016_LCS.pdf (2015 doc still posted as of 11/16; update for 2016 available at link once posted)

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

39

Page 40: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Technology Updates

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION40

Page 41: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Updated Secure Browser for iOS AvailableLink to App Store on WCAP Portal at http://wa.portal.airast.org/browsers/

This new version of the iOS Secure App (3.2) MUST be downloaded for ELPA21 and Smarter Balanced Assessments, if you have not already done so last week.

Note that iOS 9.0 and 9.1 for iPad will NOT be supported for either operational ELPA21 or Smarter Balanced Assessments.

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

41

Page 42: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

MacOS X Secure Browser 8.1 is AvailableDownload from WCAP Portal at http://wa.portal.airast.org/browsers/

All Mac OS X 10.11 (El Capitan) users should download and replace the previous version (8.0) prior to operational ELPA21 or Smarter Balanced Assessments. This version fully supports Mac OS 10.11 on ELPA21, which previously required a workaround.

Mac OS X 10.6-10.10 users can continue to use the Secure Browser 8.0 that was made available in Fall 2015.

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

42

Page 43: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Chrome OS Secure Browser 2.8 AvailableIf you have not already done so earlier this month, this requires a new download of the Chrome OS Secure Browser (version 2.8) for ELPA21 and Smarter Balanced Assessments. Districts will need to delete old Chrome OS Secure Browser and install this version to run in Kiosk mode.

Note that at this time, only Chrome OS versions 41-46 are officially supported for ELPA21 and Smarter Balanced Assessments. AIR is working on the audio issues encountered with Chrome OS 47 and 48.

If a user attempts to login on a Chromebook running OS 47 or 48, they receive a warning that although it is not confirmed as compatible, they may still continue to access the Smarter Balanced Interim Assessments or ELPA21 Assessment.

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

43

Page 44: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Android OS is NOT supported for ELPA 21Although Android OS will again be supported for Smarter Balanced Assessments this spring, it is NOT supported for ELPA21 at all. Districts will need to make arrangements to access the ELPA21 assessments using other supported operating systems (see http://wa.portal.airast.org/browsers/

Based upon statistics from 2015 Smarter Balanced Assessments in WA, this should impact very few districts.

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

44

Page 45: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

System Downtimes

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

45

AIR Systems◦ Friday, February 19, 2016 - The February monthly scheduled maintenance of all AIR

systems is planned beginning Friday, February 19 at 8 pm PT and will result in downtime for TIDE, TDS, ORS, and THSS. All systems will be back online by Sunday, February 21at 7:00 pm PT.

WA-AIM (Engrade)◦ Friday, February 5, 2016 - Specific times to be determined.

Page 46: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

WA-AIM Update

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION46

Page 47: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

WA-AIM Late EnrollmentStudents who enroll into your school after February 19, 2016 are exempt from taking the WA-AIM.

Process:

Contact [email protected] and request WA-AIM Late Enrollment Form

Complete form and return to [email protected]

No Engrade documentation needed

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

47

Page 48: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Collections of Evidence Updates

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION48

Page 49: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

COE WebsiteThe final submission for the Reading, Writing and Math COEs (for old learning standards) was January 27th. The website (known as Format 1 COE website) closed February 1st.

The COE website for the Exit Exam ELA COE, Exit Exam Math COE and Biology COE is open and will remain the source of information for these assessments: www.coe.k12.wa.us.

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

49

Page 50: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Subsequent COE submissionsSubsequent collections may be submitted by students who do not meet standard with their first COE.

Students who submitted a first collection under Format 1 will need to submit their subsequent collection under Format 2.

Subsequent collections under Format 2, specifically for Exit Exam ELA COE and Exit Exam Math COE, are complete, new submissions – there are no augmentations of previous collections.

Subsequent Exit Exam COEs require the same number of tasks, on demand and extended time tasks, and full strand coverage.

OSPI will continue to cover the costs of the first COE; all subsequent COEs require District Coordinator approval as a $200 scoring fee will be charged to the district.

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

50

Page 51: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Format 1 COE Inclusion Bank TasksFormat 1 inclusion bank materials (reading passages, reading and math tasks, and writing prompts) are secure test materials. These materials are not to be used in the classroom or for any purpose other than COE assessment.

Any materials still existing in paper-based form at the conclusion of Format 1 use are to be disposed of in a secure manner.

Sample tasks are available in the Exit Exam Math and ELA Moodle that replicate the type of tasks to be found in the new inclusion bank.

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

51

Page 52: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

COE Contact Information

Lesley Klenk, COE ELA Specialist

(360)725-6330 or [email protected]

Julie Wagner, COE Math Specialist

(360)725-6235 or [email protected]

Amanda Mount, COE Operations Specialist

(360)725-6037 or [email protected]

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

52

Page 53: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

ELPA21 Important Updates

Extended Test Window

The ELPA21 Test Window has been extended and will now run February 2 – March 31.

Test Administrator’s Manual (TAM)

The TAM is posted in the WCAP portal and on the ELPA21 website. The TAM provides specific instructions for the administration of the ELPA21 English Language Proficiency Assessment for the 21st Century. Details include information on security, coding, logistical and paper-handling requirements, and the TA directions to students. The TA directions to students support the K-12 Training Tests and the Summative tests.

Please note that there is a separate DFA for the grades K and 1 paper-pencil writing test. These DFAs were shipped with paper-pencil writing tests.

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

53

Page 54: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

ELPA21 TAM Updates (continued)

Tool Button Sheet

A Tool Button Sheet was created to support students when TAs proctor the ELPA21 Training Test. This sheet provides students with a visual of the tool buttons that will be used during testing and a short description of the tool.

Translations

Please be sure to reference the most recently posted version of the TAM as there have been updates. There are no translated directions available, but districts may translate general directions following the guidelines in the ELPA21 Accommodations Manual. ELPA21 Accessibility and Accommodations Manual is posted in TIDE and on the OSPI ELPA21 webpage.

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

54

Page 55: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

ELPA21 Contrasting Group Study

Provides an opportunity for classroom teachers to be involved in the standard setting process

The Contrasting Groups method is the process by which students are divided into two groups — a “proficient or above” group and a “basic or below” group based on their teacher’s prediction of their performance on the assessment

Trained teachers predict their students’ performance and those predictions are matched with actual scores of students

Additional information and registration can be found at http://www.k12.wa.us/ELPA21/default.aspx

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

55

Page 56: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

WCAP USER SUPPORT Questions regarding information in the Test Administration Manuals TAs and School Test Coordinators, contact your District Test Coordinator.

District Test Coordinators contact the OSPI Assessment Operations Team at: [email protected].

Policy or Test Administration Questions TAs and School Test Coordinators, refer to the Test Administration Manual. If additional support is needed,

contact your District Test Coordinator.

District Test Coordinators contact the OSPI Assessment Operations Team at: [email protected].

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

56

Page 57: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

WCAP ContactsAIR Help Desk for Technical, Network, and password issues

◦ AIR Help Desk: [email protected] 1-844-560-7366

OSPI Assessment Analysts for student data issues◦ OSPI Assessment Analysts: [email protected] 360-725-6109

OSPI Assessment Operations for assessment policy and test materials◦ Assessment Operations [email protected] (360) 725-6348 or (800)

725-4311, press option 3

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

57

Page 58: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

WCAP Technology, System, or Program Issues

TAs, School Test Coordinators, and District Test Coordinators contact the WCAP Help Desk (TAs and School Test Coordinators must also alert the District Test and Technology Coordinators of issues).

The WCAP Help Desk is open Monday–Friday from 6:00 a.m. to 6:00 p.m. PT (except holidays or as otherwise indicated on the Washington Comprehensive Assessment Program Portal).

Washington Comprehensive Assessment Program Help Desk

Toll-Free Phone Support: 1-844-560-7366

Email Support: [email protected]

2/3/2016

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

58

Page 59: OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION · 2017-12-14 · WA-AIM is online only (ENGRADE) The spring administration is ongoing from October 19, 2015 through April 8, 2016.

Thank you!

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

59