DTC 101 Assessment Inventory

Working Lunch

June 17, 2015

Assessment Inventory

Welcome

- Comments from Achieve

- DOE Release of Inventory

Status

- Questions

- Discussion

2

DTC 101 Face-to-Face

June 17, 2015

WELCOME

Please sign in and pick up your district/school materials

4

WRAP-UP FOR

DESSA 2014-2015

Section 1

SMARTER BALANCED

ADMINISTRATION

VISITS

Section 2

Smarter Assessments Administered

Spring 2015

7

Grade ELA CAT ELA PT MATH CAT MATH PT

3 10,218 10,166 10,253 10,247

4 9,890 9,942 9,984 9,982

5 9,923 9,969 10,021 9,956

6 10,003 9,959 10,095 10,054

7 9,728 9,698 9,794 9,735

8 9,574 9,472 9,553 9,509

11 7,609 7,446 7,668 7,524

Total 66,945 66,652 67,368 67,007

Smarter Balanced Observations

May 2015

22 visits 12 districts and 4 charter schools

8 visits in New Castle County

8 visits in Kent County

6 visits in Sussex County

Simple protocol for the first year

8

Smarter Balanced Observations

May 2015

Goals of observation protocol

Completion time for CAT, Classroom Activity, and Performance Task

Observe the testing environment

Observe the security of the material before and after testing

Gather information about the extent of technical issues when dealing with accommodations

Gather information to help with the second phase of the monitoring plan

9

Smarter Balanced Monitoring

2015-16 SY

Purpose is to ensure the testing procedures are implemented as outlined in the documentation posted on the DE portal

Monitoring protocol release in Fall 2015 with additional details

Potential Areas of Monitoring:

Administration of DeSSA assessments (Smarter, DCAS, and national tests)

Security and training Schedules Electronic device policy Student participation Accommodations provided/administered Interviews with administration, teachers, and students

10

SMARTER BALANCED

EDUCATOR SURVEY

Section 3

Survey Summary

As of June 15, 2015, 341 educators answered the survey. The survey asked questions and allowed the

educators to give comments

The Office of Assessment will use this feedback to improve next years testing administration for Smarter tests for all the categories mentioned above.

The other tests under DCAS were not surveyed as no new tests were administered.

12

What is your role in the administration of the Smarter

tests? Select all that apply.

Test

Administrator

Grades 3-5

Test

Administrator

Grades 6-8

Test

Administrator

Grades 11

School Test

Coordinator

District Test

Coordinator

Which test were you responsible for

administering? Select all that apply.

Which of these statements apply to the Smarter Test

Administration materials/resources? Select all that apply.

The Smarter TAM and Portal resources

provided necessary information to

administer the test

The Smarter TAM and Portal resources

were easily accessible

The online training was clear and

appropriate

The material was available on time

How helpful was the AIR Help Desk? Select all that

apply.

Questions and concerns were

addressed in a timely manner

The Help Desk staff was

knowledgeable

Which of these statements apply regarding the test

administration? Select all that apply.

The suggested testing time for Math

was about right (if not, please

comment below)

The suggested testing time for

ELA/Literacy was about right (if

not, please comment below)

The scripts/materials were clear and

give all necessary information

I had no problems with the testing

administration

Which of these statements apply regarding technology

conditions for Smarter tests? Select all that apply.

Computer issues were resolved in

a timely manner

Supported tools were functional

(highlighting, calculator and other

tools available through the secure

browser

Accommodations supports were

functional

I had no technology issues

TECHNICAL ISSUES

Section 4

Technical Issues Spring 2015

Accommodations

Accommodations Functionality TTS Stimuli on Performance Tasks

TTS for Spanish portion of Stacked Spanish/English

Assessment Accommodations and TIDE match issues

Grade 4 Math PT Stacked

Speech to Text

20

Technical Issues Spring 2015

Trained User Flag (early in window)

Custom/Standard Indicator

Item Counter

21

Changes for 2015-16

Training in Schoolology instead of Blackboard

Shorter wait for access after registration, completion

TA Interface has been redesigned More user friendly selection of tests for test

session

Cleaner look

New Help Ticket System to Replace ARS

Simplify Accommodation Codes

22

Menu for Selection of Test

23

Menu for Selection of Test

24

Confirmation of Summative Selection

25

DSARA v1.2

Delaware Student Assessment Reporting & Analysis

Current version of DSARA

Social Studies and Science data released into this system

26

DSARA v2015

To be released with Smarter ELA/Math scores

Also includes SAT, PSAT, DCAS, DSTP scores

Individual reports can include one of the above tests or ALL of a students tested history

Easily manipulated changes to graphs, reports

All reports downloadable

Class/Cohort reports

Includes Homeroom and Counselor watch lists

27

TIDE STUDENTS 2015-16

DTC role and STC role will have access to edit most accommodations directly

DOE will retain edit access to a small number of accommodations

No waiting overnight for changes to take effect

Assessment Accommodations Application ceases to exist

TIDE students reporting capability increased

28

SCHOOL REPORTS/

INTERPRETIVE GUIDE

Section 5

29

Family Score Reports

30

Family Score Reports

31

Interpretive Guide

Will support parents in understanding the information in the family report

Available online on the portal

32

PARTICIPATION AND RESULTS

Section 6

33

State Summary and Accountability

Participation rules

Results

Performance levels

Scale scores

Definitions

34

TEST SECURITY

Section 7

35

Definitions for Test Security Incidents

36

Definitions for Test Security Incidents

37

Definitions for Test Security Incidents

38

2015 Test Security Incidents

39

Incident Type Impropriety Irregularity Breach

Cheating 3 13 0Cellphone 33 4 0Classroom Activity 6 3 0Classroom Notes 3 0 0Incorrect Testing Session 3 0 0Student Disruption 2 0 0Advantage Given by TA 0 3 0Computer Usage 4 1 1Component V Incidents 0 3 0Calculator Usage 1 3 0Other 6 3 0

2015 Test Security Incidents by Type

40

0

5

10

15

20

25

30

35

40

Breach

Irregularity

Impropriety

2015 Test Security Incidents

41

Incident TypeImpropriety Irregularity Breach

Number of Incidents

Cheating 3 13 0 16Cellphone 33 4 0 37Classroom Activity 6 3 0 9Classroom Notes 3 0 0 3Incorrect Testing Session 3 0 0 3Student Disruption 2 0 0 2Advantage Given by TA 0 3 0 3Computer Usage 4 1 1 6Component V Incidents 0 3 0 3Calculator Usage 1 3 0 4Other 6 3 0 9Total 61 33 1 95

Test Security Manual

Update Summer 2015

Manual

Training

Finalize by August 15, 2015

Face-to-Face DTC Training

Videotape for training Purposes

42

LOOKING AHEAD

Section 8

43

5-Year Plan

44

2015/2016 School Year DeSSA Calendar

45

Communications

e-Newsletters

DTC Weekly Webinar/Conference Calls

DTC Weekly One-on-One Contacts

Face-to-Face DTC Sessions

46

WRAP-UP AND EXIT TICKET

Section 9

47

Wrap Up

Plus/Delta feedback

48