1

Dynamic Learning Maps Consortiumfor West Virginia Test Coordinators

September 29, 2015

The present publication was developed under grant 84.373X100001 from the U.S. Department of Education, Office of Special Education Programs. The views expressed herein are solely those of the author(s), and no official endorsement by the U.S. Department should be inferred.

2

Introducing DLM Staff

• Meagan Karvonen

• Mariel Zeller

• Nancy Keating

3

Purpose of Today’s Meeting

• To prepare West Virginia’s District Test Coordinators to train their Test Administrators (TAs) for the 2015-2016 DLM assessment

• To help familiarize the Test Coordinators on the DLM website and the DLM Manuals for all materials

4

Today’s Agenda

• Required Test Administrator Training

• What’s new in DLM this year?

• Roles and Responsibilities of district staff

• Educator Portal overview and demonstration, including what is new for 2015-16

• Information about data clean-up

• Q & A

5

OVERVIEW OF 2015-16 DLM TRAINING

6

Quick Comparison

2014-15• Delivered in EP• Educators could self-register

– EP accounts, choice of modules

• All test administrators took 7 modules– Confusion due to design of PD

feature in EP

• Successfully complete all 7 = prerequisite for access to student TDE login information

• Professional Development Modules on DLM website

2015-16• Delivered in Moodle• Educators registered manually

(using EP user information)• Some state customization of

training courses• Options for new vs. returning

test administrators• Successfully complete all

requirements = prerequisite for access to student TDE login information

• Professional Development Modules still on the DLM website but reorganized

7

Why Use Moodle ForRequired Training?

• DLM made changes in training based on feedback, an ad-hoc committee, and internal discussions.

• Moodle has better video and audio quality than EP.

• Moodle provides functionality that overcomes bandwidth issues and heavy demands on district technology systems.

• Moodle has features to make training a meaningful learning experience for educators:– Guidance on which quiz questions were missed– Additional information to help teachers learn more about

a missed question before retaking the quiz

8

Key Required Training Changes

• New Test Administrators take four modules.

• Returning Test Administrators take one module.

• Only the role of “teacher” is uploaded into Moodle.

• Only “teachers” are required to pass the quizzes.

• Non-teachers are also able to take the training but are not automatically enrolled.

9

Two Training Options

• Self-Direct Required Training:– For new Test Administrators– For returning Test Administrators

• Facilitated Required Training:– For new Test Administrators– Not available for returning Test

Administrators

• Both options in Moodle

10

Self-Directed Training for New TAs• Test Administrators complete all training and

quizzes at their own pace.

• Training activity consists of videos and short unscored activities in Moodle.

• Individual post-tests for each module must be passed:– ≥80% is successful completion; – unlocks next module

• Training typically takes between 3.5 and 4 hours.

11

Facilitated Training for New TAs• New Test Administrators attend a workshop with

other educators.

• Training activity also consists of videos/short unscored activities but in a group setting.

• Participants individually access Moodle and take post-tests: – ≥80% success completion required– unlocks next post-test

• Facilitated training may include an additional half day of hands-on training in Educator Portal or other activities.

12

Content for New TAs• Module 1: About the DLM System

• Module 2: Accessibility by Design

• Module 3: Computer & Teacher Administered Testlets

• Module 4: Preparing to Administer the Assessment

• Module 5: Who are the Students with the Significant Cognitive

Disabilities.

13

Post-Tests for New TAs

• Post-tests consist of both True/False and multi-select multiple choice items.

• Multiple testing attempts are allowed.

• Quiz is no longer available after successful completion of the next part.

14

Training for Returning TAs• This course is designed for the Test

Administrators who completed all training requirements in 2014-2015.

• Training time:– Video: <24 minutes– Post-test: about 20 minutes

15

Identifying Returning TAs

• A returning Test Administrator is an educator who passed all required training modules, had the role of “teacher”, and had an active Educator Portal account during the 2014-2015 school year.

• If a returning Test Administrator is registered as a new Test Administrator, that TA should notify the DTC. The DTC will contact the DLM Service Desk to get the registration corrected if appropriate.

16

Training for Returning TAs

• If the module is not successfully completed on the first attempt, additional training will be required.

• Additional training may take an additional 30 minutes to 4 hours, depending on the areas in which the test administrator was not successful on the first attempt.

17

Content for Returning TA Training

• Participants will learn how to prepare for the DLM Assessment

– Review the components of the DLM Alternate Assessment System.

– Clarify the security demands of the DLM system.

– Review accessibility options and allowable practices.

– Review test administration practices.

18

Available Resources

• DLM Website for West Virginia

• Guide to Required Training– For participants (test administrators)– Overview of what is expected (content, course

design)– Step-by-step instructions for Moodle with screen

shots

• Facilitator Guide to Required Training– Short overview of content & responsibilities– How-to for Moodle (same as participant guide +

facilitator resources area)

19

Professional Development Modules

• Professional Development Modules are on dlmpd.com and not in Moodle.

• PD modules are reorganized in two lists– Claims – Alphabetical

• Self-Directed Learning Modules Check-Off Sheet

20

REQUIRED TRAINING IN MOODLE

Educator Portal & MoodleTA has account in Educator Portal

Moodle account created

TA completes all training requirements

Completion status marked in EP

training.dynamiclearningmaps.org

WV’s Courses

• Test Administrators only see their own course

• WV facilitators see all three

24

How Educators are Enrolled

• DLM staff retrieve current user records from EP; check against file of those who completed in 2014-15–Match = returning test admin course – No match = new test admin course

• DTC has permission to request change into returning course

• Process is not automatic. May take ~5 business days.

25

Inside Moodle

• Username = same email as EP• Temporary password must be

reset at first login• Test administrators will only see

one course• In WV facilitators will see all three

courses

26

After Completion

• Automatically generates certificate if they want one for their own records

• DLM staff periodically sweep through the gradebook to find TAs who have completed all training and are ready to be marked in EP as having met all requirements– This process is not automatic. May take

2-5 business days.

27

Monitoring in Moodle

Course Monitoring Guide – Handout

Check Test Administrator enrollment in Moodle.

Monitor completed quizzes.

Who received a certificate?

training.dynamiclearningmaps.org

1. Login and navigation

2. Facilitator resources

3. Overview of course for new TAs

4. Monitoring procedures

29

Facilitator Hints

Check Moodle enrollments 7-10 days in advance of scheduled training session–Work with staff to make sure missing

people have their EP accounts correctly configured

Check technology configuration in advance – make sure videos work with local settings

30

Likely Hot Topics

1. I can’t get to the professional development tab in Educator Portal?

2. But I did this last year!3. What is my username and password?4. Do I have to take facilitated AND self-

directed?5. I just finished the course five seconds

ago. How come I can’t see my student’s password?

6. How do I prove I finished?

31

Support for Moodle

DLM Service Desk:

dlm-support@ku.edu

(See Participant and Facilitator Guides to Required Training)

32

WHAT’S NEW IN 2015-16

33

Improvements This Fall

• The system has the ability to recognize users by assessment program.

• Self-registration of user in Educator Portal is disabled.

• The View Student user interface aligns with the enrollment upload.

• Students’ username and password are visible on the individual student’s record screens after the Test Administrator meets all training requirements.

34

More Improvements

• Pre-populate organization hierarchy information in drop-downs is based on user roles.

• System-related announcements will be displayed in Educator Portal.

• The display of the active tabs has been improved.

35

More Improvements (continued)

• Student’s current grade level is added to PNP extract.

• Ability to exit a student through the user interface.

• ITI: – Teachers no longer need to select

content area, claim, conceptual area. – All EEs in the blueprint for the selected

rosters content area will appear in a single drop-down.

36

More Improvements (continued)

• New user interface in “reports” for selecting a district and school

• First Contact Survey: – Re-launched with updated

questions, fewer required questions, UI enhancements

– Updated status messages to provide more direction for users when submitting survey

37

KITE Test Delivery Engine (KITE Client)

IMPORTANT!• KITE Client 2.0 Release: Windows,

Mac, and iPad– No new client for Chromebook

• Download and install on testing devices this fall

38

What else is new this year?

West Virginia-specific handout

39

Test AdministrationScience Field Test:

• Main window for the Science Field Test is Nov. 9 – Dec. 2, 2015.

• “About the Science Field Test”

• http://www.dynamiclearningmaps.org/content/science-fall2015-test-admin

Spring Test Administration Window• April 4-June 3, 2016

– Dates are enforced in KITE

40

ROLES AND RESPONSIBILITIES

41

Data Steward Manual

• See the quick reference handout.

• A full list of roles in section, “Assign a User Role or Multiple Roles” in the Data Steward Manual.• Abbreviations for roles are required

when uploading a user .csv

42

Test Administrator Responsibilities

• Double/triple check ALL student data.

• Make sure First Contact and PNP are updated.

• Use the Instructional Tools Interface if

desired. (optional for West Virginia)– Review Blueprint for tested Essential

Elements.

43

DEMONSTRATION OF EDUCATOR PORTAL

44

Educator Portal• For the optimal experience, use Mozilla

Firefox.

• Copy/paste this link into Mozilla Firefox• https://educator.cete.us

• Other browsers are also supported.

• Check the DLM website and the Technical Liaison Manual for specific guidelines.

45

File Template Uploads

• User and enrollment data extracts are updated to match* the new uploads

• Upload templates are available through Educator Portal

• Improved error messaging for uploads with the ability to download a .csv of errors for troubleshooting

46

File Templates for West Virginia

• Data Steward Manual– File template field definitions

• Upload templates in order:

1. User File Template sample

2. Enrollment File Template sample

3. Roster File Template sample

• Organizational File for West Virginia

47

Everyone’s Responsibility

• Check your name, e-mail address, educator ID, your roles, your buildings, your students’ names, rosters, and all other listed information.

• The DLM teacher ID remains the same even if the teacher’s name changes.

48

First Contact• Data was carried forward from 2014-15

unless student has a new student ID.

• Some questions were removed and others were added.

• Responses for expressive communication and academic items are required.

• Some items are optional but highly recommended because of the impact on further test development.

49

Personal Needs and Preferences Profile (PNP)

• Data was carried forward from 2014-15 unless student has a new ID.

• The Accessibility Manual provides guidance with the decision-making process.– See the section, “Guiding Questions for

Discussion and Selection of Appropriate Accessibility Features and Supports.”

50

Instruction Tool Interface (ITI)

• The use of ITI is optional for West Virginia teachers.

• ITI is used for instructionally embedded testlets.

• ITI opens when the testing window opens on November 5, 2015.

• ITI closes briefly around each software release (usually over a weekend) and during the winter holidays.

51

Checking and Data Cleanup

• The cleanup process is similar to 2014-2015.

• Use the data extract files.

• Cleanup is critical to accuracy of student reports and the GRF.

52

Questions?

53

For more information, go to: www.dynamiclearningmaps.org

For Professional Development, contact:dlmpd@unc.edu

For the DLM Service Desk, please contact:855-277-9751 or DLM-support@ku.edu

The present publication was developed under grant 84.373X100001 from the U.S. Department of Education, Office of Special Education Programs. The views expressed herein are solely those of the author(s), and no official endorsement by the U.S. Department should be inferred.

54

THANK YOU!