2011Approaches to Assessing Students

Post on 22-May-2015

157 views 0 download

Tags:

Transcript of 2011Approaches to Assessing Students

Securexam Remote

Proctoring SystemDr. April Cognato, Ph.D.

Michigan State Universityac@msu.edu

Online Course

• Fundamentals of Geneticso Fully onlineo 150 studentso Single summer session (7 weeks)o Not proctored, remote

• Assessmentso Problem Sets, short answer, word problemso Summative assessments, weekly “mid-term”

like exams

Academic Dishonesty

Infractions included:

• Plagiarism from internet sources• Copying answer key (verbatim!!)

provided by other students• Submitting, obtaining the key,

resubmitting with the key (LMS bug)

Suspected many; failed 6 students in 2009, 2010

Pedagogical Best Practices

• Tutorial on academic integrity

• Synchronized assessments

• Question pools• Random delivery of

questions and answers

• Exam review controlled

• Required exam proctoring

Testing center at the University of Central Florida

NY Times July 5, 2010

Comprehensive Remote Proctoring System

Desired System Features1. Authenticates student

identity2. Monitors student

activity3. Secures computer

access4. Compact, portable5. LMS compatible

Desired End User Features1. Flexible2. Cost-effective3. Easy to employ for

faculty and students4. Tech-support5. Customer-support

Securexam Remote Proctoring System (SRPS) Solution

Authenticateso Biometric data

Secures computero Lockdown browser

Monitors studentso 360° camera

Compact & portableo Desktop, USB, disassembles

Records o Video record of exam session

Reportso Exam policy violations

Securexam System: How it Works

• INSERT VIDEO HERE

Remote Proctoring Solutions

Provided students with two options:

• Securexam Remote Proctoring System (SRPS)

• National College Testing Association (NCTA), Consortium of College Testing Centers (CCTC) In-person Proctoring

SRPS vs. Testing Center

Feature SRPS CCTCSystem Authentication X X

Monitoring X X

Browser security X Human

Compact/portable X

End-user

Convenient X

Cost-effective X

User friendly X X

Tech support X N/A

Customer support X N/A

Cost ComparisonTesting Center

Hours Fee CTCC 2011

SRPS

MSU M 8AM-5PM $30/exam

$180

$100

W 12PM-5PMFerris State University

M 9AM-4PM $20/hour $240W 9AM-4PM

Grand Rapids CC M 7:30AM-7:30PM

$10/hour $120W7:30AM-7:30PM

Kalamazoo CC M 8:30AM-9PM $20/test $120W 8:30AM-9PM

Central Michigan University

M 9AM-1AM $30/test $180W 9AM-1AM

Lake Superior State

M 8:30AM-4PM $15/hour $180W 8AM-12PM

Southwestern Michigan College

M 8AM-5PM $20/exam

$120W 8AM-5PM

Remote Proctored Exams

• 86 students opted to use the SRPS• 6 exams over 7 weeks• Semi-synchronous exam periods• 2 hour time limit• Multiple choice, short answer, essay (word

problems)• Survey of proctoring experience delivered for

credit at the end of the course

SRPS Protected Integrity

84%

8%4%4%

Impossible/Dif-ficult to Cheat

Easy to Cheat

Knows someone who cheated

No reponse

CMS Bug

Student Testimony

“It looks like something out of Star Wars!”

“It’s a great way to have the freedom to take the exam on your own time in whatever setting you want”

“It’s easy to use and you can take [the test] when you want”

“The remote proctoring device was easy and convenient…you could take your exam in your own home and at whatever time you wanted.”

“You couldn’t cheat and I took my test in the comfort of my own home.”

“Remote proctoring tech support was VERY NICE and HELPFUL.”

“The lowered cost compared to the in-person proctoring exam was a plus.”

Future Best Practices• Inform students of proctoring requirement (and associated costs) at the

time of registration.

• Deploy device at least 2 weeks prior to the beginning of a course (especially for a short course).

• Institute a required practice assessment the first week of the course with the device to ensure students set it up properly.

• Institute a backup exam plan for students who add the course late.

• Establish good communication with your CMS IT personnel.

• Provide clear instructions for contacting Technical Support for CMS and Software Secure.

• Anticipate some technically challenged students!

Take Home Points• Securexam Remote Proctoring system effectively

protects academic integrity• SRPS was a comprehensive proctoring system

o Authenticates student identityo Monitors student activityo Secures computero Records exam sessiono Reviews and Reports to instructors

• SRPS met the needs of the end usero Easy to use (faculty and students)o Conveniento Cost effectiveo Responsive tech supporto Attentive customer service

Top Three Features

77%

15%7% Flexible (time,

location)

Easy to use

Prevented cheat-ing