Assessing Students Online

League for Innovation 2005Dallas, TXOctober 24, 8:00 AM – 9:00 AMManchester, Tower Mezzanine

2

Who Are We?

Montgomery County Community College, Blue Bell, PA

Patricia RahmlowAssistant Professor, Computer Scienceprahmlow@mc3.edu

Marie HartleinAssociate Professor, Computer Sciencemhartlein@mc3.edu

Linda MoultonProfessor Mathematics and Computer Sciencelmoulton@mc3.edu

http://faculty.mc3.edu/prahmlow/Presentations/index.html

3

Who Are You?DisciplinesOnline, hybrid, face-to-face professorBlackboard, WebCT, otherUse publisher packagesUse online quizzes

4

Why Assess Students Online? Space and time independent

5

Why Assess Students Online? Immediate feedback

6

Why Assess Students Online? Learning aide

7

Uses of Online AssessmentEvaluation of student learning

Pre-test Post-test

8

Uses of Online AssessmentEvaluation of student learningAssessment of knowledge

Exams Make-up tests

9

Uses of Online AssessmentEvaluation of student learningAssessment of knowledgeSelf-evaluation

Repetitive testing Feedback

10

Uses of Online AssessmentEvaluation of student learningAssessment of knowledgeSelf-evaluationDistance learning assessment

Keeps students as “distance” learners More convenient for student

11

Online Assessment ToolsCourse delivery software

Blackboard WebCT Publisher course delivery sites

12

Online Assessment ToolsCourse delivery softwareSimulated software application testing

SAM Train IT SimNet SNAP

13

Online Assessment ToolsCourse delivery softwareSimulated software application testingFree / low-cost quiz sites

http://getonline.wichita.edu/transitions/assess.asp#assessmenttools

14

Online Assessment Tools Course delivery software Simulated software application testing Free / low-cost quiz sites Textbook web sites

Computer Science Conceptshttp://csilluminated.jbpub.com/

Information Literacy Conceptshttp://wps.prenhall.com/

bp_evans_techinaction_2/0,10009,1799886-,00.html Active Help Desk

http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter03/index.html

Accounting Textbookhttp://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html

15

Online Assessment ModesTime constraints

None Timed – warning mode Timed – shut down mode

16

Online Assessment ModesTime constraintsNumber of attempts

One Multiple Unlimited Student specific

17

Online Assessment ModesTime constraintsNumber of attemptsRestricted access

Site password Assessment password **********

18

Online Assessment ModesTime constraintsNumber of attemptsRestricted accessSurvey

Anonymous Course evaluation

?

19

Knowledge Based Questions True/False Multiple Choice Matching Multiple Answer Ordering Fill in the Blank Essay Calculated Numeric Calculated Formula

File Response Hot Spot Fill in Multiple Blanks Jumbled Sentence Opinion Scale/Likert Short Answer Either/Or Quiz Bowl

20

Performance Based Questions

Open / close filesSearch internetSend emailFormat documentsDevelop formulasQuery a database

21

Assessment Integrity Timed

Allow use of textbook Insufficient time to look up all answers

22

Assessment Integrity Timed Question pool

Large pool of questions No two quizzes identical

23

Assessment Integrity Timed Question pool Randomize questions

Facilitates face-to-face use Less likely to memorize answers

24

Assessment Integrity Timed Question pool Randomize questions Frequent assessments

Less likely someone else will take assessment

25

Assessment Integrity Timed Question pool Randomize questions Frequent assessments Don’t reveal answers

Send answers after exam time ends Send only correct / incorrect indicator Time release results

26

Assessment Integrity Timed Question pool Randomize questions Frequent assessments Don’t reveal correct answers Proctored

27

Assessment Integrity Timed Question pool Randomize questions Frequent assessments Don’t reveal correct answers Proctored Other forms of assessment

“Portfolio” of student ability Discussions Homework / Projects

28

Technical Issues ISP Disconnect

“Passive” assessments Keep under 30 minutes Reset quizzes Question pools

“Active” assessments Count first recorded response

Pop-up Blockers Special Software

29

Tool Selection Cost Ease of use

Student Access Software

Professor Set-up Grading (SCORM)

Purpose Graded assessment Self-assessment

30

Demonstrations SAM

http://sam2003.course.com Blackboard

https://my.mc3.edu/ Textbook web sites

Computer Science Conceptshttp://csilluminated.jbpub.com/

Information Literacy Conceptshttp://wps.prenhall.com/

bp_evans_techinaction_2/0,10009,1799886-,00.html Active Help Desk

http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter03/index.html

Accounting Textbookhttp://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html