Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q...
-
Upload
alysha-woodworth -
Category
Documents
-
view
216 -
download
0
Transcript of Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q...
![Page 1: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/1.jpg)
www.sakaiproject.org 1
Tests and Quizzes Tool(aka SAMigo)
Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford University Learning Activity Designer
![Page 2: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/2.jpg)
www.sakaiproject.org 2
Where did the design originate?• Formative Assessment (Homework)
– Stanford Assignment Tool for Human Biology– CourseWork CMS with Language Tools
(Andrew W. Mellon Foundation funded)
– OKI Tools Workshop to Specify Functionality(Andrew W. Mellon Foundation funded)
– OKI Formative Assessment Tool(Andrew W. Mellon Foundation funded)
• OnCourse Quiz Tool– Online testing
![Page 3: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/3.jpg)
www.sakaiproject.org 3
Where did the design originate?
• OKI Tools Workshop– Many schools met to define needs for a CMS– One group specified the needs for an
Assessment Tool– Several hundred functional requirements
identified
![Page 4: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/4.jpg)
www.sakaiproject.org 4
Where did the design originate?
• Assignment and Assessment Manager – Supports teaching and learning in
large lecture science courses and in language instruction
– OKI Tool developed at Stanford– Andrew W. Mellon Foundation funded
![Page 5: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/5.jpg)
www.sakaiproject.org 5
Where did the design originate?
• OnCourse CMS for Indiana University instructional support
![Page 6: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/6.jpg)
www.sakaiproject.org 6
What are its features:
• Assessment Authoring
• Assessment Publishing
• Assessment-taking Management
• Assessment Grading
• Question Pools Management
• Publishing Template Management
![Page 7: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/7.jpg)
www.sakaiproject.org 7
Organize & Publish Assessments
• Library of assessments for a course– Can be ex/imported in QTI XML format
• Published assessments with responses, grades– Can be published to sections, groups in course– Can have different release, due, retract dates
![Page 8: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/8.jpg)
www.sakaiproject.org 8
![Page 9: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/9.jpg)
www.sakaiproject.org 9
Question Types• Multiple Choice (single and multiple correct)• Multiple Choice Survey• True/False• Matching• Essay/Short Answer• Fill in the Blank• File Upload• Audio Recording** in future Sakai 2.x release
![Page 10: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/10.jpg)
www.sakaiproject.org 10
![Page 11: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/11.jpg)
www.sakaiproject.org 11
Multimedia Everywhere
• WYSIWYG editor
Fonts, style, layout, images, HTML, links
• In section headers, question texts, selections for responses, feedback, comments
![Page 12: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/12.jpg)
www.sakaiproject.org 12
![Page 13: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/13.jpg)
www.sakaiproject.org 13
Pedagogical Flexibility
• Online test
• Self-study questions
• Homework, problem-sets
• Essay, code, or project submission
• Language drills
• Quick knowledge probes
• Others???
![Page 14: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/14.jpg)
www.sakaiproject.org 14
Online Test• Unique tests for each student
– Randomized order of questions– Randomized draw from question pools
• Timed test-taking during access window– Auto-submit at end of timed period
• One submission only per student• Higher Security
– IP Addresses restricted– Secondary Password (proctored)
• No late submissions accepted• Scores transferred to gradebook
![Page 15: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/15.jpg)
www.sakaiproject.org 15
![Page 16: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/16.jpg)
www.sakaiproject.org 16
Self-Study Questions
• Immediate feedback
• Random access to Questions – Table of contents– Marked for review list
• No record of score in gradebook
• No due date; always available to student
• Unlimited submissions allowed
![Page 17: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/17.jpg)
www.sakaiproject.org 17
![Page 18: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/18.jpg)
www.sakaiproject.org 18
Homework/Problem Sets• Published with multiple release and due dates
for different sections• Multiple methods for handling late submissions• Students can save work during assignment
period.• Auto-grading with methods for diagnosing
learning problems • Quick-reviews of student aggregate performance
by instructors viewing histograms, statistics.• Pools for organizing questions for reuse
![Page 19: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/19.jpg)
www.sakaiproject.org 19
Essay and Project Submission
• Use file upload question type for submitting any type of document
• Grader can download assignment; upload marked-up file to return to student
• Grades are recorded in gradebook
![Page 20: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/20.jpg)
www.sakaiproject.org 20
Templates
• Create Assessment “Types” for different disciplines, different uses
• Select what which choices are available to the instructor.
• Hide complexity by making choices for the type (e.g., Self-study always has immediate feedback)
![Page 21: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/21.jpg)
www.sakaiproject.org 21
![Page 22: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/22.jpg)
www.sakaiproject.org 22
![Page 23: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/23.jpg)
www.sakaiproject.org 23
Question Pools
• Organize questions into multiple subpools
• Export and import questions in IMS QTI format.
• Author Questions from within Pool Mgr.
• Randomly draw from pools for an assessment
![Page 24: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/24.jpg)
www.sakaiproject.org 24
Demo
![Page 25: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/25.jpg)
![Page 26: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/26.jpg)
www.sakaiproject.org 26
![Page 27: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/27.jpg)
www.sakaiproject.org 27
![Page 28: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/28.jpg)
www.sakaiproject.org 28
![Page 29: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/29.jpg)
www.sakaiproject.org 29
![Page 30: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/30.jpg)
www.sakaiproject.org 30
![Page 31: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/31.jpg)
www.sakaiproject.org 31
![Page 32: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/32.jpg)
www.sakaiproject.org 32
![Page 33: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/33.jpg)
www.sakaiproject.org 33
![Page 34: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/34.jpg)
www.sakaiproject.org 34
![Page 35: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/35.jpg)
www.sakaiproject.org 35
![Page 36: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/36.jpg)
www.sakaiproject.org 36
![Page 37: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/37.jpg)
www.sakaiproject.org 37
![Page 38: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/38.jpg)
www.sakaiproject.org 38
![Page 39: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/39.jpg)
www.sakaiproject.org 39
![Page 40: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/40.jpg)
www.sakaiproject.org 40
![Page 41: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/41.jpg)
www.sakaiproject.org 41
![Page 42: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/42.jpg)
www.sakaiproject.org 42
![Page 43: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/43.jpg)
www.sakaiproject.org 43
![Page 44: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/44.jpg)
www.sakaiproject.org 44
![Page 45: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/45.jpg)
www.sakaiproject.org 45
![Page 46: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/46.jpg)
www.sakaiproject.org 46
![Page 47: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/47.jpg)
www.sakaiproject.org 47
![Page 48: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/48.jpg)
www.sakaiproject.org 48
![Page 49: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/49.jpg)
www.sakaiproject.org 49
2.0 Highlights
• Full integration into Sakai framework
• Assessment scores to Gradebook
• File upload question type
• Play with it:http://nightly2.sakaiproject.org/portal
![Page 50: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/50.jpg)
www.sakaiproject.org 50
T&Q 2.x Future
• Implementation of 2.0 framework – Release assessments to specific classes and
sections– Department template– Question Pool sharing
• Audio-recording question type
![Page 51: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/51.jpg)
www.sakaiproject.org 51
T&Q post 2.x Future
• Establish a T&Q sub-team (designers and developers)
• New features via Assessment DG (post Baltimore conference) and feature prioritization process
• New code via committer strategy that mirrors Sakai process
• See you in Austin! (Dec. SEPP conf.)
![Page 52: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/52.jpg)
www.sakaiproject.org 52
Questions?
![Page 53: Www.sakaiproject.org 1 Tests and Quizzes Tool (aka SAMigo) Marc Brierley, Stanford University T&Q Project Manager and Lead Designer Charles Kerns, Stanford.](https://reader035.fdocuments.us/reader035/viewer/2022062620/551ab28d550346b2288b4b21/html5/thumbnails/53.jpg)
www.sakaiproject.org 53
ContactsMarc Brierley, Stanford University T&Q Project Manager and Lead Designer [email protected] Charles Kerns, Stanford University Learning Activity Designer [email protected]