Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support...
-
Upload
dora-richards -
Category
Documents
-
view
218 -
download
0
Transcript of Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support...
![Page 1: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/1.jpg)
Tests & Quizzes (aka SAMigo)
Keli Amann, User Experience SpecialistChristine Doherty, User Support Specialist
Stanford UniversityJune 17, 2010
![Page 2: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/2.jpg)
• Feature Overview• 2.7 Highlights• 2.8 Roadmap• Assessment in 3akai• Q&A
Agenda
211th Sakai Conference - June 15-17, 2010
![Page 3: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/3.jpg)
What are SAMigo’s Features:
311th Sakai Conference - June 15-17, 2010
• Assessment Authoring• Assessment Publishing• Assessment-Taking Management• Assessment Grading• Question Pools Management• Assessment-Type Management
![Page 4: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/4.jpg)
• Online test• Self-study questions• Homework, problem-sets• Paper, code, or project submission• Language drills• Quick knowledge probes• Surveys• Others???
Pedagogical Flexibility
411th Sakai Conference - June 15-17, 2010
![Page 5: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/5.jpg)
2.7 Highlights
11th Sakai Conference - June 15-17, 2010 6
![Page 6: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/6.jpg)
Main Page
711th Sakai Conference - June 15-17, 2010
Assessments
Pending Assessments
Published Assignments
Active
Inactive
New AssessmentsCreate assessment ORImport assessment
![Page 7: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/7.jpg)
11th Sakai Conference - June 15-17, 2010 9
2.62.6
2.72.7
Main Page: Create
![Page 8: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/8.jpg)
11th Sakai Conference - June 15-17, 2010 10
2.62.6
2.72.7
Main Page: Create
![Page 9: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/9.jpg)
11th Sakai Conference - June 15-17, 2010 11
2.62.6
2.72.7
Main Page: Create
![Page 10: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/10.jpg)
Main Page, Pending
1211th Sakai Conference - June 15-17, 2010
Assessments
Pending Assessments
Published Assignments
Active
Inactive
New AssessmentsCreate assessment ORImport assessment
![Page 11: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/11.jpg)
Main Page: Pending
11th Sakai Conference - June 15-17, 2010 14
2.62.6
2.72.7
![Page 12: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/12.jpg)
Main Page: Published
1511th Sakai Conference - June 15-17, 2010
Assessments
Pending Assessments
Published Assignments
Active
Inactive
New AssessmentsCreate assessment ORImport assessment
![Page 13: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/13.jpg)
Main Page: Published
11th Sakai Conference - June 15-17, 2010 17
2.62.6
2.72.7
*OOTB, Edit (not pictured) only appears if students haven’t started
![Page 14: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/14.jpg)
Main Page: Columns
11th Sakai Conference - June 15-17, 2010 18
2.62.6
2.72.7
![Page 15: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/15.jpg)
Edit Assessment Page
1911th Sakai Conference - June 15-17, 2010
Assessments
Pending Assessments
Published Assignments
Active
Inactive
New AssessmentsCreate assessment ORImport assessment
Edit Assessment
Assessment Settings
Publish
Preview
![Page 16: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/16.jpg)
Auto-scored• Multiple Choice (single and multiple correct)• Survey (multiple choice, different rating scales available)• Fill in the Blank• Numeric Response• Matching• True/False
Manually scored• Short Answer/Essay• Audio Recording• File Upload
About Question Types
2011th Sakai Conference - June 15-17, 2010
![Page 17: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/17.jpg)
11th Sakai Conference - June 15-17, 2010 22
2.62.6
2.72.7
Edit Assessment Page: Add Part
![Page 18: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/18.jpg)
11th Sakai Conference - June 15-17, 2010 23
2.62.6
2.72.7
Edit Assessment Page: Preview, Publish
![Page 19: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/19.jpg)
About Settings• Configures delivery of assessments (how they appear to
students)
• Options include: • display/organization• late handling• number of submissions • feedback/grading options • high security and time limit for high stakes testing
• Most settings are editable after publishing, but it is still important for instructors to review carefully
2411th Sakai Conference - June 15-17, 2010
![Page 20: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/20.jpg)
Improvements to Preview
• Fill in the Blank and Numeric Response text fields and Matching selection menus made functional
• Timer (inaccurate in Preview mode) replaced with graphic/explanation
• Submit for Grading and Exit confirmation pages included
11th Sakai Conference - June 15-17, 2010 25
![Page 21: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/21.jpg)
Preview screen
11th Sakai Conference - June 15-17, 2010 26
![Page 22: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/22.jpg)
Partial Credit for Multiple Choice Questions
Allows instructor to enter percentages of credit to give student for selections other than correct answer
• Correct answer is set to 100% automatically; can not be edited
• Reset links allow instructor to go back to default grading logic or reset percentage values to 0
• Validation requires value to be between 0 and 100 (inclusive); no negative numbers allowed
• Applies to Single Correct Answer only
• Can not be used in conjunction with Negative Marking
• Feature needs to be turned on in Sakai Properties; not OOTB
• Contributed by Rice University
11th Sakai Conference - June 15-17, 2010 27
![Page 23: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/23.jpg)
11th Sakai Conference - June 15-17, 2010 28
![Page 24: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/24.jpg)
11th Sakai Conference - June 15-17, 2010 29
![Page 25: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/25.jpg)
11th Sakai Conference - June 15-17, 2010 30
![Page 26: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/26.jpg)
11th Sakai Conference - June 15-17, 2010 31
![Page 27: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/27.jpg)
11th Sakai Conference - June 15-17, 2010 32
![Page 28: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/28.jpg)
Print Assessment (with or without feedback)
• Print action appears in Actions menu on main authoring page and as link in Edit Assessment page
• Available for both pending and published assessments
• Options include:• Showing short answer key• Showing feedback (question-level and selection-level)• Showing intro and part titles• Changing font size of document• Printing as HTML or downloading a PDF
• Feature needs to be turned on in Sakai Properties; not OOTB • Contributed by Universidad Politecnica de Valencia
11th Sakai Conference - June 15-17, 2010 33
![Page 29: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/29.jpg)
11th Sakai Conference - June 15-17, 2010 34
![Page 30: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/30.jpg)
11th Sakai Conference - June 15-17, 2010 35
![Page 31: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/31.jpg)
11th Sakai Conference - June 15-17, 2010 36
![Page 32: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/32.jpg)
11th Sakai Conference - June 15-17, 2010 37
![Page 33: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/33.jpg)
11th Sakai Conference - June 15-17, 2010 38
![Page 34: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/34.jpg)
11th Sakai Conference - June 15-17, 2010 39
![Page 35: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/35.jpg)
Email Notification• Option to send site members (or group members) email notification upon
publishing or republishing assessment
• Publishing without notification is set as the default to prevent accidental spamming
• Important settings are pre-populated in notification:• Assessment title• Available date, due date• Group released to (entire site, section(s)/group(s) or anonymous users) • Assessment URL• Time limit (if applicable)• Number of submissions allowed• Grading and feedback settings
• Option to include a personal message
11th Sakai Conference - June 15-17, 2010 40
![Page 36: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/36.jpg)
11th Sakai Conference - June 15-17, 2010 41
![Page 37: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/37.jpg)
11th Sakai Conference - June 15-17, 2010 42
![Page 38: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/38.jpg)
11th Sakai Conference - June 15-17, 2010 43
![Page 39: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/39.jpg)
11th Sakai Conference - June 15-17, 2010 44
![Page 40: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/40.jpg)
Editable Parts in Published Assessments
• In 2.6, only questions and settings were editable in published assessments
• In 2.7, Parts are editable in the following ways:• Title• Information (longer text field)• Attachments (add or remove)
• Operations that are more likely to create discrepancies in scoring are not editable:• Random Draw options• Question Ordering (when not using Random Draw)
11th Sakai Conference - June 15-17, 2010 45
![Page 41: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/41.jpg)
11th Sakai Conference - June 15-17, 2010 46
![Page 42: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/42.jpg)
11th Sakai Conference - June 15-17, 2010 47
![Page 43: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/43.jpg)
File Upload in Question Feedback
Option to upload files as feedback for each question; multiple files per question allowed
• Available on Questions page or student’s full submission page (under Scores)
• Update button must be clicked in scoring page after file uploaded with attachment helper
• Useful for returning commented papers to students
• Note: File size now displayed next to all file uploads (student submissions and files uploaded by instructor)
11th Sakai Conference - June 15-17, 2010 48
![Page 44: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/44.jpg)
11th Sakai Conference - June 15-17, 2010 49
![Page 45: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/45.jpg)
11th Sakai Conference - June 15-17, 2010 50
![Page 46: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/46.jpg)
11th Sakai Conference - June 15-17, 2010 51
![Page 47: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/47.jpg)
11th Sakai Conference - June 15-17, 2010 52
![Page 48: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/48.jpg)
Improvements for No Submission Records
• Applies to Total Scores page when student identities can be seen by graders
• Comments: • Disabled for students with no submissions• ‘What’s This’ link to clarify purpose of Comments field
• Adjustment Scores:• If adjustment score is entered for student with no submission, the score is
now sent to the Gradebook and to the Export file• Useful for handling offline submissions (e.g., students experiencing technical
difficulties)
11th Sakai Conference - June 15-17, 2010 53
![Page 49: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/49.jpg)
11th Sakai Conference - June 15-17, 2010 54
![Page 50: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/50.jpg)
Improvements in Delivery Mode
• Changes in button labels• “Save and Continue” is now Next• “Save for Later” is now Exit
• Changes in button configuration• Navigation buttons to left, Save/Exit/Submit buttons to right• Submit for Grading is rightmost button on the last question page
• Auto-Save and Save (on demand)
• Improved button layout in audio recording applet
11th Sakai Conference - June 15-17, 2010 55
![Page 51: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/51.jpg)
11th Sakai Conference - June 15-17, 2010 56
2.6 Button Configuration in Delivery Mode2.6 Button Configuration in Delivery Mode
![Page 52: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/52.jpg)
11th Sakai Conference - June 15-17, 2010 57
2.7 Button Configuration in Delivery Mode2.7 Button Configuration in Delivery Mode
![Page 53: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/53.jpg)
Auto-Save and Save (on demand)
• Auto-Save:• Saves student work without interruption (no screen refresh)• Runs at configurable interval (set in Sakai Properties)• Resets session timeout for inactivity• Useful for long assessments on one page or high stakes testing
• Save (on demand):• Allows students to save anytime while remaining on same page• Useful for answers that require significant time (e.g., essay questions)
• Contributed by Rutgers University
11th Sakai Conference - June 15-17, 2010 58
![Page 54: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/54.jpg)
Improved Button Layout in Audio Recording Applet
• Record and Stop are two separate buttons now, replacing toggle • Reduces chances of students erasing recording by accident
11th Sakai Conference - June 15-17, 2010 59
![Page 55: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/55.jpg)
Students View All Submissions/Scores
• In 2.6, only the submission with the recorded score (highest or last) displays in the student’s Submitted Assignments list
• In 2.7, the student’s Submitted Assignments list will show all submissions/scores by default
• Students can collapse the Submitted Assignments list to show only recorded scores
• Useful for self-study or practice exam scenarios; students can see feedback for multiple submissions
• Contributed by Universidad Politecnica de Valencia
11th Sakai Conference - June 15-17, 2010 60
![Page 56: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/56.jpg)
11th Sakai Conference - June 15-17, 2010 61
![Page 57: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/57.jpg)
11th Sakai Conference - June 15-17, 2010 62
![Page 58: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/58.jpg)
Performance Improvements
• Performance has been improved in the following areas:
• Generation of Statistics for high number of submissions (~500)
• Loading of Questions page (under Scores) for File Upload and Audio Recording questions
• Downloading of student submission files (from File Upload questions)
11th Sakai Conference - June 15-17, 2010 63
![Page 59: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/59.jpg)
2.8 Roadmap (independent)
64
• Respondus integration
• Record Average Score for multiple submissions*• Allow students to use Rich-Text Editor for Short Answer/Essay
question type**
• Remove 4000 character limit for student response in Short Answer/Essay question type**
• Allow instructors to enter zero score for unsubmitted assessments
• Allow instructors to show students scores only, without showing any other feedback (e.g., questions/responses)
• More to be discussed
* Based on contributions from Rice University** Based on contributions from Longsight
![Page 60: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/60.jpg)
Assessment in Sakai 3.0?
65
User Research and Concept Development: Fall 09-Summer 2010
• No such thing as Tests & quizzes; functionality distributed
• All learning activities initiated from (syllabus schedule, to do, repository) in same basic way
• Activities stored in repository for sharing or reuse: find in “drawer” or repository
Work ongoing for
• instructor evaluation
• student views of syllabus, to do, grades
http://confluence.sakaiproject.org/display/UX/ Sakai+3.0+capabilities+for+learning+activities
![Page 61: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/61.jpg)
Questions?
11th Sakai Conference - June 15-17, 2010 66
![Page 62: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/62.jpg)
Contacts
Questions and feedback: [email protected]
Lydia Li, Stanford University Project Manager [email protected]
Homepage:http://confluence.sakaiproject.org/confluence/display/SAM
6711th Sakai Conference - June 15-17, 2010
![Page 63: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/63.jpg)
Appendix
Review of capabilities of Sakai 2.x
6811th Sakai Conference - June 15-17, 2010
![Page 64: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/64.jpg)
![Page 65: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/65.jpg)
Organize & Publish Assessments
7011th Sakai Conference - June 15-17, 2010
• Pending Assessments• Starting page for assessment authoring• Can be created using markup text (aka Quick Create)• Can be exported/imported in QTI XML format• Can create duplicates easily • When ready, published via Settings
• Published Assessments for student assessment-taking• When students respond, Scores action appears• Can edit published assessments and most settings • Can remove published assessments
![Page 66: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/66.jpg)
Auto-scored• Multiple Choice (single and multiple correct)• Survey (multiple choice, different rating scales available)• Fill in the Blank• Numeric Response• Matching• True/False
Manually scored• Short Answer/Essay• Audio Recording• File Upload
Question Types
7111th Sakai Conference - June 15-17, 2010
![Page 67: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/67.jpg)
• At all levels of assessment authoring:• Assessment/Part Headers • Questions• Selections• Feedback
Rich Text & Attachments
7211th Sakai Conference - June 15-17, 2010
![Page 68: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/68.jpg)
Quick Create
• Efficiency created by reducing number of clicks, pages loading and saving
• Useful for transferring assessments created in other applications or LMS (e.g., MS Word, WebCT), no need to paste into different fields
• Supports Multiple Choice, Fill in the Blank, Short Answer/Essay, and True/False question types
• Rich text, attachments, and additional questions can be added later, through assessment authoring page
7311th Sakai Conference - June 15-17, 2010
![Page 69: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/69.jpg)
Import/Export
• Supports QTI v 1.2
• Export types: IMS QTI-compliant XML or IMS Content Packaging (for use with attachments)
• Useful for:• Copying assessment to different site• Archiving assessments offline
7411th Sakai Conference - June 15-17, 2010
![Page 70: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/70.jpg)
Settings• Configures delivery of assessments (how they appear to
students)
• Options include: • display/organization• late handling• number of submissions • feedback/grading options • high security and time limit for high stakes testing
• Most settings are editable after publishing, but it is still important for instructors to review carefully
7511th Sakai Conference - June 15-17, 2010
![Page 71: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/71.jpg)
Publishing• Release assessment to students
• Copy made from pending assessment – pending assessment can be modified without affecting published version
• Can set Available Date in future -- useful for instructors who want to do bulk of setup early
• Can retract any time, making assessment unavailable to all students
• Can remove published assessment
• Can edit published assessment
7611th Sakai Conference - June 15-17, 2010
![Page 72: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/72.jpg)
Taking an Assessment (Students)
• Take an Assessment section• List determined by available, due, and retract dates,
plus number of allowed submissions• Can submit when done or save a work in progress
• Submitted Assessments section• Provides submission confirmation with timestamp• Depending on settings, students can review scores,
feedback, grader’s comments, statistics
7711th Sakai Conference - June 15-17, 2010
![Page 73: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/73.jpg)
Grading
• Ability to grade all questions for one student or grade all responses to one question
• Manual score adjustments can be made to individual questions or entire assessment
• Comments can be made for individual questions or entire assessment
• Ability to send scores to Gradebook
• Ability to export scores/responses to Excel
• Ability to calculate statistics and histograms
7811th Sakai Conference - June 15-17, 2010
![Page 74: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/74.jpg)
Question Pools
• Organize questions into multiple subpools
• Move/copy/remove multiple questions at a time
• Author questions from within Pool Manager
• Import questions from IMS QTI-compliant XML file
• Randomly draw from pools for an assessment
• Question pools belong to an individual user, available across all user’s sites
• Ability to share question pools with other site members
7911th Sakai Conference - June 15-17, 2010
![Page 75: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/75.jpg)
Assessment Types
• Create assessment “types” for different disciplines, different uses
• Hide complexity by selecting which settings are visible to the instructor.
• Pre-set defaults by making setting choices for the type (e.g., Self-study always has immediate feedback)
8011th Sakai Conference - June 15-17, 2010
![Page 76: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/76.jpg)
Assessment Creation Workflow
July 2009 10th Sakai Conference - Boston, MA, U.S.A.
![Page 77: Tests & Quizzes (aka SAMigo) Keli Amann, User Experience Specialist Christine Doherty, User Support Specialist Stanford University June 17, 2010.](https://reader036.fdocuments.us/reader036/viewer/2022062805/5697bfa81a28abf838c99325/html5/thumbnails/77.jpg)
11th Sakai Conference - June 15-17, 2010 82