Post on 20-Jan-2016
Electronic marking and feedback using GradeMark
OCSLD & Mediaworkshop 2014
Cartoon by Bob Pomfret, copyright Oxford Brookes University.
What’s it like to use?
What’s the point?
Are there any
drawbacks?
Can I have a go?
Session outline
What does the student
see?
What does the tutor
do?
Overview
• Hosted by Turnitin • Runs in Moodle• Functions include
•QuickMark (bank/set of module comments)•General Comments• In-line comments•Rubric (with grade calculation)•Grading•Audio feedback (feed-forward)
Example of the functions
Grade
Similarity score
Quickmark setComments
Add general comment
Add rubric
Activity 1: Review a marked up assignment
Open the exemplar assignment titled ‘Activity 1 – a marked up assignment to review’
Check all of the markers’ feedback and grades If you were second marker, how would you proceed?
Note: please do NOT edit/markup this assignment
Pros• Paperless• No need for students to submit or collect in person• More readable feedback for students• Richer feedback is possible• High levels of control over release of grades &
feedback• Easy access for second markers and external
examiners• Range of multi-modal feedback/feed-forward options• Easy to use• Can save marking time• Allows for peer evaluation (observation) of marking
across a module/programme• Marking via tablet device (iPad)
Cons
• Heavily reliant on internet connection (although offline marking can be done using mobile app)
• Additional screen time• No ‘blind’ second marking, need to establish system
for second markers to annotate papers• Symbols, images, cannot be used in feedback• Association with Turnitin plagiarism detection• Potential for ‘spying’?• Moodle tutor/seminar groups need to be set up so that
tutors can easily locate just their students’ submissions (from large group)
• Requires change to previous marking practice
Anonymous marking
Plan carefully with summative assignments that are being marked anonymously!
If at any time anonymity is turned off (by anyone), it cannot be turned back on again for that assignment!Plan to accommodate mitigating circumstances extensions and resits (return of grades/feedback removes anonymity)
extend the assignment post date, or create new assignment(s) for extensions and/or resits
What a student sees
Originality report
General comments section
Audio-feedback
Switch between Originality & GM
In-text comments
In-text comment about highlighted
text
Locate a set of assignments
Click here to see
submissions
What does the tutor do?
Submissions can be searched
by author, originality reading
or submission number
Tutors click on pen icon under grade
Indicates student has collected the
marked assignment
Locate a set of assignments
Click here to see
submissions
Choose group of assignments to mark
Choose your tutor/seminar
group assignments
Open an individual submission
Click on pen icon
Originality report turned off by module leader
Mark away
Choose your QM set or create a new
one
Use QM manager to edit, import or export QM sets
Personalise or colour-code QM
comments Move to General Comments or
Rubric
Use the rubric function
Select criterion &
level achieved
As you scroll to a criterion scale, its
descriptor will appear below.
Add a general comment & audio message
General comments
section
Record a message – up to 3 minutes
Written comments
Activity 2: Import a quickmark set; mark an assignment
• You have been provided with a quickmark file (exported from a manually created quickmark set) to import.
• Import the quickmark set• Select one of the ‘mock students’• Open up their assignment & use the GM functions to
give written & oral feedback / feed-forward
Discussion: How can course quickmark sets be updated each semester/year?
Activity 3: Create and apply a rubric to an assignment
Select an assignment to mark Create a new rubric (using your own marking criteria) Apply the rubric to this assignment Export the rubric and share it with a colleague Import your colleague’s rubric
Resources
Jisc Electronic Management of Assessment project website athttp://ema.jiscinvolve.org/wp/
Maguire, G. & Pearson, R. (2012) Case Study – Turnitin GradeMarkhttps://weblearn.ox.ac.uk/access/content/group/f4390f96-516a-4ab0-ac61-8a963b312453/docs/Turnitin_grademarkv1.pdf
Oxford Brookes University (2012) What is GradeMark?https://wiki.brookes.ac.uk/display/BVhelp/GradeMark