Electronic marking and feedback using GradeMark

OCSLD & Mediaworkshop 2014

Cartoon by Bob Pomfret, copyright Oxford Brookes University.

What’s it like to use?

What’s the point?

Are there any

drawbacks?

Can I have a go?

Session outline

What does the student

see?

What does the tutor

do?

Overview

• Hosted by Turnitin • Runs in Moodle• Functions include

•QuickMark (bank/set of module comments)•General Comments• In-line comments•Rubric (with grade calculation)•Grading•Audio feedback (feed-forward)

Example of the functions

Grade

Similarity score

Quickmark setComments

Add general comment

Add rubric

Activity 1: Review a marked up assignment

Open the exemplar assignment titled ‘Activity 1 – a marked up assignment to review’

Check all of the markers’ feedback and grades If you were second marker, how would you proceed?

Note: please do NOT edit/markup this assignment

Pros• Paperless• No need for students to submit or collect in person• More readable feedback for students• Richer feedback is possible• High levels of control over release of grades &

feedback• Easy access for second markers and external

examiners• Range of multi-modal feedback/feed-forward options• Easy to use• Can save marking time• Allows for peer evaluation (observation) of marking

across a module/programme• Marking via tablet device (iPad)

Cons

• Heavily reliant on internet connection (although offline marking can be done using mobile app)

• Additional screen time• No ‘blind’ second marking, need to establish system

for second markers to annotate papers• Symbols, images, cannot be used in feedback• Association with Turnitin plagiarism detection• Potential for ‘spying’?• Moodle tutor/seminar groups need to be set up so that

tutors can easily locate just their students’ submissions (from large group)

• Requires change to previous marking practice

Anonymous marking

Plan carefully with summative assignments that are being marked anonymously!

If at any time anonymity is turned off (by anyone), it cannot be turned back on again for that assignment!Plan to accommodate mitigating circumstances extensions and resits (return of grades/feedback removes anonymity)

extend the assignment post date, or create new assignment(s) for extensions and/or resits

What a student sees

Originality report

General comments section

Audio-feedback

Switch between Originality & GM

In-text comments

In-text comment about highlighted

text

Locate a set of assignments

Click here to see

submissions

What does the tutor do?

Submissions can be searched

by author, originality reading

or submission number

Tutors click on pen icon under grade

Indicates student has collected the

marked assignment

Locate a set of assignments

Click here to see

submissions

Choose group of assignments to mark

Choose your tutor/seminar

group assignments

Open an individual submission

Click on pen icon

Originality report turned off by module leader

Mark away

Choose your QM set or create a new

one

Use QM manager to edit, import or export QM sets

Personalise or colour-code QM

comments Move to General Comments or

Rubric

Use the rubric function

Select criterion &

level achieved

As you scroll to a criterion scale, its

descriptor will appear below.

Add a general comment & audio message

General comments

section

Record a message – up to 3 minutes

Written comments

Activity 2: Import a quickmark set; mark an assignment

• You have been provided with a quickmark file (exported from a manually created quickmark set) to import.

• Import the quickmark set• Select one of the ‘mock students’• Open up their assignment & use the GM functions to

give written & oral feedback / feed-forward

Discussion: How can course quickmark sets be updated each semester/year?

Activity 3: Create and apply a rubric to an assignment

Select an assignment to mark Create a new rubric (using your own marking criteria) Apply the rubric to this assignment Export the rubric and share it with a colleague Import your colleague’s rubric

Resources

Jisc Electronic Management of Assessment project website athttp://ema.jiscinvolve.org/wp/

Maguire, G. & Pearson, R. (2012) Case Study – Turnitin GradeMarkhttps://weblearn.ox.ac.uk/access/content/group/f4390f96-516a-4ab0-ac61-8a963b312453/docs/Turnitin_grademarkv1.pdf

Oxford Brookes University (2012) What is GradeMark?https://wiki.brookes.ac.uk/display/BVhelp/GradeMark