Assessment and feedback in university teaching Kieron Flanagan.

30
Assessment and feedback in university teaching Kieron Flanagan

Transcript of Assessment and feedback in university teaching Kieron Flanagan.

Page 1: Assessment and feedback in university teaching Kieron Flanagan.

Assessment and feedback in university teaching

Kieron Flanagan

Page 2: Assessment and feedback in university teaching Kieron Flanagan.

Outline

1. The nature of university teaching

2. Purposes of assessment3. Types of and routes for

feedback4. Plagiarism

2

Page 3: Assessment and feedback in university teaching Kieron Flanagan.

What is university teaching for?• We teach our students things

(“subject knowledge and understanding”)

• However, in the course of learning those things they should also develop a range of skills

• Students tend to forget about the latter 3

Page 4: Assessment and feedback in university teaching Kieron Flanagan.

A university education should encourage students to build…• Subject-specific skills (e.g.

accounting conventions, techniques)

• General (transferrable) skills• General critical thinking and

analytical skills

4

Page 5: Assessment and feedback in university teaching Kieron Flanagan.

General (transferrable) skills

• Team-working• Time/task management• Active reading and active listening• Critical thinking• Document preparation• Communication skills (oral/written)• &c.

5

Page 6: Assessment and feedback in university teaching Kieron Flanagan.

Critical thinking and analytical skills

• These are the skills necessary to analyse information, weigh up evidence and arguments, draw (own) conclusions and justify them

• We shouldn’t let our students think that these are just obscure or useless scholarly skills

• Typically these are the skills most employers are looking for from graduates

6

Page 7: Assessment and feedback in university teaching Kieron Flanagan.

Critical thinking skills…

• Of course they are also the skills that will get them good marks…

• What does critical thinking mean in practice?

7

Page 8: Assessment and feedback in university teaching Kieron Flanagan.

Critical thinking

• Critical thinking means thinking about the positions taken by authors, about the validity of their evidence, the strengths of their arguments

• This includes the student being critical (critically appraising and reflecting upon) their own stance

• Clearly, it does not mean blindly criticising everything – it is an informed process 8

Page 9: Assessment and feedback in university teaching Kieron Flanagan.

Critical thinking FAQs

Q: How can I be critical of academic experts or people in important positions? They know more than I do…A: We are trying to develop critical

skills…• They may be biased in some way• They may have ignored important evidence• They may have overdone their conclusions

Q: But isn’t it disrespectful to criticise your teachers?A: If a student disagrees with us but backs up

their argument with evidence then we will always give them credit for it!

9

Page 10: Assessment and feedback in university teaching Kieron Flanagan.

Uncritical thinking is…

• Accepting (and repeating) the arguments of authors - or lecturers/tutors - without question

• Putting forward own personal views without reflecting critically upon them, or otherwise taking a position without explaining why

10

Page 11: Assessment and feedback in university teaching Kieron Flanagan.

Evidence of uncritical thinking…• Stating in assessed work that something

is ‘obvious’ or ‘clearly correct’ without providing an explanation

• Regurgitating lecture notes in assessed work

• Basing assessed work entirely on one or two readings (or on the results of a Google or Wikipedia search)

11

Page 12: Assessment and feedback in university teaching Kieron Flanagan.

We expect our students to take responsibility for their own learning• The style of learning that takes place at

a university is very different from school or college. It is largely self-directed (i.e. most of the learning is meant to be done outside contact time).

• Lectures are intended to guide this learning.

• Seminars are supposed to help students discuss what they are learning, and to receive feedback.

• We need to encourage students to develop an active learning style.

12

Page 13: Assessment and feedback in university teaching Kieron Flanagan.

Active learning?

• Active listening in lectures (taking detailed notes, not relying on handouts)

• Taking an active part in seminars, the most important part of their contact time: taking notes, contributing, and listening actively and respectfully to others

• Making the time to do the necessary reading and preparation beforehand (this is part of the total study time)

• Reading actively: with a pencil, taking notes, not using a highlighter, not using a PC to cut-and-paste.

• Active reading can also be selective reading – use of abstracts, tables of contents, indices, introductions, summaries etc to help find and focus on what is important to the task in hand

13

Page 14: Assessment and feedback in university teaching Kieron Flanagan.

If they don’t do these things?• Seminar attendance is compulsory

(poor attendance goes on their record and could potentially be reflected in the references we write for them)

• More importantly, lack of preparation or participation and lack of active learning will mean they are wasting their (and your) time in lectures and seminars

• …and that will lead them to FAIL….

14

Page 15: Assessment and feedback in university teaching Kieron Flanagan.

How can students become more active learners?• They need to understand their own

attitudes to learning• They need to understand their own

study and critical thinking skills (audit) and how they can be improved (guides, help)

• They need to practice! Encourage them to take advantage of their strengths and work on their weaknesses

• Encourage them to seek help and support (student guidance service, ELC, etc. etc.)

15

Page 16: Assessment and feedback in university teaching Kieron Flanagan.

Purposes of assessment?

• The purpose of assessment is ultimately to demonstrate learning from the course (i.e. subject knowledge + skills)

• Assessment can have both formative (to build confidence & improve performance) and summative elements

• Some assessment is mainly formative (e.g. practice essays, presentations)

• Some assessment is mainly summative (e.g. final exams)

• Mostly it is some mixture of the two…

16

Page 17: Assessment and feedback in university teaching Kieron Flanagan.

Some Purposes of Feedback

FORMATIVE• To encourage better work

in the future

• Subject knowledge and understanding• To correct errors of

understanding (or of omission)

• Skills• To identify strengths

and weaknesses in skills

SUMMATIVE• To reward good work• To account for the grade

given• To help them understand

the progress they are making in their programme

17

Page 18: Assessment and feedback in university teaching Kieron Flanagan.

Some important considerations

Validity – does assessment really measure the intended learning outcomes?

Reliability – is assessment consistent from student to student, examiner to examiner? (Hence need for explicit learning outcomes, grading criteria, and for safeguards such as moderation)

18

Page 19: Assessment and feedback in university teaching Kieron Flanagan.

Feedback

• Arguably, the UK system is historically biased towards summative assessment

• Students often (& sometimes fairly) complain about alack of timely and useful formative “feedback”

• However, it’s also crucial to address common student misconceptions about feedback…

19

Page 20: Assessment and feedback in university teaching Kieron Flanagan.

Feedback

• Students tend to associate “feedback” with written comments on essays…

• This can tend to be rather brief and generic, and can use negative or inaccessible language which doesn’t work well as formative feedback

• But feedback comes via multiple routes and it is important to help the students to realise that 20

Page 21: Assessment and feedback in university teaching Kieron Flanagan.

Multiple routes for feedback

• Informal advice and discussion during a lecture, seminar, workshop or lab. (For this, students need to participate!)

• Online exercises and quizzes• Responses to your questions from a

member of staff or tutor, including feedback provided via email, to a group via an online discussion forum or via FAQs

• Specific course related feedback sessions

• Written and/or verbal comments on assessed or non assessed coursework

21

Page 22: Assessment and feedback in university teaching Kieron Flanagan.

Multiple routes for feedback

• Written and/or verbal comments after a group or individual presentation

• Generic feedback posted on Blackboard regarding overall assessment performance (common problems, etc)

• Group and individual discussions/meetings with an Academic Advisor or with a Programme Director

22

Page 23: Assessment and feedback in university teaching Kieron Flanagan.

What should students expect?

It is MBS policy that feedback should be…

• Prompt• Individual• Constructive• Related to progression• Related to learning outcomes

23

Page 24: Assessment and feedback in university teaching Kieron Flanagan.

What should students expect from tutors?

• Clarification and discussion of the lectures • The opportunity to discuss the themes of

the course in seminars, with the tutor and with each other

• Advice on prioritising their reading• Timely feedback on essay plans etc. where

appropriate• Continuous informal feedback on their

developing understanding of the subject (and on their developing skills) through seminar discussions, presentations &c and on demand

24

Page 25: Assessment and feedback in university teaching Kieron Flanagan.

Approaches to feedback

• The Open University recommends the ‘feedback sandwich’• start with the good things• move onto (constructive) criticism• end on a positive note for future

improvement

• Focus your feedback – be specific, relate feedback to learning outcomes and avoid unhelpful comments like “could do better”, “not a bad effort” &c.

• Structured versus less structured approaches

25

Page 26: Assessment and feedback in university teaching Kieron Flanagan.

A few words about plagiarism…

• Despite warnings, lectures, etc. many of our students have a poor understanding of plagiarism

• Experience suggests this is often related to a poor understanding of good academic practices (and why they are important)

• Tutors have a crucial role in reinforcing positive messages here…

26

Page 27: Assessment and feedback in university teaching Kieron Flanagan.

A few words about plagiarism…

We should encourage our students to:

• Develop their critical thinking/reading skills

• Think about what resources are appropriate/reliable (information literacy)

• Develop good note-taking practices

• Develop good referencing, quotation, citation practices

27

Page 28: Assessment and feedback in university teaching Kieron Flanagan.

A few words about plagiarism…

• Individual assessment requires that students demonstrate their own learning

• They must do this by critically appraising evidence, sources and by constructing their own argument to answer the question

• And not by assembling an essay from quotations or close paraphrases of others’ arguments and conclusions 28

Page 29: Assessment and feedback in university teaching Kieron Flanagan.

A few words about plagiarism…

• Plagiarism does attract serious (life-changing) penalties and MBS students are caught and disciplined!

• Tutors can play an important part in positively encouraging students to better understand the purposes of assessment, develop good practices - and avoid risky ones

• Tutors can also look out for signs of personal problems, non-attendance etc. which are sometimes associated with plagiarism 29

Page 30: Assessment and feedback in university teaching Kieron Flanagan.

Thank you for your attention!Questions? Feedback?

[email protected]