Post on 29-Jan-2016
description
Assessment Analytics
• Should we do it?• If so – what might it look like?
Learning Analytics
NewOperationalisation
Poorly understood Gaps
Ethics
Emphasis on SNA
Emphasis on SNA
Partial
• Most student learning doesn’t happen online
• Most teaching happens in classrooms
Not useful
• ‘Isn’t this interesting and aren’t I clever’
• ‘How can I put this to use to improve student learning?
Emphasis on attrition/retention
• Attrition rate: single figures (%)
Learning Analytics
Useful to only a tiny proportion of
students and teachers
Focus on things other than learning
Academic Analytics
Business intelligence
in HE
Learning Analytics
Focused on retention
Assessment Analytics
Assessment data used within a learning analytics strategy
InstitutionalisedOperationalisation
Assessment
All students are assessed and all tutors mark student work
Ubiquitous
Routine Normative
Widely understood
Expected Everyone ‘gets’ it
Important
It’s what students pay
for
It’s what tutors are paid to do
Focused on achievement
not just retention
Degree Classification
GPA at progression
Module Results
Assessment task results
Granularity
Degree Classification
GPA at progression
Module Results
Assessment task results
Granularity
Common errors
Assessment criteria
Assessment Analytics
Automates• Data harvesting at fine granularity
Allows• handling assessment data over large and dispersed cohorts• monitoring common errors, progression and achievement• informed curriculum planning even in year
Reporting• Student• School• Institution • PSRB
License to practice
Evidence for stakeholders
1
2
3
4
5
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Rubric Results
First
2.1
2.2
3rd
Fail
Percentage of Students
Ass
essm
ent
Cri
teri
a
Criterion 1 09-10
Criterion 1 10-11
Criterion 2 09-10
Criterion 2 10-11
Criterion 3 09-10
Criterion 3 10-11
Criterion 4 09-10
Criterion 4 10-11
Criterion 5 09-10
Criterion 5 10-11
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
2009-10/2010-11 Rubric Result Comparison
1st2.12.23rdfail
% Students
Rubr
ic Cr
iteria
Activity
Usefulness• Supporting student learning• Informing curriculum design decisions
(between and in year)
Risks• Ethics• Negative backwash