Getting ready for learning analytics

Getting ready for learning analytics

Introductions

Facilitators»Paul Bailey»Shri Footring»Niall Sclater»Rob Wyn Jones»George Munroe

3/03/2016

Overview

»Toolkit› Discovery› Code of practice› Technical and data

definitions»Community› Network Meetings› http://analytics.jiscinvolve.org/

wp/ › analytics@jiscmail.ac.uk

»Technical architectureJisc learning analytics project

3/03/2016 Getting ready for learning analytics

Activity 1

1. How would you define learning analytics?2. What do you want to gain from using learning

analytics at your institution?

Discussion questions

3/03/2016 Getting ready for learning analytics

A definition of learning analytics

“Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs”

SoLAR – Society for learning analytics research

3/03/2016 Getting ready for learning analytics

Finding a starting point…

“I think one of the main problems with analytics is finding a starting point. Going through the Discovery phase does give a number of starting points.”

Sheila MacNeillhttps://howsheilaseesit.wordpress.com/2016/02/09/clawing-my-way-up-through-the-trough-of-disillusionment-with-learning-analytics/

3/03/2016 Getting ready for learning analytics

Activity 2: Getting ready…

Activity 2: Getting Ready….

1. Are you aware of the Legal and Ethical issues relating to learning analytics?

2. What the technical and data challenges you need to consider?

3. Are you culturally ready for learning analytics?

3/03/2016 Getting ready for learning analytics

Legal and ethical

3/03/2016 Getting ready for learning analytics

Legal and ethical

3/03/2016 Getting ready for learning analytics

Group Name QuestionMain type

Importance Responsibility

2 Consent Adverse impact of opting out on individual

If a student is allowed to opt out of data collection and analysis could this have a negative impact on their academic progress?

Ethical 1 Analytics Committee

7 Action Conflict with study goals

What should a student do if the suggestions are in conflict with their study goals?

Ethical 3 Student

8 Adverse impact

Oversimplification How can institutions avoid overly simplistic metrics and decision making which ignore personal circumstances?

Ethical 1 Educational researcher

86 issues in 9 groups

Legal and ethical

Code of practice for learning analytics.

Available at:jisc.ac.uk/guides/code-of-practice-for-learning-analytics

3/03/2016 Getting ready for learning analytics

Technical and data

»What data must be collected to provide useful learning analytics? You might need…› Historical (18 months minimum) for Predictive

modelling › LIVE data to refine the model moving forwards› Student data, assignment and examination marks

plus results/ grade data, etc. › Activity data – VLE, library, attendance, etc.

»How long should data be preserved?

3/03/2016 Getting ready for learning analytics

Technical and data

»How can this be collected from the various systems involved?› Do data from different systems need to be mapped to

each other to be useful?› How can any required mappings be achieved?› Should mapped data be stored separately from the

sources?› Where should mapped data be stored?

3/03/2016 Getting ready for learning analytics

Technical and data

»What analysis outputs are of most interest?› What would bring confidence to making important

decisions based on analysis outputs?› What would erode confidence in making those

important decisions?

3/03/2016 Getting ready for learning analytics

Getting ready for learning analytics

Culture

»Leadership»Wide engagement»A shared vision

»Staff skills»Effective interventions»Support for learners

3/03/2016

Discussion Questions…

»Should students be asked for consent to use their data for learning analytics?

»Can students access all the data held about them in your institution?

»Should interventions always be human-mediated?

Legal and Ethical

3/03/2016 Getting ready for learning analytics

Discussion Questions…

»What sources/ good indicators of student engagement or activity exist?

»What problems are foreseen with LIVE student data capture?

Institutional Culture»Who will you involve in implementing learning

analytics in your institution?

»What is the strategic driver? Quality, finance,student satisfaction?

Technical and Data

3/03/2016 Getting ready for learning analytics

Plenary

1. Are you aware of the Legal and Ethical issues relating to learning analytics?

2.What the technical and data challenges you need to consider?3.Are you culturally ready for learning analytics?

3/03/2016 Getting ready for learning analytics

jisc.ac.uk

Learning analytics

Further information

Paul BaileySenior Co-design managerpaul.bailey@jisc.ac.uk

3/03/2016 Getting ready for learning analytics