Paul Bailey, Senior Codesign Manager, Research and DevelopmentJisc Building a national learning analytics service

UKSG Building a national learning analytics service 2

OutlineBackgroundOverview of the Learning Analytics ServiceA user view of the serviceLibrary Analytics Labs

UKSG Building a national learning analytics service 3

About Jisc…

It operates shared digital infrastructure and services, negotiates sector-wide deals with IT vendors and commercial publishers, and provides trusted advice and practical assistance for universities and colleges.

Jisc is the UK higher and further education sectors’ not-for-profit organisation for digital service and solutions.

UKSG Building a national learning analytics service 4

Effective Learning Analytics ChallengeRationaleUniversities and colleges don't have enough useful data about students and how they are learning. What they have they don’t analyse and interpret. They are missing opportunities to use technology to provide feedback to students. They need to support staff who could be using analytics and a standard set of tools and technologies to monitor and intervene. Who it affects and howStudents are missing out on the possibility of an improved experience, better retention, and better achievement.Staff are missing the opportunity to develop skills to use analytics to improve support, teaching and curriculum design.TimescalePilot tools and metrics 1-2 yearsImpact on retention, achievement and progression 3-4 years.

UKSG Building a national learning analytics service 5

Learning Analytics

What is learning analytics?

UKSG Building a national learning analytics service 6

“learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs”SoLAR – Society for Learning Analytics Research

UKSG Building a national learning analytics service 7

What do we mean by Learning Analytics?The application of big data techniques such as machine based learning and data mining to help learners and institutions meet their goals:

For our project: » Improve retention (current project)» Improve attainment (current project)» Improve employability (future project)»Personalised learning (future project)

UKSG Building a national learning analytics service 8

Retention 178,100 students aged 16-18 failed to finish post-secondary

school qualifications they started in the 2012/13 academic year costing £814 million a year - 12 per cent of all government

spending on post-16 education and skills (Centre for Economic and Social Inclusion

8% of undergraduates drop out in their first year of study This costs universities around £33,000 per student students with 340 UCAS points or above were considerably less

likely (4%) than those with less UCAS points (9%) to leave their courses without their award

UKSG Building a national learning analytics service 9

Attainment 70% of students reporting a parent with HE qualifications

achieved an upper degree, as against 64% of students reporting no parent with HE qualifications

In all disciplines except Computer Science, Medicine and Dentistry, and Physical Science, students with a parent with an HE qualification were more likely to have achieved an upper degree

Overall, 70% of White students and 52% of BME students achieved an upper degree

UKSG Building a national learning analytics service 10

Jisc’s Learning Analytics ProjectThree core strands:

Learning Analytics Service

Toolkit Community

Jisc Learning Analytics

Learning Analytics - Initial Meetings 2015 11

Community: Project Blog, mailing list and network eventsBlog: http://analytics.jiscinvolve.org

Mailing: analytics@jiscmail.ac.uk

UKSG Building a national learning analytics service 12

http://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics

Toolkit: Code of Practice

http://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-_Literature_Review.pdf

UKSG Building a national learning analytics service 13

Toolkit: Learning analytics

http://repository.jisc.ac.uk/5657/1/Learning_analytics_report.pdf

The current state of play in UK higher and further education

UKSG Building a national learning analytics service 14Toolkit: Learning Analytics in Higher Education: A review of UK and international practice 

Including case studies on Traffic Lights and Interventions: Signals at Purdue

University Analysing use of the VLE at the University of Maryland,

Baltimore County Identifying at-risk students at New York Institute of

Technology Fine-grained analysis of student data at California

State University Transferring predictive models to other institutions

from Marist College Enhancing retention at Edith Cowan University Early alert at the University of New England Developing an ‘analytics mind-set’ at the Open

University Predictive analytics at Nottingham Trent University Analysing social networks at the University of

Wollongong Personalised pathway planning at Open Universities

Australiahttps://www.jisc.ac.uk/reports/learning-analytics-in-higher-education

UKSG Building a national learning analytics service 15

Toolkit: Discovery Institutional ReadinessA process to support institutions to access their readiness to implement learning analytics 2015-16 – Three days onsite consultancy visit of workshops, focus groups and

interviewsReview of the reports form 26 institutions are being used to develop a new readiness process 2016 -17 – Overview workshop, introducing a “Readiness Toolkit” with a

diagnostic set of questions and support materials leading to implementation.

Further details will be announced via analytics @jiscmail.ac.uk

UKSG Building a national learning analytics service 16

Toolkit: Data structures and definitionsContains the Student Unified Data Definitions and the Jisc xAPI recipes (for learner activity data)The main branch contains the latest agreed versions»Other branches contain versions in developmentContributions and modifications are welcome!https://github.com/jiscdev/learning-analytics

UKSG Building a national learning analytics service 17

Learning Analytics Service Architecture

UKSG Building a national learning analytics service 18

Data Visualisations straight out of the Warehouse

Learning Analytics - Initial Meetings 2015 19

DashboardsVisual tools to allow lecturers, module leaders, senior staff and support staff to view: » Student engagement» Cohort comparisons» etc…

Based on either commercial tools from Tribal (Student Insight) or open source tools from Unicon/Marist (OpenDashBoard)

Learning Analytics - Initial Meetings 2015 23

Learning Analytics - Initial Meetings 2015 24

Alert and Intervention SystemTools to allow management of interactions with students once risk has been identified:

» Case management» Intervention management» Data fed back into model» etc…

Based on open source tools from Unicon/Marist (Student Success Plan)

Learning Analytics - Initial Meetings 2015 25

Learning Analytics - Initial Meetings 2015 26

First version will include: »Overall engagement»Comparisons»Self declared data»Consent management

Bespoke development by Therapy Box

Student App

Student Learning Analytics App 27

Stats – Provides an engagement and attainment overview and drilling down to gives comparative activity graphs.

Log – Allows you to log time spent on specified activities e.g. reading for an assignment

Target – Allows you set personal targets to improve your engagement e.g. study for 10 hours this week

UKSG Building a national learning analytics service 28

The Learning Analytics Project in numbersExpressions of interest: 85Engaged in activity: 35Discovery to Sept 16: agreed (26), completed (14), reported (10)Learning Analytics Pre-Implementation: (12)Learning Analytics Implementation: (7)

Learning Analytics - Initial Meetings 2015 29

Phase 1&2Sep 15 – Apr 16

Phase 2&3 Jan – Sept

16

Transition to Service

Sept 16 – July 17

Jisc Learning Analytics

Service Sept 2017

UKSG Building a national learning analytics service 30

Building on the learning analytics service Freemium vs premium service Integration of third party products into the architecture Briefing day in April attended by 30 suppliers Supplier demos and panel at network meeting 22 June,

Newman College, Birmingham Analytics Labs Development teams work with data to produce new

dashboards and visualisations

UKSG Building a national learning analytics service 31

Analytics Labs – user stories approach

UKSG Building a national learning analytics service 32

Library Analytics LabsOpen call for expressions of interest to join a team working on Library

BI Stories at 0.2 FTE, total estimated effort 15 daysBoth Product Owners and Sector Data Experts invited:

Product Owner from the sector to steer which stories are of interest Sector Experts to understand what data sources are available & what is in the data Jisc Contracted Data transformation specialist (CETIS) Jisc Agile Scrum Master & Tableau User

Teams receive experience and guidance of Agile workingOption for Tableau Desktop training to help with creating visualisationsApply at http://bit.ly/jisc_library_data_labs_applicationsQueries to siobhan.burke@jisc.ac.uk or myles.danson@jisc.ac.uk

Call for Library Lab Teams 20 July – 6 Oct

Contacts

Paul Bailey paul.bailey@jisc.ac.uk

Further Information: http://www.analytics.jiscinvolve.org

Join: analytics@jiscmail.ac.uk

Student Learning Analytics App 33