Phase 1 Learning Analytics Intro Slides
-
Upload
paul-bailey -
Category
Education
-
view
754 -
download
4
Transcript of Phase 1 Learning Analytics Intro Slides
![Page 1: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/1.jpg)
Overview
Jisc Learning Analytics
![Page 2: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/2.jpg)
Learning Analytics
Background
Jisc Learning Analytics Services
User views of products
Timeline and next steps
Student App (additional slides)
How data is included (additional slides)
Learning Analytics - Initial Meetings 2015 2
Outline of session
![Page 3: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/3.jpg)
About Jisc…
Learning Analytics - Initial Meetings 2015 3
It operates shared digital infrastructure and services, negotiates sector-wide deals with IT vendors and commercial publishers, and provides trusted advice and practical assistance for universities and colleges.
Jisc is the UK higher and further education sectors’ not-for-profit organisation for digital service and solutions.
![Page 4: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/4.jpg)
What does Jisc do?
Does 4 things…
Providing and developing a network infrastructure and
related services that meet the needs of the UK research and
education communities
Supporting the procurement of digital content for UK education and research
Our network of national and regional teams provide local
engagement, advice and support to help you get the
most out of our service offer
Our R&D work, paid for entirely by our major funders, identifies
emerging technologies and develops them around your
particular needs
![Page 5: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/5.jpg)
Co-design challenges
Research at risk (R@R)
Prospect to alumnus (P2A) Learning analytics
Digital learning & capabilitiesImplementing FELTAG
Business intelligence
Hosting platform Hosting platform
![Page 6: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/6.jpg)
About Learning Analytics…
6Learning Analytics - Initial Meetings 2015
![Page 7: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/7.jpg)
Effective Learning Analytics ChallengeRationale
Universities and colleges don't have enough useful data about students and how they are learning. What they have they don’t analyse and interpret. They are missing opportunities to use technology to provide feedback to students. They need to support staff who could be using analytics and a standard set of tools and technologies to monitor and intervene.
Who it affects and how
Students are missing out on the possibility of an improved experience, better retention, and better achievement.
Staff are missing the opportunity to develop skills to use analytics to improve support, teaching and curriculum design.
Timescale
Pilot tools and metrics 1-2 years
Impact on retention, achievement and progression 3-4 years.
Learning Analytics - Initial Meetings 2015 7
![Page 8: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/8.jpg)
What do we mean by Learning Analytics?
The application of big data techniques such as machine based learning and data mining to help learners and institutions meet their goals:
For our project:
» Improve retention (current project)
» Improve achievement (current project)
» Improve employability (current project)
» Personalised learning (future project)
8Learning Analytics - Initial Meetings 2015
![Page 9: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/9.jpg)
About Learning Analytics…Products and Solutions
9Learning Analytics - Initial Meetings 2015
![Page 10: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/10.jpg)
Jisc’s Learning Analytics Project
10
Three core strands:
Learning Analytics Service
Toolkit Community
Jisc Learning Analytics
Learning Analytics - Initial Meetings 2015
![Page 11: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/11.jpg)
Jisc’s Learning Analytics Service Walkthrough
11
Learning Analytics Service
Learning Analytics - Initial Meetings 2015
![Page 12: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/12.jpg)
Learning Analytics - Initial Meetings 2015 12
![Page 13: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/13.jpg)
A user perspective…
13Learning Analytics - Initial Meetings 2015
![Page 14: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/14.jpg)
Dashboards
14
Visual tools to allow lecturers, module leaders, senior staff and support staff to view:
» Student engagement
» Cohort comparisons
» etc…
Based on either commercial tools from Tribal(Student Insight) or open source tools from Unicon/Marist (OpenDashBoard)
Learning Analytics - Initial Meetings 2015
![Page 15: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/15.jpg)
15Learning Analytics - Initial Meetings 2015
![Page 16: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/16.jpg)
First version will include:
» Overall engagement
» Comparisons
» Self declared data
» Consent management
Bespoke development by Therapy Box
16
Student App
Learning Analytics - Initial Meetings 2015
![Page 17: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/17.jpg)
17Learning Analytics - Initial Meetings 2015
![Page 18: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/18.jpg)
Alert and Intervention System
Tools to allow management of interactions with students once risk has been identified:
» Case management
» Intervention management
» Data fed back into model
» etc…
Based on open source tools from Unicon/Marist (Student Success Plan)
18Learning Analytics - Initial Meetings 2015
![Page 19: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/19.jpg)
19Learning Analytics - Initial Meetings 2015
![Page 20: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/20.jpg)
Timeline and next steps…
20Learning Analytics - Initial Meetings 2015
![Page 21: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/21.jpg)
Learning Analytics - Initial Meetings 2015 21
Phase 1&2Sep 15 – Apr 16
Phase 2&3 Jan – Sept 16
Transition to Service
Sept 16 – July 17
Jisc Learning Analytics Service
Sept 2017
![Page 22: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/22.jpg)
22
Jisc/UniconDiscovery
Jisc Learning Analytics
Implementation
Wish to explore readiness and products
Know you are ready and what you want
Want to get involved in tech work first
Blackboard Discovery
Unicon/Marist pre-implementation
Tribal pre-implementation
Other pre-implementation
Blackboard Trial
Moodle Trial
Other Learning Analytics
Implementation
Tech Trials Discovery Pre-implementation Implementation
Learning Analytics - Initial Meetings 2015
![Page 23: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/23.jpg)
Next Steps
Review Legal and Ethical issues – Code of Practice
Discovery Stage – See offers from Blackboard and Unicon
Technical Overview – Register and enrol https://courses.alpha.jisc.ac.uk
Technical Trials – Set up Learner Records Warehouse, install VLE plugin, identify and
share, look data sets for student information
Technical Implementation – chose preferred analytics solution (Tribal Student Insights or
Unicon processor and dashboard). Jan 2016 onwards for implementation.
Learning Analytics - Initial Meetings 2015 23
![Page 24: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/24.jpg)
Learning Analytics - Initial Meetings 2015 24
https://courses.alpha.jisc.ac.uk
![Page 25: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/25.jpg)
The student app…
25Learning Analytics - Initial Meetings 2015
![Page 26: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/26.jpg)
Student Learning Analytics App 26
When first logging in the student is able to select their institution from a pre-populated lists of UK universities. If the students’ institution is using other parts of Jisc’s learning analytics architecture, in particular the learning analytics warehouse, then much more data will be available to the app.
![Page 27: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/27.jpg)
Student Learning Analytics App 27
The screen will be an activity feed or timeline, we plan to integrate this dynamic and engaging concept, so essential to applications such as Twitter and Facebook.
Photos or badges could be included next to the text.
![Page 28: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/28.jpg)
Student Learning Analytics App 28
Stats – Provides an engagement and attainment overview and drilling down to gives comparative activity graphs.
Log – Allows you to log time spent on specified activities e.g. reading for an assignment
Target – Allows you set personal targets to improve your engagement e.g. study for 10 hours this week
![Page 29: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/29.jpg)
Student Learning Analytics App 29
The engagement and attainment overview mirrors what many fitness apps do: it provides an overview of your “performance” to date. Critically here we show how you compare to others. This will be based on data about you and others held in the learning analytics warehouse.
![Page 30: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/30.jpg)
Student Learning Analytics App 30
In the activity comparison screen you’ll see a graph of your engagement over time and how it compares with that of others. You can select a particular module or look at your whole course.
You can compare yourself with people on my course, people on this module and top 20% of performers (based on grades).
Comparing yourself to prior cohorts of students on a module might be of interest in the future too.
![Page 31: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/31.jpg)
Student Learning Analytics App 31
Starting an activity allows you to select the module on which you’re working, choose an activity type from a drop-down list such as reading a book, writing an essay, or attending a lab, and select a time period you want to spend on the activity and whether you want a notification when that period is up.
A timer is displayed in the image box and you can hit the Stop button when you’ve finished. The timer will continue even if you navigate away from the app.
![Page 32: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/32.jpg)
Student Learning Analytics App 32
Setting a target is the final bit of functionality we want to include in the app at this stage. Again this is building on the success of fitness tracking apps where you set yourself targets as a way of motivating yourself.
![Page 33: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/33.jpg)
Student Learning Analytics App 33
Setting a target involves selecting a learning activity from a pre-populated list and specifying how long you want to be spending on it.
We added a “because” free text box so that learners can make it clear (to themselves) why they want to carry out the activity e.g. I want to pass the exam, tutor told me I’m not reading enough).
Users may be more likely to select a reason from a pre-populated list than to fill in a text field but we’ll monitor this to see whether it’s being used.
![Page 34: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/34.jpg)
Jisc Learning Analytics Toolkit
34
Toolkit
Learning Analytics - Initial Meetings 2015
![Page 35: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/35.jpg)
Discovery …
The learning analytics discovery service is a way of
investigating your institution’s readiness for learning
analytics. The process will investigate strategic,
technical, process and data readiness, providing
recommendations for action before moving on to deploy
a learning analytics solution.
35Learning Analytics - Initial Meetings 2015
![Page 36: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/36.jpg)
http://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics
Code of Practice
Learning Analytics - Initial Meetings 2015 36
![Page 37: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/37.jpg)
Deeper Dive
http://repository.jisc.ac.uk/5661/1/Learning_Analytics_A-_Literature_Review.pdf
Literature review – basis
for the code of practice
Learning Analytics - Initial Meetings 2015 37
![Page 38: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/38.jpg)
Code of Practice
Privacy
Validity
Responsibility
AccessEnabling positive
interventions
Minimising adverse impacts
Transparency and consent
Learning Analytics - Initial Meetings 2015 38
![Page 39: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/39.jpg)
39
Community
Community
Learning Analytics - Initial Meetings 2015
![Page 40: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/40.jpg)
Project Blog, mailing list and network events
Blog: http://analytics.jiscinvolve.org
Mailing: [email protected]
40Learning Analytics - Initial Meetings 2015
![Page 41: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/41.jpg)
How can institutions get involved…
41
Toolkit
Learning Analytics - Initial Meetings 2015
![Page 42: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/42.jpg)
Learning Analytics - Initial Meetings 2015 42
Phase 1&2Sep 15 – Apr 16
Phase 2&3 Jan – Sept 16
Transition to Service
Sept 16 – July 17
Jisc Learning Analytics Service
Sept 2017
![Page 43: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/43.jpg)
Timeline
Jun 15 Sep 15 Jan 16 Apr 16
3. Trial Integration pt1
x 2
1. Jisc complete contracts
2. Jisc Sandbox4. Phase 1 Discovery
5. Phase 1 implementation
x 6
8. Phase 2 implementation
x 6 - 12
6. Trial Integration pt2
x 2
7. Phase 2 Discovery x 6-
12
Learning Analytics - Initial Meetings 2015 43
![Page 44: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/44.jpg)
44
Jisc/UniconDiscovery
Jisc Learning Analytics
Implementation
Wish to explore readiness and products
Know you are ready and what you want
Want to get involved in tech work first
Blackboard Discovery
Unicon/Marist pre-implementation
Tribal pre-implementation
Other pre-implementation
Blackboard Trial
Moodle Trial
Other Learning Analytics
Implementation
Tech Trials Discovery Pre-implementation Implementation
Learning Analytics - Initial Meetings 2015
![Page 45: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/45.jpg)
One Castlepark Tower Hill Bristol BS2 0JAT 020 3697 5800
[email protected] jisc.ac.uk
Michael WebbDirector of Technology and Analytics
45
![Page 46: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/46.jpg)
How’s the data collected?
46Learning Analytics - Initial Meetings 2015
![Page 47: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/47.jpg)
Learning Analytics - Initial Meetings 2015 47
About the student Activity data
TinCan(xAPI)ETL
Data collection
![Page 48: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/48.jpg)
About the student’ data
Personal (demographic) data
Birthdate, gender etc.
Course data
mode of study, level etc.
Grade data
Assignment, module etc.
(aligned with HESA data)
48Learning Analytics - Initial Meetings 2015
![Page 49: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/49.jpg)
Activity data via Tin Can API
• People learn from interactions with other
people, content, and beyond.
• These actions can happen anywhere and signal
an event where learning could occur.
• When an activity needs to be recorded, the
application sends secure statements in the
form of “Actor, verb, object” or “I did this” to
the Learning Record Store (LRS.)
from: http://tincanapi.com/
49Learning Analytics - Initial Meetings 2015
![Page 50: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/50.jpg)
Activity Data (trivial!) examples
50
Actor Action Object Result
Michael Accessed VLE
Sally Completed Basic Maths Test 85.0
Kim Module CommentAdded
https://registry.tincanapi.com
Learning Analytics - Initial Meetings 2015
![Page 51: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/51.jpg)
51Learning Analytics - Initial Meetings 2015
![Page 52: Phase 1 Learning Analytics Intro Slides](https://reader031.fdocuments.us/reader031/viewer/2022030318/58f046db1a28ab975b8b4675/html5/thumbnails/52.jpg)
‘Recipes’ are key
• ‘Recipes’ are a shared way of describing
activities..
• So the data from ‘accessing a course’ is the
same whether Moodle or Blackboard is
used.
• The same holds for..
• ‘Attend a lecture’
• ‘Borrow a book’
• …
52Learning Analytics - Initial Meetings 2015