Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning...
-
Upload
alexandra-m-pickett -
Category
Education
-
view
20 -
download
0
Transcript of Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning...
![Page 1: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/1.jpg)
Examining the Hype and Reality ofLearning Analytics"
Patsy Moskal
University of Central Florida
![Page 2: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/2.jpg)
“the use of data, statistical analysis, and explanatory and predictive models to gain insight
and act on complex issues.”
Analytics!!
The Analy8cs Landscape in Higher Educa8on, 2015 (ECAR). Retrieved from hHps://library.educause.edu/~/media/files/library/2015/5/ers1504cl.pdf
![Page 3: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/3.jpg)
![Page 4: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/4.jpg)
![Page 5: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/5.jpg)
![Page 6: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/6.jpg)
Learning Analytics
“The measurement, collection, analysis and report of data about learners and their contexts, for purposes of understanding and optimizing learning and the environments in which it occurs.”
hHps://solaresearch.org/
![Page 7: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/7.jpg)
“Learning analytics collects and analyzes the ‘digital breadcrumbs’ that students leave as they interact with various computer systems to look for correlations between those activities and learning
outcomes.”
Learning Analytics!!
7 Things you should know about first-‐genera8on learning analy8cs. EDUCAUSE Learning Ini3a3ve (ELI). 2011. Retrieved from hHps://net.educause.edu/ir/library/pdf/ELI7079.pdf
![Page 8: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/8.jpg)
Check it out…!
hHps://library.educause.edu/resources/2015/5/analy8cs-‐in-‐higher-‐educa8on-‐2015
![Page 9: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/9.jpg)
![Page 10: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/10.jpg)
![Page 11: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/11.jpg)
Major Prio
rity N
ot a Priority
![Page 12: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/12.jpg)
Students’ interest in analytics applications
![Page 13: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/13.jpg)
Student perspectives on using analytics
Helpful “big mother”
Creepy “big brother”
Progress toward degree or cer8ficate Performance in current courses
Performance in past courses Performance in courses compared to other students
Ac8vity in university applica8on or service Ac8vity on a college or university website
Campus ac8vi8es logged through student ID/smart card Campus ac8vi8es logged through smartphone
Proximity to a college building, office, or resource
Loca8on on campus
Social media ac8vi8es
![Page 14: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/14.jpg)
Predictive Analytics in Higher Education:!Five Guiding Practices for Ethical Use!
• Have a vision and plan • Build a supportive infrastructure • Work to ensure proper use of data • Design predictive models and algorithms that avoid bias • Meet institutional goals and improve student outcomes by
intervening with care.
Reported in Inside Higher Ed 3/6/17 – ‘Conversa8on Starter’ on Ethical Data Use For more informa8on, visit newamerica.org/dataethics.
![Page 15: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/15.jpg)
Learning analytics in practice!
![Page 16: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/16.jpg)
Available Data!!SIS
• Demographics • Socio-‐economic status • High school informa8on • Placement tests (SAT/ACT) LMS • Students’ behavior/interac8on
with system • Access (views, 8me) • Gradebook data
Other data (varies widely!) • Use of advising & tutoring • Interac8on with various campus services (library, wri8ng center, dining hall, etc)
• AHendance at large lecture classes
• Financial behavior • Orienta8on par8cipa8on
![Page 17: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/17.jpg)
The big issue is…!
![Page 18: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/18.jpg)
Who is at risk???
hHp://www.youthareawesome.com/wp-‐content/uploads/2010/10/wheres-‐waldo1.jpg
![Page 19: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/19.jpg)
A more difficult task is…!
![Page 20: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/20.jpg)
hHp://matrix.wikia.com/wiki/File:Matrix-‐neo-‐stops-‐bullets-‐wallpaper.jpg
How do we stop them from failing? How do we stop them from failing?
![Page 21: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/21.jpg)
High Level to !Home Grown !
Learning Analytics Approaches!
![Page 22: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/22.jpg)
§ SIS, LMS and other data § Model trends across time to identify and ultimately predict
which students are at risk
Trawl net approach!
![Page 23: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/23.jpg)
UCF Student Performance Dashboard!
![Page 24: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/24.jpg)
UMBC Check My
Activity (John Fritz)!
Fritz & Whitmer (2017) Learning Analytics Research for LMS Course Design: Two Studies. http://er.educause.edu/articles/2017/2/learning-analytics-research-for-lms-course-design-two-studies
![Page 25: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/25.jpg)
Some Prototype !Adaptive Learners!
![Page 26: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/26.jpg)
![Page 27: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/27.jpg)
Students’ adaptive learning behaviors!
![Page 28: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/28.jpg)
How Students Behave in Personalized Adaptive Courses!
• Colm Howlin, Principal Researcher • March 16, 2017 • Realizeit Webinar http://realizeitlearning.com/community/
![Page 29: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/29.jpg)
Questions still being asked…!" " " " " "…your mileage may vary!
Issues/strategies with implementaCon
Sources of data to use
Cost issues
InsCtuConal approaches Improving student outcomes
Governance strategy and milestones
Details, benefits, challenges
Security and ethics concerns
![Page 30: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/30.jpg)
Final Resources to Check Out…!
![Page 31: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/31.jpg)
Special Learning Analytics issue of Online Learning
http://onlinelearningconsortium.org/read/online-learning-journal/
Editors: Karen Vignare, Patsy Moskal, Matthew Pistilli and Alyssa Wise
![Page 32: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/32.jpg)
Learning Analytics Bibligraphy "!
• Online Learning list of articles • Must read articles • General bibliography • Early alert system articles • Articles focused on ethics
![Page 33: Patsy Moskal: Panel Presentation - Learning Analytics - Examining the Hype and Reality of Learning Analytics](https://reader031.fdocuments.us/reader031/viewer/2022030311/58ef6f6f1a28ab4d3d8b45a7/html5/thumbnails/33.jpg)
Patsy [email protected]!
For more informa8on, contact:
Director,!Research Initiative for Teaching Effectiveness!
Center for Distributed Learning!University of Central Florida!