Seminario eMadrid/SHEILA sobre "Analítica del Aprendizaje". Panorama general de las actividades de...

An Overview of Learning Analytics Activities in

UC3MCarlos Delgado Kloos, Pedro J. Muñoz-Merino

Univ. Carlos III de Madrid, www.it.uc3m.esRed eMadrid, www.emadridnet.org

Knowledge and Data"Quite simply,

knowledge is the engine of our economy.And data is its fuel."

Neelie KroesFormer Vicepresident

European Commission,Responsible for Digital Agenda

C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21

2

Precious Data

"Data is a precious thingand will last longerthan the systems themselves."

Tim Berners-LeeDirector W3C

Inventor of the WWW


3

Privacy

www.aclu.org/ordering-pizzaC. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21

4

Data is PreciousMedical Sector

Data needed for the well-being of the patientFor medical research

Educational SectorEducational Data MiningLearning AnalyticsUseful for whom?


5

Learning & Academic Analytics

www.educause.edu/ero/article/penetrating-fog-analytics-learning-and-education


6

CompromiseBalance

Accountable, justified usePrivacySecurity

Regulation and policies neededBriefgeheimnis


7

Legal Background in Spain Spanish Constitution (1978)

Article 18:Right to personal privacy

AEPD: Agencia Españolade Protección de Datos Since 1993

Data Protection Directive 95/46/EC

LOPD: Ley Orgánica de Protección de Datos 15/1999 Protects personal privacy

rights related to data

Agencia deProtección de Datos de la Comunidad de Madrid 2001-2012

Reglamento de Medidas de Seguridad (RD 1720/2007) Data security measures

Universities: Comisión LOPD Gives recommendations

and takes care of lawat the university


8

PoliciesThe legal background is in placeThe structures operativeHowever, the field is moving fastPolicies have to be put in place for handling

the different scenarios that are coming upAwareness, training, involvement of many

stakeholders, ... International collaboration


9

Adoption at UC3MFirst pilots

0 Courses (Khan Academy)SPOCs (Open edX)

In progressAll SPOCsedXMoodle


10

0 Courses


11

JavaMOOC

Introduction to Programming with Java –Part 1: Starting to Code with Java

Over 250.000 learners from 208 countries in 3 editions

uc3mx.es

12


Active Research Projects on LA SHEILA: European Commission,

2016-2018

MOOC-Maker: European Commission, 2016-2019

eMadrid: Regional Government of Madrid, 2014-2018

Smartick: Project with company. 2015-2016

Aplicaciones de analítica y sistemas de recomendación: Project with company, 2016-2017

Simlap: Spanish Ministry of Economy, 2014-2016

mapaTIC: Spanish Ministry of Education. 2015-2016

RESET: Spanish Ministry of Economy. 2015-2017

SNOLA (Spanish Network of Learning Analytics):Spanish Ministry of Economy


13

Research lines at UC3M1) Collection of events and interoperability2) Inference of intelligent information

3) Visualization systems in e-learning platforms

4) Evaluation of learning experiences5) Adaptive learning. Personalized learning6) Prediction and recommendation systems


14

1) Collection of events and interoperability

PJ Muñoz-Merino, M Wolpers, K Niemann, M Friedrich,A Pardo, C Delgado Kloos, M Muñoz-Organero:“CAM in the Semantic Web world,”6th Internat. Conf. on Semantic Systems, 2010 I-SEMANTICS ’10


15

2) Inference of intelligent information

Image taken from http://www.datadial.net/blog/index.php/2011/08/24/why-your-website-isnt-as-fast-as-it-should-be/ Learning

profiles

Behaviours

Meta-cognitive

skills

Emotions

Efectiveness Efficiency Interest

Gamification interest

Machine learningPedagogy Expert

Knowled. Semantics


16

2) Example: Skill ModellingKnow if a student has

mastered certain skills• Application of

probabilistic models such asItem Response Theory (IRT), Bayesian Networks (BN),or Knowledge Spaces (KS) and proposal of new techniques

Master thesis:Ruth González Novillo. Supervisors: PJ Muñoz-Merino, C Delgado Kloos


17

2) Example: Effectiveness

PJ Muñoz-Merino, JA Ruipérez-Valiente, C Alario-Hoyos,M Pérez-Sanagustín, C Delgado Kloos:"Precise effectiveness strategy for analyzing the effectiveness of students with educational resources and activities in MOOCs", Computers in Human Behavior, vol. 47, pp. 108–118 (2015)


18

2) Example: Emotions

D Leony, PJ Muñoz-Merino, A Pardo, C Delgado Kloos:“Provision of awareness of learners’ emotions through visualizations in a computer interaction-based environment”, Expert Systems With Applications, vol. 40, no. 3 (2013), pp. 5093-5100


19

2) Example: GamificationUser

Is it a thematic badge?

Do nothing

No

For each badge earned

Yes

Does the exercise belong to the badge

requisities?

Do nothing

No

Yes

Sum 1 to concentration counter

for that badge

Retrieve all the attempted exercises between the last

thematic badge acquired and the current badge

For each exercise

attempted

Sum 1 to thematic

badge counter

1𝑁 𝐶𝑜𝑛𝑐𝑒𝑛𝑡𝑟𝑎𝑡𝑖𝑜𝑛 𝐶𝑜𝑢𝑛𝑡𝑒𝑟𝑖𝐵𝑎𝑑𝑔𝑒 𝐶𝑜𝑢𝑛𝑡𝑒𝑟𝑖𝑁

𝑖=1

D Leony, PJ Muñoz-Merino, A Pardo, C Delgado Kloos:“Provision of awareness of learners’ emotions through visualizations in a computer interaction-based environment”, Expert Systems with Applications, 40:3 (2013), 5093-5100


20

3) Visualization Systems:ALAS-KA

JA Ruipérez-Valiente, PJ Muñoz-Merino, D Leony, C Delgado Kloos:“ALAS-KA: A learning analytics extension for better understanding the learning process in the Khan Academy platform”,Computers in Human Behavior, 47 (2015), 139-148


21

3) Visualization Systems: ANALYSE

Main people involved:Héctor Pijeira Díaz, Javier Santofimia, Jaime Alzola, Javier Orcoyen, José A. Gascón Pinedo, José A. Ruipérez Valiente, Pedro J. Muñoz-Merino, Carlos Delgado Kloos


22

3) Visualization Systems: Google Course Builder

M Marciel, F Michelinakis, R Fanou, PJ Muñoz-Merino:“Enhancements to Google Course Builder: Assessments Visualisation, YouTube Events Collector and Dummy Data Generator”, SINTICE conference (2013)


23

4) Evaluation ofLearning Experiences

Examples: universities,high schools, companies

For the evaluation, we use: system indicators, tests, surveys, interviews, etc.

Evaluated: students, tools, the learning process, …


24

5) Adaptive learning. Personalized learning

PJ Muñoz-Merino, C Delgado Kloos, M Muñoz-Organero, A Pardo:"A Software Engineering Model for the Development of Adaptation Rules and its Application in a Hinting Adaptive E-learning System", Computer Science and Information Systems, 12:1, 203-231(2015)C. Delgado Kloos, P.J. Muñoz-Merino Madrid, 2016-10-21

25

5) Adaptive learning. Personalized learning

PJ Muñoz-Merino, M Fernández Molina, M Muñoz-Organero,C Delgado Kloos: “An Adaptive and Innovative Question-driven Competition-based Intelligent Tutoring System for Learning”, Expert Systems with Applications, 39:8 (2012), 6932-6948


26

6) Prediction and Recommendation Systems

• Prediction about• Learning gains• Certificate earners• Social activity• Cheating• System behaviours

• Recommenders about

• Resources• Users


27

Design and implementation of telematic applications

• E-learning applications• Processing efficiency• Technologies

• Web: J2EE, PHP, Django, …• Data bases: mysql, MongoDB, Oracle, …• Client: HTML, JavaScript, CSS, …


28

ConclusionAdvancing in new territoriesInvolvement of stakeholders from many fields

Law and policiesTeaching methodologiesEducational researchPractice


29

K K’

K’>K?


30

Seminario eMadrid/SHEILA sobre "Analítica del Aprendizaje". Panorama general de las actividades de...

Education

Transcript of Seminario eMadrid/SHEILA sobre "Analítica del Aprendizaje". Panorama general de las actividades de...