Seminar at UC3M Madrid

129
LEARNING ANALYTICS José Luis Santos slideshare.net/jlsantoso HCI group img src: http://en.wikipedia.org/wiki/File:Stonehenge2007_07_30.jpg ...augmenting the human intellect... Monday 16 December 13

Transcript of Seminar at UC3M Madrid

Page 1: Seminar at UC3M Madrid

LEARNING ANALYTICS

José Luis Santos slideshare.net/jlsantoso

HCI group

img src: http://en.wikipedia.org/wiki/File:Stonehenge2007_07_30.jpg

...augmenting the human intellect...

Monday 16 December 13

Page 2: Seminar at UC3M Madrid

Monday 16 December 13

Page 3: Seminar at UC3M Madrid

Monday 16 December 13

Page 4: Seminar at UC3M Madrid

Monday 16 December 13

Page 5: Seminar at UC3M Madrid

Monday 16 December 13

Page 6: Seminar at UC3M Madrid

Monday 16 December 13

Page 7: Seminar at UC3M Madrid

Monday 16 December 13

Page 8: Seminar at UC3M Madrid

Monday 16 December 13

Page 9: Seminar at UC3M Madrid

Music

Technology Enhanced Learning

e-health

Research 2.0

Monday 16 December 13

Page 10: Seminar at UC3M Madrid

Is learning analytics a ‘new’ field?

Monday 16 December 13

Page 11: Seminar at UC3M Madrid

Is learning analytics a ‘new’ field?

... or ...

is it only a cool name to attract funding?

Monday 16 December 13

Page 12: Seminar at UC3M Madrid

img src: http://www.loomlearning.com/wp-content/uploads/ether/phpFd9VdRPM.jpgMonday 16 December 13

Page 13: Seminar at UC3M Madrid

img src: http://www.loomlearning.com/wp-content/uploads/ether/phpFd9VdRPM.jpg

Have we had so many learning traces

before?

Monday 16 December 13

Page 14: Seminar at UC3M Madrid

src img: http://aerva.com/wordpress/wp-content/uploads/2011/11/internalcomm2.jpgMonday 16 December 13

Page 15: Seminar at UC3M Madrid

Monday 16 December 13

Page 16: Seminar at UC3M Madrid

Monday 16 December 13

Page 17: Seminar at UC3M Madrid

src img: http://blog.commarts.wisc.edu/wp-content/uploads/2013/03/MOOCbetterwordbubble.pngMonday 16 December 13

Page 18: Seminar at UC3M Madrid

Monday 16 December 13

Page 19: Seminar at UC3M Madrid

We have only covered the software part so far...

Monday 16 December 13

Page 20: Seminar at UC3M Madrid

src img: http://www.emerkirrane.com/wp-content/uploads/2013/03/Devices2.jpg

Monday 16 December 13

Page 21: Seminar at UC3M Madrid

src img: http://www.emerkirrane.com/wp-content/uploads/2013/03/Devices2.jpg

src img: http://www.rtcmagazine.com/files/images/3860/rtc09_td_gre_fig01_large.jpgMonday 16 December 13

Page 22: Seminar at UC3M Madrid

EXERCISE

3-5 min of discussion(small group)

3-5 min of general discussion

Monday 16 December 13

Page 23: Seminar at UC3M Madrid

Monday 16 December 13

Page 24: Seminar at UC3M Madrid

Monday 16 December 13

Page 25: Seminar at UC3M Madrid

Monday 16 December 13

Page 26: Seminar at UC3M Madrid

Monday 16 December 13

Page 27: Seminar at UC3M Madrid

Monday 16 December 13

Page 28: Seminar at UC3M Madrid

http://quantifiedself.com/2013/02/qs-and-mindfulness/#more-5798

Monday 16 December 13

Page 29: Seminar at UC3M Madrid

https://www.youtube.com/watch?v=kjflrXDDU-w

Monday 16 December 13

Page 30: Seminar at UC3M Madrid

shall we avoid to end up being all the same?

Monday 16 December 13

Page 31: Seminar at UC3M Madrid

Monday 16 December 13

Page 32: Seminar at UC3M Madrid

...and what now?Monday 16 December 13

Page 33: Seminar at UC3M Madrid

DISCUSSION

3-5 min...

challenges/issues

Monday 16 December 13

Page 34: Seminar at UC3M Madrid

CHALLENGES

Monday 16 December 13

Page 35: Seminar at UC3M Madrid

Monday 16 December 13

Page 36: Seminar at UC3M Madrid

Monday 16 December 13

Page 37: Seminar at UC3M Madrid

Monday 16 December 13

Page 38: Seminar at UC3M Madrid

... but we are engineers....

... be open....

Monday 16 December 13

Page 39: Seminar at UC3M Madrid

Monday 16 December 13

Page 40: Seminar at UC3M Madrid

Technical  challenges

Monday 16 December 13

Page 41: Seminar at UC3M Madrid

Technical  challenges

Concurrency

Monday 16 December 13

Page 42: Seminar at UC3M Madrid

Technical  challenges

ConcurrencyMultiple  identities

Monday 16 December 13

Page 43: Seminar at UC3M Madrid

Technical  challenges

ConcurrencyMultiple  identitiesInformation

Monday 16 December 13

Page 44: Seminar at UC3M Madrid

Technical  challenges

ConcurrencyMultiple  identitiesInformation

Human  Computer  Interaction

Monday 16 December 13

Page 45: Seminar at UC3M Madrid

How does current research address these

challenges?

Monday 16 December 13

Page 46: Seminar at UC3M Madrid

2. Visual Analytics

1. Educational data mining

Monday 16 December 13

Page 47: Seminar at UC3M Madrid

2. Visual Analytics

** http://erikduval.wordpress.com/2013/10/24/augmentation-not-replacement/

...in the tradition of Doug Engelbart, and try to focus on ‘augmenting the human intellect’, rather than

replacing it... **

1. Educational data mining

Monday 16 December 13

Page 48: Seminar at UC3M Madrid

... but we need a story...

Monday 16 December 13

Page 49: Seminar at UC3M Madrid

2ND YEAR BACHELOR’S DEGREE STUDENTS

http://ariadne.cs.kuleuven.be/wiki/index.php/PEnO3-1213Monday 16 December 13

Page 50: Seminar at UC3M Madrid

2ND YEAR BACHELOR’S DEGREE STUDENTS

http://ariadne.cs.kuleuven.be/wiki/index.php/PEnO3-1213Monday 16 December 13

Page 51: Seminar at UC3M Madrid

2ND YEAR BACHELOR’S DEGREE STUDENTS

http://ariadne.cs.kuleuven.be/wiki/index.php/PEnO3-1314Monday 16 December 13

Page 52: Seminar at UC3M Madrid

Monday 16 December 13

Page 53: Seminar at UC3M Madrid

Monday 16 December 13

Page 54: Seminar at UC3M Madrid

Monday 16 December 13

Page 55: Seminar at UC3M Madrid

Monday 16 December 13

Page 56: Seminar at UC3M Madrid

http://philippedecroock.wordpress.com/Monday 16 December 13

Page 57: Seminar at UC3M Madrid

Is itlearning analytics?

Monday 16 December 13

Page 58: Seminar at UC3M Madrid

http://gradient.it.uc3m.es/research/

Monday 16 December 13

Page 59: Seminar at UC3M Madrid

Dillenbourg, Pierre, and Patrick Jermann. "Technology for classroom orchestration." New science of learning. Springer New York, 2010. 525-552.

Monday 16 December 13

Page 60: Seminar at UC3M Madrid

http://link.springer.com/chapter/10.1007/978-3-642-40814-4_48#page-1

Why should only students expose their info?

Monday 16 December 13

Page 61: Seminar at UC3M Madrid

http://link.springer.com/chapter/10.1007/978-3-642-33263-0_30#page-1

Monday 16 December 13

Page 62: Seminar at UC3M Madrid

http://www.sciencedirect.com/science/article/pii/S0957417413001930

Monday 16 December 13

Page 63: Seminar at UC3M Madrid

http://dl.acm.org/citation.cfm?id=2466128

Monday 16 December 13

Page 64: Seminar at UC3M Madrid

http://abs.sagepub.com/content/early/2013/02/27/0002764213479363.abstract

awareness

(self-)reflection

sensemaking

impact

Monday 16 December 13

Page 65: Seminar at UC3M Madrid

http://abs.sagepub.com/content/early/2013/02/27/0002764213479363.abstract

awareness

(self-)reflection

sensemaking

impact

data

questions

answers

behavior changenew meaning

Monday 16 December 13

Page 66: Seminar at UC3M Madrid

Monday 16 December 13

Page 67: Seminar at UC3M Madrid

1 2 3Monday 16 December 13

Page 68: Seminar at UC3M Madrid

Design based research

Monday 16 December 13

Page 69: Seminar at UC3M Madrid

Monday 16 December 13

Page 70: Seminar at UC3M Madrid

Usability

Perceived usefulness

Usage analyticsMonday 16 December 13

Page 71: Seminar at UC3M Madrid

bottomup

topdown

Monday 16 December 13

Page 72: Seminar at UC3M Madrid

bottomup

topdown

Monday 16 December 13

Page 73: Seminar at UC3M Madrid

Govaerts, Sten; Verbert, Katrien, Duval, Erik; Pardo, Abelardo, The Student Activity Meter for Awareness and Self-reflection. Proceedings of CHI Conference on Human Factors in Computing Systems, 2012, Austin, Texas, ACM.

Monday 16 December 13

Page 74: Seminar at UC3M Madrid

Monday 16 December 13

Page 75: Seminar at UC3M Madrid

metrics

reliability

Monday 16 December 13

Page 76: Seminar at UC3M Madrid

* http://hci.stanford.edu/courses/cs448b/papers/shneiderman96eyes.pdfMonday 16 December 13

Page 77: Seminar at UC3M Madrid

* http://hci.stanford.edu/courses/cs448b/papers/shneiderman96eyes.pdf

1 2 3*

Monday 16 December 13

Page 78: Seminar at UC3M Madrid

http://dl.acm.org/citation.cfm?id=2330639Monday 16 December 13

Page 79: Seminar at UC3M Madrid

http://dl.acm.org/citation.cfm?id=2330639Monday 16 December 13

Page 80: Seminar at UC3M Madrid

http://dl.acm.org/citation.cfm?id=2330639Monday 16 December 13

Page 81: Seminar at UC3M Madrid

Monday 16 December 13

Page 82: Seminar at UC3M Madrid

table

usage

Monday 16 December 13

Page 83: Seminar at UC3M Madrid

Monday 16 December 13

Page 84: Seminar at UC3M Madrid

1 2 3Monday 16 December 13

Page 85: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 86: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 87: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 88: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 89: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 90: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 91: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 92: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 93: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 94: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 95: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 96: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 97: Seminar at UC3M Madrid

STEPUP!

http://ceur-ws.org/Vol-931/paper6.pdfMonday 16 December 13

Page 98: Seminar at UC3M Madrid

Monday 16 December 13

Page 99: Seminar at UC3M Madrid

Learners’

Monday 16 December 13

Page 100: Seminar at UC3M Madrid

Monday 16 December 13

Page 101: Seminar at UC3M Madrid

1 2 3Monday 16 December 13

Page 102: Seminar at UC3M Madrid

Monday 16 December 13

Page 103: Seminar at UC3M Madrid

We simplified the process...

Monday 16 December 13

Page 104: Seminar at UC3M Madrid

Monday 16 December 13

Page 105: Seminar at UC3M Madrid

“"Everything should be made as simple as possible, but not simpler."

Monday 16 December 13

Page 106: Seminar at UC3M Madrid

Monday 16 December 13

Page 107: Seminar at UC3M Madrid

1 2 3Monday 16 December 13

Page 108: Seminar at UC3M Madrid

• List of 34 issues

http://dl.acm.org/citation.cfm?id=2330639Monday 16 December 13

Page 109: Seminar at UC3M Madrid

• List of 34 issues

We asked the students what were their learning issues...

http://dl.acm.org/citation.cfm?id=2330639Monday 16 December 13

Page 110: Seminar at UC3M Madrid

RESULTS

• List of 7 issues

http://dl.acm.org/citation.cfm?id=2330639Monday 16 December 13

Page 111: Seminar at UC3M Madrid

Monday 16 December 13

Page 112: Seminar at UC3M Madrid

Monday 16 December 13

Page 113: Seminar at UC3M Madrid

1 2 3Monday 16 December 13

Page 114: Seminar at UC3M Madrid

http://link.springer.com/chapter/10.1007%2F978-3-642-40814-4_25Monday 16 December 13

Page 115: Seminar at UC3M Madrid

Monday 16 December 13

Page 116: Seminar at UC3M Madrid

Monday 16 December 13

Page 117: Seminar at UC3M Madrid

1 2 3Monday 16 December 13

Page 118: Seminar at UC3M Madrid

http://jlsantoso.blogspot.be/2013/05/reveal-it-applied-in-educational-context.html

Monday 16 December 13

Page 119: Seminar at UC3M Madrid

8 May 2013 | @svencharleer | svencharleer.comhttp://ceur-ws.org/Vol-1103/paper5.pdf

Monday 16 December 13

Page 120: Seminar at UC3M Madrid

http://ceur-ws.org/Vol-1103/paper5.pdfMonday 16 December 13

Page 121: Seminar at UC3M Madrid

Monday 16 December 13

Page 122: Seminar at UC3M Madrid

Social discourse...

two people understand badges better that one by her/himself.

Monday 16 December 13

Page 123: Seminar at UC3M Madrid

1 2 3Monday 16 December 13

Page 124: Seminar at UC3M Madrid

http://svencharleer.com/blog/2013/11/07/privacy-concerns-with-learning-dashboards/

Monday 16 December 13

Page 125: Seminar at UC3M Madrid

Monday 16 December 13

Page 126: Seminar at UC3M Madrid

“We only know one thing:we do not know anything”

Monday 16 December 13

Page 127: Seminar at UC3M Madrid

Monday 16 December 13

Page 128: Seminar at UC3M Madrid

Keep your learning analytics tool simple...

Engage your users...

Be open...

Be cool...

Be social...

Monday 16 December 13

Page 129: Seminar at UC3M Madrid

@jlsantoso @svencharleer @erikduvalMonday 16 December 13