Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob...
Transcript of Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob...
![Page 1: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/1.jpg)
Online Education with Learnersourcing
Rob Miller User Interface Design Group
MIT CSAIL
Joint work with Juho Kim, Sarah Weir, Elena Glassman, Philip Guo, Carrie Cai,
Max Goldman, Phu Nguyen, Rishabh Singh, Jeremy Scott
![Page 2: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/2.jpg)
Crowdsourcing vs. Learnersourcing • Crowdsourcing
– asking a crowd to do micro-work for problems we can’t solve with software
– what does the crowd get in return? money, fun, social
• Learnersourcing – asking students to do micro-work to improve an online course – what do students get in return? learning
• Active learnersourcing – asking learners to do something for us
• Passive learnersourcing – watching what learners are doing to infer improvements
![Page 3: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/3.jpg)
Outline • How-to videos (active learnersourcing) • Lecture video analytics (passive learnersourcing) • Solution visualization • Online Python tutor • Wait-learning
![Page 4: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/4.jpg)
HOW-TO VIDEOS
![Page 5: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/5.jpg)
How-to videos are everywhere
![Page 6: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/6.jpg)
Problems in Watching How-To Videos
You can’t tell what happens in the video.
It’s difficult to navigate to specific parts you need.
![Page 7: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/7.jpg)
ToolScape Player
With ToolScape: Learners feel more confident about their design skills. - self-efficacy gain Learners believe they produced better designs. - self-rating on designs produced Learners actually produce better designs. - rating by external judges
![Page 8: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/8.jpg)
How to get annotations? !"#$#%&$&'(!"#$$$"%&'()*+"","")*"&+,"(!"-)*./".&0("-++./012#,3/&,/'0+/$44.5/$+#6,+63416"&,7/
![Page 9: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/9.jpg)
Are “steps” enough? • Students follow verbatim without thinking • Limited retention and transfer
![Page 10: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/10.jpg)
12-3(4*(""-)2.34*."
5(-)3'"4*""3(6*478("4-.&)2"
9''""%&:2(..&2:"
"
!1%74#$/$#%+$&,7"*6;;)3.*"8(432&2:"2(<"=2)<8(':("7>"-86*.(3&2:"4":3)6;")?"*.(;*"&2.)"4"@&:@A8(%(8"-)2-(;.648"62&.B""""
C4.3407)2(/"5B"80+/31%74#$/$+#6,&,7/249+$5/:6+#'&,7/%+''+6/+;#2.$+3/34/'0#'//3'19+,'3/"#,/34$<+/,4<+$/.64%$+23="D)63248")?"EF;(3&0(2.48"G*>-@)8):>!"H(2(348/"
#IJ/"K#LLMNB"
Subgoal Labeling
![Page 11: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/11.jpg)
+
subgoals
Mix dry ingredients 1. Add 2 c. flour 2. Add 1/2 tsp salt 3. Mix ingredients together
Mix wet ingredients 4. Beat 1/2 c. butter in a separate bowl 5. Add 2 eggs 6. Combine ingredients until smooth
individual steps
Lauren Margulieux, Mark Guzdial, and Richard Catrambone, ICER 2012
Goal: How to Bake a Cake
![Page 12: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/12.jpg)
alternative YouTube
![Page 13: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/13.jpg)
individual steps
![Page 14: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/14.jpg)
stage 1 generation
stage 2 evaluation
stage 3 proofreading
![Page 15: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/15.jpg)
stage 1 generation
stage 2 evaluation
stage 3 proofreading
![Page 16: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/16.jpg)
stage 1 generation
stage 2 evaluation
stage 3 proofreading
![Page 17: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/17.jpg)
MIT UI design class ~280 students 21 videos
Pilot Deployment
![Page 18: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/18.jpg)
76 students/video, !=39 20 subgoals/video, !=16 6:18 min./video, !=2:49
learner-generated subgoals
Pilot Deployment
![Page 19: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/19.jpg)
Smarter interval choice based on audio and/or content Large-scale deployment and evaluation of learner-generated subgoals Study of pedagogical benefit of learnersourcing tasks
Future Work
![Page 20: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/20.jpg)
LECTURE VIDEOS
![Page 21: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/21.jpg)
LectureScape: Enhancing lecture videos!
Motivation: Online lecture videos are widespread, but standard video players are not optimized for learning.!
![Page 22: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/22.jpg)
Challenge for instructors/editors • Don’t know how students use lecture videos
– Confusion – “Aha” moments – Bored – Re-watching important parts
• We analyzed video interaction data from the lectures in 4 edX courses – Clickstream (play, pause, scrub)
29
![Page 23: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/23.jpg)
Interaction Peaks
30
![Page 24: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/24.jpg)
Example: Beginning of new material
31
![Page 25: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/25.jpg)
Example: Backing up
32
![Page 26: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/26.jpg)
LectureScape: Enhancing lecture videos!
![Page 27: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/27.jpg)
SOLUTION MINING
![Page 28: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/28.jpg)
OverCode: Visualize student code variation!
Motivation: It’s hard for CS instructors in large classes and MOOCs to give meaningful feedback on coding style. !
![Page 29: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/29.jpg)
OverCode: Visualize student code variation!
![Page 30: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/30.jpg)
ONLINE PYTHON TUTOR
![Page 31: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/31.jpg)
Online Python Tutor!
Motivation: Execution diagrams are essential for learning programming, but manual drawings are messy and tedious.!
![Page 32: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/32.jpg)
Online Python Tutor!
![Page 33: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/33.jpg)
Online Python Tutor!
Real-time shared sessions for remote tutoring and collaborative learning!
![Page 34: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/34.jpg)
Online Python Tutor!
www.pythontutor.com!500,000+ users from 165+ countries, popular in MOOCs!
![Page 35: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/35.jpg)
WAIT LEARNING
![Page 36: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/36.jpg)
Motivation Learning a second language requires significant time
and effort to practice on a recurring basis.
The busyness of daily life
makes it difficult for those with a casual interest in learning to set aside time for regular practice.
![Page 37: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/37.jpg)
Micro-Waiting
browser loading
video ad
check-out line
escalator
![Page 38: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/38.jpg)
Wait-Learning Use “wait time” during IM conversations to help
people learn vocabulary
![Page 39: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/39.jpg)
Rationales Guiding System Design
Encoding Specificity & Situated Cognition: if we learn language in its context of use, it should help us recall it when/where we need to use it.
Spaced Repetition: learning is best when content is
spaced over time rather than in quick succession Feedback: learning is more effective when feedback is
delivered frequently and close in time to learner action
![Page 40: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/40.jpg)
WaitChatter Modes
Study Mode (first exposure)
Quiz Mode (subsequent exposures)
![Page 41: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/41.jpg)
Difficulty Levels
Easier (translate to English)
Harder (translate to Spanish)
Spaced Repetition
![Page 42: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/42.jpg)
Conversational Relevance
Contextual Non-Contextual
Yellow background & italic text signal that this word is taken from the conversation
![Page 43: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/43.jpg)
Tracking Knowledge and Progress
![Page 44: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/44.jpg)
User Study / Deployment " 20 beginner/intermediate learners (age 19-33) used
WaitChatter for 14 days on their personal computers inside GChat
" 46% of vocabulary presented was contextual
" on average, learners were exposed to 88 new vocabulary words that they didn’t already know
" post-study evaluation quiz:
1) production quiz (translate to Spanish/French) 57 words correct
2) recognition quiz (translate to English) 77 words correct
![Page 45: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/45.jpg)
Preliminary Results " Users engage with a learning exercise faster if it is
presented: o shortly after he sends a chat message, or o as he is typing the last few characters of the message
" Because users tend to multi-task while awaiting a
response, grabbing their attention before they context-switch is key
" Even when exercises appeared during inopportune times,
users reported that they did not feel interrupted because the exercise does not occlude IM-ing, and fades away after several seconds, so they always had the option to ignore it.
![Page 46: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/46.jpg)
Preliminary Results Learner Perception of Time “The key thing is is that i didnt feel like i was taking extra time out of my
day to dedicate to learning vocabulary words” “With Duolingo you definitely have to take your time to devote to it. I think it
requires your main focus, you have to actively seek and go and learn it. It feels like you actually have to set aside time to use duolingo, but it doesnt feel like it’s that way with [WaitChatter].”
Learner Perception of Effort “To go on my phone and open Duolingo is more work for me than if i
already have gmail open and i’m always chatting with people anyway.”
“I think it being so close to the chatbox made me do it more, cuz it was a separate thing it wouldn’t be as easy to do some words while i’m waiting for a response.”
![Page 47: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/47.jpg)
Preliminary Results Learner Perception of Structure vs. Pressure
WaitChatter Disadvantages: “A disadvantage is that we could do a lot of stuff in class where we would
memorize a blob of thematically related vocabulary so that way you could give it a little bit of context in your head, in [WaitChatter] there was no real connection between the words.”
WaitChatter Advantages: “This is more entertaining and almost more low-key. i would just type it in,
low pressure, just a simple thing.” “With other apps there are modules, so on the one hand its very
structured, but it also feels like you know what’s ahead of you, so it also feels like more work -- there another module next and next, whereas with [WaitChatter] there are no modules.”
“With other apps i tend to have this mental thing that oh i should do it for 5 minutes straight”
![Page 48: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/48.jpg)
CONCLUSION
![Page 49: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/49.jpg)
O)<A.)"%&'()*"PQQC"%&'()*"
G3):3400&2:"4**&:20(2.*"R(-)2'A842:64:("8(432&2:"
80+46(""
5)8(")?"&2.(34-.&%&.>"S(432(3"-)2.3)8"R67:)48"847(8&2:"R&.64.('"-):2&.&)2"R;4-('"3(;(.&.&)2"
>+'049"C3)<'*)63-&2:"S(432(3*)63-&2:"T&*648&U4.&)2"
C)8847)34.&%("*>*.(0*"
?42#&,"
![Page 50: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/50.jpg)
Vision in learnersourcing • Feedback loop between
– Learners: natural, pedagogically useful activities – System: improve interaction using learner data
• Visualize and analyze large-scale learning activities • Use data to inform learning platform design
![Page 51: Online Education with Learnersourcing · 2014-06-23 · Online Education with Learnersourcing Rob Miller User Interface Design Group MIT CSAIL Joint work with Juho Kim, Sarah Weir,](https://reader034.fdocuments.us/reader034/viewer/2022042223/5ec9ab255cc3f919ea333095/html5/thumbnails/51.jpg)
Conclusion
Toolscape (how-to videos)
Lecturescape (MOOC videos)
OverCode (programming solutions)
Online Python Tutor (programming help)
WaitChatter (language learning)