IBM Watson Health - Evry · IBM Watson Health Bo Rathjen Watson health Nordic [email protected]
Watson And The Future of Learning Science &...
Transcript of Watson And The Future of Learning Science &...
![Page 1: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/1.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
-./'0'12$"32'
Satya V. Nitta, Ph. D
Global Head, Cognitive Science & Education Technology
IBM Research
IBM T. J. Watson Research Center
'
Watson And The Future of Learning Science & Technology!
![Page 2: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/2.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
-./'0'12$"32'
&
*+710/085$9:;/5<;$65.,1$.14$01/5,.=/$1./>,.66:$?0/@$-5+-65$/+$5A/514$?@./$50/@5,$@><.1;$+,$<.=@015;$=+>64$4+$+1$/@50,$+?1B$
(DE'$ (EF'$ &'(($
951;+,;$$G$H580=5;$
I+!J$
C1/5,-,0;5$H./.$
9+=0.6$#540.$
<"#"',$'#=2''>2?#'>"#*9"6'@2$%*9+2''
!2'"92''A292'
The Eras of Computing!
![Page 3: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/3.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
-./'0'12$"32'
“The recent breakthroughs in AI have been largely the result of turning away from …human thought processes and using the awesome data-mining powers of super-computers to grind out valuable connections and patterns without trying to make them understand what they are doing….It is very, very hard to imagine … the limitations of entities that can be such valued assistants, and the human tendency is always to over-endow them with understanding”!!
https://www.edge.org/response-detail/26035!
Daniel Dennett, on AI!
![Page 4: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/4.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
-./'0'12$"32'
F
Watson: A Cognitive System
Watson is available as a set of open APIs and SaaS products!https://www.ibm.com/watson/developercloud/!
![Page 5: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/5.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
-./'0'12$"32'
“In the next 30 years more people will receive formal education than in all of human history thus far” -- UNESCO''
The non-linearity of change…!
![Page 6: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/6.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
*+1/51/K$J>L60;@5,$.14$M-51$C4>=./0+1$N5;+>,=5;$
O4.-/085$P5.,1017$C17015;$!"#$Q./;+1K$RPJS$#.=@015$P5.,1017S$H0.6+7S$*+1=5-/$01;07@/;S$T$
Devops!
Blue
mix!
Softl
ayer
Hyb
rid
Exte
nsio
ns!
9/>451/$!1U+,<./0+1$9:;/5<;$H./.$.14$*+1/51/$#.1.75<51/$.14$O1.6:/0=;$*6+>4$J6./U+,<;$$
Watson Enabled Cognitive Assistants for Education
Watson Classroom Watson IntelligentTutor Career Advisor Student Advisor Future Ideas
Educator Focused Learner Focused
Watson Based Cognitive Assistants For Learning Transformation
![Page 7: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/7.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
B&',Ċ,72&#'#*#%9,&7'$C$#23'D-41E',$'"'+%3F*#29'$C$#23'#="#'",3$'#%'F9%;,)2'
,332),"#2'"&)'+*$#%3,G2)',&$#9*+#,%&'%9'H22)5"+I'#%'62"9&29$J'*$*"66C'K,#=%*#',2&#,%&'H9%3'"'=*3"&'#2"+=29L'
![Page 8: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/8.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
Past, Present and the Future of Intelligent Tutoring Systems
/2+="&,+"6'(9"'892$$2C'/"+=,&2'(E&F$
(62+#9%&,+'(9"''B-'05"$2)'#*#%9,&7'(EV'$W$(EE'$
B-'!,''/%)29&'-41'(EXF$W$(EEY$
892$2&#'<"C''-41M$'92;,$,#2)'&'')$Z$$
“You don't understand anything until you learn it more than one way.” Marvin Minsky
![Page 9: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/9.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
! "#$%&'$($(')*#&+($('),-+./'-)(&,/+&*)*&('/&'#)0&1#2)/(2#+1,&(2$('3)(#/+.14$#(4#)&(2)2##5)$(,#+&4,$6$,7)
1. Multiple choice assessments 2. No real exploration or socratic inquiry 3. Focus on what next learning object is, not
how it is delivered 4. No affective compute based models
O4.-/085$P5.,1017$[+4.:$
1. Natural language based socratic dialog 2. Analyzing natural language responses
and remediation 3. Multi-modal experiences 4. Instrumentation of the learning process
!<.75$ !1/5,.=/085$ O>7<51/54$N5.60/:$\ON]$
!"#$O--,+.=@$
Adaptive Learning Reimagined: Watson Based Intelligent Tutor
![Page 10: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/10.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
N-OO'!B41P>Q''^>5;/0+1ZO1;?5,017$?0/@$Q./;+1$01$.$#MM*$$\OB$_+:.6$5/B$.6]$
![Page 11: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/11.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
Concept Maps overlaid with student mastery Tangible + Augmented Reality to teach chemistry
Dialog to engage students and assess Tangible + Augmented Reality to teach earth science
9th Grade Earth Science Pilot
![Page 12: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/12.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
!"#$%&'()*'+,-$
Analyzing Natural Language Reponses! Related Concept Clustering!
Conversation / Dialog
Learner Models (ABC)A"ect, Behavior, Cognitive!
Question Answering (Deep QA)!
Machine learning based learner Modeling!
Personalized one on one tutoring with Watson!
24x7 Virtual Assistant
![Page 13: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/13.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
![Page 14: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/14.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
Watson Intelligent Tutor Demo!
![Page 15: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/15.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
Sesame and IBM Watson will create products that help kids become $3"9#29, $#9%&729 and I,&)29 by harnessing the power of cognitive computing
U'VWW'>2*9%&"6':%&&2+#,%&$'"'$2+%&)',&'#=2'X9$#'H2K'C2"9$':9,#,+"6'#,32'H%9'6"&7*"72'62"9&,&7'
8#90.+() :);.(,-) <);.(,-) =)>#&+1) ?2/*,)
Synapse Density Over Time Source: Corel, JL. The postnatal development of the human cerebral cortex Cambridge, MA: Harvard University press; 1975
![Page 16: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/16.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
![Page 17: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/17.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
-./'0'12$"32'
"Why, Dan," ask the people in artificial intelligence, "do you waste your time conferring with those neuroscientists?
They wave their hands about 'information processing' and worry about where it
happens, and which neurotransmitters are involved, but they haven't a clue about
the computational requirements of higher cognitive functions." "Why," ask the
neuroscientists, "do you waste your time on the fantasies of artificial intelligence?
They just invent whatever machinery they want, and say unpardonably ignorant
things about the brain!
![Page 18: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/18.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
Learning Transformation
Cognitive Neuroscience
Evidence Based Learning
Cognitive Computing & Deep interactivity (AR, VR, !)
Assertion: Simultaneous Advances in Cognitive Science & Computing will Help Transform Future Learning Experiences
![Page 19: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/19.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
UNDERSTANDING LEARNING ! How is learning defined at various, inter-coupled levels of abstraction (molecular " cellular "
brain " behavior)? ! How do we know learning has happened? ! How is learning impacted by collaboration? ! …
TESTING FOR LEARNING ! What are some bio-, neuro-, and physical- markers of learning that we can determine? ! What are all the sources of signals we can tap into to understand how we learn? What sensors should
we be using? ! What experiments should we be conducting? ! Does skill training effect transfer to other tasks? ! What technologies will help? ! Does studying learning disabilities give us a better chance of understanding learning? If so why? And
which ones? (autism, dyslexia …) ! …
LEARNING EXPERIENCES ! What makes an effective learning experience? What does “effective” mean? ! How do we keep learners engaged? Does engagement lead to learning? ! What are the best learning experiences we can create? ! How do we embody or encode these experiences in technology? ! Should we incorporate VR into a classroom or a classroom into the VR? ! …
Research Questions
Transfer
Attention Representation
Emotion
Conditioning
Reaction Time
Cognitive Load
Memory: recall/retrieval/storage
Engagement
Interruption Reasoning
Trust
Priming
Scaffolding
Stress
Plasticity
Cognitive Flexibility
Creativity Confidence
![Page 20: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/20.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
Translational Agenda Accelerating learning through technology, underpinned by neuroscience
Principles confirmed through neuroscience
Technology Enablement: Personalized intelligent tutoring systems with dialog, rich student models, learner instrumentation, multi-modal experiences, story telling and analogical reasoning
![Page 21: Watson And The Future of Learning Science & Technologyweb.mit.edu/xtalks/FoL-2017-Satya-Nitta.pdf · 2017. 2. 10. · Watson: A Cognitive System Watson is available as a set of open](https://reader035.fdocuments.us/reader035/viewer/2022063021/5fe397129813e507461af847/html5/thumbnails/21.jpg)
!"#$!"#$%&'()*+"#,%&'%$&'()$!"#$*+,-+,./0+1$$2$$$!"#$*+13451/0.6$
:%7&,#,;2'1%6*#,%&$Q'[@5$-./@$U+,?.,4T.14$.$1+4$/+$#.,801$#01;`:$\(E&X$W$&'()]$
A model of human intelligence, built up from the interactions of simple parts called agents, which are themselves mindless
Combining relatively “simple” cognitive services can yield surprising results!