Anna Ly & Hain -Lee Hsueh
description
Transcript of Anna Ly & Hain -Lee Hsueh
![Page 1: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/1.jpg)
Anna Ly & Hain-Lee Hsueh
![Page 2: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/2.jpg)
About Us
Background in ECE and Software Engineering from Cornell. Formally worked for Oracle Enterprise Applications.
Background in HCI, Business & Communication Design from Carnegie Mellon. Formally worked for IBM Strategy.
Anna
Ly
Hai
n-Le
e H
sueh
![Page 3: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/3.jpg)
Social Processing Machines
![Page 4: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/4.jpg)
Background
Autism and ASD•Affects 1 in 88 American children•# of yearly diagnoses •Autism > cancer + diabetes + pediatric AIDs
ProblemChildren with autism struggle socially with:•Verbal/non-verbal communication•Emotional reciprocity•Social interactions
![Page 5: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/5.jpg)
Refining the Learning Space
Emphasis on socio-emotional learning/thinking• Displaying feelings through facial expressions is not
automatic
• Learners may know what to do, but anxiety impedes execution
• A common difficulty is understanding things from another’s perspective
![Page 6: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/6.jpg)
Research
Empathy has two components (Baron-Cohen et al, 2009)• Cognitive: recognizing mental states• Affective: reacting appropriately• Some studies show that the cognitive component can
be taught!
Limitations with behavioral approaches (Koegal & Koegal, 1995, Strain et. al, 2011, Schriebman, 2007, Luckett et. al, 2007)
![Page 7: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/7.jpg)
Learning Problem
Target Learners• Children or adolescents with mild to moderate
Autism
Learning Goal• Strengthen understanding of emotions to
develop socio-emotional skills and behaviors
![Page 8: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/8.jpg)
Two solutions
• One-liner• Process• Walkthrough
• Learner Studies• Feedback
![Page 9: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/9.jpg)
Me.Mu is a pair of mini-games on the Kinect that teaches greetings and facial emotions.
![Page 10: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/10.jpg)
Initial Video Prototype
![Page 11: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/11.jpg)
Initial Video Prototype
Feedback• Needs to be more realistic• Focus on emotions in context
![Page 12: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/12.jpg)
2nd Video Prototype
![Page 13: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/13.jpg)
2nd Video Prototype
Feedback / Results• Good idea, but is this really leveraging the
affordances of Kinect?
?
![Page 14: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/14.jpg)
Me.Mu
Falling Faces Hello Park
![Page 15: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/15.jpg)
[Video Removed From File]
![Page 16: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/16.jpg)
Learning Theories for Me.Mu
• Embodied Learning• Joint Media Engagement• Social Thinking
![Page 17: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/17.jpg)
Emotionary is an emotion diary to facilitate awareness of emotions in context through scaffolded reflection.
![Page 18: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/18.jpg)
![Page 19: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/19.jpg)
Emotionary v.0
![Page 20: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/20.jpg)
Strengths of Emotionary v.0
• Emotions in context• Engagement with camera• Documenting progress
Can we design something different that still keeps these strengths?
![Page 21: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/21.jpg)
[Live Demo]
![Page 22: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/22.jpg)
Learning Theories for Emotionary
• Joint Media Engagement• Social Thinking• Vygotskian social development
![Page 23: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/23.jpg)
Learner Studies
Short informal studies at the Pacific Autism Center for Education
(PACE)
![Page 24: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/24.jpg)
Learner Study Data – Me.Mu• 9 students• 1-3 sessions• 4 days
TOTAL STUDENTS
>1 SESSIONS
78% of total
IMPROVED SCORES
100% of those with
>1 sessions
![Page 25: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/25.jpg)
Me.Mu FindingsLearning• Falling Faces – colors of the faces not a distraction• Hello Park – one student able to correct his wave• Less prompting in subsequent sessions
Engagement• Students clapped, cheered, and volunteered• Students talked to the characters on screen• Repetitive nature of “Hello Park” was appealing
![Page 26: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/26.jpg)
Learner Study Data - Emotionary
• 36 entries• 6 students• 3 days
TOTALENTRIES
PHOTO
TEXT
AUDIO
97% 72% 50%36
32/36
![Page 27: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/27.jpg)
Emotionary FindingsLearning• Some students able to connect emotions with
specific events• Responses typically a short sentence
Engagement• Students excited to have their turn with the iPad
![Page 28: Anna Ly & Hain -Lee Hsueh](https://reader035.fdocuments.us/reader035/viewer/2022062309/568152ce550346895dc0e9e3/html5/thumbnails/28.jpg)
AcknowledgementsThank you to….• Pacific Autism Center for Education (pacificautism.org)
• Associated Learning & Language Specialists (allsinc.com)
• Developmental Pathways (developmentalpathways.com)
• All the parents, therapists, & students who tested and supported our project!
• Microsoft, for awarding us a Kinect• Financial support from Mr. Reece Duca