easyADL - Wearable Support easyADL - Wearable Support System for Independent Life System for Independent Life

despite Dementiadespite Dementia

Dipak SurieDipak SurieDept. of Computing ScienceDept. of Computing Science

Umeå UniversityUmeå University

SwedenSweden

dipak@cs.umu.sedipak@cs.umu.se

Two-year projectTwo-year project

Dept. of Geriatric MedicineDept. of Geriatric Medicine, , VRlabVRlab, and, and

Dept. of Computing ScienceDept. of Computing Science,,

Umeå University, SwedenUmeå University, Sweden

Problem Description and General Problem Description and General ApproachApproach

INTERACT

Cognitive support required ?

no

yes

RECOGNITION SUPPORT

User´s Activity User-Environment Interaction

User´s State State of space surrounding the user

• Activities of daily living (ADL)Activities of daily living (ADL)• Behavioural patternsBehavioural patterns• Sense of causeSense of cause• Sense of spaceSense of space• Sense of timeSense of time• MemoryMemory• Sense of quantitySense of quantity• Sense of qualitySense of quality• Mutual communicationMutual communication• Social interactionSocial interaction

Simulation of Wearable Support System in Simulation of Wearable Support System in

Immersive Virtual-Reality Immersive Virtual-Reality

• Wearable InfrastructureWearable Infrastructure VsVs Infrastructure in the environmentInfrastructure in the environment

• Wearable hardware prototype development and evaluation...Wearable hardware prototype development and evaluation...

• Accelerate (design & re-design) prototype Accelerate (design & re-design) prototype development processdevelopment process

• Build prototypes ahead of technologyBuild prototypes ahead of technology• Explore UBICOMP user interfacesExplore UBICOMP user interfaces• Identify feasible sensor configurations and Identify feasible sensor configurations and

combination of computing algorithmscombination of computing algorithmsHardware Prototyping...Hardware Prototyping...

Multi-layer Architecture Multi-layer Architecture

Clustering LayerClustering Layer Growing Neural Gas algorithmGrowing Neural Gas algorithm

User LabellingUser Labelling Text, Picture, AudioText, Picture, Audio

• Event TemplatesEvent Templates

Feature Extraction LayerFeature Extraction Layer

(Client)(Client)

Activity Modeling LayerActivity Modeling Layer Hidden Markov Model(s)Hidden Markov Model(s)

Classification LayerClassification Layer Event TemplatesEvent Templates

Feature Extraction LayerFeature Extraction Layer

(Server)(Server)

Sensing LayerSensing LayerObjects grabbed/released Objects grabbed/released

Left Hand & Right Hand movementsLeft Hand & Right Hand movements

Body postureBody posture

Scenario-based AnalysisScenario-based AnalysisVirtual Reality Home EnvironmentVirtual Reality Home Environment3 ADL from AMPS Framework3 ADL from AMPS Framework• Preparing coffee and cakesPreparing coffee and cakes• Having a coffee break Having a coffee break • Hand washing the dishesHand washing the dishes

Ethnographical Studies in Real Home EnvironmentEthnographical Studies in Real Home Environment• 15 ADL from AMPS Framework15 ADL from AMPS Framework• Wearable audio & video recorder with bullet camera Wearable audio & video recorder with bullet camera • Interviews with the subject and subject’s family Interviews with the subject and subject’s family

Initial prototype evaluationInitial prototype evaluation User-Environment InteractionUser-Environment Interaction User’s stateUser’s state State of space surrounding the userState of space surrounding the user