New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory...

48
Medical Media and Design Laboratory Division of Surgery New Media and Healthcare: Avatars, Virtual Worlds and Apps Dave Taylor MSc MBCS Medical Media and Design Lab Imperial College London Email: [email protected] Web: http://tinyurl.com/medmedia Blog: http://www.nanodave.com Dept of Primary Care and Public Health Oct 19 th 2011

Transcript of New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory...

Page 1: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

New Media and Healthcare: Avatars, Virtual Worlds and Apps

Dave Taylor MSc MBCS Medical Media and Design Lab

Imperial College London

Email: [email protected]

Web: http://tinyurl.com/medmedia

Blog: http://www.nanodave.com

Dept of Primary Care and Public

Health

Oct 19th 2011

Page 2: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Virtual Worlds – Immersive, 3D experiences

Users interact with each other via personalised avatars

Easily accessible technology, fully recordable and

reproducible scenarios

Real time, multiple person interaction in bespoke

settings

Merging with web and other social media

Page 3: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Preview of what is to come ….

Introduction to virtual worlds

Relevance to healthcare

Some applications ….

Michael Taylor: Group and Individual Psychology/Obesity

Wellnote iPhone App

Page 4: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Collaboration and innovation between institutions across discipline and geographic boundaries

Page 5: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

One of our neighbours….

Page 6: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Healthcare – Patients are there

Alcoholics

Accessibility

ADD/ADHD

Agoraphobia

Cancer

Aids/HIV

Alzheimers

Sign Language Users

Social Anxiety

Autistic Spectrum Disorders/Aspergers

Blind/Visually impaired

Bipolar

Borderline Personality Disorder

Babies

Breast Cancer

Patient groups in Second Life: Mental Health Cluster Headache Counseling Chrohns and Colitis Deaf community Dementia Depression Diabetes Disability Red Cross Endometriosis Fibromyalgia Dissociative Identity

Disorder Horses for healing Hospices

Irritable Bowel Symptom Aging Leukemia and Lymphoma Facial Differences Loss, death and bereavement Manic depression Muscular Dystrophy Mobility Impaired Mental Health Multiple Sclerosis Multiple Personality Disorder Smoking

Neurological Disorders Nutrition Obsessive Ambulatory

Disorder Organ donors Polycystic Ovary

Syndrome Chronic Pain Psychosis Prostate Cancer Self Harm Sexual Health Epilepsy Social Anxiety Spina Bifida Traumatic Brain Injury Sensory and Motor

Disability Substance Misuse

Patient group meeting: May 2006

Sources: slhealthy.wetpaint.com and HealthInfo Island

Page 7: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

International Virtual Association of Surgeons, Apr 2008

Page 8: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Page 9: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

How we got started …. Second Health – Visualising the future of healthcare in London

Page 10: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Second Health – Visualising the future of healthcare in London

www.youtube.com/secondhealth

Page 11: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Medical Device Training &

Patient Safety

Virtual Patients for training &

assessment

Team Skills Training

Behaviour Change

Trialling Clinical Environments

Towards gaining valid consent from patients with

learning disability

Other Virtual World Projects

Page 12: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Memorial Sloan-Kettering Brooklyn Infusion Clinic

Real World

Virtual World

Page 13: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Virtual Surgical Innovation Centre

Page 14: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Adults with Learning Disability

People with learning disabilities

have poorest access to health care

and receive least comprehensive

service

People with learning disability learn

best from multimodal experiences

Immersive VR has been shown to

support learning

Use a virtual hospital experience to

discover if we can enhance recall

and understanding

Page 15: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Virtual patients – Vish Patel

Page 16: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Anatomy

Page 17: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Functional Anatomy

Page 18: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Anatomy

Page 19: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Major Incident Training

Page 20: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

A Tabletop exercise: The Emergo Train System (ETS)

Page 21: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

MISSIVE Major Incident Scenario Simulation In Virtual Environments

Dirty bomb at a sports stadium

Ambulance

HART:

Triage and

Treatment

Multi-person

Trauma team

Clinical Major

Incident

Co-ordinator

Page 22: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

MISSIVE Major Incident Scenario Simulation In Virtual Environments Ambulance

HART:

Triage and

Treatment

Multi-person

Trauma team

Clinical Major

Incident

Co-ordinator

Page 23: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

MISSIVE Major Incident Scenario Simulation In Virtual Environments Ambulance

HART:

Triage and

Treatment

Multi-person

Trauma team

Clinical Major

Incident

Co-ordinator

Page 25: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Meetings in virtual worlds

Michael Taylor MSc

Research Assistant

Imperial College London

[email protected]

Page 26: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Team meetings in a healthcare context

Meetings in virtual worlds

CLAHRC in Second Life

Research on teamwork in virtual worlds

Virtual Worlds and Obesity

Conclusion and Summary

Presentation contents

Page 27: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

CLAHRC for NW London supports health research teams

These teams are dispersed across different locations and often have to

travel to meet with one another

Page 28: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

The Healthlands is a Second Life

‘Island’ owned by CLAHRC

The Healthlands

Page 29: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Page 30: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

What do we mean by teamwork?

Collaboration

Negotiation

Shared decision making

How can we measure this using objective quantitative

measures?

Teamwork in Virtual Worlds

Page 31: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Negotiation scenarios

Page 32: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Effect on perception of hierarchy

Page 33: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Are there other ways that behaviour is affected by using virtual worlds?

The Proteus Effect: Appearance and actions of your avatar affects your behaviour

Having a tall or more attractive avatar

boosts confidence– effect persists in

physical world Yee and Bailenson 2007)

• Exposure to own avatar running on a treadmill

leads to higher physical activity 24 hours later

than if avatar was inactive (Fox & Bailenson

2009)

Page 34: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Virtual World (VW) and face to face (F2F) programs ran for 12 weeks

Participants met 4 times per week

Meetings centred on Nutrition Physical activity Habit change Social support

Both groups lost weight (VW: 3.98kn, F2F: 2.74kg).

- VW group conducted more

exercise

- They also improved on confidence

in their ability to exercise and

lose weight

-F2F group had no significant

different in these measures

Virtual worlds obesity study

Page 35: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Virtual worlds are useful for remote meetings between individuals

Communication is less affected by social power in a virtual worlds

context

We have available a controlled, manipulatable environment, which

may facilitate communication for individuals who perceive

themselves to have low social power comapred to those they tend to

interact with face-to-face

Conclusions

Page 36: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Obesity interventions using virtual worlds

Page 37: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Patient focus groups in virtual worlds

Page 38: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

There is huge potential for using virtual worlds for

meetings

Interaction between individuals is affected by the

virtual world context

Remote communicating results in mediated social power

The ‘proteus effect’ results in behaviour being influenced

by the appearance and behaviours of their avatars

Summary

Page 39: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Wellnote by Dr Darzi

Page 40: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Overview

The WellNote iPhone App groups together a range of

useful and important tools in one handy place, including:

Find services: e.g. hospital, GP, Pharmacy, etc

My medications

My medical history

Health news

Wellnote by Dr Darzi

Page 41: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Find Services

Wellnote uses location to find the nearest:

GP

Hospital

Dentist

Pharmacy

Walk in centre

Minor injuries unit

Sexual health centre

Page 42: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Service ratings

We provide user with the

national rating of the hospital

or service they have

searched for, so they can

make an informed choice

about where to go for the

best care.

Users can also rate the care

that they received so that

others can benefit from their

experiences

Page 43: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Medical history

The app also lets users store their (family members)

medical history and medications in an easy to use and

easy to access format.

They can enter your personal details, operations,

medical conditions and results of any tests and

investigations

Can be accessed by medical team in the event that

user become unwell

User can also email their medical history to a doctor or

themselves

Page 44: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

My Medications

Wellnote lets users keep a list of their medications

(or those of a friend or family member) in a simple to

use and easy to see format.

Page 45: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Health news

Wellnote also keeps users

updated on important

health stories from NHS

Choices

Daily articles are selected

form the NHS choices

news feed

Wellnote by Dr Darzi

Page 46: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Information & data

All location services data is

provided through NHS

choices, guaranteeing up to

date information

Hospital ratings data is

taken directly from the

Commission for Care Quality

All user ratings are

anonymous and stored in a

secure and encrypted

dataset

Page 47: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with
Page 48: New Media and Healthcare: Avatars, Virtual Worlds and Apps · Medical Media and Design Laboratory Division of Surgery Virtual Worlds – Immersive, 3D experiences Users interact with

Medical Media and Design Laboratory Division of Surgery

Acknowledgements

Virtual World Team:

Daniel Cohen

Vishal Patel

Robin Winter

Michael Taylor

Nick Sevdalis

Nicola Batrick

Karen Kerr

James Kinross

Raj Aggarwal

Ivaylo Vlaev

Henry Lee

Dave Taylor

Prof Ara Darzi