Conference Presentation BioRob2012

31
Directional vs Non-directional Modes of Vibrotactile Feedback for Arm Posture Replication Albert Causo, Le Dung Tran , Song Huat Yeo and I-Ming Chen School of Mechanical and Aerospace Engineering Nanyang Technological University, Singapore 25 th Jun 2012 1

description

f

Transcript of Conference Presentation BioRob2012

Page 1: Conference Presentation BioRob2012

Directional vs Non-directional Modes of Vibrotactile Feedback for Arm Posture Replication

Albert Causo, Le Dung Tran, Song Huat Yeo and I-Ming Chen

School of Mechanical and Aerospace Engineering

Nanyang Technological University, Singapore

25th

Jun 2012

1

Page 2: Conference Presentation BioRob2012

Motivation & Objective http

:/2.b

p.b

log

spo

t.com

/69

cpY

P6

lmkU

/TV

l_IZ

iRp

zI/AA

AA

AA

AA

Ea

c/

x8y2

JdG

_S

GQ

/s40

0/p

hysio

the

rap

y%2

Bstro

ke%

2B

old

%2

Bw

om

an

.jpg

http:/i1.ytimg.com

/vi/tdFX

lB3H

LUQ

/hqdefault.jpg

15m

67%

stroke patient

survive

Develop low-cost device

for rehabilitation

Best feedback strategy for

posture correction2

Page 3: Conference Presentation BioRob2012

Presentation Outline

System Overview

Arm Posture Modeling & Measurement

Vibo-tactile for Posture Correction

3

Page 4: Conference Presentation BioRob2012

Different ways of capturing motion

Inertial Motion Unit

MAGNETIC

MECHANICAL

SYSTEM

OPTIC

System Overview Modeling Vibro-tactile

4

Page 5: Conference Presentation BioRob2012

Vibro-tactile Feedback

posture guidance

motor learning hand

rehabilitation

5

System Overview Modeling Vibro-tactile

Page 6: Conference Presentation BioRob2012

IMU

IMU

Vibro-tactile Unit

System Overview

IMU

Vibro-tactile

Unit

6

System Overview Modeling Vibro-tactile

Software

Page 7: Conference Presentation BioRob2012

Arm Posture Modeling

Wrist

Position

Elbow

Position

Forearm

Roll

7

System Overview Modeling Vibro-tactile

Page 8: Conference Presentation BioRob2012

Shoulder

Wrist

Elbow

IMU 1

IMU 2

𝐿2

𝐿1

Arm Posture Kinematics

IMU 1 -

𝑟1 ,𝑝1 , 𝑦1

IMU 2 -

𝑟2 ,𝑝2 , 𝑦 2

Arm Lengths -

𝐿1,𝐿2

𝑓 (𝑟 1 ,𝑝1 , 𝑦 1 ,𝑟2 ,𝑝2 , 𝑦 2 ,𝐿1 ,𝐿2)𝑓 (𝑟 2 ,𝑝2 , 𝑦2 ,𝐿2)

wrist -

elbow -

forearm roll -

𝑟1

8

System Overview Modeling Vibro-tactile

Page 9: Conference Presentation BioRob2012

Vibro-tactile feedback for arm posture correction

Vibro-tactile unit

Directional feedback

Non-directional feedback

9

System Overview Modeling Vibro-tactile

Page 10: Conference Presentation BioRob2012

Directional Feedback Non-directional Feedback

Global

system at

shoulder 10

right hand right hand

System Overview Modeling Vibro-tactile

Local

system at

wrist

Page 11: Conference Presentation BioRob2012

Experiments

1 2 3

4 5

11

System Overview Modeling Vibro-tactile

Page 12: Conference Presentation BioRob2012

Calibration Step

12

System Overview Modeling Vibro-tactile

Page 13: Conference Presentation BioRob2012

Using Vibro-tactile Feedback

Directional Feedback Non-directional Feedback

1m36s 25s13

System Overview Modeling Vibro-tactile

Page 14: Conference Presentation BioRob2012

Results

Feedback Strategy Mapping Time (s)Directional Feedback 52.68 ± 17.98

Non-directional Feedback 36.82 ± 19.37

2 3

1 42 3 5

Average error of 7 subjects for 5 posturesAverage error of 7 subjects for 5 postures

14

The use of tactors as directional & non-directional feedback

Error Directional Feedback Non-directional Feedback

Wrist position (mm)

34.42 ± 22.46 26.61 ± 12.92

Elbow position (mm)

20.63 ± 9.53 19.61 ± 9.56

Forearm roll (deg) 6.81 ± 2.96 7.07 ± 3.05

System Overview Modeling Vibro-tactile

Page 15: Conference Presentation BioRob2012

Conclusion

IMU

IMU

Vibro-tactile Unit

Integrated System

Arm Posture Modeling

& Measurement

Vibo-tactile for

Posture Correction

15

Page 16: Conference Presentation BioRob2012

Future Work

• Combine active visual + audio + vibro-tactile feedback

• Compare direction & non-direction when adding vision

• Design rehab modules

16

Page 17: Conference Presentation BioRob2012

Thank you!

Email: [email protected]

17

Page 18: Conference Presentation BioRob2012

APPENDICES

18

Page 19: Conference Presentation BioRob2012

Design of GUI

Experiment tabTesting tabConfiguration tab 19

Page 20: Conference Presentation BioRob2012

Software - System Overview

StartReceive

Master’s IMU

data

Determine

target

position

Receive

Student’s

IMU data

Determine

current

position

Handle

error

Send tactile

feedbackFinish

Student

adjusts

his/her arm

+-

Arm Replication Process

Page 21: Conference Presentation BioRob2012

IMU Measurements

IMU packs 9 sensors (3 accelerometers, 3 angular rate

gyros, 3 magnetometers)

Given the angular value at (t − 1) and t, the numerical approximation becomes

Inertial Motion Unit

Page 22: Conference Presentation BioRob2012

Kinematic Formulation (1)

Cartesian transformation

Page 23: Conference Presentation BioRob2012

Kinematic Formulation (2)

Yaw - z axis

Pitch - y axis

Roll - x axis

Page 24: Conference Presentation BioRob2012

Kinematic Formulation (3)

Page 25: Conference Presentation BioRob2012

IMU Specification

Page 26: Conference Presentation BioRob2012

Tactor Specification

Specifications of VPM2

VPM2 tactor

Dimensions of VPM2

Page 27: Conference Presentation BioRob2012

Capture of Program

Page 28: Conference Presentation BioRob2012

IMU device

Page 29: Conference Presentation BioRob2012

Vibrotactile Unit

Page 30: Conference Presentation BioRob2012

Average error of 7 subjects for 5 posturesAverage error of 7 subjects for 5 postures

Data

Directional and non-directional feedback indicators

Feedback Strategy Mapping Time (s)

Directional feedback 52.68 ± 17.98

Non-directional feedback 36.82 ± 19.37

Average mapping time of 7 subjects for 5 posturesAverage mapping time of 7 subjects for 5 postures

Error Directional feedback Non-directional feedback

Wrist position (mm)

34.42 ± 22.46 26.61 ± 12.92

Elbow position (mm)

20.63 ± 9.53 19.61 ± 9.56

Forearm roll (deg) 6.81 ± 2.96 7.07 ± 3.05

Page 31: Conference Presentation BioRob2012

Threshold values

Directional and non-directional experiments