Wearable Sensor Analysis for Gesture

Recognition

Supervisor:Supervisor: Dr. Manolya Kavakli Dr. Manolya Kavakli

Student:Student: Alexey NovoselovAlexey Novoselov

St. ID: St. ID: 4165088341650883

22

AgendaAgenda1: Background;1: Background;2: Goals;2: Goals;3: Intended Outcomes;3: Intended Outcomes;4: Significance;4: Significance;5: Approach;5: Approach;6: Contemporary Technologies;6: Contemporary Technologies;7: Piezo-Electric Technology;7: Piezo-Electric Technology;8: Problems;8: Problems;9: Experiments;9: Experiments;10: Output Data;10: Output Data;11: Initial Analysis;11: Initial Analysis;12: Mathematical Approach;12: Mathematical Approach;13: Algorithmic Approach;13: Algorithmic Approach;14: Conclusion14: Conclusion15: Future Work15: Future Work

33

1: Background1: Background

Virtual Reality is very promising scientific area;Virtual Reality is very promising scientific area;

Needs tools for interaction;Needs tools for interaction;

A lot of various technologies and devices;A lot of various technologies and devices;

Sensor Jacket is one of them;Sensor Jacket is one of them;

No appropriate software for output analysis;No appropriate software for output analysis;

44

2: Goals2: Goals

Investigate contemporary Motion Capture Investigate contemporary Motion Capture technologies and techniquestechnologies and techniques;;

Collect Sensor Jacket’s output data;Collect Sensor Jacket’s output data;

Analyze it;Analyze it;

Develop a mathematical model or an algorithm for Develop a mathematical model or an algorithm for Sensor JacketSensor Jacket;;

55

3: Intended Outcomes3: Intended Outcomes

The list of justified experiments;The list of justified experiments;

Data, collected during the set of Data, collected during the set of experiments;experiments;

General characteristics of signals;General characteristics of signals;

Application of mathematical approach;Application of mathematical approach;

Application of algorithmic approach;Application of algorithmic approach;

Mathematical model or algorithm for Mathematical model or algorithm for signal processing;signal processing;

66

4: Significance4: Significance

Other Motion Capture systems not very Other Motion Capture systems not very convenient in use;convenient in use;

Sensor Jacket is wearable;Sensor Jacket is wearable;

Sensor Jacket is simple;Sensor Jacket is simple;

But is has no software for output But is has no software for output analysis;analysis;

77

5: Approach5: Approach

Develop and perform experiments;Develop and perform experiments;

Collect data;Collect data;

Filter data;Filter data;

Analyze data;Analyze data;

Develop a tool;Develop a tool;

88

6: Contemporary Technologies6: Contemporary Technologies

Optical; Optical;

Inertial;Inertial;

Mechanical;Mechanical;

99

7: Piezo-Electric Technology7: Piezo-Electric Technology

Piezo-effect;Piezo-effect;

Piezo-electric sensor;Piezo-electric sensor;

Made of graphite and silicone rubber;Made of graphite and silicone rubber;

1010

8: Problems8: Problems

Only static characteristic provided;Only static characteristic provided;

Electric noise in the output channels;Electric noise in the output channels;

Strongly non-linear output signal;Strongly non-linear output signal;

Speed dependent;Speed dependent;

1111

9: Experiments9: Experiments

1212

10: Output data10: Output data

0

200

400

600

800

1000

1200

1400

1600

1 21 41 61 81 101 121 141 161 181 201 221 241 261 281 301 321 341 361 381 401 421

200

400

600

800

1000

1200

1400

1 9 17 25 33 41 49 57 65 73 81 89 97 105 113 121 129 137 145 153

1313

11: Initial Analysis11: Initial Analysis

Minimal (Starting) value;Minimal (Starting) value;

Maximal (Peak) value;Maximal (Peak) value;

Steady Value;Steady Value;

The overshoot;The overshoot;

Difference between initial and final values;Difference between initial and final values;

1414

12: Mathematical Approach12: Mathematical Approach

Basic characteristics;Basic characteristics;

Speed of the signal change;Speed of the signal change;

Angle of slope of the signal;Angle of slope of the signal;

Area of the signal;Area of the signal;

1515

13: Algorithmic Approach13: Algorithmic Approach

1.1. Determine the active sensors;Determine the active sensors;2.2. Calculate the area of their signals;Calculate the area of their signals;3.3. Calculate the speed of sensors’ signals change;Calculate the speed of sensors’ signals change;4.4. Using the graphs (Figures 18-20), calculate the real speed of Using the graphs (Figures 18-20), calculate the real speed of

movement;movement;5.5. Using the tables of active sensors, determine to which types Using the tables of active sensors, determine to which types

of movement (AoF, AoS, or AStF) this motion belongs;of movement (AoF, AoS, or AStF) this motion belongs;6.6. Determine the approximate direction of movement;Determine the approximate direction of movement;7.7. Calculate the average time between the start and the peak of Calculate the average time between the start and the peak of

transient process for each group of sensors, forming the transient process for each group of sensors, forming the movement type;movement type;

8.8. Using the information from steps 4, 5, and 6, calculate the Using the information from steps 4, 5, and 6, calculate the approximate distance that operator’s hand has passed during approximate distance that operator’s hand has passed during the motion in each direction;the motion in each direction;

9.9. Calculate the final coordinates of operator’s palm using Calculate the final coordinates of operator’s palm using formulas;formulas;

1616

14: Conclusion14: Conclusion

Technologies review;Technologies review;

Designed and performed experiments;Designed and performed experiments;

Collected, filtered, and analysed data;Collected, filtered, and analysed data;

Mathematical approach did not succeed;Mathematical approach did not succeed;

Algorithm created;Algorithm created;

1717

15: Future Work15: Future Work

More experiments;More experiments;

More sensitive data filtration;More sensitive data filtration;

Use advanced mathematical techniques;Use advanced mathematical techniques;

Create more accurate and precise tool.Create more accurate and precise tool.

1818

Thank you!Thank you!