Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport...

23
Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier Pattern Recognition Lab (CS 5) Digital Sports Group 14.09.2012

Transcript of Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport...

Page 1: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

Automatic Classification of Sport Exercises for Training Support

Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

Pattern Recognition Lab (CS 5)

Digital Sports Group

14.09.2012

Page 2: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Goals in Sports

muscle size body weight performance

training 2

[1] [2] [3]

Page 3: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Training Schedule

3

coach athlete training schedule

5.6 km/h 5.6 km/h 8.3 km/h week 1

50 watt 100 watt 100 watt week 2

Monday Wednesday Friday

[4]

[5]

Page 4: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Feedback

4

coach athlete

training schedule

5.6 km/h 5.6 km/h 8.3 km/h week 1

50 watt 100 watt 100 watt week 2

Monday Wednesday Friday

feedback

[4]

[5]

Page 5: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

self

reports

•physiological

•motion sensors

Feedback

5

[6]

Page 6: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Idea

6

8.3 km/h

automatic classification of sport exercises for training support

Page 7: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Pattern Recognition Pipeline

data acquisition

preprocessing feature

extraction feature

selection classification

7

Page 8: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Data Acquisition

data acquisition

preprocessing feature

extraction feature

selection classification

8

3-D accelerometer 6g

3-D gyroscope 500 deg/s 2000 deg/s

sampling rate 200 Hz

storage SD card

Page 9: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

treadmill • 5.6 km/h

• 8.3 km/h

bicycling • 50 watt (70 rev. / min)

• 100 watt (70 rev. / min)

Data Acquisition

data acquisition

preprocessing feature

extraction feature

selection classification

9

20 [7]

120 s

Page 10: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Preprocessing

data acquisition

preprocessing feature

extraction feature

selection classification

10

5 s 5 s

Page 11: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Feature Extraction

data acquisition

preprocessing feature

extraction feature

selection classification

11

4 sensors 6 axes 7 features

5 LPC coefficients

spectral centroid

bandwidth

x x = 168

LPC: linear predictive coding

time

frequency

Page 12: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Feature Extraction (Spectral Centroid)

data acquisition

preprocessing feature

extraction feature

selection classification

12

spectral centroid

treadmill

5.6 km/h 8.3 km/h

Page 13: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Feature Selection

data acquisition

preprocessing feature

extraction feature

selection classification

13

• reduction of number of features • sequential forward selection • leave-one-subject-out cross-validation

Page 14: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

level 1

Classification

data acquisition

preprocessing feature

extraction feature

selection classification

14

feature 2

feature 1

level 2

5.6 km/h

8.3 km/h

50 watt

100 watt

Page 15: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Classification

data acquisition

preprocessing feature

extraction feature

selection classification

15

• Support Vector Machine (SVM)

• linear kernel

• cost parameter: C = 1 algorithms

• classification rate

• class dependent mean

• overall mean

performance assessment

Page 16: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Classification Rates

16

level 1 level 2

class rate

treadmill 97.3 %

bicycling 99.0 %

mean 98.2 %

class rate

5.6 km/h 99.6 %

8.3 km/h 98.3 %

mean 99.0 %

class rate

50 watt 60.5 %

100 watt 61.6 %

mean 61.1 %

Page 17: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Bicycling

17

100 watt

50 watt

Page 18: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

level 1

Feature Selection: Sensor Placement

18

level 2

wrist

chest

hip

ankle

wrist

chest

hip

wrist

chest hip

ankle

Page 19: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Feature Selection: Sensor Type

19

level 1 level 2

accel

gyro

accel gyro

accel

Page 20: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Summary

20

coach athlete

training schedule

feedback

8.3 km/h

data acquisition

preprocessing feature

extraction feature

selection classification

treadmill / bicycling

two treadmill levels

two bicycling levels

class rate 98.2 % 99.0 % 61.1 %

Page 21: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

Outlook

exercises

21

sensors

[10]

additional

elements

detail level

increasement

number of steps

quality of exercise

execution

[8] [9]

[11]

Page 22: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

Thank you for your attention!

Bavarian Ministry of

Economic Affairs,

Infrastructure, Transport and

Technology

Page 23: Automatic Classification of Sport Exercises for Training ... · Automatic Classification of Sport Exercises for Training Support Dominik Schuldhaus, Heike Leutheuser, Bjoern Eskofier

14.09.2012 | Dominik Schuldhaus | Pattern Recognition Lab (CS 5) | Training Support

References

23

[1] http://images2.fitforfun.de/img/gen/o/p/HBopsypb_Pxgen_r_478x307.jpg

[2] http://www.wellnessonline.com/images/body-composition-e1283287230864.jpg

[3] http://www.craigliebenson.com/wp-content/uploads/2012/08/sports-performance-tag.jpg

[4] http://www.erhard-sport.de/Neuheiten-es/Fitness/U-N-O-FITNESS-Laufband-TR5000.html

?listtype=search&searchparam=tr5000&redirected=1

[5] http://fitnessworld24.net/kraftmaschinen/finnlo-bio-force-3810.php

[6] http://zeitgeistlab.ca/doc/doc_images/wban05.png

[7] http://png-3.findicons.com/files/icons/977/rrze/720/list_all_participants.png

[8] http://www.intersport.at/eshop/Fitness/Fitnessgeraete-Gross/ENERGETICS-Power-Bench

-380-Hantelablage-schwarz-001.html?force_sid=b67cc2d09c2b08a9148d4100de58404f&

[9] http://www.digital-project.info/img/stepcounter/stepcounter256.png

[10] http://www.gizmodo.de/wp-content/uploads/2009/12/adidas-micoach340.jpg

[11] http://webstarts.com/blog/wp-content/uploads/2012/08/quality.gif