A personalized body motion sensitive training system based on auditive feedback
-
Upload
coby-bolton -
Category
Documents
-
view
34 -
download
0
description
Transcript of A personalized body motion sensitive training system based on auditive feedback
![Page 1: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/1.jpg)
Hoelzl Gerold
![Page 2: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/2.jpg)
Overview
Motivation System design Summary Future work
20.04.23 2Hoelzl Gerold
![Page 3: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/3.jpg)
Motivation
20.04.23 3Hoelzl Gerold
![Page 4: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/4.jpg)
Motivation
During training (jogging) it is fun to listening to music problem:
rhythm of the music ≠ rhythm of the runner
20.04.23 4
music rhythm (bpm) running rhythm
≠
Hoelzl Gerold
![Page 5: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/5.jpg)
Motivation
Idea adaptive selection of music according to the
running respectively the walking pace
additionally playing auditive status information like
heart rate speed, distance warnings if predefined limits are exceeded …
20.04.23 5Hoelzl Gerold
![Page 6: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/6.jpg)
System design
20.04.23 6Hoelzl Gerold
![Page 7: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/7.jpg)
System design
3 tasks movement analysis audio analysis mapping: movement<-> music
20.04.23 7Hoelzl Gerold
![Page 8: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/8.jpg)
System design Movement analysis
20.04.23 8
[Scholich M., 1978, S.93]
acceleration maximum during heel- and toe ground contact g > 1,75 m/s²
recognition of a footstep: phase 7: „front support phase“phase 8,9: „rear support phase“
phase 7, 8 ,9 : „support phase“
[Larch R., 2001, S.3]
Hoelzl Gerold
![Page 9: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/9.jpg)
System design Movement
acceleration values
extracted footsteps
distance calculation ->d(i)[ms]
20.04.23 9
d(0)d(1)
d(2)d(3) d(4)
1
0
])[(1 n
i
msidn
mftFeature for classifying running rhythm defined as mean footsteptime (mft)
Hoelzl Gerold
![Page 10: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/10.jpg)
System design
Audio analysis audio feature
beats per minute (bpm) (beat-tracking) recognized as a binary regular pulse
underlaying the music
separate calculation too computational intensive on mobile
devices stored as metadata
20.04.23 10Hoelzl Gerold
![Page 11: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/11.jpg)
System design
Mapping
O[bpm] = F(M,f[mft]) mapping function
M = {m1,…,mn} set of music piecesf[mft] feature
O[bpm] M set of fitting music pieces
20.04.23 11
O = F(M,f)mft [ms]
feature f output O
music pieces [bpm]
Hoelzl Gerold
![Page 12: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/12.jpg)
System design - Hardware
20.04.23 12Hoelzl Gerold
![Page 13: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/13.jpg)
System design
20.04.23 13Hoelzl Gerold
![Page 14: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/14.jpg)
System design
Hardware sensors
acceleration-sensor (movement analysis) ECG-sensor (biofeedback) GPS-sensor (speed, route, tracking)
communication technology Bluetooth
controller mobile phone (JavaME)
20.04.23 14Hoelzl Gerold
![Page 15: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/15.jpg)
System design Hardware (prototype)
acceleration-sensorSparkfun WiTilt v33-axis acceleration sensor with integrated Bluetooth capabilities
ECG-sensorPolar Heart Rate Monitor Interface +AMB2300-EV-Bluetooth-Board
GPS-sensor (integrated in mobile phone)
20.04.23 15Hoelzl Gerold
![Page 16: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/16.jpg)
System design - Software
20.04.23 16Hoelzl Gerold
![Page 17: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/17.jpg)
System design Software design
20.04.23 17
Sensor-Controller
ECGSensor
Acceleration
Sensor
GPSSensor
Controller-
View
Audioplayer
Feature-calculation
Mappingmft<->bpm
Actors(pulse,
speed,..)
Hoelzl Gerold
![Page 18: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/18.jpg)
System design
Software JavaME
API´s JSR 82: Bluetooth JSR 179: Location (GPS) JSR 135: Media (Audio, Video)
SonyEricsson JP8 current JavaME platform implementation
20.04.23 18Hoelzl Gerold
![Page 19: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/19.jpg)
Summary & Future work
20.04.23 19Hoelzl Gerold
![Page 20: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/20.jpg)
Summary
adaptive selection of music according to the running- respectively the walking pace
additionally playing auditive status information like
heart rate speed, distance warning if predefined limits are exceeded …
20.04.23 20Hoelzl Gerold
![Page 21: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/21.jpg)
Summary
Experimental results prototype showed high accuracy and
stability in both laboratory and naturalistic environments
short response time giving realtime “feeling”(~50ms)
Unexpected: crash of Bluetooth connections when built
in GPS sensor was used
20.04.23 21Hoelzl Gerold
![Page 22: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/22.jpg)
Summary
mapping function difficult to define one function for many
users music rhythm / speed is perceived very
subjective learning „on the fly“
20.04.23 22Hoelzl Gerold
![Page 23: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/23.jpg)
Summary
integrated sensors usage possible (less components) but restriction of device usage likely
(e.g. fixed position of acceleration sensor for movement analysis)
20.04.23 23Hoelzl Gerold
![Page 24: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/24.jpg)
Future work
support training programs in adaptively selecting forcing / retaining music pushing music if beneath a defined limit assuasive music if above a defined limit
20.04.23 24Hoelzl Gerold
![Page 25: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/25.jpg)
Future work
tracking with status information (using remote computer)
„control sportsman“ competitions (without borders)
20.04.23 25Hoelzl Gerold
![Page 26: A personalized body motion sensitive training system based on auditive feedback](https://reader036.fdocuments.us/reader036/viewer/2022062517/568135fc550346895d9d6f0c/html5/thumbnails/26.jpg)
Questions?
20.04.23 26Hoelzl Gerold