Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science...

53
Advances of Neural Networks in Advances of Neural Networks in Sports Science Sports Science Aviroop Dutt Mazumder Aviroop Dutt Mazumder 13 13 th th Aug, 2010 Aug, 2010 COSC COSC - 460 460

Transcript of Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science...

Page 1: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Advances of Neural Networks inAdvances of Neural Networks inSports ScienceSports Science

Aviroop Dutt MazumderAviroop Dutt Mazumder1313thth Aug, 2010Aug, 2010COSC COSC -- 460460

Page 2: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Outline

Sports Science

Artificial Neural Network

Importance of ANN

Application of ANN is Sports Science

• Modeling a swimming performance• Modeling a swimming performance

• Movement variability analysis by SOMs

• Dynamical System analysis

Future Research

Conclusion

Page 3: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Application of scientific principles and techniques with the aim of improving sporting performance.

Sports Science

Page 4: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Neural Network - Information processing paradigm inspired by biological nervous systems, such as our brain.

Structure - Large number of highly interconnected processing elements.

Neurons – Working together.

Artificial Neural Networks

Neurons – Working together.

Page 5: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Importance of ANN in Sports Science

• Qualitative analysis

• Pick out the structure from existing data.

• Non-linear analysis

• Study the behaviour of an evolving dynamical system

Page 6: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Application of ANN in sports science

• Data Analysis (Pattern recognition or data classification through a learning process)

• Model a performance

• Predict performance (learning from past experience)• Predict performance (learning from past experience)

• Identify talent

• Human movement variability

• Dynamical sports scene

• Decision making

Page 7: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Inspiration from Cybernetics - Ştefan Odobleja (1902–1978)

Earlier research models - Fourier analysis,

Coherent State analysis.

Parameters - Kin anthropometric evaluation

Functional evaluation

Modeling a swimming performance

Functional evaluation

Specific functional evaluation

Semi-qualitative swimming technical evaluation

80% of data was used for training and 20% for validating

Silva, A., et al. (2007). The use of neural network technology to model swimming performance. Journal of Sports Science and Medicine, 6, 117-125

Page 8: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Model – Multiple layer perceptron with a single hidden layer.

Modeling a swimming performance

Silva, A., et al. (2007). The use of neural network technology to model swimming performance. Journal of Sports Science and Medicine, 6, 117-125

Page 9: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Non linear function was optimized using Lavenberg-Maarquardt to minimize mean square error

Modeling a swimming performance

Weight Initialization – Decline method (Nguyen and Widrow, 1990)

Pattern Error -

Silva, A., et al. (2007). The use of neural network technology to model swimming performance. Journal of Sports Science and Medicine, 6, 117-125

Page 10: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

• Male Swimmers

• height correlated positively with the performance.

• composition variables were correlated with performance.

• Female swimmers

• the performance was correlated with chest depth, foot

Results

• the performance was correlated with chest depth, foot length, & height.

• correlation between the lactate accumulation and performance

• General

• Strength and performance was not much of significance.

• Some correlations between performance and flexibility.

Silva, A., et al. (2007). The use of neural network technology to model swimming performance. Journal of Sports Science and Medicine, 6, 117-125

Page 11: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

• Deviations from predicted and actual result

• 4.64 seconds after 6 months

• 3.16 seconds after 18 months

Results

• 3.16 seconds after 18 months

• 3.03 seconds after 30 months

Silva, A., et al. (2007). The use of neural network technology to model swimming performance. Journal of Sports Science and Medicine, 6, 117-125

Page 12: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

SOMs as a tool to measure movement variability

• Unsupervised learning – no target output

• Self-organization - Network organises based on the emergent collective properties of the input.

• Dimensionality reduction - Identify important features in the data by removing redundancy.

Lamb, P.F. (2010). The use of self-organizing maps in analyzing multi-dimensional human movement coordination. PhD Thesis. University of Otago, New Zealand.

Page 13: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

SOMs as a tool to measure movement variability

Time shifted at constant interval to represent the temporal nature of the data pattern

Page 14: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 15: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 16: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 17: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 18: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 19: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 20: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 21: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing mapsSelf-organizing maps

Page 22: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 23: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 24: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 25: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 26: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 27: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 28: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 29: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 30: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 31: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Self-organizing maps

Page 32: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Neighbourhood Function

Page 33: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Neighbourhood Function

Page 34: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Neighbourhood Function

Page 35: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Neighbourhood Function

Page 36: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Neighbourhood Function

Page 37: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Neighbourhood Function

Page 38: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Clear cells represent nodes in the output layer

U-matrix

Page 39: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Coloured Cell represent the distances between the neighbouring nodes in the output layer

U-matrix

Page 40: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Blue cells represent short distances, while the red cells represent much larger distance.

U-matrix

Page 41: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Phase of the movement can be identified on the U-Matrix

U-matrix

Page 42: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Shooting Phase

Page 43: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Shooting Phase

Page 44: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Shooting Phase

Page 45: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Shooting Phase

Page 46: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

• Advantages of 3-D analysis

1. Depict the complete spatial motion of the players.

2. The trajectories of attacker – defender dyad or

attacker-ball-defender triad can be visualized from above.

Dynamical Systems analysis

attacker-ball-defender triad can be visualized from above.

3. Reconstruction of performance through simulation.

Page 47: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

• Advantages ANN to make 3-D analysis

1. MLP allows non-linear analysis.

2. Erroneous intrinsic & extrinsic camera parameters unaccounted.

3. VGA camera can be used instead of HD.

Dynamical Systems analysis

3. VGA camera can be used instead of HD.

4. Camera orientation and position is not much of significance.

Page 48: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

3-D reconstruction of stereo-vision using neural networks

Dynamical Systems analysis

Passos, et al. (2006). Interpersonal dynamics in sport: The role of artificial neural networks and 3-D analysis. Behaviour Research Methods, 38(4), 683-691.

Page 49: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Dynamical Systems analysis

Feed-forward neural net topology is to produce a non-linear mapping between the input and output neurons

Passos, et al. (2006). Interpersonal dynamics in sport: The role of artificial neural networks and 3-D analysis. Behaviour Research Methods, 38(4), 683-691.

Page 50: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Dynamical Systems analysis

Reconstruction of the trajectories in a 3-D space

Page 51: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

• Study the dyadic system between an attacker and a

defender.

Future Research

• Synergetic of a triad or small group.

• Study the chaotic attractors in a team sport.

• Analyze the perturbation changes.

• Other models like – Neural Gas & DyCoN

Page 52: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

Thus ANN is an important tool for analyzing human movement individually and as a team.

Conclusion

Better tracking system and efficient lifelong learning models will make better qualitative analysis.

Page 53: Advances of Neural Networks in Sports Science · Advances of Neural Networks in Sports Science Aviroop Dutt Mazumder 13th Aug, 2010 COSC COSC -- 460 460. Outline Sports Science Artificial

University of Otago – PHSE 427 Presentation18th May, 2010