USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A...

15
USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Cant a,b , Stephanie Kovalchik a,b , Rod Cross c and Machar Reid b a Institute for Health and Sport, Victoria University, Melbourne, Victoria, Australia ; b Game Insight Group, Tennis Australia, Melbourne, Victoria, Australia; c School of Physics, University of Sydney, Sydney, New South Wales, Australia

Transcript of USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A...

Page 1: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

USING A MULTI-CAMERA TRACKING SYSTEM TO

ESTIMATE BALL SPIN IN TENNIS

Olivia Canta,b, Stephanie Kovalchika,b, Rod Crossc and Machar Reidb

aInstitute for Health and Sport, Victoria University, Melbourne, Victoria, Australia;

bGame Insight Group, Tennis Australia, Melbourne, Victoria, Australia;cSchool of Physics, University of Sydney, Sydney, New South Wales, Australia

Page 2: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

OVERVIEW

Ball spin in tennis

Minimise errors

Limit aggressive hitting

↑ probability of winning a pointMecheri et al. 2016

Page 3: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

OVERVIEW

Ball spin measurement

Image 1

Image 2 Image 3

Kelley 2011

Page 4: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

1) Determine the accuracy of the current Hawk-Eye ball spin measure for both spin rate

and direction (i.e., topspin, backspin)

2) Assess if an alternate measure could provide a more accurate estimate of ball spin rate

and direction.

STUDY AIMS

Page 5: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

EXPERIMENTAL SETUP

Ball

Machine

Lig

hts

HS

Birds-eye view

Ball mark up

Page 6: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

−4500 −3500 −2500 −1500 −500 500 1500 2500 3500 4500vision spin

Topspin + Backspin: Ball Spin (RPM) by condition

Spin directionMinimum spin

rate

Maximum spin

rate

Backspin -62 -4,392

Topspin 442 3,400

DATA COLLECTION

Backspin

Topspin

Spin rate (RPM)

Page 7: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

DATA PROCESSING

Spin direction Number of valid trials

Topspin 70

Backspin 62

132

Page 8: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

DATA PROCESSING

Hawk-Eye ball spin validation

• Hawk-Eye ball spin value and direction for each trial matched with digitised ball spin value

Ball trajectory model

𝐹𝐷

𝐹𝐺

𝐹𝐿

𝑉𝑒𝑙𝑜𝑐𝑖𝑡𝑦

=1

2𝐶𝐿𝜌𝐴𝑣

2

=1

2𝐶𝐷𝜌𝐴𝑣

2

1 ൗ𝑑𝑣𝑥𝑑𝑡 = −𝑘𝑣(𝐶𝐷𝑣𝑥 + 𝐶𝐿𝑣𝑧)

2 ൗ𝑑𝑣𝑧𝑑𝑡 = 𝑘𝑣 𝐶𝐿𝑣𝑥 + 𝐶𝐷𝑣𝑧 − 𝑔

𝑘 =1

2𝜌𝜋𝑅2/𝑚

Figure 1: forces acting on a ball

Equations describing a balls motion in 2D:

Where,

𝑅 = 𝑏𝑎𝑙𝑙 𝑟𝑎𝑑𝑖𝑢𝑠 = 66 𝑚𝑚

𝑚 = 𝑏𝑎𝑙𝑙 𝑚𝑎𝑠𝑠 = 58 𝑔𝑟𝑎𝑚𝑠

𝜌 = 𝑎𝑖𝑟 𝑑𝑒𝑛𝑠𝑖𝑡𝑦 = 1.21 𝑘𝑔/𝑚3

(Choppin et al. 2018, Cross and Lindsey 2014)

Page 9: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

DATA PROCESSING

Ball trajectory model

𝞱

HeightVx

Launch parameters:

• Height

• Location

• Angle

• Velocity

Forces:

• CL

• CD

Other:

• Ball mass

• Ball radius

• Air density

Vz

Page 10: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

DATA PROCESSING

Ball trajectory model: Best fit CD and CL (Cross and Lindsey 2014)

CD and CL that minimise difference in:

Vx

Vz

Ball height

Point 2

Launch

CD

CL−0.3

−0.2

−0.1

0.0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

−0.7 −0.6 −0.5 −0.4 −0.3 −0.2 −0.1 0.0 0.1 0.2 0.3 0.4 0.5 0.6

Sp = R*w/V

CL

an

d C

D

Spin Direction

topspin

backspin

Best fit CD and CL at 6.40m, Sp at ball launch

Page 11: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

DATA PROCESSING

Ball trajectory model: spin estimation

Launch parameters:

• Height

• Location

• Angle

• Speed

Landing parameters:

• Height

• Angle

• Vx

• Vz

Error:

• Height

• Height + angle

• Height + velocity

• Height + angle + velocity

Optimised values:

• CD

• Spin? →

Optimisers:

• Nelder-Mead (optim package)

• L-BFGS-B (optim package)

• Nmkb (dfoptim package)

Page 12: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

DATA ANALYSIS

1) Hawk-Eye ball spin validation: Hawk-Eye spin estimate compared to true spin (high-speed vision)

2) Ball trajectory model validation: Ball trajectory model estimates compared to true spin (high-speed vision)

Analysis:

• Paired t-test • RMSE • Cohen’s d • Bland-Altman

Page 13: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

RESULTSHawk-Eye current measure Ball trajectory model

Bias + SD RMSESpin direction

correctly classified

Hawk-Eye -100.01 ± 542.44* 549.56 98%

Bias + SD RMSESpin direction

correctly classified

Ball trajectory method 2.92 ± 222.76 221.93 100%

−2500

−2000

−1500

−1000

−500

0

500

1000

1500

0 1000 2000 3000 4000

Average spin of methods

Diffe

ren

ce

be

twe

en m

eth

od

s

Spin Direction

topspin

backspin

−2500

−2000

−1500

−1000

−500

0

500

1000

1500

0 1000 2000 3000 4000

Average spin of methods

Diffe

ren

ce

be

twe

en m

eth

od

s

Spin Direction

topspin

backspin

Page 14: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

RESULTS + IMPLICATIONS

• Ball trajectory model outperformed the current measure used by Hawk-Eye

• Practical method to implement during matches

• Allows for large scale collection of spin rates

Page 15: USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE …jbn/conferences/MathSport... · USING A MULTI-CAMERA TRACKING SYSTEM TO ESTIMATE BALL SPIN IN TENNIS Olivia Canta,b,Stephanie Kovalchika,b,Rod

USING A MULTI-CAMERA TRACKING SYSTEM TO

ESTIMATE BALL SPIN IN TENNIS

Olivia Canta,b, Stephanie Kovalchika,b, Rod Crossc and Machar Reidb

aInstitute for Health and Sport, Victoria University, Melbourne, Victoria, Australia;

bGame Insight Group, Tennis Australia, Melbourne, Victoria, Australia;cSchool of Physics, University of Sydney, Sydney, New South Wales, Australia

[email protected]