Validation of Postural Stability Assessment Using ... · Validation of Postural Stability...

1
Validation of Postural Stability Assessment Using Accelerometer and Gyroscopic Measures Deanna K. Graber 1 , Joshua R. Hirsch 2 , Daniel E. Kana 2 , Susan M. Linder 2 , David D. Schindler 2 , Jay L. Alberts 2,3 1. Cleveland Clinic Sports Health, Cleveland Clinic 2. Department of Biomedical Engineering, Cleveland Clinic 3. Cleveland Clinic Concussion Center, Cleveland Clinic, Cleveland, Ohio 44195 Background Methods and Hardware C3 Logix Test Battery Acknowledgements Supported by the Lincy Foundation and the Bell Family. We thank Patrick Cummings PTA, ATC for initial discussions regarding the clinical utility of this approach and all of the Cleveland Clinic Athletic Trainers and Staff who participated in data collection. Quantification of Balance Error Scoring System: 3-D Volumes vs. Error Count ATC Utilization of C3 Logix Application Based on the 2012 Consensus Statement on Concussion in Sport, neuropsychological testing is a valuable tool in concussion management. However, the presentation of symptoms and rate of recovery can be variable, which reinforces the value of assessing all three areas (symptoms, balance, and cognition) as part of a comprehensive sport concussion program(McCrory et al., 2013). The primary aim of this project was to develop a reliable, portable and cost-effective method of objectively quantifying balance and postural stability. The C3 Logix Application was developed on the Apple iPad™ platform to determine the feasibility of using accelerometer and gyroscope data for the assessment of postural stability. The secondary aim was to determine the feasibility of using the C3 Logix App to support concussion management by ATCs and clinicians within the Cleveland Clinic Health System. Single-Leg Stance Tandem Stance Firm Surface Double-Leg Stance Stances 3D iCoM Foam Surface Errors 0 0.196 0 4.308 0 3.652 Stances 3D iCoM log e (Volume) Errors 0 4.106 7 7.030 2 5.253 log e (Volume) TR ML AP Double-Leg Single-Leg Tandem 0 8 10 *** *** 4 6 2 Double-Leg Single-Leg Tandem 0 8 10 *** 4 6 2 Rater Error Count Normalized 3-D Volume 3-D Postural Stability metric showed significant differences between surfaces during double-leg stance, while BESS Errors show no difference in performance (zero errors recorded across entire test population). Normalized volumes are significantly different between surfaces within each stance (***p<0.001). Floor effect and subjectivity of Error Count removed by 3-D Postural Stability assessment in double-leg stance Validation Conclusions Accelerometer and gyroscope data provided by the iPads native hardware provide a precise and reliable assessment of postural stability relative to the gold standardSOT. The developed measures can be used to objectively quantify postural stability during the performance of a clinical balance test (BESS) specifically designed and validated for concussion assessment. Three-dimensional volume metric may be useful for identifying postural instability, determining need for secondary referral for rehabilitation or intervention, and tracking post-injury recovery. The objectivity of this approach combined with the portability and accessibility of the iPad platform may make this solution ideal for clinical and in-the-field use in the evaluation and monitoring of athletes post-concussion. 56 Cleveland Clinic Certified Athletic Trainers, 46 high schools and colleges 4921 Fall 2012 Baseline Tests (3834 M, 1087 F): Football, Soccer, Volleyball 482 well-characterized concussions: when injury suspected, Incident Report filed and Follow Up Assessments completed until athlete is returned to play Comprehensive visualization of performance on follow-up assessments compared to baseline highlights impairments in specific domains and allows more timely referral to specialists for intervention Baseline Incident Follow-Up RTP Field Utilization Conclusions The C3 Logix App provides ATCs with a portable and quantitative method of assessing balance, dynamic visual acuity, and neurocognitive domains including set switching, information processing, working memory and learning. C3 Logix provides a standardized method of assessing the multifactorial manifestation of concussion across a system with multiple providers of care. We are currently assessing the efficacy of using C3 Logix in return-to-play decision-making and in guiding care in cases of a complicated recovery. Trail Making Test A & B Simple Reaction Time Choice Reaction Time Memory & Processing Speed Static & Dynamic Vision Graded Symptom Checklist Standardized Assessment of Concussion Balance Assessment Validation of Postural Stability Assessment with iPad Forty-nine (22 male, 27 female) healthy subjects between 14-25 years of age (19.5 ± 3.1) completed the Sensory Organization Test (SOT) and the Balance Error Scoring System (BESS) with an Apple iPad affixed at mid-sacral level via a customized belt. Data was collected at a sampling rate of 100 Hz using the iPad’s native gyroscope (±250 degrees per second range and 8.75-millidegree resolution) and 3-axis linear accelerometer (±2.0g range and 0.9-1.1mg resolution). Application code was written in objective C for use across multiple mobile device platforms. iPad sensor data was fit to center-of-gravity (COG) sway output from NeuroCom using a non-linear, mixed effects model comprised of a 5-knot restricted cubic spline and a sine function Graded Symptom Checklist Symptom tracking and management (by domain) SAC Orientation, memory, concentration Simple Reaction Time Information processing and neuromotor control Choice Reaction Time Complex information processing, response inhibition, and neuromotor control Trail Making Test A & B Working memory, visual scanning, cognitive flexibility, set-switching Balance Assessment Objective quantification of postural stability with iPad motion sensors Memory and Processing Speed Complex processing speed, working memory, attention, learning, visuospatial scanning Static & Dynamic Vision Visual acuity and vestibulo-ocular reflex integrity iPad ES (%) Neurocom ES (%) r=.45 r=.62 r=.71 r=.75 r=.70 r=.83 CS 2 4 3 5 6 1

Transcript of Validation of Postural Stability Assessment Using ... · Validation of Postural Stability...

Validation of Postural Stability Assessment Using Accelerometer and Gyroscopic Measures Deanna K. Graber1, Joshua R. Hirsch2, Daniel E. Kana2, Susan M. Linder2, David D. Schindler2, Jay L. Alberts2,3

1.  Cleveland Clinic Sports Health, Cleveland Clinic 2. Department of Biomedical Engineering, Cleveland Clinic

3. Cleveland Clinic Concussion Center, Cleveland Clinic, Cleveland, Ohio 44195

Background

Methods and Hardware

C3 Logix Test Battery

Acknowledgements Supported by the Lincy Foundation and the Bell Family. We thank Patrick Cummings PTA, ATC for initial discussions regarding the clinical utility of this approach and all of the Cleveland Clinic Athletic Trainers and Staff who participated in data collection.

Quantification of Balance Error Scoring System: 3-D Volumes vs. Error Count

ATC Utilization of C3 Logix Application

Ø  Based on the 2012 Consensus Statement on Concussion in Sport, neuropsychological testing is a valuable tool in concussion management. However, “the presentation of symptoms and rate of recovery can be variable, which reinforces the value of assessing all three areas (symptoms, balance, and cognition) as part of a comprehensive sport concussion program” (McCrory et al., 2013).

Ø  The primary aim of this project was to develop a reliable, portable and cost-effective method of objectively quantifying balance and postural stability. The C3 Logix Application was developed on the Apple iPad™ platform to determine the feasibility of using accelerometer and gyroscope data for the assessment of postural stability.

Ø  The secondary aim was to determine the feasibility of using the C3 Logix App to support concussion management by ATCs and clinicians within the Cleveland Clinic Health System.

Single-Leg Stance Tandem Stance

Firm

Sur

face

Double-Leg Stance

Stan

ces

3D iC

oM

Foam

Sur

face

Errors 0 0.196

0 4.308

0 3.652

Stan

ces

3D iC

oM

loge(Volume)

Errors 0 4.106

7 7.030

2 5.253 loge(Volume)

TR ML

AP

Double-Leg Single-Leg Tandem 0

8

10

*** ***

4

6

2

Double-Leg Single-Leg Tandem 0

8

10

***

4

6

2

Rater Error Count Normalized 3-D Volume

Ø  3-D Postural Stability metric showed significant differences between surfaces during double-leg stance, while BESS Errors show no difference in performance (zero errors recorded across entire test population).

Ø  Normalized volumes are significantly different between surfaces within each stance (***p<0.001).

Ø  Floor effect and subjectivity of Error Count removed by 3-D Postural Stability assessment in double-leg stance

Validation Conclusions Ø  Accelerometer and gyroscope data provided by the iPad’s native hardware provide a precise and reliable assessment of

postural stability relative to the “gold standard” SOT. Ø  The developed measures can be used to objectively quantify postural stability during the performance of a clinical balance

test (BESS) specifically designed and validated for concussion assessment. Ø  Three-dimensional volume metric may be useful for identifying postural instability, determining need for secondary referral

for rehabilitation or intervention, and tracking post-injury recovery. Ø  The objectivity of this approach combined with the portability and accessibility of the iPad platform may make this solution

ideal for clinical and in-the-field use in the evaluation and monitoring of athletes post-concussion.

Ø 56 Cleveland Clinic Certified Athletic Trainers, 46 high schools and colleges Ø 4921 Fall 2012 Baseline Tests (3834 M, 1087 F): Football, Soccer, Volleyball Ø 482 well-characterized concussions: when injury suspected, Incident Report

filed and Follow Up Assessments completed until athlete is returned to play Ø Comprehensive visualization of performance on follow-up assessments

compared to baseline highlights impairments in specific domains and allows more timely referral to specialists for intervention

Baseline

Incident Follow-Up RTP

Field Utilization Conclusions Ø  The C3 Logix App provides ATCs with a portable and quantitative method of assessing

balance, dynamic visual acuity, and neurocognitive domains including set switching, information processing, working memory and learning.

Ø  C3 Logix provides a standardized method of assessing the multifactorial manifestation of concussion across a system with multiple providers of care.

Ø  We are currently assessing the efficacy of using C3 Logix in return-to-play decision-making and in guiding care in cases of a complicated recovery.

Trail Making Test A & B

Simple Reaction Time Choice Reaction Time

Memory & Processing Speed Static & Dynamic Vision

Graded Symptom Checklist Standardized Assessment

of Concussion

Balance Assessment

Validation of Postural Stability Assessment with iPad

Ø  Forty-nine (22 male, 27 female) healthy subjects between 14-25 years of age (19.5 ± 3.1) completed the Sensory Organization Test (SOT) and the Balance Error Scoring System (BESS) with an Apple iPad affixed at mid-sacral level via a customized belt.

Ø  Data was collected at a sampling rate of 100 Hz using the iPad’s native gyroscope (±250 degrees per second range and 8.75-millidegree resolution) and 3-axis linear accelerometer (±2.0g range and 0.9-1.1mg resolution).

Ø  Application code was written in objective C for use across multiple mobile device platforms.

Ø  iPad sensor data was fit to center-of-gravity (COG) sway output from NeuroCom using a non-linear, mixed effects model comprised of a 5-knot restricted cubic spline and a sine function

Graded Symptom Checklist Ø  Symptom tracking and

management (by domain) SAC Ø Orientation, memory, concentration

Simple Reaction Time Ø  Information processing and

neuromotor control Choice Reaction Time Ø Complex information processing,

response inhibition, and neuromotor control

Trail Making Test A & B Ø Working memory, visual scanning,

cognitive flexibility, set-switching Balance Assessment Ø Objective quantification of postural

stability with iPad motion sensors

Memory and Processing Speed Ø Complex processing speed,

working memory, attention, learning, visuospatial scanning

Static & Dynamic Vision Ø  Visual acuity and vestibulo-ocular

reflex integrity

iPad

ES

(%)

Neurocom ES (%)

r=.45 r=.62

r=.71 r=.75

r=.70 r=.83

CS 2 4 3 5 6 1