Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to...
Transcript of Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to...
![Page 1: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/1.jpg)
Data Mining for
Translation to Practice
Chih-Lin Chi, Ph.D., M.B.A.
Assistant Professor, School of Nursing
Core Faculty, Institute for Health Informatics
University of Minnesota
Second International Conference on Research
Methods for Standard Terminologies
April 15, 2015
![Page 2: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/2.jpg)
DISCLOSURES There are no conflicts of interest or relevant financial
interests that have been disclosed by this presenter or the
rest of the planners and presenters of this activity that
apply to this learning session.
![Page 3: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/3.jpg)
Steps for Translating from Big Data to Practical Use
1. Computational A. Develop research question and data-mining approaches
B. Demonstrate preliminary results of these approaches for a single Problem
C. Standardize the process and develop data-mining pipeline for other Problems
D. Validate with world-wide structured nursing data
E. Simulated clinical trail using client randomization
2. Practical A. Test on home-visiting care scenarios
B. Integrate with current workflow and develop software and guidelines to facilitate the use in
practical settings (e.g., identify patients, identify personalized interventions)
C. Implementation
![Page 4: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/4.jpg)
http://www.ihi.org/Engage/Initiatives/TripleAim/pages/default.aspx
![Page 5: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/5.jpg)
Predict need for intervention
Think about a difficult problem in a population.
Regardless of outcome, who will need more
interventions?
![Page 6: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/6.jpg)
Predict responsiveness to interventions
Within the population, which individuals will be
responsive to more interventions for this problem,
compared to those who are less responsive?
![Page 7: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/7.jpg)
Predict type of intervention that will be efficient
and effective for an individual
Understand different intervention patterns in order to
personalize care planning based on an individual’s
characteristics
![Page 8: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/8.jpg)
Benefits of Standardized Terminologies
in Data Mining
Big Data + Data Mining = Progress to Triple Aim
Why use a Standardized Terminology for Big Data? – Pre-classification of clinical knowledge
– Outcome metrics
– Relational database structure
![Page 9: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/9.jpg)
Benefit: Pre-classification of Clinical Knowledge
Problem representation
Domains
Problems
Signs/symptoms
Intervention representation
Categories
Outcomes Knowledge
Behavior
Status
![Page 10: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/10.jpg)
Benefit 2: Outcome Metrics
Explicit outcome measurement for all problems
Not looking for surrogate or proxy measures
E.g. claims data, laboratory results
Less chance of missing values
![Page 11: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/11.jpg)
Benefit 3: Relational database structure
All data relate to a central concept (Problem)
Improves clinical and theoretical management of
information
![Page 12: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/12.jpg)
Data Mining for Translation to Practice:
Oral health
1. Computational A. Develop research question and data-mining approaches
B. Demonstrate preliminary results of these approaches for a single Problem
C. Standardize the process and develop data-mining pipeline for other Problems
D. Validate with world-wide structured nursing data
E. Simulated clinical trail using client randomization
2. Practical A. Test on home-visiting care scenarios
B. Integrate with current workflow and develop software and guidelines to facilitate the use in
practical settings (e.g., identify patients, identify personalized interventions)
C. Implementation
![Page 13: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/13.jpg)
Our Translational Project Starting from Data-
Mining Approaches: Oral health problem
The health of the mouth and surrounding craniofacial
(skull and face) structures is central to a person’s
overall health and well-being.
Social determinants affect oral health. In general,
people with lower levels of education and income,
and people from specific racial/ethnic groups, have
higher rates of disease.
People with disabilities and other health conditions,
like diabetes, are more likely to have poor oral
health.
https://www.healthypeople.gov/2020/topics-objectives/topic/oral-health
![Page 14: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/14.jpg)
Data Set
Clients (N=1,618 or subset)
Characteristics (demographic and signs/symptoms)
Interventions (113,989 or subset)
Teaching, Guidance, and Counseling
Treatments and Procedures
Case Management
Surveillance
Outcomes
Knowledge
Behavior
Status
![Page 15: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/15.jpg)
Steps for Translating from Big Data to Practical Use
1. Computational A. Develop research question and data-mining approaches
B. Demonstrate preliminary results of these approaches for a single Problem
C. Standardize the process and develop data-mining pipeline for other Problems
D. Validate with world-wide structured nursing data
E. Simulated clinical trail using client randomization
2. Practical A. Test on home-visiting care scenarios
B. Integrate with current workflow and develop software and guidelines to facilitate the use in
practical settings (e.g., identify patients, identify personalized interventions)
C. Implementation
![Page 16: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/16.jpg)
Our research question as an example: A small
percentage of clients consume a high percentage of
service resources (80-20 rule in Oral health problem)
20% patients use 70%
of intervention resource
![Page 17: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/17.jpg)
Data Mining (Visualization) Method Used to Show
Intervention Usage
Excel
Sort and rank clients based on percentage of
interventions received for the episode of care
Create line graph of cumulative percentage of
interventions for the entire sample
![Page 18: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/18.jpg)
Steps for Translating from Big Data to Practical Use
1. Computational A. Develop research question and data-mining approaches
B. Demonstrate preliminary results of these approaches for a single Problem
C. Standardize the process and develop data-mining pipeline for other Problems
D. Validate with world-wide structured nursing data
E. Simulated clinical trail using client randomization
2. Practical A. Test on home-visiting care scenarios
B. Integrate with current workflow and develop software and guidelines to facilitate the use in
practical settings (e.g., identify patients, identify personalized interventions)
C. Implementation
![Page 19: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/19.jpg)
Detail Research Question 1 of 3: Predict
Intervention Usage
Regardless of outcome, who will need more interventions?
For 75% threshold
Maximal accuracy ~ 74%
Maximal AUC ~ 77%
Prediction measured using receiver operating curves and area under the curve (AUC).
For 50% threshold
Maximal accuracy ~ 60%
Maximal AUC ~ 75%
![Page 20: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/20.jpg)
Data Mining Method Used to Predict Intervention
Usage
Support vector machines in Matlab software
Input: Client characteristics (demographics and
signs/symptoms from first encounter)
Output: Interventions across all clients (compared to
50th and 75th percentiles)
![Page 21: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/21.jpg)
Detail Research Question 2 of 3: Predict
Personalized Responsiveness to Interventions
Within the population, which individuals will be
responsive to more interventions for this problem,
compared to those who are less responsive?
More responsive Less responsive
![Page 22: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/22.jpg)
Data Mining Method Used to Predict Personalized
Responsiveness to Interventions
Support vector machines in Matlab software
with sensitivity analysis
Input: Client characteristics (demographics and
signs/symptoms from first encounter), interventions,
and any KBS improvement from admission to
discharge
Output: Responsive score based on personal
characteristics
![Page 23: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/23.jpg)
Detail Research Question 3 of 3: Predict
Personalized Nursing Intervention
How to personalize care planning based on an
individual’s characteristics and what intervention
patterns can be used to help personalization?
Intervention patterns typically used in Oral health Teaching,
guidance, and
counseling
Treatments and
procedures
Case
management Surveillance
Number of
clients
A 0.00% 0.00% 0.00% 100.00% 24
B 0.00% 10.00% 0.00% 90.00% 2
C 0.00% 20.00% 0.00% 80.00% 285
D 30.00% 0.00% 30.00% 40.00% 1
E 30.00% 10.00% 10.00% 50.00% 1
F 40.00% 0.00% 10.00% 50.00% 210
G 50.00% 0.00% 10.00% 40.00% 234
H 60.00% 0.00% 10.00% 30.00% 1
![Page 24: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/24.jpg)
Data Mining Method Used to Summarize
Intervention Patterns
Simple cluster analysis in Excel using round-up or
round-down technique
Proportion of interventions by category observed in the
data
![Page 25: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/25.jpg)
Relative Improvement of Predicted Personalized
Nursing Intervention
Relative improvement is 51% (compared to
maximum possible improvement for all clients)
Choosing the right pattern can improve care
(efficiency and effectiveness)
51%
![Page 26: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/26.jpg)
PHNs Personalize Well
Maximum possible improvement : 1.18% (the
largest possible improvement space) Standard
deviation: 0.64%
![Page 27: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/27.jpg)
Comparison Baseline: Random Assignment of
Interventions
Random baseline improvement: -0.03% (randomly
choose 1 of the 8 patterns for each patient)
Showing importance of personalized interventions
![Page 28: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/28.jpg)
Data Mining Method Used to Predict Personalized
Nursing Intervention
Support vector machines in Matlab software
with optimization
Input: Client characteristics (demographics and
signs/symptoms from first encounter) and
intervention patterns for each client
Output: Any KBS improvement from admission to
discharge
![Page 29: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/29.jpg)
Steps for Translating from Big Data to Practical Use
1. Computational A. Develop research question and data-mining approaches
B. Demonstrate preliminary results of these approaches for a single Problem
C. Standardize the process and develop data-mining pipeline for other Problems
D. Validate with world-wide structured nursing data
E. Simulated clinical trail using client randomization
2. Practical A. Test on home-visiting care scenarios
B. Integrate with current workflow and develop software and guidelines to facilitate the use in
practical settings (e.g., identify patients, identify personalized interventions)
C. Implementation
![Page 30: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/30.jpg)
Building Evidence (your study here)
Problems
Data
Source
Oral health
Problem
Caretaking
/parenting
Growth and
development
Pregnancy Other
Problems
Dakota
County, MN Personalized
intervention
evidence
To be done To be done To be done To be done
Other
County, MN To be done To be done To be done To be done To be done
Other
County,
Other State
To be done To be done To be done To be done To be done
Other
Country To be done To be done To be done To be done To be done
Evidence matrix
Goal: Standardize the data-mining process and develop a pipeline to
automate and document evidence
![Page 31: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/31.jpg)
More Data = More Confidence in Findings and
More External Generalizability
Data Mining Methods can increase confidence when
using observational data
Personalized method helps us understand and
validate predictions (remember netflix)
![Page 32: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/32.jpg)
Typical Data Mining Validation Process: Compare
Predictive with True Outcomes
Patient
Data 1
Patient
Data 2
Prediction
model
Training
Independent Variable
Dependent Variable
(outcome)
Independent Variable Dependent Variable
(Outcome)
Validation (compare
predicted to true outcomes)
Predictive performance: e.g.,
AUC, accuracy, confusion
matrix, F-measure, …etc
More complicated method to further reduce variation, such
as (multiple) 10-fold cross validation, leave one out, etc
![Page 33: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/33.jpg)
Steps for Translating from Big Data to Practical Use
1. Computational A. Develop research question and data-mining approaches
B. Demonstrate preliminary results of these approaches for a single Problem
C. Standardize the process and develop data-mining pipeline for other Problems
D. Validate with world-wide structured nursing data
E. Simulated clinical trail using client randomization
2. Practical A. Test on home-visiting care scenarios
B. Integrate with current workflow and develop software and guidelines to facilitate the use in
practical settings (e.g., identify patients, identify personalized interventions)
C. Implementation
![Page 34: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/34.jpg)
Using clinical trial simulations to provide baseline
information to learn efficacy improvement
Arm 1: Non-
personalized
approach
Arm 2:
Personalized
approach
Predicted
outcome for
personalized
approach
Predicted
outcome for non-
personalized
approach Predict
outcome
Compare
efficacy
improvement
![Page 35: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/35.jpg)
Steps for Translating from Big Data to Practical Use
1. Computational A. Develop research question and data-mining approaches
B. Demonstrate preliminary results of these approaches for a single Problem
C. Standardize the process and develop data-mining pipeline for other Problems
D. Validate with world-wide structured nursing data
E. Simulated clinical trail using client randomization
2. Practical A. Test on home-visiting care scenarios
B. Integrate with current workflow and develop software and guidelines to facilitate the use in
practical settings (e.g., identify patients, identify personalized interventions)
C. Implementation
![Page 36: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/36.jpg)
Your Study Here (80-20 rule)
![Page 37: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/37.jpg)
Summary
Take home message for data mining techniques
and the use for translational research – Triple Aim
– Standardized Terminology
– Methods for Translation
• Data mining to practical implementation
– Oral health example
• Small percentage of clients receive most interventions
• Personalization of care
– Collaboration
![Page 38: Data Mining for Translation to Practice - School of Nursing · Data Mining for Translation to Practice: Oral health 1. Computational A. Develop research question and data-mining approaches](https://reader033.fdocuments.us/reader033/viewer/2022042104/5e82062383bb29715368de9e/html5/thumbnails/38.jpg)
References
Martin KS. The Omaha System: A key to practice,
documentation, and information management
(Reprinted 2nd ed.). Omaha, NE: Health
Connections Press; 2005.
Duda RO, Hart PE, Stork DG. Pattern classification.
second ed. NY: John Wiley and Sons, Inc.; 2001