Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms...
Transcript of Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms...
![Page 1: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/1.jpg)
Biostatistics in Biomedical and Clinical Research
Sandra Taylor, Ph.D. Clinical and Translational Science Center
University of California, Davis 30 April 2013
![Page 2: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/2.jpg)
Do I really need a statistician?
“My study is really simple.”
“I don’t have funding to support a statistician.”
“I don’t know any statisticians.”
“A statistician will make my study more complicated or turn it into a statistics research project.”
![Page 3: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/3.jpg)
Goals and objectives
Understand the role of statisticians in biomedical research and clinical trials – What we can do for you
– When we should be involved
– Why it’s important
Provide pointers for working with statisticians
Understand what resources are available and how to access those resources
![Page 4: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/4.jpg)
Where are statisticians involved in research projects/clinical trials?
![Page 5: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/5.jpg)
Where are statisticians involved in research projects/clinical trials?
![Page 6: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/6.jpg)
Why and when to work with a statistician?
Planning the study – Study design, randomization, sample size – Proposal preparation
Conducting the study – Interim analyses, DSMB
Evaluating the results – Conducting statistical analyses
Reporting the results – Interpreting the results – Manuscript preparation
![Page 7: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/7.jpg)
The Research Process
![Page 8: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/8.jpg)
“Gee, I wonder if…”
![Page 9: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/9.jpg)
Planning Stage Involvement
![Page 10: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/10.jpg)
Planning Stage Involvement
Statistics can’t fix a poorly designed study!
![Page 11: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/11.jpg)
Planning Stage Activities Not just sample size calculations
• Develop specific aims • Identify endpoints and formulate
testable hypotheses • Identify confounding factors, biases • Develop study design, randomization
scheme, matching protocol • Conduct sample size calculations and
prepare statistical analysis plan
![Page 12: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/12.jpg)
Formulating specific aims
Identify parameters of interest Specify testable hypotheses
– Determines statistical methods Specific aims determine
– Study design – Sample size calculations
Identify fatal flaws
![Page 13: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/13.jpg)
Specific Aim 1: Determine if new treatment is better than standard care.
What constitutes better? What measureable parameter reflects
better? – Survival, number of events, mean value?
What testable hypothesis addresses the specific aim? – H0: Mean cholesterol under new treatment
does not differ from standard care – Ha: Mean cholesterol under new treatment
differs from standard care
![Page 14: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/14.jpg)
Study type and design considerations
Prospective Study – Randomization – Stratification – Matching – Interim analyses, adaptive or sequential
designs Retrospective Study
– Confounding variables – Site effects and biases in data often
overlooked
![Page 15: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/15.jpg)
How many subjects do I need?
Too few – insufficient power to detect differences
Too many – unnecessary costs Statisticians need input from
researchers to determine sample size requirements.
![Page 16: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/16.jpg)
Sample size determination comes at the end of a series of steps.
Specific Aim Testable
Hypothesis
Study Design
Statistical Methods
Sample Size Calculations
![Page 17: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/17.jpg)
How is sample size determined?
Depends on: Specific aim – primary hypothesis of
the study Study design
– These two influence the statistical test. Effect size to be detected Variability of the response variable
– Researchers need to provide this information
![Page 18: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/18.jpg)
Example: New medication study
• Test: Ho: µnew = µold vs. Ha: µnew ≠ µold • Design: Randomized into each arm • Statistical method: t-test
• σ2 = variance; Δ = effect size to detect Researchers need to provide this information. – Published results – Pilot data – Clinically meaningful change
![Page 19: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/19.jpg)
Sample size calculations may not be straight-forward
More complex designs require more complex calculations
Examples: – Longitudinal studies – Cross-over studies – Correlation of outcomes
Sometimes simulations are required
![Page 20: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/20.jpg)
Sample size calculations may not be straight-forward
More complex designs require more complex calculations
Examples: – Longitudinal studies – Cross-over studies – Correlation of outcomes
Sometimes simulations are required
THERE IS NO MAGIC NUMBER.
![Page 21: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/21.jpg)
Proposal Content
Proposal sections involving statistics Sample size justification Statistical analysis plan
– Statistical methods for each aim For clinical trials, Interim analyses/Early stopping rules
Engage a statistician to write or at least review these sections.
![Page 22: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/22.jpg)
Common statistical problems in proposals
Sample size justification absent or insufficiently justified
Lack of statistical analysis plan for all aims, including secondary aims
Inappropriate statistical analysis methods
![Page 23: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/23.jpg)
Common statistical problems in proposals
Sample size justification absent or insufficiently justified
Lack of statistical analysis plan for all aims, including secondary aims
Inappropriate statistical analysis methods
These issues can doom a proposal.
![Page 24: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/24.jpg)
Data Collection and Compilation
![Page 25: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/25.jpg)
Data Collection and Compilation
Valid results require – Collection of accurate data – Clear and accurate data compilation
Create workable and documented data sets
QA/QC procedures – Validation during data entry – Periodically audit the data – Conduct internal validation of final data
![Page 26: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/26.jpg)
Bad Scene!
![Page 27: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/27.jpg)
RedCAP is user-friendly alternative.
![Page 28: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/28.jpg)
Leverage informatics and biostatistics expertise
Medical informatics group can – Create forms for data collection – Extract information from EMR
Use inter-disciplinary team to determine what information to collect and how – Investigator, practitioners, biostatistician,
informatics specialist – Ensures information is collected and compiled
in a manner that facilitates analysis
![Page 29: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/29.jpg)
Data Do’s and Don’ts
• Use RedCAP where possible • Assign unique ID to each subject and
use consistently • Remove all PHI prior submitting to
statistician • Unambiguously and consistently
specify missing values – Avoid using “0” or blanks for missing values
• Avoid free text fields
![Page 30: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/30.jpg)
Go forth and collect data!
![Page 31: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/31.jpg)
Statistician activities during the study
• Sometimes limited involvement by statistician
• Involvement can include – Conducting interim analyses – Serving on DSMB
• Some study designs entail periodic reassessments and statistician will necessarily be involved during the study – Two-stage, adaptive or sequential trials
![Page 32: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/32.jpg)
Analysis and
Reporting
![Page 33: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/33.jpg)
Analyzing the data
Conduct statistical analyses – Data validation – Run statistical tests
Interpret the results Prepare tables and figures to
illustrate findings
![Page 34: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/34.jpg)
Working with a Statistician to Analyze your Data
Range of support provided
One-time Advice Only
Select methods Conduct all analyses
![Page 35: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/35.jpg)
If statistician analyzes the data…
Remove PHI Provide “clean”, documented data set Allow sufficient time for analysis
– Rule of Thumb is 4 to 6 weeks Provide references from similar
studies if available Iterative and interactive process
![Page 36: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/36.jpg)
Report/Publication Preparation
Craft statistical analysis section Contribute to results section Generate tables and figures
![Page 37: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/37.jpg)
Biostatistics Resources at UC Davis
Clinical and Translational Science Center – Biostatistics Workshop: 12-1 on Tuesdays
[email protected] – Biostatistics Core
• Assist with study design, grant writing, data analysis and interpretation
• Application for Resource Use (AFRU) http://www.ucdmc.ucdavis.edu/ctsc/
Division of Biostatistics
![Page 38: Biostatistics in Biomedical and Clinical Research · Medical informatics group can – Create forms for data collection – Extract information from EMR Use inter-disciplinary team](https://reader034.fdocuments.us/reader034/viewer/2022050719/5f085e9d7e708231d421abd7/html5/thumbnails/38.jpg)
Other CTSC Resources
Biomedical Informatics Clinical Research Center Clinical Trials Resource Group Community Engagement Clinical Research Ethics Translational Technologies Pilot Studies Funding
www.ucdmc.ucdavis.edu/ctsc/