Molecular malaria diagnostics: A systematic review and meta-analysis
Systematic Review, Meta-Analysis,...
Transcript of Systematic Review, Meta-Analysis,...
![Page 1: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/1.jpg)
Systematic Review, Meta-Analysis, Clinical Practice Guidelines…
Tools, TSH and Tricks of the Trade…
Larry Young
Sheri Keitz
![Page 2: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/2.jpg)
Teaching Objectives
• Understand what systematic reviews can and cannot do for you
• To learn to love forest plots• To review principles of when it is appropriate to
combine studies • Interpret the results of a meta-analysis including
forest plots• Become familiar with the GRADE approach and
its use in creating clinical practice guidelines and implementing evidence
![Page 3: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/3.jpg)
Definitions
• A systematic review is a summary of research that addresses a focused clinical question in a systematic, reproducible manner.
• A meta-analysis is a statistical pooling or aggregation of estimate of effect.
SR MA
Users’ Guide to the Medical Literature. Guyatt et al.
![Page 4: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/4.jpg)
Advantages of Meta-Analyses
• More representative of the total body of evidence
• Save time
• Increase precision of results
• Include a greater range of patients, potentially improving generalizability
• Provide an assessment of confidence in results
![Page 5: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/5.jpg)
The Systematic Review
![Page 6: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/6.jpg)
Hierarchy of Evidence Pyramid
Unsystematic Clinical Experience
Case-Control
Case Series
Observational Studies
(Cohort)
RCT
Systematic Review/Meta-analysis
![Page 7: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/7.jpg)
Ask
Acquire
Appraise
Apply
Assess
Clinical
dilemma
Evidence-based
medicine
cycle
Values &
PreferencesHierarchy of
Evidence
![Page 8: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/8.jpg)
THE BEST WAY TO UNDERSTAND JUST ABOUT ANYTHING IN MEDICINE IS TO REFLECT ON A PATIENT…
![Page 9: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/9.jpg)
The Setting
• You are covering the walk in clinic for one of your colleagues.
• A staff member, who usually sees one of your residents, is here for follow up of her lab results.
![Page 10: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/10.jpg)
Mrs. SR
• 67 year old retired 3rd GRADE teacher
• PMH: hypertension and osteopenia
• Weight gain, dry skin and fatigue for the last 6 months; quality of life has declined – less active, new knee pain
• Normal physical examination
• BP 158/92
• TSH 9.5; normal T3 and T4
• You diagnose subclinical hypothyroidism.
![Page 11: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/11.jpg)
She wonders if thyroid replacement will help with her symptoms
• P : non-pregnant patients with subclinical hypothyroidism
• I : thyroid hormone replacement
• C : no treatment, placebo
• O : quality of life, thyroid related symptoms, HTN, worsening osteopenia
• T : therapy
• T : randomized clinical trial, meta-analysis of RCTs
![Page 12: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/12.jpg)
She wonders if thyroid replacement will help with her symptoms
• P : non-pregnant patients with subclinical hypothyroidism
• I : thyroid hormone replacement
• C : no treatment, placebo
• O : quality of life, thyroid related symptoms, HTN, worsening osteopenia
• T : therapy
• T : randomized clinical trial, meta-analysis of RCTs
![Page 13: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/13.jpg)
Acquire
![Page 14: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/14.jpg)
• 21 studies
• 2192 patients
• RCTs comparing thyroid hormone replacement to placebo or no treatment
![Page 15: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/15.jpg)
Ask
Acquire
Appraise
Apply
Assess
Clinical
dilemma
Evidence-based
medicine
cycle
Values &
PreferencesHierarchy of
Evidence
![Page 16: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/16.jpg)
Appraisal
Let’s appraise the article together… in 5 minutes?
![Page 17: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/17.jpg)
Rea
d A
bst
ract
… 2
m
inu
tes
![Page 18: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/18.jpg)
Assessing the Credibility of the Systematic Review Process
Did the review address a focused clinical question (i.e.
can be framed in PICO format)?
1
Was the search for relevant studies detailed and
exhaustive?
2
Was the risk of bias of the primary studies assessed? 3
Did the review address possible explanations of
between-study differences in results using prespecified
hypotheses?
4
Were selection and assessment of studies reproducible? 5
Did the review describe a process to assess confidence
in effect estimates? (e.g. GRADE tool to assess quality of
the body of evidence)
6
Understanding the Summary Estimate of a Meta-analysis
What is the magnitude of treatment effect? (what is the
pooled estimate?)
7
How precise are the results? (i.e. confidence interval
around the pooled estimate)
8
Rating Confidence in the Estimates (the Quality of a Body of Evidence)How serious is the risk of bias in the body of evidence? 9
Are the results consistent across studies? (i.e.
heterogeneity or inconsistency)
10
Do the results directly apply to my patient? (i.e. PICO,
generalizability, indirectness)
11
Is there a concern about reporting or publication bias? 12
Are there reasons to increase or decrease the confidence
of the rating? (Randomized trials start high and
observational studies start low)
13
Overall, what is the quality of the body of evidence by
outcome? (High, moderate, low, very low)
14
How can I apply the results to my patient care?
Did the review present results that are ready for clinical
application? (e.g. patient important outcomes, absolute
benefit /risk)
15
Are the study patients similar to my patient and are
likely benefits worth potential harms/costs?
16
Ap
pra
isal
… in
yo
ur
bin
der
![Page 19: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/19.jpg)
Assessing the Credibility of the Systematic Review ProcessDid the review address a focused clinical
question (i.e. can be framed in PICO format)?
1
Was the search for relevant studies detailed
and exhaustive?
2
Was the risk of bias of the primary studies
assessed?
3
Did the review address possible explanations
of between-study differences in results using
prespecified hypotheses?
4
Were selection and assessment of studies
reproducible?
5
Did the review describe a process to assess
confidence in effect estimates? (e.g. GRADE
tool to assess quality of the body of
evidence)
6
Appraisal – Did the Meta-Analysts Do a Good Job?
![Page 20: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/20.jpg)
Did the review address a focused clinical question (i.e. can be framed in PICO format)?
![Page 21: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/21.jpg)
Was the search for relevant studies detailed and exhaustive?
![Page 22: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/22.jpg)
Was the risk of bias of the primary studies assessed?
![Page 23: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/23.jpg)
Did the review address possible explanations of between-study differences in results using prespecified hypotheses?
![Page 24: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/24.jpg)
Were selection and assessment of studies reproducible?
![Page 25: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/25.jpg)
Did the review describe a process to assess confidence in effect estimates? (e.g. GRADE tool to assess quality of the body of
evidence)
![Page 26: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/26.jpg)
Assessing the Credibility of the Systematic Review ProcessDid the review address a focused clinical
question (i.e. can be framed in PICO format)?
1
Was the search for relevant studies detailed
and exhaustive?
2
Was the risk of bias of the primary studies
assessed?
3
Did the review address possible explanations
of between-study differences in results using
prespecified hypotheses?
4
Were selection and assessment of studies
reproducible?
5
Did the review describe a process to assess
confidence in effect estimates? (e.g. GRADE
tool to assess quality of the body of
evidence)
6
Appraisal
![Page 27: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/27.jpg)
What are the results
• Everyone: look at Figure 1 (page 1354).
• Let’s look together at the primary outcomes
![Page 28: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/28.jpg)
Page 1354
![Page 29: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/29.jpg)
Page 1354
![Page 30: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/30.jpg)
Should we pool the results?Heterogeneity??? What the fork?
![Page 31: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/31.jpg)
Expert on Heterogeneity
https://www.youtube.com/watch?v=HwqHUSOHPvU
![Page 32: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/32.jpg)
Is pooling sensible?
• A priori determination of whether it makes sense to combine on a principled basis.
• You have not looked at the data yet…
The Common Sense Test
![Page 33: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/33.jpg)
Is pooling sensible?
• MA of all kinds of treatments for all cancers?
• MA of steroid treatments for COPD?
• MA of studies looking at CT-angiogram for diagnosis of pulmonary embolism?
![Page 34: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/34.jpg)
Does combining RESULTS make sense?
• Comes from a review of dots and lines
![Page 35: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/35.jpg)
Favors New Treatment Favors ControlNo Difference
Result 1
![Page 36: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/36.jpg)
Eye-ball test
![Page 37: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/37.jpg)
Favors New Treatment Favors ControlNo Difference
Can we combine?
![Page 38: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/38.jpg)
Favors New Treatment Favors ControlNo Difference
Result 2
![Page 39: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/39.jpg)
Eye-ball test
![Page 40: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/40.jpg)
Favors New Treatment Favors ControlNo Difference
Can we combine?
![Page 41: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/41.jpg)
Favors New Treatment Favors ControlNo Difference
Result 3
![Page 42: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/42.jpg)
Eye-ball test
![Page 43: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/43.jpg)
Favors New Treatment Favors ControlNo Difference
Can we combine?
![Page 44: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/44.jpg)
Okay: What is the “Eye-ball test”?
![Page 45: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/45.jpg)
Eye-ball test
• Visual impression of degree of overlap of each study’s results (find a common neighborhood of truth)
• Visual impression of where the estimates of study “effects” themselves lie (where are the dots)
![Page 46: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/46.jpg)
c
Favors New Treatment Favors ControlNo Difference
![Page 47: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/47.jpg)
Favors New Treatment Favors ControlNo Difference
Back to result 3: if not, why not?
![Page 48: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/48.jpg)
Why might things be different
• P: more or less severe symptoms
• I: types of replacement (and duration)
• C: active control / placebo
• O: different scales for QOL, fatigue, others
• T: treatment question
• T: RCT or other study designs
![Page 49: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/49.jpg)
![Page 50: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/50.jpg)
I2 what?
• From 0 to 100
• The variability that is due to a real difference
• I2 = 0
• I2 = 100
• What is the range of possible values for I2
• Explain in a sentence?
• Is the variability between studies due ONLY to chance?
• Is the variability between studies due ONLY to a real difference in treatment?
![Page 51: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/51.jpg)
Favors New Treatment Favors ControlNo Difference
Result 1: what is I2
![Page 52: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/52.jpg)
Favors New Treatment Favors ControlNo Difference
Result 2: what is I2
![Page 53: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/53.jpg)
Favors New Treatment Favors ControlNo Difference
Result 3: what is I2
![Page 54: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/54.jpg)
Back to Results
![Page 55: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/55.jpg)
![Page 56: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/56.jpg)
BACK TO THE PAPER
BUT HOW MUCH CONFIDENCE CAN WE HAVE IN THIS BODY OF EVIDENCE?
![Page 57: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/57.jpg)
Rating Confidence in the Estimates (the Quality of a Body of Evidence)
How serious is the risk of bias in the body
of evidence?
9
Are the results consistent across studies?
(i.e. heterogeneity or inconsistency)
10
Do the results directly apply to my
patient? (i.e. PICO, generalizability,
indirectness)
11
Is there a concern about reporting or
publication bias?
12
Are there reasons to increase or decrease
the confidence of the rating?
(Randomized trials start high and
observational studies start low)
13
Overall, what is the quality of the body of
evidence by outcome? (High, moderate,
low, very low)
14
![Page 58: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/58.jpg)
How serious is the risk of bias?
Do these look familiar?
Remember, LOW values are GOOD
![Page 59: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/59.jpg)
Rating Confidence in the Estimates (the Quality of a Body of Evidence)
How serious is the risk of bias in the body
of evidence?
9
Are the results consistent across studies?
(i.e. heterogeneity or inconsistency)
10
Do the results directly apply to my
patient? (i.e. PICO, generalizability,
indirectness)
11
Is there a concern about reporting or
publication bias?
12
Are there reasons to increase or decrease
the confidence of the rating?
(Randomized trials start high and
observational studies start low)
13
Overall, what is the quality of the body of
evidence by outcome? (High, moderate,
low, very low)
14
![Page 60: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/60.jpg)
Rating Confidence in the Estimates (the Quality of a Body of Evidence)
How serious is the risk of bias in the body
of evidence?
9
Are the results consistent across studies?
(i.e. heterogeneity or inconsistency)
10
Do the results directly apply to my
patient? (i.e. PICO, generalizability,
indirectness)
11
Is there a concern about reporting or
publication bias?
12
Are there reasons to increase or decrease
the confidence of the rating?
(Randomized trials start high and
observational studies start low)
13
Overall, what is the quality of the body of
evidence by outcome? (High, moderate,
low, very low)
14
![Page 61: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/61.jpg)
Does This Match Our PICOTT?
• P : non-pregnant patients with subclinical hypothyroidism
• I : thyroid hormone replacement
• C : no treatment, placebo
• O : quality of life; thyroid related symptoms, HTN, worsening osteopenia
• T : therapy
• T : randomized clinical trial, meta-analysis of RCTs
![Page 62: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/62.jpg)
Rating Confidence in the Estimates (the Quality of a Body of Evidence)
How serious is the risk of bias in the body
of evidence?
9
Are the results consistent across studies?
(i.e. heterogeneity or inconsistency)
10
Do the results directly apply to my
patient? (i.e. PICO, generalizability,
indirectness)
11
Is there a concern about reporting or
publication bias?
12
Are there reasons to increase or decrease
the confidence of the rating?
(Randomized trials start high and
observational studies start low)
13
Overall, what is the quality of the body of
evidence by outcome? (High, moderate,
low, very low)
14
![Page 63: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/63.jpg)
Is there a concern about reporting or publication bias?
• Positive studies may be as much as 3 times more likely to be published than negative studies.
• Usually exaggerate treatment effect
• Funnel plot
• Look for asymmetry in the included studies
Result
Stu
dy
size
Result
Stu
dy
size
Result
![Page 64: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/64.jpg)
Is there a concern about reporting or publication bias?
![Page 65: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/65.jpg)
Rating Confidence in the Estimates (the Quality of a Body of Evidence)
How serious is the risk of bias in the body
of evidence?
9
Are the results consistent across studies?
(i.e. heterogeneity or inconsistency)
10
Do the results directly apply to my
patient? (i.e. PICO, generalizability,
indirectness)
11
Is there a concern about reporting or
publication bias?
12
Are there reasons to increase or decrease
the confidence of the rating?
(Randomized trials start high and
observational studies start low)
13
Overall, what is the quality of the body of
evidence by outcome? (High, moderate,
low, very low)
14
![Page 66: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/66.jpg)
Are there reasons to increase or decrease the confidence of the rating?
X is GOODSummary of Findings Table
No downgrade; inconsistency due to one trial that showed effect of placebo.
![Page 67: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/67.jpg)
Rating Confidence in the Estimates (the Quality of a Body of Evidence)
How serious is the risk of bias in the body
of evidence?
9
Are the results consistent across studies?
(i.e. heterogeneity or inconsistency)
10
Do the results directly apply to my
patient? (i.e. PICO, generalizability,
indirectness)
11
Is there a concern about reporting or
publication bias?
12
Are there reasons to increase or decrease
the confidence of the rating?
(Randomized trials start high and
observational studies start low)
13
Overall, what is the quality of the body of
evidence by outcome? (High, moderate,
low, very low)
14
For Primary Outcomes: High
![Page 68: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/68.jpg)
![Page 69: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/69.jpg)
![Page 70: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/70.jpg)
![Page 71: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/71.jpg)
Rating Confidence in the Estimates (the Quality of a Body of Evidence)
How serious is the risk of bias in the body
of evidence?
9
Are the results consistent across studies?
(i.e. heterogeneity or inconsistency)
10
Do the results directly apply to my
patient? (i.e. PICO, generalizability,
indirectness)
11
Is there a concern about reporting or
publication bias?
12
Are there reasons to increase or decrease
the confidence of the rating?
(Randomized trials start high and
observational studies start low)
13
Overall, what is the quality of the body of
evidence by outcome? (High, moderate,
low, very low)
14
Rating Confidence in the Estimates (the Quality of a Body of Evidence)
How serious is the risk of bias in the body
of evidence?
9
Are the results consistent across studies?
(i.e. heterogeneity or inconsistency)
10
Do the results directly apply to my
patient? (i.e. PICO, generalizability,
indirectness)
11
Is there a concern about reporting or
publication bias?
12
Are there reasons to increase or decrease
the confidence of the rating?
(Randomized trials start high and
observational studies start low)
13
Overall, what is the quality of the body of
evidence by outcome? (High, moderate,
low, very low)
14
For Primary Outcomes: High
We already did this!
![Page 72: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/72.jpg)
![Page 73: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/73.jpg)
CLINICAL PRACTICE GUIDELINES DEVELOPMENT
Evidence Recommendations
![Page 74: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/74.jpg)
Guideline Development Committee
YOU!
![Page 75: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/75.jpg)
Three Groups
ABlood
pressure
B Fatigue
CBMI
Look at e-Table 4
![Page 76: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/76.jpg)
![Page 77: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/77.jpg)
TABLE VOTE Make recommendation using
handout on your table
YES
NO
WEAK
STRONG
OR OR
![Page 78: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/78.jpg)
Five Ten Minutes
![Page 79: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/79.jpg)
A: Blood Pressure
X is GOODNo difference
![Page 80: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/80.jpg)
Blood PressureMake Recommendation - VOTE
YES
NO
OR
![Page 81: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/81.jpg)
Blood PressureMake Recommendation - VOTE
YES
NO
WEAK
STRONG
OR OR
![Page 82: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/82.jpg)
![Page 83: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/83.jpg)
B: Fatigue
X is GOODDowngrade due to only one trial.
No difference
![Page 84: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/84.jpg)
FatigueMake Recommendation - VOTE
YES
NO
OR
![Page 85: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/85.jpg)
FatigueMake Your Recommendation - VOTE
YES
NO
WEAK
STRONG
OR OR
![Page 86: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/86.jpg)
C: BMI
![Page 87: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/87.jpg)
BMI
X is GOODNo downgrade; inconsistency due to one trial that showed effect of placebo.
No difference
![Page 88: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/88.jpg)
BMIMake Recommendation - VOTE
YES
NO
OR
![Page 89: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/89.jpg)
BMI Make Recommendation- VOTE
YES
NO
WEAK
STRONG
OR OR
![Page 90: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/90.jpg)
Back to Mrs. SR…
• Among nonpregnant adults with subclinical hypothyroidism, the use of thyroid hormone therapy was not associated with improvements in general quality of life or thyroid-related symptoms.
• We advise her that this medication will not improve her symptoms and discuss alternative approaches to address her ongoing concerns.
![Page 91: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/91.jpg)
Anyone Recognize This?
• GRADE: a process for rating the quality of the best available evidence and developing health care recommendations.
• Why did we add this content? – It is a good way to bring many concepts together
and make explicit how evidence can be incorporated on a broader scale
– It is everywhere
![Page 92: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/92.jpg)
GRADE: adopted by over 100 organizations
worldwide
![Page 93: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/93.jpg)
Take Home Messages
• Systematic Reviews and Meta-analyses are needed to inform practice and can be used to drive decisions and actions.
• GRADE is a tool with explicit rules that is transparent and sensible for users of evidence and makers of clinical practice guidelines
• Two components of the GRADE process
– Quality of a body of evidence (certainty, confidence)
– Strength of recommendation: yes/no; weak/ strong
• When determining confidence in results: RCTs start high and Observational studies start low (hierarchy of evidence)
![Page 94: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/94.jpg)
![Page 95: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/95.jpg)
Take Home Messages
• Not all evidence is created equalA Hierarchy of evidence helps us differentiate information more likely to be valid or true
• Evidence alone is never enoughDecisions are made with our patients, guided by values and preferences.
![Page 96: Systematic Review, Meta-Analysis, Clinicalsites.duke.edu/ebmworkshop/files/2019/04/EBM2019-Systematic-Review.pdfSystematic Review, Meta-Analysis, Clinical ... Was the risk of bias](https://reader035.fdocuments.us/reader035/viewer/2022071109/5fe49a8f0e139d3db16e17be/html5/thumbnails/96.jpg)
Final Take Home Message:Cookie Monster is awesome