Finding and Using Best Evidence
description
Transcript of Finding and Using Best Evidence
![Page 1: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/1.jpg)
Finding and Using Best Evidence
Rebecca Payne, MPHLaura Straw, MPH
Health Analysis DepartmentNavy and Marine Corps Public Health
Center
![Page 2: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/2.jpg)
FOR OFFICIAL USE ONLY2
Disclaimer
The views expressed in this presentation are those of the author and do not necessarily reflect the official policy or position of the Department of the Navy, Department of Defense, or the U.S. Government.
![Page 3: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/3.jpg)
Health Analysis Department
Department within the Population Health Directorate of the Navy and Marine Corps Public Health Center, Portsmouth, VA
Highly trained team consisting of: Epidemiologists Program Manager Technical Affairs Officer Biostatistician Physician Lead Navy Tumor Registry Consultant
FOR OFFICIAL USE ONLY3
![Page 4: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/4.jpg)
FOR OFFICIAL USE ONLY4
Objectives
1. Define “best evidence”2. Describe how one would find
best medical evidence3. List the hierarchy of strength
of evidence4. List examples of best evidence
in Navy Medicine
![Page 5: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/5.jpg)
FOR OFFICIAL USE ONLY5
“Evidence-Based…”?
• Evidence-based medicine:• “The conscientious, explicit, and judicious use of
current best evidence in making decisions about the care of individual patients.”1
• Evidence-based clinical practice:• “Evidence-based clinical practice is an approach to
decision making in which the clinician uses the best evidence available, in consultation with the patient, to decide upon the option that suits the patient best” 2
• Evidence-based practice in health care:• Evidence-based health care “takes place when
decisions that affect the care of patients are taken with due weight accorded to all valid, relevant information”
3
![Page 6: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/6.jpg)
FOR OFFICIAL USE ONLY6
Levels of Evidence
Qua
lity
of e
vide
nce
Filtered Information
Filtered Information
Unfiltered InformationUnfiltered
Information
Source: Adapted from http://www.ebmpyramid.org/samples/complicated.html
![Page 7: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/7.jpg)
Background Info/ Expert Opinion
• Quick references• Medscape Reference• 5 Minute Clinical Consult
• Textbooks• Internet• Colleagues/experts
FOR OFFICIAL USE ONLY7
![Page 8: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/8.jpg)
Example: Medscape Reference
FOR OFFICIAL USE ONLY8
![Page 9: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/9.jpg)
FOR OFFICIAL USE ONLY9
Levels of Evidence
Qua
lity
of e
vide
nce
Filtered Information
Filtered Information
Unfiltered InformationUnfiltered
Information
Source: Adapted from http://www.ebmpyramid.org/samples/complicated.html
![Page 10: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/10.jpg)
Unfiltered Information
• Reports• Case series: Descriptive study of group with
common exposures or outcomes• Case-controlled studies: People with a
specific health outcome are matched with people who do not have the outcome to compare if the groups differ with respect to potential causes
• Cohort studies: People exposed to a cause or a treatment are compared to those not exposed to determine if they differ with respect to risk of some outcome
FOR OFFICIAL USE ONLY10
![Page 11: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/11.jpg)
Unfiltered Information
FOR OFFICIAL USE ONLY11
• Randomized Controlled Trials• “Gold standard”• Experimental design• Participants are
randomly assigned to a control condition or to an experimental condition
• Minimizes bias• Drawbacks: Expensive
and time consuming
![Page 12: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/12.jpg)
Unfiltered Information Resources
• PubMed http://www.ncbi.nlm.nih.gov/pubmed
• Ovid MEDLINE http://www.ovid.com/site/catalog/DataBase/901.jsp
• PsychINFOwww.apa.org/psycinfo/
FOR OFFICIAL USE ONLY12
![Page 13: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/13.jpg)
Example: PubMed
FOR OFFICIAL USE ONLY13
![Page 14: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/14.jpg)
Example: PubMed
FOR OFFICIAL USE ONLY14
![Page 15: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/15.jpg)
FOR OFFICIAL USE ONLY15
Levels of Evidence
Qua
lity
of e
vide
nce
Filtered Information
Filtered Information
Unfiltered InformationUnfiltered
Information
Source: Adapted from http://www.ebmpyramid.org/samples/complicated.html
![Page 16: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/16.jpg)
Filtered Evidence
Critically Appraised Individual Articles• Synopsis and evaluation of individual
research studies• Critically Appraised Topics• Synthesis and evaluation of multiple
research studies
FOR OFFICIAL USE ONLY16
![Page 17: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/17.jpg)
CAIA Resources
• ACP Journal Clubhttp://acpjc.acponline.org/
• Evidence Updates- from the BMJ Evidence Centerhttp://plus.mcmaster.ca/evidenceupdates/
• Any “Evidence-Based…” Journal series (i.e. Evidence-Based Nursing)
FOR OFFICIAL USE ONLY17
![Page 18: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/18.jpg)
CAT Resources
• AHRQ National Guideline Clearinghouse
http://guideline.gov/index.aspx
• Clinical Evidence http://clinicalevidence.bmj.com/x/index.html
• Essential Evidence Plus- POEMshttp://www.essentialevidenceplus.com/
FOR OFFICIAL USE ONLY18
![Page 19: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/19.jpg)
Example: AHRQ National Guideline Clearinghouse
FOR OFFICIAL USE ONLY19
![Page 20: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/20.jpg)
Example: AHRQ National Guideline Clearinghouse
FOR OFFICIAL USE ONLY20
![Page 21: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/21.jpg)
FOR OFFICIAL USE ONLY21
CAT Resources
• The VHA/ MHS have their own Clinical Practice Guidelines• http://www.healthquality.va.gov/• VA/DoD Evidence-Based Practice Guideline
Work Group (EBPWG) include representatives from all military branches and the VA
• EBPWG selects topics based on cost, volume, risk, and feasibility.
![Page 22: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/22.jpg)
Example: VA/DoD CPGs
FOR OFFICIAL USE ONLY22
![Page 23: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/23.jpg)
FOR OFFICIAL USE ONLY23
Levels of Evidence
Qua
lity
of e
vide
nce
Filtered Information
Filtered Information
Unfiltered InformationUnfiltered
Information
Source: Adapted from http://www.ebmpyramid.org/samples/complicated.html
![Page 24: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/24.jpg)
Filtered Information
Systematic Review: • Searching for, recording, analyzing and interpreting the
existing evidence 4
Meta-Analysis:• Applying a statistical formula to measure the effect, size,
and impact of treatment programs 4
Example From Cochrane:• Exercise or Exercise and Diet for preventing
type 2 diabetes7
• 8 trials, with ~5,000 participants• Conclusion: Exercise and diet can decrease
type 2 diabetes
FOR OFFICIAL USE ONLY24
![Page 25: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/25.jpg)
FOR OFFICIAL USE ONLY25
Systematic Review Resources
• Cochrane Database of Systematic Reviews • www.cochrane.org
• The Database of Abstracts of Review of Effects (DARE)• http://www.ovid.com/site/products/ovidguide/
daredb.htm• PUBMED• http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?
otool=yalelib&dr=citation• Ovid MEDLINE
Source: http://www.ebmpyramid.org/samples/complicated.html
![Page 26: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/26.jpg)
FOR OFFICIAL USE ONLY26
Example: USPSTF
• US Preventive Services Task Force (USPSTF)• http://www.uspreventiveservicestaskforce.org/
• Independent group of prevention and EBM experts that makes recommendations about clinical preventive services
![Page 27: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/27.jpg)
Example: USPSTF
FOR OFFICIAL USE ONLY27
![Page 28: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/28.jpg)
Evidence Based Applications and
Examples
![Page 29: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/29.jpg)
29
The 5-Minute Clinical Consult 2009OR UptoDate
![Page 30: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/30.jpg)
30
Restless Leg Syndrome
![Page 31: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/31.jpg)
Cervical Cancer Screening
• What is the evidence for routine cervical caner screening in women?
• US Preventive Services Task Force
FOR OFFICIAL USE ONLY31
Source: Whitlock, E.P., Vesco, K.K., Eder, M., Lin, J., Senger, C., Burda, B., Liquid Based Cytology and Human Papillomavirus Testing to Screen for Cervical Cencer: A Systematic Review for the US Preventive Services Task Force. Annals of Internal Medicine. 2011. Vol 155 No 10. p 687-697
![Page 32: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/32.jpg)
Cervical Cancer, Ctd
FOR OFFICIAL USE ONLY32
![Page 33: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/33.jpg)
Cervical Cancer, ctd.
FOR OFFICIAL USE ONLY33
• Does everyone agree?
Source: http://www.cdc.gov/cancer/cervical/pdf/guidelines.pdf
![Page 34: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/34.jpg)
PTSD• What is the best evidence available about
treatment for PTSD?• VA/DOD Clinical Practice Guideline:
FOR OFFICIAL USE ONLY34
Source: VA/DOD Clinical Practice Guideline: Management of Post Traumatic Stress Disorder and Acute Stress Reaction (2010). http://www.healthquality.va.gov/Post_Traumatic_Stress_Disorder_PTSD.asp
![Page 35: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/35.jpg)
PTSD Cont’d
FOR OFFICIAL USE ONLY35
![Page 36: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/36.jpg)
PTSD Cont’d
FOR OFFICIAL USE ONLY36
Cochrane Review: PTSD• Psychological and psychosocial interventions
• “Some types of psychological treatment (individual trauma-focused cognitive behavioural therapy/exposure therapy [TFCBT], eye movement desensitisation and reprocessing [EMDR], stress management, and group TFCBT) were effective in the treatment of PTSD, and individual TFCBT and EMDR appeared to be superior to stress management at two to five months. Insufficient evidence was available to determine whether psychological treatment is harmful, but there was greater drop-out in active treatment groups. Caution is needed in interpreting these results because of considerable unexplained heterogeneity, and the potential impact of publication bias”
• Pharmacotherapy for post-traumatic stress disorder• “Medication treatments can be effective in treating PTSD, acting to reduce its core symptoms,
as well as associated depression and disability. The findings of this review support the status of selective serotonin reuptake inhibitors as first-line agents in the pharmacotherapy of PTSD, as well as their value in long-term treatment. However, there remain important gaps in the evidence base, and a continued need for more effective agents in the management of PTSD.”
Source: http://www.thecochranelibrary.com/details/collection/1045825/Cochrane-Evidence-Aid-resources-for-post-traumatic-stress-disorder-following-nat.html
![Page 37: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/37.jpg)
HEDIS• NCQA’s Health Effectiveness Data and
Information Set (HEDIS)• Widely used set of health performance
indicators• Desirable attributes for HEDIS
measures are:• Relevance • Scientific Soundness –Clinical
Evidence! (There should be evidence documenting the link between clinical processes and outcomes that measures address)
• Feasibility
Source: HEDIS Technical Specification Manual
FOR OFFICIAL USE ONLY37
![Page 38: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/38.jpg)
FOR OFFICIAL USE ONLY38
Evidence Applications
• In Military Medicine: Population Health Navigator/CarePoint
![Page 39: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/39.jpg)
Analysis Application
How could we apply best evidence when measuring healthcare?
1. Look for best evidence: systematic reviews, CPGs, research
2. Assess evidence3. Look for existing measures; if none
exist, look for “measurable points” in evidence.
4. Ensure proposed measure is meaningful and feasible
5. Develop measure
FOR OFFICIAL USE ONLY39
![Page 40: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/40.jpg)
Application Example: mTBI Metrics
Wounded, Ill, and Injured (WII) Program: Navy Medicine effort to monitor and improve the care
offered to wounded, ill, and injured service members and their families
mTBI MetricsTBI Screening: Percent of Coded Head Injury/Trauma
Patients Coded as Screened for TBICo-Occurring Conditions Screen: Percent of Coded
mTBI Patients Coded as Screened for Co-Occurring Conditions
Six Week Follow Up Visit: Percent of Coded mTBI Patients with Follow-Up within Six Weeks
40
![Page 41: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/41.jpg)
mTBI Metrics Example (cont’d)
Metric Definitions: The Department of Veterans
Affairs (VA) and Department of Defense (DoD) Concussion and mTBI Clinical Practice Guideline (CPG)
Coding Guidance: Defense Centers of Excellence
for Psychological Health and Traumatic Brain Injury (DCoE PH/TBI)
Navy Medicine TBI subject matter experts (SMEs) 41
![Page 42: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/42.jpg)
General Coding Guidance & CPG Recommendation
mTBI Metrics Example (cont’d)
42
![Page 43: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/43.jpg)
CPG Recommendation:
“Regardless of the time that has elapsed
since injury, management should
begin with the patient’s first
presentation for treatment,” and head injury cases should be
screened for TBI.
All Head Injury Cases: 5%
Active Duty Only: 7%
mTBI Metrics (cont’d)
Not using codes?Not screening for
TBI?Actual process different than
recommendation?43
![Page 44: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/44.jpg)
FOR OFFICIAL USE ONLY44
References1. Sackett,D., Richardson, W., Rosenberg, W., & Haynes, R. (1997). Evidence-
based medicine: How to practice and the EBM. New York:Churchill Livingston.
2. Muir Gray, J.A. (1997) Evidence-based healthcare: How to make health policy and management decisions. London:Churchill Livingstone.
3. Hicks, N. (1997). Evidence based healthcare. Bandolier, 4(39),8. 4. Roberts, A., Yeager, K. (2004). Evidence-Based Practice Manual. New
York, NY: Oxford University Press. 5. Whitlock, E.P., Vesco, K.K., Eder, M., Lin, J., Senger, C., Burda, B. (2011).
Liquid Based Cytology and Human Papillomavirus Testing to Screen for Cervical Cencer: A Systematic Review for the US Preventive Services Task Force. Annals of Internal Medicine. 155 (10),687-697.
6. Framingham Heart Study http://www.framinghamheartstudy.org/about/history.html
7. Orozco LJ, Buchleitner AM, Gimenez-Perez G, Roqué i Figuls M, Richter B, Mauricio D. Exercise or exercise and diet for preventing type 2 diabetes mellitus. Cochrane Database of Systematic Reviews 2008, Issue 3. Art. No.: CD003054. DOI: 10.1002/14651858.CD003054.pub3
![Page 45: Finding and Using Best Evidence](https://reader036.fdocuments.us/reader036/viewer/2022062803/568148ec550346895db607c3/html5/thumbnails/45.jpg)
Navy and Marine Corps Public Health Center
Health Analysis
CAPT Paul Rockswold, MD, MPHHead, Health Analysis
P: 757-953-0690Email: [email protected]
FOR OFFICIAL USE ONLY45
web: http://www-nehc.med.navy.mil/Data_Statistics/Health_Analysis/ha_overview.aspx