Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.
-
Upload
logan-ferguson -
Category
Documents
-
view
215 -
download
0
Transcript of Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.
![Page 1: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/1.jpg)
Final Presentation
Group 2
Porto, 2nd May 2007
Medical Faculty of Oporto
![Page 2: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/2.jpg)
1. Introduction
2. Methods
3. Results
4. Discussion and Conclusions
5. Acknowledgements
![Page 3: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/3.jpg)
As an extremely dynamic field, medicine evolves each day, integrating new ideas and concepts which come from all over the world
Gastroenterology and hepatology are medical specializations concerned with the diagnosis and treatment of diseases of the digestive tract and organs
Diagnostic tests play a crucial role in the accurate diagnose of diseases
![Page 4: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/4.jpg)
The number of existing diagnostic tests has grown over the past few years1
In January 2003, the guide for reporting studies of diagnostic accuracy Standards for Reporting of Diagnostic Accuracy (STARD) was published1
The objective of the STARD initiative is to improve the quality of reporting of studies of diagnostic accuracy1
1- Bossuyt, P; Reitsma, J; Bruns, D; Gatsonis, C; Glasziou, P; Irwig, L; Lijmer, J; Moher, D; Rennie, D; de Vet, H, Towards complete and accurate reporting o studies of diagnostic accuracy: the STARD initiative; Annals of internal medicine; Volume 138, 2003.
![Page 5: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/5.jpg)
Bossuyt, P; Reitsma, J; Bruns, D; Gatsonis, C; Glasziou, P; Irwig, L; Lijmer, J; Moher, D; Rennie, D; de Vet, H, Towards complete and accurate reporting o studies of diagnostic accuracy: the STARD initiative; Annals of internal medicine; Volume 138, 2003.
![Page 6: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/6.jpg)
Objectives
Evaluate the quality of the articles which evaluate diagnostic tests in Gastroenterology and Hepatology on journals with the highest impact factor in the past 12 years based on the STARD checklist, and unveil if there was evolution in this type of studies
Assess if the STARD initiative had influence in the articles or not
1 - Bossuyt, P; Reitsma, J; Bruns, D; Gatsonis, C; Glasziou, P; Irwig, L; Lijmer, J; Moher, D; Rennie, D; de Vet, H, Towards complete and accurate reporting o studies of diagnostic accuracy: the STARD initiative; Annals of internal medicine; Volume 138, 2003.
![Page 7: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/7.jpg)
1. Introduction
2. Methods
3. Results
4. Discussion and Conclusions
5. Acknowledgements
![Page 8: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/8.jpg)
1. Article search
2. Selection of abstracts
3. Article evaluation
![Page 9: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/9.jpg)
Initial Query for studies of diagnostic accuracy
Definition of inclusion parameters
Restriction to the five journals of gastroenterology and hepatology with the highest impact factor
Restriction to diagnostic tests in humans
![Page 10: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/10.jpg)
Initial Query
(((((((((((("sensitivity and specificity"[All Fields] OR "sensitivity and specificity/standards"[All Fields]) OR "specificity"[All Fields]) OR "screening"[All Fields]) OR "false positive"[All Fields]) OR "false negative"[All fields]) OR "accuracy"[All Fields]) OR (((("predictive value"[All Fields] OR "predictive value of tests"[All Fields]) OR "predictive value of tests/standards"[All Fields]) OR "predictive values"[All Fields]) OR "predictive values of tests"[All Fields])) OR (("reference value"[All Fields] OR "reference values"[All Fields]) OR "reference values/standards"[All Fields)) OR (((((((((("roc"[All Fields] OR "roc analyses"[All Fields]) OR "roc analysis"[All fields]) OR "roc and"[All fields]) OR "roc area"[All fields]) OR "roc auc"[All Fields]) OR "roc characteristics"[All Fields]) OR "roc curve"[All Fields]) OR "roc curve method"[All Fields]) OR "roc curves"[All Fields]) OR "roc estimated"[All Fields]) OR "roc evaluation"[All Fields])) OR "likelihood ratio"[All Fields])
Ref:Dévillé WL, Buntins F, Bouter LM, Montori, VM, de Vet H, Windt DAWM, Bezemer PD. Conducting systematic reviews of diagnostic studies: didactic guidelines, BMC medical research methodology 2002, 2:9
![Page 11: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/11.jpg)
Initial Query
(((((((((((("sensitivity and specificity"[All Fields] OR "sensitivity and specificity/standards"[All Fields]) OR "specificity"[All Fields]) OR "screening"[All Fields]) OR "false positive"[All Fields]) OR "false negative"[All fields]) OR "accuracy"[All Fields]) OR (((("predictive value"[All Fields] OR "predictive value of tests"[All Fields]) OR "predictive value of tests/standards"[All Fields]) OR "predictive values"[All Fields]) OR "predictive values of tests"[All Fields])) OR (("reference value"[All Fields] OR "reference values"[All Fields]) OR "reference values/standards"[All Fields)) OR (((((((((("roc"[All Fields] OR "roc analyses"[All Fields]) OR "roc analysis"[All fields]) OR "roc and"[All fields]) OR "roc area"[All fields]) OR "roc auc"[All Fields]) OR "roc characteristics"[All Fields]) OR "roc curve"[All Fields]) OR "roc curve method"[All Fields]) OR "roc curves"[All Fields]) OR "roc estimated"[All Fields]) OR "roc evaluation"[All Fields])) OR "likelihood ratio"[All Fields]) AND (Humans[MeSH])
![Page 12: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/12.jpg)
Year 1994
Articles Found – 174
Query parameters:
(…) 1994 [Publication Date] AND (GASTROENTEROLOGY [Journal] OR HEPATOLOGY [Journal] OR GUT [Journal] OR GASTROINTEST ENDOSC [Journal] OR J HEPATOL [Journal])
![Page 13: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/13.jpg)
1994 – 174 1995 – 144
1996 – 168
1997 – 167
1998 – 129
1999 – 180
2000 – 170
2001 – 144
2002 – 165
2003 – 140
2004 – 261
2005 – 299
Journals with highest occurence:
•Gastroenterol•Hepatol•Gut
![Page 14: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/14.jpg)
1. Article search
2. Selection of abstracts
3. Article evaluation
![Page 15: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/15.jpg)
![Page 16: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/16.jpg)
• Non-excluded and non-included abstracts were listed along with reasons of non-inclusion and added to the data base on SPSS
![Page 17: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/17.jpg)
1. Article search
2. Selection of abstracts
3. Article evaluation
![Page 18: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/18.jpg)
![Page 19: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/19.jpg)
1. Introduction
2. Methods
3. Results
4. Discussion and Conclusions
5. Acknowledgements
![Page 20: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/20.jpg)
![Page 21: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/21.jpg)
Does not assess diagnostic tests
Missing abstract
Other
Reasons for non-inclusion
102 abstracts not excluded from 300 found
Comparison between excluded and included articles
![Page 22: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/22.jpg)
Agreement between abstract reviewers
Rate of agreement between reviewers – 84,3%
![Page 23: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/23.jpg)
Does not assess diagnostic tests
Missing article
Exclusion reasons (%)
78 articles included from 102 abstracts not excluded
Comparison between excluded and included articles
![Page 24: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/24.jpg)
Agreement between article reviewers
1 - Smidt, N.; Rutjes, A.; van der Windt, D.; Ostelo, R.; Bossuyt, P; Reitsma, J.; Bouter, L; de Vet, H; Reproducibility of the STARD checklist: an instrument to assess the quality of reporting of diagnostic accuracy studies; BMC medical research methodology; 2006
Obtained ICC value is in accordance with ICC to be expected by Smidt, N.
Expected ICC = 0,79 [95% CI: 0,62 to 0,89]1
![Page 25: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/25.jpg)
Evolution of the article’s score by mean
![Page 26: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/26.jpg)
Evolution of the article’s score by median
![Page 27: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/27.jpg)
Items with highest absence (i13, i24) refer to reproducibility issues
Individual STARD items absence percentage
![Page 28: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/28.jpg)
1. Introduction
2. Methods
3. Results
4. Discussion and Conclusions
5. Acknowledgements
![Page 29: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/29.jpg)
STARD did not had a significant effect in the article’s quality
• Insufficient time span between the STARD publishing (2003) and the current date
• The small evolution in the article’s quality is likely to be a consequence of other factors, not taken into account in this study
This study should be repeated in a wider time span
![Page 30: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/30.jpg)
The quality of the this kind of articles in the journals with the highest impact factors is not as positive as expected
• The credibility of these articles may be compromised
• The results presented may be misleading
![Page 31: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/31.jpg)
The STARD items referring to reproducibility issues are highly absent
• The studies might be difficult to reproduce, which may lead to difficulties in the repeating of the studies by other researchers and therefore may impede verification of results
• There is the possibility of the diagnostic tests assessed to be inaccurate
![Page 32: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/32.jpg)
1. Introduction
2. Methods
3. Results
4. Discussion and Conclusions
5. Acknowledgements
![Page 33: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/33.jpg)
• Cristina Santos, MD
• Altamiro da Costa Pereira, PhD MD
![Page 34: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/34.jpg)
Porto, 2nd May 2007
Medical Faculty of Oporto
Orientation
Cristina Santos, MD
Supervisor
Altamiro da Costa Pereira, PhD MD
Authors
![Page 35: Final Presentation Group 2 Porto, 2 nd May 2007 Medical Faculty of Oporto.](https://reader035.fdocuments.us/reader035/viewer/2022062515/56649f4e5503460f94c6f4ce/html5/thumbnails/35.jpg)