How Often Are Studies Wrong?

14
How Often Are Studies Wrong? AHCJ 2016 Cleveland Ivan Oransky Vice President, Global Editorial Director, MedPage Today Co-Founder, Retraction Watch Distinguished Writer In Residence, New York University Arthur Carter Journalism Institute @ivanoransky

Transcript of How Often Are Studies Wrong?

Page 1: How Often Are Studies Wrong?

How Often Are Studies Wrong?

AHCJ 2016Cleveland

Ivan OranskyVice President, Global Editorial Director, MedPage Today

Co-Founder, Retraction WatchDistinguished Writer In Residence,

New York University Arthur Carter Journalism Institute@ivanoransky

Page 2: How Often Are Studies Wrong?
Page 3: How Often Are Studies Wrong?
Page 4: How Often Are Studies Wrong?

“Fifty-three papers were deemed 'landmark' studies. It was acknowledged from the outset that some of the data might not hold up, because papers were deliberately selected that described something completely new, such as fresh approaches to targeting cancers or alternative clinical uses for existing therapeutics. Nevertheless, scientific findings were confirmed in only 6 (11%) cases. Even knowing the limitations of preclinical research, this was a shocking result.”

Page 5: How Often Are Studies Wrong?
Page 6: How Often Are Studies Wrong?
Page 7: How Often Are Studies Wrong?
Page 8: How Often Are Studies Wrong?

"An analysis of past studies indicates that the cumulative (total) prevalence of irreproducible preclinical research exceeds 50%, resulting in approximately US$28,000,000,000 (US$28B)/year spent on preclinical research that is not reproducible—in the United States alone."

Page 9: How Often Are Studies Wrong?
Page 10: How Often Are Studies Wrong?

Retractions on the Rise

http://pmretract.heroku.com/byyear

Page 11: How Often Are Studies Wrong?

Which Journals Retract?

-Infection and Immunity 2011

Page 12: How Often Are Studies Wrong?

What Scientists Are Doing About It

Page 13: How Often Are Studies Wrong?

What Scientists Are Doing About It

Page 14: How Often Are Studies Wrong?

Contact Info/[email protected]

http://retractionwatch.com

@ivanoransky

Thanks:

The MacArthur Foundation

The Arnold Foundation

The Helmsley Trust

Nancy Lapid, Reuters Health