Innovation in peer review

25
Maria Kowalczuk, PhD Deputy Biology Editor, BioMed Central Innovation in Peer Review http://www.meta-activism.org/2011/05/fixing-peer-review-freeing- knowledge-creation/

description

 

Transcript of Innovation in peer review

Page 1: Innovation in peer review

Maria Kowalczuk, PhDDeputy Biology Editor, BioMed Central

Innovation in Peer Review

http://www.meta-activism.org/2011/05/fixing-peer-review-freeing-knowledge-creation/

Page 2: Innovation in peer review

Traditional peer review

• Peer review in the current form has been used since 1960s.

• Traditionally scientific journals use single blind peer review or double blind peer review models.

• Online publishing and open access have changed the publishing landscape while peer review process has remained the same.

Page 3: Innovation in peer review

Pitfalls of traditional peer review• Slow• Expensive to manage• Inconsistent • Bias• Favouritism• Abuse

http://www.eusci.org.uk/articles/exploring-scientific-peer-review

Page 4: Innovation in peer review

Innovative peer review models• Open peer review• Minimal re-review• Portable peer review• Technical peer review• Decoupled peer review• Post publication peer review

http://www.bishop-hill.net/blog/2011/3/20/peer-review-not-for-the-short-sighted-josh-87.html

Page 5: Innovation in peer review

Open (non-anonymous) peer review

Randomised Controlled Trial (BMJ 1999; 318: 23 – 27): - no effect on report quality, recommendation, or time taken to review- increased likelihood of reviewers declining to review

Page 6: Innovation in peer review
Page 7: Innovation in peer review
Page 8: Innovation in peer review
Page 9: Innovation in peer review
Page 10: Innovation in peer review

Biology Direct PubMed record

Page 11: Innovation in peer review

Publishing peer review documents

- In all 4 EMBO publications, including EMBO J, EMBO Reports- ‘Peer Review Process File’ shows all referee reports , author responses and editorial

decision letters- Referees remain anonymous; opt-out is possible - 95% of take-up rate; willingness of referees to review unchanged

Page 12: Innovation in peer review

Authors can opt out of re-review; if the editors judge the revisions sufficient, the article is published, often accompanied by a critical Commentary.Discussed in Editorial: http://www.biomedcentral.com/1741-7007/11/18.

Re-review opt-out – BMC Biology

Page 13: Innovation in peer review
Page 14: Innovation in peer review

Portable peer review

Flagships

Subject-specific journals

BMC Research Notes

BMC seriesBMC NeuroscienceBMC Public Health

BMC Independent Journals

Page 15: Innovation in peer review

Neuroscience Peer Review Consortium

Page 16: Innovation in peer review
Page 17: Innovation in peer review

Technical peer review

Page 18: Innovation in peer review
Page 19: Innovation in peer review
Page 20: Innovation in peer review
Page 21: Innovation in peer review
Page 22: Innovation in peer review
Page 23: Innovation in peer review

Post publication peer review via comments

• PubMed Commons• PubPeer.com• Research Gate• Frontiers• BioMed Central and other publishers

Page 24: Innovation in peer review

Conclusions Peer review is under scrutiny Developments in peer review include:

Open peer reviewMinimizing re-reviewPortable peer reviewTechnical peer reviewPeer review decoupled from journalPost publication peer review

Page 25: Innovation in peer review

Thank you!Maria Kowalczuk, PhD

Deputy Biology Editor, BioMed [email protected]

Any questions?