THE ROLE OF DOAJ IN QUALITY ASSURANCE OF

OPEN ACCESS PUBLISHING

ISMTE BEIJING 2017MARCH 26-29, 2017

TOM@DOAJ.ORGEDITOR-IN-CHIEF DOAJ

 

You are free to:

Copy, share, adapt, or re-mix;

Blog, live-blog, or post video of;

This presentation. Provided that:

You attribute the work to its author and respect the rights and licenses associated with its components.

Slide Concept by Cameron Neylon, who has waived all copyright and related or neighbouring rights. This slide only ccZero.Social Media Icons adapted with permission from originals by Christopher Ross. Original images are available under GPL at;http://w w w.thisism yurl.com /free-dow nloads/15-free-speech-bubble-icons-for-popular-w ebsites

• W h a t i s t h e q u a l i t y o f a j o u r n a l ?• Quality of publishing（出版的质量）• Quality of the science （科学的质量）

• I n d e x i n g s e r v i c e s : S C O P U S, Wo S , D O A J• D O A J c r i t e r i a f o r g o o d p u b l i s h i n g p r a c t i c e s• D O A J c r i t e r i a f o r g o o d o p e n a c c e s s• O p e n a c c e s s c o p y r i g h t a n d l i c e n s i n g• H o w i s s c i e n t i fi c q u a l i t y m e a s u r e d ?• D O A J u s e s i n d i r e c t q u a l i t y a s s e s s m e n t• A r t i c l e , j o u r n a l , s c i e n t i s t q u a l i t y• C i t a t i o n s , A l t m e t r i c s , J I F, C i t e s c o r e , h - I n d e x• H o w D O A J d e a l s w i t h q u e s t i o n a b l e p u b l i s h e r s

Presentation overview内容概要

• QUALITY OF PUBLISHING （出版的质量）• QUALITY OF THE SCIENCE （科学的质量）

Assessing the Quality of a Journal核期刊的 量审 质

WHAT IS QUALITY?

• DOAJ Directory o f Open Access JournalsO P E N A C C E S S J O U R N A L S O N LY

• SCOPUSO P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S

• WEB OF SCIENCE O P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S

• NATIONAL LISTS O P E N A C C E S S & S U B S C R I P T I O N J O U R N A L S

INDEXING SERVICES数据库收录for quality control

Centrally, publicly and internationally available community-curated list of high quality open access journal titles across all disciplines and languages

The starting point for all information searches for quality, peer-reviewed open access material

A hub for metadata for Open Access articles and journals

What is the DOAJ?DOAJ是什么？

• DOAJ CRITERIA FOR QUALITY OPEN ACCESS PUBLISHING

•Principles of transparency and Best Practice in Scholarly Publishing

•(DOAJ, OASPA, COPE, WAME)

Assessing the Quality of Publishing（衡量出版 量）质

Required information when applying for DOAJ收录DOAJ所需的信息

*Basic requirement（＊为基本要求）

https://doaj.org/publishers

1. Peer review process * 2. Governing Body3. Editorial team/contact* 4. Author fees*5. Copyright&Licensing*6. Identification of and dealing with allegations of research misconduct7. Ownership and management

8. Website*9. Name of journal*10. Conflicts of interest11. Access *12. Revenue sources13. Advertising14. Publishing schedule15. Archiving16. Direct marketing

The Principles （原则）Good Publishing Practice

Journal Web Site * 期刊网站• Dedicated web site per journal – journal

specific web address*• Unique identifier (web address) *:

• Journal level• Article metadata level (also DOI)• Full text article level (pdf, html, xml, epub)

• ISSN (International Standard Serial Number) *• Print ISSN and/or• Online ISSN

Editorial Office & Editorial Team 编辑部 & 编辑团队

• Editor*/Editor-in-Chief/Associate Editor/Co-Editor

• Full names, Affiliations, Countries, Emails*• Postal address of office• Contact information: email/telephone

Author Fees 作者费用• Clearly visible for prospective authors – also if

no charges apply*• Article Processing Charges (APCs)• Article Submission Charges (APCs)• Other fees• Waiver policy

Peer Review Process* 同行评议• Advice on individual manuscripts from

reviewers/ experts in the field who are not part of the journal's editorial staf

• Quality control rigorous• Process & policies clearly described on

journal's web site• Editorial/Peer - Blind/Double blind/Open*

Access & Usage 获取 & 使用• Full text of all content available as Open

Access, no delay/embargo*• How accessible is journal to the rest of the

world, harvesters (TDM Text & Data Mining)• Journal specific OA statement/policy*• Diferentiate between OA statement –

Copyright – Licensing*

Copyrights 权利• Clearly described on web site*• Recommend: author retains copyright• Recommend: no exclusive publishing rights• Recommend: no transfer of commercial

rightshttps://doajournals.wordpress.com/2015/06/02/copyright-and-licensing-part-2/

Content Licensing 内容许可• Clearly described on web site*• Recommend:

• licensing terms on all articles,

all versions (html, pdf, xml etc.)

• embedded in article level metadata

• Creative Commons licensing

• A r t i c l e s o n l i n e f r e e t o r e a d = O p e n A c c e s s ?

A r t i c l e s o n l i n e f r e e t o d o w n l o a d = O p e n A c c e s s ?

• A u t h o r s c a n o n l y u s e a c c e p t e d o p e n a c c e s s a r t i c l e s f o r c l a s s r o o m u s e , p u t t h e m o n t h e i r o w n o r i n s t i t u t e w e b s i t e , m a k e l i m i t e d n r o f p r i n t s i s o p e n a c c e s s ?

• A u t h o r s n e e d t o r e t a i n t h e i r c o p y r i g h t i n O p e n A c c e s s ?

NO

• O p e n A c c e s s n e e d s B O A I s t a t e m e n t o n j o u r n a l w e b s i t e ,

s a y i n g t h e a r t i c l e w i l l b e i m m e d i a t e o p e n a c c e s s , f r e e t o r e a d , d o w n l o a d , d i s t r i b u t e , p r i n t o r u s e f o r w h a t e v e r o t h e r l e g a l p u r p o s e

A N D O p e n A c c e s s n e e d s l i c e n s i n g c o n d i t i o n s t e l l i n g w h o m a y u s e a r t i c l e c o n t e n t a n d f o r w h a t p u r p o s e s f o r i n s t a n c e C C - B Y, C C - B Y- N C , C C - B Y- S A•

Common Misunderstandings on Open Access开放 取常 的 解对 获 见 误

Examples of Copyright & Licensing in Chinese Journals (1)中国期刊的版权规定示例（ 1）• The Shanghai Archives of Psychiatry is an open-access journal. All users have the right to read, download,

copy, distribute, print, search, or link to the full texts of all articles published on Shanghai Archives of Psychiatry. The full text of all articles published since the beginning of 2011 are freely available from the journal’s website or from Pubmed both in html and pdf formats. the copyright is reserved to the Editorial Department of Shanghai Archives of Psychiatry.

• All articles published by JIMW are made available under an open access license worldwide immediately.And COPYRIGHT AND LICENSING is cc by-nc-nd Copyright：《 Journal of Infrared And Millimeter Waves.

Examples of Copyright & Licensing in Chinese Journals (2)中国期刊版权规定示例（ 2）• This journal (CIGR) provides immediate open access to its content on the principle that making research

freely available to the public supports a greater global exchange of knowledge. [no licensing described: open access statement alone insufficient)

• OFTEN SEEN: Only mention of "open access" , no open access statement , no copyright and license description

• Journal: Guoji Yanke Zazhi Accepted papers may not be reproduced by any means, in whole or in part, without the written consent of the publisher.At the same time the journal states : Users are allowed to read, download, copy, distribute, print, search, or link to the full texts of the articles, or use them for any other lawful purpose, without asking prior permission from the publisher or the author.

• International Journal of Ophthalmology. Open access. Accepted papers may not be reproduced by any means, in whole or in part, without the written consent of the publisher. License CC-BY- NC-ND

Examples of Copyright & Licensing in Chinese Journals (3)中国期刊版权规定示例（ 3）• Journal: Knowledge Management Forum.  I use the Creative Commons Attribution (CC BY) agreement to

allow everyone to download, reuse, copy, adapt, disseminate published articles, please refer to the author and article when the source (recommended cited formats such as: Wu Qinghai. Enterprise knowledge extraction Theoretical and Practical Research [J / OL]. Knowledge Management Forum, 2016, 1 (4): 243-250 [Quote Date]. Http://www.kmf.ac.cn/p/1/36/.

• Zhishi guanli luntan 我刊采用知识共享署名（ CC BY）协议，允许所有人下载、再利用、复制、改编、传播所发表的文章，引用时请注明作者和文章出处（推荐引用格式如：吴庆海．企业知识萃取理论与实践研究 [J/OL]. 知识管理论坛 , 2016, 1(4): 243-250[引用日期 ]. http://www.kmf.ac.cn/p/1/36/.）。

• Open access to papers for people for education, research and free download, reading, dissemination and preservation. The copyright of authors and author institutions will be properly protected. Any person who uses the author's essay should accurately mark the author and the paper published information. If a third party uses the content of the paper for commercial purposes or produces derivative works, the author agrees.

• 开放获取论文是供人们为教育、科研而免费下载、阅读、传播和保存。作者和作者机构的著作权将得到妥善保护。任何人在使用作者论文时应准确标注作者及论文出版信息。如果第三方要将论文内容用于商业目的或制作衍生作品，需要得到作者同意。

Copyright & Licensingthe ideal situation最佳的版 定权规

Author retains copyright• Article published using

CC-BYPublisher has copyright• Article published using

CC-BY

DOAJ Seal 印章

o C I TAT I O N A N A LY S I S I S F L AW E D

o Citing does not necessarily mean having read, self-citation, many articles instead of one, many authors per article, author contribution, ghost authors, journal impact factor not related to individual article quality

o P E E R - R E V I E W SY S T E M S H AV E P R O B L E M S

o Fake peer review, biased peer review, experts disagree (too) much in assessments

Assessing Quality of Research核科学的 量审 质

OTHER DRAWBACKS

o IND IVI DUAL CITATI ON SCORE: THE H- I NDEX HIGHEST NUMBER (N) OF ARTICLES WI TH (N) C I TATIONS B ECOMES HI GHER W HEN NUMBER OF PUBLIC ATIONS INCREASES

o THE JOURNAL I MPACT FACTOR ( J IF ) I S HI GHER WHEN A FEW ARTIC LES HAVE HIGH CI TATI ON RATES

o THE J IF I S HI GHLY B I ASED TOWARDS ENGLISH LANGUAGE PUBLIC ATI ONS

Citation Based Metrics 基于引用的指标

Table 2: Percentage of papers published in 2013-2014 with

number of citations below the value of the 2015 JIF.

Larivière et al. (2016)

highly skewed distribution of citations高度不平衡的文献引用分布

doi: http://dx.doi.org/10.1101/062109

o T H E S C I E N T I F I C Q UA L I T Y O F A J O U R N A L C A N N O T B E A SS E SS E D BY T H E AV E R A G E C I TAT I O N S C O R E S O F A RT I C L E S( T H E J O U R N A L I M PA C T FA C T O R J I F )

o T H E S C I E N T I F I C Q UA L I T Y O F A RT I C L E S C A N N O T B E A SS E SS E D BY W H E R E T H E Y A R E PU B L I S H E D

o T H E S C I E N T I F I C Q UA L I T Y O F S C I E N T I S T C A N N O T B E A SS E SS E D BY W H E R E O R H O W M U C H T H E Y PU B L I S H

o S C I E N T I F I C Q UA L I T Y C A N O N LY B E A SS E SS E D O N A RT I C L E L E V E L

Assessing Quality of Research核科学的 量审 质

ALTMETRICSTAKING INTO ACCOUNT CITATIONS, SOCIAL MEDIA,

CONVENTIAL MEDIA (NEWSPAPERS, TV, VIDEO)

RELATIVE CITATION SCORESCITATION INDICES ADJUSTED FOR SCIENTIFIC FIELD

Article Level Impact Assessment基于文献的影 力 估响 评

LEIDEN MANIFESTOdoi:http://dx.doi.org/10.1101/062109

DORAThe San Francisco Declaration on Research Assessmentdoi: 10.1242/dmm.012955

San Francisco Declaration on Research Impact

关于科研影 力的旧金山声明响

http://www.ascb.org/dora/

How we detect questionable journals我们如何发现可疑期刊• Low publishing quality

Journal name, website, fees, peer review, publisher, ownership, volume of articles, advertisements, prominent soliciting for editors

• Low scientific quality focus, format, self-citations, plagiarism

• Malpracticefalse claims, hidden costs, spamming authors, wrong information

The problem of questionable journals

Questionable Publishing in Perspective对于可疑出版行为的看法• Beall’s list has promoted a belief that open

access publishing is synonymous with bad publishing

• But bad publishing exists in subscription based publishing as well (consult Retraction Watch)

The problem of questionable journals

Questionable Publishing in Perspective对于可疑出版行为的看法• Not as frequent as suggested in open

accessaccording to a study* by Walt Crawford the number

questionable journals in 2014 was about 3275 publishing about 121,000 articles (Shen and Björk reported 8000 journals and 420,000 articles!!)

• Proportion of low quality journals is comparable between open access and subscription publishing

FACTS• Not all subscription journals are in Scopus : only 10-20,000 of 100,000 (data Ulrich’s

Web)• Not all open access journals are in DOAJ : only 8 -10,000 of 30,000 **

CONCLUSION Percentage of Quality Journals is comparable

Shen and Björk.  BMC Medicine201513:230

* Source : http://walt.lishost.org/2015/11/ppppredatory-article-counts-an-investigation-part-1/** Source: Walt Crawfordhttp://citesandinsights.info/civ17i1.pdf

IF OPEN ACCESS WERE REALLY SUCH LOW QUALITY.... .

W H Y W O U L D B I G PU B L I S H E R S S W I T C H T O O P E N A C C E SS ? W H Y W O U L D 3 0 % O F A L L S T M PA P E R S T O D AT E B E PU B L I S H E D U S I N G O P E N A C C E S S ? W H Y W O U L D O P E N A C C E SS G R O W AT T W I C E T H E R AT E O F S U B S C R I P T I O N B A S E D A C C E SS ?•

The Reality of Open Access关于开放 取的事获 实

OPEN ACCESS.....• A RT I C L E S R E C E I V E M O R E C I TAT I O N S• R E A C H E S A B I G G E R A U D I E N C E• L E A D S T O B E T T E R E D U C AT I O N• AVO I D S D U P L I C AT E S T U D I E S• A RT I C L E S C A N B E M O R E E A S I LY C H E C K E D• D ATA L E SS P R O N E T O M A N I PU L AT I O N• I S B E T T E R F O R A DVA N C I N G S C I E N C E• L E A D S T O M O R E I N N OVAT I O N

The Reality of Open Access真正的开放 取获

Thanks to :

Xin Bi and the Xi'an Jiaotong-Liverpool University , all the Library Consortia, Universities and Publishers and our Sponsors for the financial support to DOAJ!感谢我们所有的图书馆联盟，大学，出版商和赞助商对 DOAJ的财政支持！

Thank you for your attention!谢谢你们的关注！tom@doaj.org

lars

lars@doaj.org

DOAJ depends entirely on donations

https://doaj.org/membership