Journal Quality

Improvement &

BenchmarkingPractical Tools and Tips

Dju-Lyn Chng

Solution Consultant, ASEAN

dju-lyn.chng@Clarivate.com

2

Web of Science Content Curation Criteria

Citation Analysis

International Diversity

Editorial Content

Journal Publishing Standard

SCIESSCI AHCI

ESCI

Publishing Quality Publishing Impact

WOS CORE

3

Publishing Quality

Improved

Publishing Quality

Identify Emerging

Trends

Attracting highly cited

authors

Improve peer review standards

Identifying Emerging

Trends Using

Web of Science

5

Data in Web of Science is used to determine….

• Highly Cited Paper

– A paper published in the past 10 years that belongs to the

top 1% of papers in a research field published in a

specified year.

• Hot paper

– A paper published in the past 2 years that received a

number of citations in the most recent two-month period

that places it in the top 0.1% of papers in the same field.

6

Identify Emerging Trends in your Field

DEMO

Analysing your journal’s

Author Diversity

8

Improving Author Diversity

• Is your Journal National/ Regionally/ Internationally focused?

• Analyze your author diversity based on your scope

9

What is the author diversity make-up of your journal?

International

focus

44 Countries/territories

DEMO

Attracting High Quality

Authors, Reviewers and

Editorial Members

11

Using WOS to find potential authors

DEMO

13

Publons provides free profiles for researchers and lets them effortlessly

track, verify and showcase their peer review and editorial contributions

across the world's journals.

● Cross-publisher

recognition for

peer review

● Verified record of

review and

editorial work

● Reviewer

anonymity

maintained

according to

journal policy

Recognise your Reviewers

Public reviewer profile

14

Researchers will be more likely to review for, and submit to, your

journals

"Publons has definitely made the reviewing

process more rewarding and enjoyable!”

- Sadaf Atarod, Postdoctoral Associate -

Center for Regenerative Medicine, Boston

University

“I’m more likely to submit papers to and more

likely to review papers for [partnered journal]. ”

- Rob W. Briddon

"It was a little easier spending [the morning] on

manuscript review knowing, even if comments are

ignored - I still get some credit...I also believe I am

much more constructive and spend more time

explaining issues and offering solutions. Thanks

Publons.”

- Steven B. Roberts, University of Washington

Editorial Board - Scientific Data

""Yes, I am more likely to carry out a review now.

I feel that Publons does deliver on helping me

get credit for peer review.”

- Alex Bateman, Head of Protein Sequence

Resources - EMBL European

Bioinformatics Institute - Present

48% Just as likely

as before

20% Far more

likely

30% More

likely

15

Create your own Journal’s Dashboard on Publons – Free!

16

Use a Robust Reviewer Search Tool

17

18

19

Conduct a Citation

Health Check

The Difference Between Good and Great

21

o Journal self-citations?

o Author/EB self-citations?

o Is the journal Cited?

o Is authors' prior work cited?

o Is Editorial Board members' prior work cited?

o Rank in category (by JIF/Quartile)

Conduct a Citation Health Check

DEMO

22

Citation Analysis – How to calculate your journal’s impact factor?

2015 2016 2017

IF2017 =Citations in 2017 to items published in 2015 + 2016

Number of citable items in 2015 + 2016

23

o 2017 Citations for 2015 + 2016

content = 76

o Total 2015 + 2016 Citable Items =

173

o 2017 Impact Factor = 76/173 =

0.439

Example: Estimated JIF for “Australasian Medical Journal”

DEMO

24

Now It’s your turn to calculate your journal’s Impact Factor for 2017

2015 2016 2017

IF2017 =Citations in 2017 to items published in 2015 + 2016

Number of citable items in 2015 + 2016

Journals Benchmarking

using InCites

26

What data is available in InCites™ Benchmarking & Analytics

InCites™

Benchmarking &

Analytics is built upon

a comprehensive set

of data from the Web

of Science™

27

Full cover-to-cover

indexing with every

author and their

affiliations captured

The default InCites

dataset spans 1980 to

the present day

(updated every two

months)

28

Article and

journal-level

indicators

include

And offer a wide range of possible

analyses such as

With InCites™ Benchmarking & Analytics

Understand the impact of authors and their papers

Analyse competitors and peers, find strengths and weaknesses

Contextualise performance with normalization and benchmarking

Compare publications, articles, institutions, funders, on a wide range of criteria

Demonstrate the effectiveness of a publishing strategy

30

The focus today…

o Where is my journal’s relative position in the subject category?

o What is my journal’s estimated quartile?

31

Before we dive deep… Normalizing & Benchmarking 101

25

0

100

0

GOOD

BAD

Is Good or Bad?

Context is Everything

Indicators must be put in context to be useful:

Category, Journal, Peers, Global

Normalized Indicators: for relative performance comparisons

Percentiles: where does it fall in the range of values?

Benchmarks: how does it compare in a group or globally?

32

Journal ranking is subject dependent

min

max

25%

25%

25%

25%median

Q1

Q2

Q3

Q4

Imp

act

Fa

cto

r

33

Let’s get started…

o Sample journal: “AUSTRALASIAN MEDICAL JOURNAL”

o Self Calculated 2017 Journal Impact Factor: 0.439

34

Where is my journal’s relative position in the subject category?

• Search for your journal in InCites and identify the subject category it is indexed in

• Search for all journals in your subject category

• Sort by Journal Impact Factor

DEMO

35

Further understand your journal

• Find out who are your contributing authors

• Where else are they publishing in? (Thus identifying competing journals)

• Which of papers are contributing to your journal’s citation counts?

36

Who are the highly cited authors contributing to my journal?

37

Where are your authors publishing? And identify competing

journals?

• Search for your author name in Web of Science

• Analyze his/her output to see what journals they are publishing in

38

Conduct Article-Level Analytics

• Which articles are cited more?

• Gives insight into what content appeals to your readers

39

In Summary

• Make use of tools like the Web of Science to gain insights and identify

areas of improvement for your journal

• Attract good peer reviewers and authors by recognizing their peer review

work using Publons

• Adjust your publishing strategies after using benchmarking tools like

InCites to gauge your journal’s standing within category