Publishing strategies – A seminar about the scientific publishing landscapePeter Sjögårde, Bibliometric analyst

KTH Royal Institute of Technology, ECE School of Education

and Communication in Engineering Sciences (ECE), Unit for

Publication Infrastructure

ARC – 2014-11-25

Outline

1. Introduction to bibliometrics

2. Publishing strategies

What is bibliometrics and why bother about it?

Is someone reading and building on your results?

Statistics on publications and citations

Measuring Impact on research society

Used for evaluation of research• Publication level• Individual level• Organizational level

Research Publication A

ReaderWriter Publication B

with Reference to the publication A

Citation

Impact?

• On society• On industry• On research community

As measured by the use of bibliometrics (citations)

Citation indicators > Research Quality

• Correlation between peer review assessments and bibliometric indicators.

• High quality necessary to receive high citation scores at aggregated levels.• But not enough

• There are research groups who get good judgments by reviewers but has low citation scores. Applied research and research for which the bibliometric methods are insufficient.

Lutz Bornmann and Hans-Dieter Daniel, “Selection of Research Fellowship Recipients by Committee Peer Review. Reliability, Fairness and Predictive Validity of Board of Trustees’ Decisions,” Scientometrics 63, no. 2 (April 1, 2005): 297–320, doi:10.1007/s11192-005-0214-2; A. F. J. van Raan, “Advanced Bibliometric Methods as Quantitative Core of Peer Review Based Evaluation and Foresight Exercises,” Scientometrics 36, no. 3 (July 1, 1996): 397–420, doi:10.1007/BF02129602; Charles Oppenheim, “The Correlation between Citation Counts and the 1992 Research Assessment Exercise Ratings for British Research in Genetics, Anatomy and Archaeology,” Journal of Documentation 53, no. 5 (December 1, 1997): 477–87, doi:10.1108/EUM0000000007207; Fler studier är refererade i Bornmann and Daniel, “What Do Citation Counts Measure?”; och i Blaise Cronin, The Hand of Science: Academic Writing and Its Rewards (Lanham, Md: Scarecrow Press, 2005), 125–129

Differences between research fields affecting bibliometric indicators

• Publication pace (time for publishing and peer review process)• Size of research field• Coverage of publications in citation database• Number of references• Length of publications• Document type (e.g. reviews get more citations, proceedings

papers are often excluded)

Field normalized citation rate

For a publication:

Same research field same yearsame document type

Average = 1

Bibliometrics at KTH

• Research Assessment Exercise (research groups, UoA)• Yearly indicator report• Funding allocation

• Journals’ mean field normalized citation rate• Multiplied with the number of faculty

• Reports and analyses on demand from management and schools

• Consultancy work for other universities

New bibliometric indicator for funding allocation at KTH

Why? • Incitement to publish in highly cited journals indexed by

Web of Science.

Field normalized journal impact• Average of the citation rate of the journals in which KTH:s

researchers have published the last three years.• Calculated for each department. Multiplied with the

number of faculty at each department.• Aggregated to Schools and used for allocation to the

Schools.

Outline

1. Introduction to bibliometrics

2. Publishing strategies

What should a researcher think of when publishing?

1. Quality of the research and publication

2. Making the research visible- Reaching other researchers (citers)

Research Publication A

ReaderWriter Publication B

with Reference to the publication A

Citation

From paper to reader/citer

Publishing strategies

1. Planning the publishing of the research results

2. Choosing publishing channel and making the research available

3. Collaboration, networks and communication

4. Open Access

1. Planning the publishing of the research results

- Formal/Informal communication

1. Planning the publishing of the research results

- Formal/Informal communication- Choosing publication type

Article in journal Book Chapter in book Conference Paper0

2000

4000

6000

8000

10000

12000

14000

16000

Number of KTH publications in Web of Science and DiVA (RAE2012)

Web of Science

DiVA

1. Planning the publishing of the research results

- Formal/Informal communication- Choosing publication type- Quality vs. Quantity

1. Planning the publishing of the research results

- Formal/Informal communication- Choosing publication type- Quality vs. Quantity- Publishing the same results in multiple publications

1. Planning the publishing of the research results

- Formal/Informal communication- Choosing publication type- Quality vs. Quantity- Publishing the same results in multiple publications- Search-ability

1. Planning the publishing of the research results

- Formal/Informal communication- Choosing publication type- Quality vs. Quantity- Publishing the same results in multiple publications- Search-ability- Language

2. Choosing publishing channel and making the research available

- The subject relevance of the publishing channel and the outreach within the research area

2. Choosing publishing channel and making the research available

- The subject relevance of the publishing channel and the outreach within the research area

- The availability of the publication

2. Choosing publishing channel and making the research available

- The subject relevance of the publishing channel and the outreach within the research area

- The availability of the publication- The permanency of the availability of the publication

2. Choosing publishing channel and making the research available

- The subject relevance of the publishing channel and the outreach within the research area

- The availability of the publication- The permanency of the availability of the publication- The indexing of the channel in databases

2. Choosing publishing channel and making the research available

- The subject relevance of the publishing channel and the outreach within the research area

- The availability of the publication- The permanency of the availability of the publication- The indexing of the channel in databases- Citation rate of journals

Journal Impact Factor (JIF)

Citations/Paper

Thomson Reuters description http://thomsonreuters.com/products_services/science/free/essays/impact_factor/

Citations from 2012

Papers from 2010-2011

SNIP and SJR

Alternative to JIF

Scopus data - Different coverage

Normalized to field

Find Journal indicators:

https://www.kth.se/kthb/publicering/bibliometri/faq-biblimetrics/faq/journal-impact-factor-and-alternative-journal-metrics-1.436351

2. Choosing publishing channel and making the research available

- The subject relevance of the publishing channel and the outreach within the research area

- The availability of the publication- The permanency of the availability of the publication- The indexing of the channel in databases- Citation rate of journals- Availability of meta data

2. Choosing publishing channel and making the research available

- The subject relevance of the publishing channel and the outreach within the research area

- The availability of the publication- The permanency of the availability of the publication- The indexing of the channel in databases- Citation rate of journals- Availability of meta data- Using DiVA for dissemination of publications

3. Collaboration, networks and communication

- Participation in the communication within the research area

3. Collaboration, networks and communication

- Participation in the communication within the research area

- Participation in conferences

3. Collaboration, networks and communication

- Participation in the communication within the research area

- Participation in conferences- Collaboration with other researchers (Internationally)

3. Collaboration, networks and communication

- Participation in the communication within the research area

- Participation in conferences- Collaboration with other researchers (Internationally)- References as means of communication

3. Collaboration, networks and communication

- Participation in the communication within the research area

- Participation in conferences- Collaboration with other researchers (Internationally)- References as means of communication- Digital social networks

3. Collaboration, networks and communication

- Participation in the communication within the research area

- Participation in conferences- Collaboration with other researchers (Internationally)- References as means of communication- Digital social networks- Research profiles in Google Scholar, ResearcherID,

Orcid, KTH´s web

4. Open Access

- OA to research publications

Open Access

Green – Parallel publishing

Gold – Publishing in Open Access journals

Open acccess and the publishing infrastructure

More impact/citations with Open Access?

Some studies show that OA articles get more downloads and more citations - Other show no advantage - debate is still going on

• More possible citers• Easier access• Easier indexing for web crawlers• Better visibility outside the research community• Easier to share in social media and other networks

Traditional, subscription accessed high impact journalor new Open Access journal?No contradiction between OA and high impact factor journals• If choosing to publish in OA journals the same recommendations apply

– Check outreach and impact– Check the peer review process– Relevance– …

4. Open Access

- OA to research publications- OA to research data and/or software

Further information

www.kth.se/kthb > Publishing

For publishing strategies see p.37 in ”Projektrapport – Fördjupande studie av KTH:s publikationskultur med högre citering som mål” (in Swedish)

https://www.kth.se/polopoly_fs/1.508323!/Huvudrapport_KTHs_publiceringskultur.pdf

Thank you!

Peter Sjögårde, Bibliometric Analyst

pi@ece.kth.se

KTH Royal Institute of Technology

School of Education and Communication in Engineering Sciences (ECE)

Unit for Publication Infrastructure