Research evaluation and academic publishing

Marina Carbonell Biblioteca d’Humanitats Juny 2014

Credits • Some slides are extracted and contents are the

following educational materials:

Bibliotecnia. UPC La publicació i avaluació de la recerca.

[Presentacions]. [Consulta 29.05.14] Disponible a:

http://www.slideshare.net/

Alexandre López-Borrull, UOC (Jul 21, 2011). Articles i

Revistes Científiques a Internet. [Presentacions]. [Consulta

29.05.14] Disponible a: http://www.slideshare.net/

Contreras, Núria. Eines de suport a l'acreditació i

avaluació de la recerca [Presentacions]. [Consulta 29.05.14] Disponible a: http://ddd.uab.cat/

3

What does it involves?

• Authors and their new ideas.

• Dissemination and impact of these ideas.

• Value of the publications in which these ideas are published.

Research evaluation

4

• Of an article: number of citations in academic journals

• Of an author: h-index

• Of a journal:

• Observance of quality criteria, ex. Latindex / DICE

• Appearance in databases, ex. Arts and Humanities Citation Index, Bibliographie Linguistique, and derived calculations, ex. ICDS (MIAR)

• Calculations based on the number of citations, ex. JCR impact factor, SJR (SCIMAGO), etc.

Impact factors

5

Impact factors of an article

• Web of Science:

• Searching that article using the Cited Reference Search option on http://www.accesowok.fecyt.es/

• SCOPUS: Searching that article on http://www.scopus.com

•Citeseer http://citeseerx.ist.psu.edu/

•Citebase Search: use with prudence http://www.citebase.org/

•Google Scholar http://scholar.google.es/

6

Appearence on social networks

• The influence of an article can be appraised through its impact on popular social networks (Twitter, Facebook, LinkedIn, etc.) as well as academic ones (Mendeley, ResearchGate, Academia.edu, etc.). In this case some Altmetric tools can be used.

• Altmetric indicators can be obtained using applications for web browsers, mobile devices or bibliographic databases.

Impact factors of an article

7

Impact factors of an author

h-index

•It’s based on the author’s most cited papers and the number of citations of each of these papers. It’s the only index that focuses on the author and not on his/her articles.

How is it calculated?

•It can be calculated by listing the articles according to the amount of citations in descending order. Each article is assigned a correlative number. The point in which the assigned number is the same or greater than the number of citations is called the h-index.

Where to look it up?

•Web of Knowledge www.accesowok.fecyt.es/login/ (UAB network)

By searching the author on Web of science and selecting Create citation report.

•Scopus www.scopus.com/ (UAB network)

By searching the author on Author search and selecting View citation overview (Only from 1996 on.)

8

1.- Enter Web of Science: http://www.accesowok.fecyt.es/login/

2.- Search the articles by an author. The h-index can be applied to any list of articles. For instance, academic papers by Prof. Antonio Armario:

h-index on WoK (I)

9

3.- Click on this icon:

h-index on WoK (II)

10

4.- Look up the h-index on the citation report.

h-index on WoK (III)

11

5.- In this example the h-index is 28. Following the list of articles in descending

order of citations we find a orange line. This indicates that the article appearing in the 28th position has 28 citations or more.

h-index on WoK (IV)

12

The quality of academic journals is usually appraised through their impact according to the following criteria:

• Impact factor (or impact index) • Immediacy index • Quartile • SJR (SCImago Journal Rank) • SNIP (Source Normalized Impact per Paper)

Impact factors of a journal

13

What is it?

• It indicates the impact of a journal on academic literature through the number of citations its articles have.

How is it calculated?

• Number of citations within one year for the articles published in a journal the previous 2 years divided by the total number of articles published in that journal these previous 2 years.

Example:

Number of citations in 2012 for articles published in 2010 and 2011

Impact factor 2012 = __________________________________________________

Number of articles published in 2010 and 2011

What is it for?

- To compare journals on a specific field.

- To set up rankings and reflect the relative relevance of any title.

- To make decisions, as it is used to appraise the quality of a journal and has great influence.

Impact factor

14

Where to look it up?

•Journal Citation Reports (JCR) – Social sciences edition

www.accesowok.fecyt.es/login (UAB network)

•IN-RECS (Índice de impacto-Revistas españolas de ciencias sociales) ec3.ugr.es/in-recs

•RESH (Revistas Españolas de Ciencias Sociales y Humanidades) epuc.cchs.csic.es/resh

Impact factor

15

What is it?

It is an indicator to evaluate the relative relevance of a journal amongst the whole set of journals within an academic field.

How is it calculated? If a list of journals in descending order according to their impact factor is divided in four equal parts, each part is called a quartile. The journals with a higher impact factor are in the upper section (quartile 1) while the ones with a lower factor are at the bottom section (quartile 4). Quartiles 2 and 3 are in the middle. For instance, in a list containing 100 titles, quartile 1 contains the 25 titles with a higher impact factor, which are therefore most appreciated by researchers.

Where to look it up? Journal Citation Reports (JCR)

IN-RECS i IN-RECH

Quartile

16

What is it?

It indicates the speed an article is cited and the frequency of citations of a journal within one year time. A high immediacy factor means that journal publishes leading articles.

How is it calculated?

It is calculated dividing the number of citations of the whole set of articles of a journal published within one year by the total number of articles published within that year.

Where to look it up?

Journal Citation Reports (JCR)

Immediacy index

17

To search the impact index of the following journal: Language in Society

1.- Enter Web of Science: http://www.accesowok.fecyt.es/jcr

2.- Select JOURNAL CITATION REPORTS (JCR)

Impact factor of a journal on JCR (I)

18

4.- Select edition and year and “Search for a specific journal”.

5.- Although any field can be used, ISSN is recommended.

Impact factor of a journal on JCR (II)

19

6. - Click on the title to access all the related information.

7.- The immediacy index is provided as well.

8.- Click on the link and then on “Journal ranking”.

Impact factor of a journal on JCR (III)

20

9.- Quartile is provided here.

Impact factor of a journal on JCR (IV)

21

SJR (SCImago Journal Rank)

What is it?

• It reflects the prestige of a source, according to the idea that “not all citations are equal”. With SJR research field, quality and reputation of a journal have a direct impact on the value of a citation. That means that a citation in a source with a high SJR index has more value than a citation in a source with a low SJR.

How is it calculated? • It is calculated using the PageRank algorithm (created by Google).

Where to look it up? • Scopus : www.scopus.com (UAB network). See Analytics.

22

SNIP (Source-Normalized Impact per Paper)

What is it? • It indicates the contextual impact of each citation in

relation to the entire amount of citations in a specific field.

How is it calculated? • The impact of a citation is assigned a higher value in

those fields with lesser frequency of citations and viceversa.

Where to look it up? • Scopus www.scopus.com (UAB network). See

Analytics.

23

1.- Enter Scopus: http://www.scopus.com

2.- Click on Analyze Journals

3.- Search Translation review

SCOPUS (I)

24

4.- Scimago Journal Rank (SJR) and related qualitative data are provided here.

SCOPUS (II)

25

SCOPUS (III)

26

Entities that evaluate and certify research

• CNEAI (Comisión Nacional Evaluadora de la Actividad Investigadora)

• ANECA (Agencia Nacional de Evaluación de la Calidad y Acreditación)

• AQU (Agència per a la Qualitat del Sistema Universitari de Catalunya)

27

Índexs i Bases de dades que valoren la investigació

http://www.bib.uab.cat/human/acreditacions/planes/publiques/index.php

28

29

30

31

RETI/REAO In these pages you will find a list of academic journals in this area of knowledge with the quality indicators of the different resources evaluated by the accrediting bodies: AQU, ANECA and CNEAI. We have added more information, including links to various bibliographic catalogs, the requirements for the publication of articles

according to the publisher and the permissions for self-archiving. http://www.bib.uab.cat/human/acreditacions/planes/publiques/revistes/eti.php?area=eti&menuidioma=eng

32

33

34

35

36

• Scientific publication must be original and contribute something new to a scientific discipline.

• Scientific publication provides recognition. It is the only way to obtain the approval of the scientific community and the admission as a scientist. It is also the only way to ensure that science reaches the next generations of scientists.

• The fact that scientific publications are reviewed and following a peer-review process determines the articles presented, which pretend to discourage reviewers by providing a detailed section on methodology and sources of information.

Scientific publication

37

Current research

Get teams working on the same issues

Suggestion for a later article

Limited diffusion

Create a network of affinities

Completed research

Wide circulation among the academic community

Publish original research for the 1st time

The most recognized of scientific papers

Traditional publishing models

Presentation at a congress

Article in a journal

38

1. Choose a topic relevant, original and interesting today.

2. Search for partners (if possible, international).

3. Make a work well written, well organized, well presented...

4. Make a good bibliographic review (international, current...).

5. Select the appropiate journal.

6. Follow the instructions to authors of the journal.

7. Ask the opinion of colleagues.

8. Publish it also in institutional and academic repositories.

9. Spread the work with Web 2.0 tools.

10. Manage your digital identity correctly.

What to consider when publishing:

39

• Title (informative) • Signatories (appointment and contact details) • Summary • Keywords • Introduction • Methodology • [Body] • Results and conclusions • Bibliographic references

Structure of a scientific article

40

• Scientific journals are not all equal...

• ... And when choosing a scientific journal take into account...

– Prestige Dissemination and impact International scope Presence in databases Distribution Thematic scope

Speed of publication Membership in an association Review process Works property, OA (journal, deposit)

Choose the journal

Swan, A. What authors want: the ALPSP research study on the motivations and concerns of contributors

to learned journals. Learned publishing 1999; 12(3): 170-172

41

Process of an article

eprint preprint

postprint reprint

42

As part of research the author of the article:

• Writes the article

• Searches for a journal in which to publish

• Is submitted to the review process

• In case of acceptance

– Reviews the text and makes the appropiate changes in content and/extension

– Adjusts the text to the editorial standards

• Delivers the document in due time

• Makes a celebration !!

Process of publication

43

• Beware of the title, the summary and the first pages. They are crucial because the publishers have to choose the reviewers.

“First impressions are strong impressions; hence, the title should be well studied and give; insofar as permitted by the limits, a clear and concise indication of things to come.” T. Clifford Allbutt

• Take a look at the members of the editorial board.

• Respect scrupulously the instructions for authors

• Check the style of your thecnical and scientific text

Advises

44

It is essential to cite sources but also: • It should be done well and in a standardized way (ISO

690, APA, Chicago, MLA...)

Why? • For readers to be able to find the referenced sources

• Because the ref. are cited and used in the indexes (network of relationships among articles)

Bibliographic references

45

Peer review system

Reception of the article

Preliminary selection

Peer Review

Collects reviews

The author modifies the article

Article refused

Article accepted

Publication of the article

Janette K. Klingner, David Scanlon and Michael Pressley. How to Publish in Scholarly Journals Educational Researcher November 2005 34: 14-20

Submitting the results of an investigation

46

• Once the editorial board admits a work which meets the general conditions of the magazine:

• Internal review (experiences, resources evaluation works, etc.)

• External review (of the articles) by a Scientific Committee or Advisory Counsel

• External review:

• Peer-review system (review by experts or arbitration):

– Open review (the evaluators’ names are known)

– Double-blind system (both the evaluators and the author are kept anonymous)

How do magazines evaluate the articles

47

The results of the external review can be:

• It’s unconditionally accepted

• It’s accepted but with the condition of some changes or improvements

• It’s refused but the author is encouraged to review it soundly

• It’s unconditionally refused

How do magazines evaluate the articles

48

It’s not an irrevocable decision

DO INSIST

What if your article is refused?

49

• Open access magazines

• Institutional repositories

• Blogs

• Podcasts

• Wikis ...

New models of publication

50

Access to scientific

information without barriers

51

What is open access? Access to scientific information without barriers

Open Access (OA) to scientific information consists of deposit research production

in the net freely and free of charge as an alternative to the model of paying for

access to information generated by the own institutions.

52

• Copyright

• Thinking that open access magazines don’t

have an impact factor

• Also thinking that they don’t have a review

process (‘peer review’)

• Fear of plagiarism

• Not knowing about the existence of the diposit

and the procedure

• Losing time

The brakes

53

• More visibility for authors and for institutions.

• Guarantees the preservation and conservation.

• Favors the impact of research results.

• Stable computing environment

• Platform to host unpublished documents

• Fix URL

• Standardized and interchangeable description

• Full text search

• Grouping of own scientific production in full text

• Benefits for the scientific community

• Customized statistics

The advantages

54

Intellectual production of the researcher: copyrights

• You must manage correctly the copyrights of your works. Controling them will facilitate their open publication and its diffusion by different means, therefore increasing the visibility and impact of the results of your research.

• From the very moment of the creation of a scientific article, law guarantees your rights as an author and you are the owner of these rights. As such, you have control over the possible uses of your work.

55

Copyrights

Author

Connected

Moral rights: Being recognized as the author

Exploitation: • Copy • Distribution • Public communication • Transformation • Remuneration for private copy

A. Rights

Intellectual property

56

Relationship publisher-author or viceversa

• Publishers of scientific magazines will require you to post your article that you cede your exploitation rights by means of a written contract. This cession can be exclusive.

• If you cede your rights exclusively, you will have to ask permission from the publisher to make any change on your article.

57

So, if you want to reuse your article, you must:

• Know the contracts and aggreements about rights established by the publishers.

• These aggreements are not standardized and you won’t find them easily in the publishers or magazines’ web pages. It’s more usual to find them with the guidelines for the author, that you may find in the publisher page under the following epigraphs : author’s side, author’s rights, publicaen, etc.

58

How to know the publisher’s policy:

Sherpa-Romeo: Publisher copyright policies, specially

abroad and self-archiving. (International Journal of Advertising, Sage Publications)

Dulcinea: Publisher policies about patrimonial rights and self-

archiving permissions of Spanish science and law magazines. (Comunicación y sociedad, Creatividad y sociedad)

Héloïse: Publishers policies about self-archiving of magazines,

specially French (Documentaliste-Sciences de l’information)

59

Publishing in open access • Thanks to initiatives as open access, many publishers

now let the authors to post copies of their articles in their personal web pages. Or to deposit them in digital archives known as deposits or repositories, where people has an open access to them through Internet

• The two main types of deposit are: – institutional deposits, which get all the scientific production

from a university or research center : DDD (UAB) – thematic deposits, which give access to works of authors from

different institutions, specializing in one or more disciplines

60

• When an author deposits an article or any other work in one of those archives, that’s called self-archiving

• Based on the conditions established by the publishers, the author can self-archive different versions of his/her article, the preprint which still has not been reviewed, or the postprint, the article after the peer-review. In this last case, you can use both the author’s version or the publisher’s version on pdf

Self-archiving

61

• If you, as an author, don’t aggree with the conditions established by the publisher in the aggreement he/she asks you to sign, you can negotiate with him/her by means of an addendum describing the rights you want to retain, ask your publisher to accept a modification in the aggreement about the policy of self-archiving.

Examples: • Scholar Copyright Addendum Engine: scholars.sciencecommons.org

• Science Commons (CC)

• Model amendment to publishing agreement (Open access in FP7)

Addendum

62

Open access magazines

• Some publishers, and there’s more of them every day, give open access to their magazines through the Internet and use to let the authors keep all their rights. They are known as open access magazines. Some of them permit the reuse of the articles with minimum restrictions, for instance, the articles can be translated without asking permission.

63

Paying to publish in open access...

• Some publishing companies offer to publish articles in open access if the authors pay a certain amount. The UAB offers aid for open access publishing in this type of magazines. You could consult the Cercador d'ajuts, beques i convocatòries. : Cercador d'ajuts, beques i convocatòries: http://www.uab.cat/servlet/Satellite/beques-i-ajuts-1276168992788.html

64

Copyright Copyleft

We can make some reserved actions under some conditions.

“All rights reserved”

We can’t use the work without permission.

“Some rights reserved”

65

Creative Commons licenses

After choosing one of these licenses (http://creativecommons.org/choose) a code will be generated that you must insert in your digital publication

67

DOAJ • Certain publications publish openly their contents. You

could consult DOAJ (Directory of Open Access Journals) to know these publications: http://www.doaj.org

•Consult E-revistas or Redalyc to know journals in context Hispanic. We recommend you the REDI service of the UAB.

68

• Some publishing companies that publish wholly or partly in open access: http://www.scielo.org

• Dialnet http://dialnet.unirioja.es

• Openj-gate http://www.openj-gate.com/Footer/About.aspx

• Hindawi http://www.hindawi.com

• Medknow http://www.medknow.com

• Highwire Press http://highwire.stanford.edu/cgi/search?quick=true

• Bentham http://www.bentham.org/open/index.htm

• J-stage http://www.jstage.jst.go.jp/browse

In open access journals

69

ddd.uab.cat

What and where can we publish?

70

Source: http://repositories.webometrics.info of CSIC. July 2012. Total: 1522 repositories.

Spain’s 1st, Europe’s 4th and world’s 10th

71

Increase its impact!

• Check that the article has been correctly indexed in the relevant databases.

• Follow the authors that have quoted you.

• Deposit the e-print in the UAB’s institutional deposit (DDD).

• Promote your work with the tools 2.0

What to do once the article has been

published?

72

Moltes gràcies!

Contacte:

Ana Lopo

Gestora de Suport a la Docència i la Recerca

Correu-e: anna.lopo@uab.cat

Biblioteca d’Humanitats (UAB)