Redefining research impact

William Gunn

Head of Academic Outreach, Mendeley

@mrgunn

https://orcid.org/0000-0002-3555-2054

Citations are too slow

Google Analytics for research

New data on research impact

Get better data on researcher engagement with research

Get it faster

Serve all the stakeholders in research

...and aggregates research data in the cloud

Mendeley extracts research data…

Mendeley is not just a reference manager!

Install Mendeley Desktop

Collecting rich signals from domain experts.

Rich user profile data

Instrumenting the research workflow

• 2.6 Million users

• 470 M documents

• 4-700K uploads per day

• 90% coverage of Pubmed

• Accessible alternative to citations

Instrumenting the Research Workflow

Search

Read Annotate Organize

Write

Import

http

://arx

iv.org

/htm

l/1203.4

745v1

altmetrics show broader impact

http://www.asis.org/Bulletin/Apr-13/AprMay13_Lin_Fenner.html

altmetrics show broader impact

What would people build if they could get the data?

• Impact Story – get credit for all your work

• PLOS ALM – article-level metrics for papers

• Plum Analytics – bespoke analytics for libraries (EBSCO)

• Altmetric.com – altmetrics for publishers. (Digital Science)

New data on research impact

Get better data on researcher engagement with research

Get it faster

Serve all the stakeholders in research

Personalized Impact

New forms of discovery

• Mendeley Suggest

– personalized recommendations based on reading history

• related articles

– relatedness based on document similarity

• third-party platforms

– PubChase, ScienceScape, myScienceWork, Docphin

Secondary literature

Off-line

• Correspondence to journals

• peer review

Online

• peer review

• comments at publishers website (PLOS, PeerJ)

• third-party platforms

– Pubmed Commons, Publons, Stack Exchange, Quora, blog posts

Secondary publication

Secondary publication

How authors use Pubmed Commons

• Went public on Dec 19.

• ~700 comments

• 1 in 5 are from authors

• Commenters must have a paper in Pubmed to comment, but they’re publicly viewable

• Comments can be cited by PMID

http://pubmedcommonsblog.ncbi.nlm.nih.gov/2013/12/13/expanding-and-updating-the-record-authors-using-pubmed-commons/

• 50% of comments

– add study data

– link to full free text

– give updates related specifically to that publication

– link to newer publications

• 10% used it to add errata or notify readers that the conclusions no longer hold

• only 2 used it to talk about how great their own paper is

How authors use Pubmed Commons

How authors use Pubmed Commons

Issues To Be Addressed

• Identity

• Privacy

• Attribution

• Gaming

• Filtration

Identity

• Mendeley - http://www.mendeley.com/profiles/jonathan-eisen/

• Scopus - http://www.scopus.com/authid/detail.url?authorId=35247902700

• Pubmed - http://www.ncbi.nlm.nih.gov/myncbi/jonathan.eisen@gmail.com/comments/

• ORCID - http://orcid.org/0000-0002-0159-2197

Building a reproducibility dataset

• Mendeley and Science Exchange have started the Reproducibility Initiative

• working with Figshare & PLOS to host data & replication reports

• building open datasets backing high-impact work

• http://cos.io/cancerbiology

www.mendeley.com

william.gunn@mendeley.com @mrgunn