Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric...

44
Researchers talk: Let’s listen An introduction to altmetrics and Altmetric Cat Chimes 28 th Nov 2014

Transcript of Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric...

Page 1: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Researchers talk: Let’s listen

An introduction to

altmetrics and Altmetric

Cat Chimes 28th Nov 2014

Page 2: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Today we’ll cover

•  What are altmetrics, and how did they come about?

•  Who are Altmetric? •  Who is using the data? •  How can you use it? •  Getting started

Page 3: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

35K online mentions of scholarly articles every day.

1 mention every 2.5 seconds!

137K unique articles are shared each week.

>2M articles with tracked attention data.

The conversation is moving online...

Source: Altmetric internal data, June 2014

Page 4: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

And it’s not just about articles…

Page 5: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Traditional metrics lag behind…

Page 6: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Traditional metrics lag behind… Google Scholar – flawed metadata and no citations

Web of Science – no citations

Page 7: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

A huge online impact in 2 months

Page 8: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Funders are noticing…

Grant funders looking for proof of “broader impacts” often defined as “an effect, change, or benefit to the economy, society, culture, public policies, health, the environment, etc.” Research Excellence Framework, http://www.ref.ac.uk/panels/assessmentcriteriaandleveldefinitions/

“The primary aim of SEP assessments is to reveal and confirm the quality and the relevance of the research to society and to improve these where necessary.” https://www.knaw.nl/nl/actueel/publicaties/standard-evaluation-protocol-2015-2021

Royal  Netherlands  Academy  of  Arts  and  Sciences  

Page 9: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View
Page 10: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Filling the evaluation gap

Page 11: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Altmetric is a data science company that tracks attention to research outputs, delivering article level metrics via visually engaging, intuitive interfaces. In other words, we help give credit where credit is due.

Who are we?

Page 12: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Curate, Dissambiguate, Display

Search for links to papers

Follow a list of sources

Collate attention

Display data in “Altmetric details pages”

Manual curation.

Automatic collection.

Disambiguation of mentioned work.

Collecting attention

data

Reporting attention

data

Page 13: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Sources: high quality, high relevance

News outlets

Over 1,300 sites Manually curated list

Text mining Global coverage

Social media and blogs

Twitter, Facebook,

Google+, Sina Weibo Public posts only

8,000+ Blogs

Reference managers

Mendeley etc Demographics

Other sources

Youtube Reddit F1000 Q&A

Post-publication peer review

Publons Pubpeer

Page 14: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Sources: policy documents •  ASHA Practice Policy •  AWMF - Association of Scientific Medical Societies •  European Food Safety Authority (EFSA) •  Food and Agriculture Organization •  GOV.UK - Policy papers, Research & Analysis •  Intergovernmental Panel on Climate Change (IPCC) •  International Committee of the Red Cross (ICRC) •  International Monetary Fund •  (IMF) – (Tracking working papers) •  Medicins sans Frontieres (MSF) •  Mental Health Foundation (UK) •  NICE Evidence •  UNESCO •  World Health Organization (WHO) •  Australian Policy Online •  The World Bank •  International Fund for Agricultural Development •  Scottish Intercollegiate Guideline Network And more being added each week…

Page 15: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Visualizing Attention

Page 16: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View
Page 17: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Wait, what’s that donut?

Page 18: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Attention in context

Page 19: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics.

Altmetric Badges View the altmetrics for a single article on a journal article page.

Altmetric Bookmarklet Retrieve the altmetrics for a single article (even if no badges are present).

Altmetric Details Page The article-level metrics page.

Page 20: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

What can the data tell you?

What type of attention is this research receiving?

Where has this article received the most traction?  

Which countries are engaging most with the content?

Has this article influenced policy, spurred new research, or engaged a new audience?  

Are reactions to this article positive or negative?

Page 21: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

What the data doesn’t tell you

The quality of the paper

The quality of the researchers

The whole story

Page 22: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Who uses our data?

Page 23: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Publishers

Page 24: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Recommenda5on  Engine    Integra5on  for  Medical  research  Apps  

Integra5ng  Altmetric  service  into  publishing  pla>orm  

Altmetric  Integra5on  for  JAMA  and  others  to  monitor  research  impact  

Integrates  Altmetric  data  for  over  1  million  ar5cles  

Platform providers

Page 25: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Funders

Page 26: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Other metrics providers

Page 27: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Author Tools “A CV that documents alternative metrics […] offers a much more compelling argument to a tenure committee of their research impact than a traditional publication list.” - Donald Samulack, Editage

Page 28: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

•  Institutional repository badge embeds

•  Badge integration with discovery systems

Institutions

Page 29: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

How can you easily filter and report on the data for your institution?

Page 30: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Total research outputs

Altmetric database (2.5m mentioned articles)

Your Institution’s research

Page 31: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Your Institution at a glance…

Page 32: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Quickly see items with most attention…

Page 33: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Navigate by authors, departments & journal subjects

Page 34: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Easily see the data for a specific researcher

Page 35: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Save, monitor and export reports

Page 36: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Who benefits?

Librarians «  I want to help researchers track the

attention paid to their articles.

«  I want to add value to my institutional repository or discovery service.

«  I want to consider journal attention data in my library’s acquisition decisions.

Research administrators «  I want to monitor and report on

uptake, usage, and impact of publications by department.

«  I want to comply with funder and governmental mandates.

Communications / PR team «  I want to share our institution’s

success stories.

«  I want to maximize the reach of our institution’s research.

Researchers «  I want to find indicators of impact for my

CV and funding applications, quickly.

«  I want to make informed decisions on future publishing choices.

«  I want to discover interesting content in

my field

Page 37: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Some of your researchers are already there

Page 38: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View
Page 39: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

“I already added the [altmetrics] results to a grant proposal submitted to NIH, and I already got e-mails from the program officer saying this is fantastic information for their budget report. So now NIH likes my lab, and I like Altmetrics.”

Terrie Moffitt Duke University

Page 40: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Institutions catching on fast

•  Over 50 with badges installed in IRs

•  Embeds for Primo, Summon and EBSCO Discovery platforms

•  Altmetric for Institutions customers in the US, Europe, Australia and the UK

Page 41: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Want to try it out? Visit our website to get access to our demo instance, Lilliput University: http://www.altmetric.com/institutional-edition.php

Page 42: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Free IR badge embeds

api.altmetric.com  

Page 43: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

For your researchers

altmetric.it

Page 44: Researchers talk: Let’s listen - Network of Universities ... · Altmetric tools Altmetric Explorer Browse through Altmetric’s data and analyse the metrics. Altmetric Badges View

Thank you!

altmetric.com @altmetric