Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining:...
Transcript of Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining:...
![Page 1: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/1.jpg)
1
Mike Buschman
Co-founder, Plum Analytics
August 5, 2014
@amichalek | @PlumAnalytics
Altmetrics 101
![Page 2: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/2.jpg)
2
Metrics provide a Feedback
Loop
2
Redefining:
How Scholarship is Measured
![Page 3: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/3.jpg)
3
Current state of
Scholarly Measure
3
Journal
Impact Factor
3.161
![Page 4: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/4.jpg)
4
Metrics provide a Feedback
Loop
4
What impact has our research
had in the past 18 months?
![Page 5: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/5.jpg)
5
Researchers have
Moved Online
![Page 6: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/6.jpg)
6
Sources of Data Exhaust
• Amazon
• Bit.ly
• CrossRef
• Delicious
• Dryad
• dSpace
• EBSCO
• ePrints
• Figshare
• Github
• Google+
• Medwave
• Mendeley
• PLOS
• PubMed Central
• Research
Blogging
• Scopus
• SlideShare
• SourceForge
• Stack Overflow
• USPTO
• Vimeo
• Wikipedia
• Worldcat
• YouTube
![Page 7: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/7.jpg)
7
Metrics Categories
USAGE (clicks, downloads, views,
library holdings, video plays)
CAPTURES (bookmarks, code forks, favorites,
readers, watchers)
MENTIONS (blog posts, comments, reviews,
Wikipedia links)
SOCIAL MEDIA (+1s, likes, shares, tweets)
CITATIONS (PubMed Central, Scopus,
patents)
![Page 8: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/8.jpg)
8
Changing the focus
COUNTER how much your university uses the collection
Article-level metrics and
PlumX
how much the world uses your research
on metrics
![Page 9: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/9.jpg)
9
Metrics provide
a Feedback Loop
![Page 10: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/10.jpg)
10
Open Metrics Open Science
![Page 11: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/11.jpg)
11
Visualizing Impact: Plum Print
![Page 12: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/12.jpg)
12
![Page 13: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/13.jpg)
13
Group and Researcher
Widgets
![Page 14: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/14.jpg)
14
![Page 15: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/15.jpg)
![Page 16: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/16.jpg)
16
Citations are lagging indicators
• Scopus = 2
• Web of
Science = 0
Scholar = 8
• PubMed = 1
16
Photo credit: A. Wayne Vogl and Nicholas D.
Pyenson / Smithsonian Institution.
Research output is
more than articles…
Measure all of it
![Page 17: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/17.jpg)
17
Beyond the Journal Article
• Articles
• Blog posts
• Book chapters
• Books
• Cases
• Clinical Trials
• Conference Papers
• Data Sets
• Figures
• Grants
• Interviews
• Letters
• Media
• Patents
• Posters
• Presentations
• Reports
• Source Code
• Theses /
Dissertations
• Videos
• Web Pages
![Page 18: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/18.jpg)
18
Books count!
![Page 19: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/19.jpg)
19
How does this help me?
Performing Research
Funding Research
Publishing Research
![Page 20: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/20.jpg)
20
Given how tight budgets are around
the world, governments are rightfully
demanding effectiveness in the programs
they pay for.
To address these demands, we
need better measurement tools
to determine which approaches
work and which do not.”
Bill Gates
Gates Foundation Annual Letter 2013
“
![Page 21: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/21.jpg)
21
NIH: The Competition for
Research $$$
http://report.nih.gov/NIHDatabook/Charts/Default.aspx?showm=Y&chartId=20&catId=2
4 in 5 people do
NOT get funded
![Page 22: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/22.jpg)
22
Who Gets Funded? N
um
ber
of P
roposals
Almost
Always
Funded
Almost
Never
Funded
“Gray Zone” Typically
Funded
Adapted from:
http://nuweb.neu.edu/nhe/insideview%20NSF.pdf
![Page 23: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/23.jpg)
23
Metrics provide a Feedback
Loop
23
An opportunity for libraries
and the office of research
to work together
![Page 24: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/24.jpg)
24
Funders are using PlumX
![Page 25: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/25.jpg)
25
Citations are lagging indicators
• Scopus = 2
• Web of
Science = 0
Scholar = 8
• PubMed = 1
25
Photo credit: A. Wayne Vogl and Nicholas D.
Pyenson / Smithsonian Institution.
Thank You!
![Page 27: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/27.jpg)
27
Citations are lagging indicators
• Scopus = 2
• Web of Science = 0
• Google Scholar = 8
• PubMed = 1
Photo credit: A. Wayne Vogl and Nicholas D.
Pyenson / Smithsonian Institution.
![Page 28: Altmetrics 101 · 2014. 8. 12. · Altmetrics 101 . Metrics provide a Feedback 2 Loop 2 Redefining: How Scholarship is Measured . Current state of 3 Scholarly Measure Journal Impact](https://reader035.fdocuments.us/reader035/viewer/2022071004/5fc1432f61349f30da58f537/html5/thumbnails/28.jpg)
28
“Same” Article,
Different Places