Telling the impact story defining new metrics for library success - 2014
Telling your research story with (alt)metrics
-
Upload
paul-groth -
Category
Education
-
view
1.981 -
download
2
description
Transcript of Telling your research story with (alt)metrics
Paul Groth (@pgroth)Web & Media GroupVU University Amsterdamhttp://www.few.vu.nl/~pgroth
Telling your research story with (alt)metrics
NIH Data Book – (http://report.nih.gov/ndb/index.aspx) Data provided by the Division of Information Services, Reporting Branch
Research Project Grants Applications, awards, and success rates
Metrics: Do metrics matter?Nature 2010http://doi.org/10.1038/465860a
"Outside letters basically trump everything," says Robert Simoni, chairman of the biology department at Stanford University in California.
http://blog.peerj.com/post/65345738206/changing-the-currency-of-science-to-solve-our-greatest
“Imagine how the academic appointment process might change if search and review committees had access—within an appropriately tagged or linked online CV, for example, or via the ORCID system—to information about the specific contributions made by a candidate to each of his/her works, including contributions that might not otherwise have qualified for ‘authorship’ status?”
Point of view: Faculty appointments and the record of scholarshipAmy Brandhttp://dx.doi.org/10.7554/eLife.00452
Point of view: Faculty appointments and the record of scholarshipAmy Brandhttp://dx.doi.org/10.7554/eLife.00452
Slide 3: http://article-level-metrics.plos.org/files/2013/10/Brand.pptx
Opportunities• Individuals and institutions need better
tools for curating and networking their own record of scholarship
• Institutions need more information about scholarly contribution
• ALMs that reliably differentiate sources of input (general; academic; expert; etc.) would be more useful”
ENTER ALTMETRICS
Altmetrics is the study and use of scholarly impact measures based on activity in online tools and environments.
http://doi.org/10.1371/journal.pone.0048753
“It took approximately a generation (20 years) for bibliographic citation analysis to achieve acceptability as a measure of academic impact."
(Vaughan and Shaw, 2003)
What altmetrics are not good at
(Wouters & Costas, 2012)
“The main problem is that none of the new tools we reviewed meet crucial requirements for data quality and indicator construction. This prevents them from currently being usable in the context of research evaluation and assessment.”
(Wouters & Costas, 2012)
http://www.slideshare.net/paulwouters1/issi2013-wg-pw
The Research is Happening
htt
p:/
/jaso
npri
em
.org
/self-a
rchiv
ed/5
uni-
post
er.
png
(Birkholtz et al. 2013)
(Fausto et al 2012)
http://ploscollections.org/altmetricshttp://asis.org/Bulletin/Apr-13/AprMay13_Piwowar.html
http://www.cwts.nl/pdf/CWTS-WP-2013-003.pdf
Why now?
Figure 1. Terms and definitions.
Allen HG, Stanton TR, Di Pietro F, Moseley GL (2013) Social Media Release Increases Dissemination of Original Articles in the Clinical Pain Sciences. PLoS ONE 8(7): e68914. doi:10.1371/journal.pone.0068914http://www.plosone.org/article/info:doi/10.1371/journal.pone.0068914
SOURCES
http://blog.peerj.com/post/65345738206/changing-the-currency-of-science-to-solve-our-greatest
Largest List of Metrics Sources• Amazon• Bit.ly• CrossRef• Delicious• Dryad• dSpace• ePrints• Facebook• Figshare• Github
27
• Google+• Medwave• Mendeley• Microsoft
Academic Search• PLOS• PubMed• Reddit• Research Blogging• Scopus
• SlideShare• SourceForge• Stack Overflow• Twitter• USPTO• Vimeo• Wikipedia• Worldcat• YouTube
From Andrea Michalek
STORIES
Steve
34
Published AND discussed AND cited
THE FUTURE – RICHER VIEWS OF IMPACT
• Cameron Neylon - ALM Workshop 2013 Summary
• http://article-level-metrics.plos.org/files/2013/10/Neylon.pptx
Not very high views
Not an obvious outlier...
...but interesting interactions...
...driven by this person...
...who I can talk to.
See http://bit.ly/NJOyUn for the whole conversation
This. Is Impact.
SUPPORT FOR YOUR STORY
Three Points
1) The story you want to convey2) Metrics as evidence3) Transparency is central
Conclusion
• Altmetrics is still developing– But useful today
• Your content is embedded in a network of content– Show the impact of your content
through associated content
• Tell a story using your network
Thanks
Collaborators: Peter van den Besselaar, Julie Birkholz, Frank van Harmelen, Shenghui Wang, Rinke Hoekstra, Thomas Gurney, Mike Taylor, Anita de Waard, Jason Priem, Dario Taraborelli, Cameron Neylon