June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level
-
Upload
national-information-standards-organization-niso -
Category
Education
-
view
847 -
download
1
description
Transcript of June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level
![Page 1: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/1.jpg)
Paul Groth @pgroth
Web & Media GroupDepartment of Computer ScienceThe Network InstituteVU University Amsterdamhttp://www.few.vu.nl/~pgroth
Altmetrics at the portfolio level
![Page 2: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/2.jpg)
NIH Data Book – (http://report.nih.gov/ndb/index.aspx) Data provided by the Division of Information Services, Reporting Branch
Research Project Grants Applications, awards, and success rates
![Page 3: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/3.jpg)
Metrics: Do metrics matter?Nature 2010http://doi.org/10.1038/465860a
"Outside letters basically trump everything," says Robert Simoni, chairman of the biology department at Stanford University in California.
![Page 4: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/4.jpg)
![Page 5: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/5.jpg)
“Imagine how the academic appointment process might change if search and review committees had access—within an appropriately tagged or linked online CV, for example, or via the ORCID system—to information about the specific contributions made by a candidate to each of his/her works, including contributions that might not otherwise have qualified for ‘authorship’ status?”
Point of view: Faculty appointments and the record of scholarshipAmy Brandhttp://dx.doi.org/10.7554/eLife.00452
![Page 6: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/6.jpg)
Point of view: Faculty appointments and the record of scholarshipAmy Brandhttp://dx.doi.org/10.7554/eLife.00452
Slide 3: http://article-level-metrics.plos.org/files/2013/10/Brand.pptx
Opportunities• Individuals and institutions need better
tools for curating and networking their own record of scholarship
• Institutions need more information about scholarly contribution
• ALMs that reliably differentiate sources of input (general; academic; expert; etc.) would be more useful”
![Page 7: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/7.jpg)
ENTER ALTMETRICS
![Page 8: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/8.jpg)
Altmetrics is the study and use of scholarly impact measures based on activity in online tools and environments.
http://doi.org/10.1371/journal.pone.0048753
![Page 9: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/9.jpg)
http://blog.peerj.com/post/65345738206/changing-the-currency-of-science-to-solve-our-greatest
![Page 10: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/10.jpg)
Thanks Ian Mulvany
![Page 11: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/11.jpg)
![Page 12: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/12.jpg)
![Page 13: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/13.jpg)
ALTMETRICS AS MEASURES OF IMPACT?
![Page 14: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/14.jpg)
“It took approximately a generation (20 years) for bibliographic citation analysis to achieve acceptability as a measure of academic impact."
(Vaughan and Shaw, 2003)
![Page 15: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/15.jpg)
The Research is Happening
htt
p:/
/jaso
npri
em
.org
/self-a
rchiv
ed/5
uni-
post
er.
png
(Birkholtz et al. 2013)
(Fausto et al 2012)
http://ploscollections.org/altmetricshttp://asis.org/Bulletin/Apr-13/AprMay13_Piwowar.html
![Page 16: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/16.jpg)
http://www.cwts.nl/pdf/CWTS-WP-2013-003.pdf
![Page 17: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/17.jpg)
Altmetrics 2014
Zahedi, Zohreh; Fenner, Martin; Costas, Rodrigo (2014): How consistent are altmetrics providers? Study of 1000 PLOS ONE publications using the PLOS ALM, Mendeley and Altmetric.com APIs. figshare. http://dx.doi.org/10.6084/m9.figshare.1041821
![Page 18: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/18.jpg)
http://www.slideshare.net/paulwouters1/issi2013-wg-pw
![Page 19: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/19.jpg)
Bottom Line: use altmetrics as evidence in a larger story
![Page 20: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/20.jpg)
WHAT’S THE LARGER STORY?
![Page 21: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/21.jpg)
![Page 22: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/22.jpg)
![Page 23: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/23.jpg)
DIFFERENT AGGREGATIONS
![Page 24: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/24.jpg)
Aggregations
• Institutional Level– See the next talk
• Faculty• Department• Group
![Page 25: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/25.jpg)
Aggregations
• Institutional Level– See the next talk
• Faculty• Department• Group• Most interesting: adhoc Groups
![Page 26: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/26.jpg)
Projects
• Typical lifetime 2-5 years
• Networks of sub-groups
• Networks of projects• Different measures
of success
![Page 27: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/27.jpg)
![Page 28: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/28.jpg)
![Page 29: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/29.jpg)
29
Published AND discussed AND cited
![Page 30: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/30.jpg)
30
![Page 31: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/31.jpg)
31
![Page 32: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/32.jpg)
32
![Page 33: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/33.jpg)
Events
• Interval lifetime• Changing networks• Virtual teams• Affiliation is transient• Aggregates• Central to scholarly communication
![Page 34: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/34.jpg)
![Page 35: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/35.jpg)
![Page 36: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/36.jpg)
![Page 37: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/37.jpg)
![Page 38: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/38.jpg)
![Page 39: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/39.jpg)
Summary: a broader view
• Almetrics gives a broader view• Altmetrics is must be situated in
context• We should begin looking at the
portfolio level– Multiple aggregations– What cannot be measured
![Page 40: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/40.jpg)
Challenge: Architecture
![Page 41: June 18 NISO Virtual Conference: Keynote Speaker: Altmetrics at the Portfolio Level](https://reader035.fdocuments.us/reader035/viewer/2022070313/554958a6b4c905fc4e8b5369/html5/thumbnails/41.jpg)
Thanks
Collaborators: Peter van den Besselaar, Julie Birkholz, Frank van Harmelen, Shenghui Wang, Rinke Hoekstra, Thomas Gurney, Mike Taylor, Anita de Waard, Jason Priem, Dario Taraborelli, Cameron Neylon, Ian Mulvany