2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure
Fixing the infrastructure for open science
-
Upload
bjoern-brembs -
Category
Documents
-
view
630 -
download
3
description
Transcript of Fixing the infrastructure for open science
![Page 1: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/1.jpg)
An institutional infrastructure crisis in science
Björn BrembsUniversität Regensburg
http://brembs.net
![Page 2: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/2.jpg)
SCHOLARSHIP
Institutions produce publications, data and software
![Page 3: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/3.jpg)
Today‘s Digital Dystopia
• Institutional email• Institutional
webspace• Institutional blog• Library access card• Open access
repository
• No archiving of publications
• No archiving of software
• No archiving of data
![Page 4: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/4.jpg)
CRISIS I
Dysfunctional scholarly literature
![Page 5: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/5.jpg)
Literature
• Limited access• No global search• No functional hyperlinks• No flexible data
visualization• No submission
standards• (Almost) no statistics• No text/data-mining• No effective way to sort,
filter and discover• No scientific impact
analysis• No networking feature• etc.
…it’s like the web in 1995!
![Page 6: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/6.jpg)
CRISIS II
Scientific data in peril
![Page 7: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/7.jpg)
![Page 8: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/8.jpg)
![Page 9: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/9.jpg)
CRISIS III
Non-existent software archives
![Page 10: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/10.jpg)
![Page 11: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/11.jpg)
![Page 12: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/12.jpg)
My Digital Utopia:
• No more corporate publishers – libraries archive everything and make it publicly accessible according to a world-wide standard
• Single semantic, decentralized database of literature, data and software
Technically feasible today (almost)
![Page 13: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/13.jpg)
Distribution yesterday
![Page 14: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/14.jpg)
Subscriptions yesterday
![Page 15: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/15.jpg)
Distribution today
![Page 16: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/16.jpg)
Subscriptions today
![Page 17: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/17.jpg)
![Page 18: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/18.jpg)
Software to control the experiment and save the data
![Page 19: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/19.jpg)
Software to analyze and visualize the data
![Page 20: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/20.jpg)
![Page 21: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/21.jpg)
buridan.sourceforge.net
![Page 22: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/22.jpg)
![Page 23: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/23.jpg)
![Page 24: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/24.jpg)
![Page 25: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/25.jpg)
However, a version is already available
![Page 26: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/26.jpg)
Add new, or update an existing article
![Page 27: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/27.jpg)
Run your script and...
Same type of experiments → same scriptDefault: → same categories
→ same tags→ same authors→ same links→ same description
→ One complete article, in one click.
Update the figure: Higher sample size directly published while analysed, your boss may see the results before you do! (or you may see the results of your student before they do)
Possibility to make it public and citable in one click or directly in the R code.
![Page 29: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/29.jpg)
Citable!
![Page 30: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/30.jpg)
![Page 31: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/31.jpg)
JULIEN COLOMB
One person is not an institutional infrastructure!
![Page 32: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/32.jpg)
The main obstacle: JournalRank
• Thomson Reuters: Impact Factor• Eigenfactor (now Thomson Reuters)• ScImago JournalRank (SJR)• Scopus: SNIP, SJR
Source Normalized Impact per Paper
![Page 33: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/33.jpg)
Job applications
![Page 34: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/34.jpg)
Job application instructions
Publikationstätigkeit(vollständige Publikationsliste, darunter Originalarbeiten als Erstautor/in, Seniorautor/in, Impact-Punkte insgesamt und in den letzten 5 Jahren, darunter jeweils gesondert ausgewiesen als Erst- und Seniorautor/in, persönlicher Scientific Citations Index (SCI, h-Index nach Web of Science) über alle Arbeiten)
Publications:Complete list of publications, including original research papers as first author, senior author, impact points total and in the last 5 years, with marked first and last-authorships, personal Scientific Citations Index (SCI, h-Index according to Web of Science) for all publications.
![Page 35: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/35.jpg)
METRICS
Lies, damn lies and bibliometrics
![Page 36: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/36.jpg)
The Impact Factor
Introduced in 1960’s by Eugene Garfield: ISI
2008 and 20092010
IF=5Articles published in 08/09
were cited an average of 5 times in 10.
citations articles
![Page 37: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/37.jpg)
The Impact Factor
Journal X IF 2010=
All citations from TR indexed journals in 2010 to papers in journal X
Number of citable articles published in journal X in 2008/9
€30,000-130,000/year subscription ratesCovers ~11,500 journals (Scopus covers ~16,500)
![Page 38: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/38.jpg)
Main Problems with the IF
• Negotiable
• Irreproducible
• Mathematically
unsound
![Page 39: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/39.jpg)
Negotiable
• PLoS Medicine, IF 2-11 (8.4)(The PLoS Medicine Editors (2006) The Impact Factor Game. PLoS Med 3(6): e291. http://www.plosmedicine.org/article/info:doi/10.1371%2Fjournal.pmed.0030291)
• Current Biology IF from 7 to 11 in 2003– Bought by Cell Press (Elsevier) in 2001…
![Page 40: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/40.jpg)
![Page 41: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/41.jpg)
![Page 42: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/42.jpg)
Not Reproducible
• Rockefeller University Press bought their data from Thomson Reuters
• Up to 19% deviation from published records• Second dataset still not correct
Rossner M, van Epps H, Hill E (2007): Show me the data. The Journal of Cell Biology, Vol. 179, No. 6, 1091-1092 http://jcb.rupress.org/cgi/content/full/179/6/1091
![Page 43: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/43.jpg)
Not Mathematically Sound
• Left-skewed distributions• Weak correlation of individual article citation
rate with journal IF
Seglen PO (1997): Why the impact factor of journals should not be used for evaluating research. BMJ 1997;314(7079):497 (15 February)http://www.bmj.com/cgi/content/full/314/7079/497
![Page 44: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/44.jpg)
A different journal rank
![Page 45: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/45.jpg)
Relation of journal-impact factor to retractions for fraud or suspected fraud, error, and plagiarism, or duplicate publication.
Fang F C et al. PNAS 2012;109:17028-17033
©2012 by National Academy of Sciences
![Page 46: Fixing the infrastructure for open science](https://reader035.fdocuments.us/reader035/viewer/2022062512/5549efe9b4c9050d488b52b1/html5/thumbnails/46.jpg)
(A) Number of retracted articles for specific causes by year of retraction.
Fang F C et al. PNAS 2012;109:17028-17033
©2012 by National Academy of Sciences