Improving Integrity, Transparency, and Reproducibility Through Connection of the Scholarly Workflow
-
Upload
andrew-sallans -
Category
Science
-
view
59 -
download
1
Transcript of Improving Integrity, Transparency, and Reproducibility Through Connection of the Scholarly Workflow
Improving Integrity, Transparency, and Reproducibility Through Connec:on of
the Scholarly Workflow
Andrew Sallans Partnerships Lead
Center for Open Science
A talk on the Open Science Framework
1. Free, open source plaHorm 2. Designed to add efficiency to workflow 3. Connector to other tools and services
So, why is this important?
Challenges: Perceived norms Norms Communality Open Sharing
Universalism Evaluate research on own merit
Disinterestedness Motivated by knowledge and discovery
Organized skepticism Consider all new evidence, even against one’s prior work
Quality
Counternorms Secrecy Closed
Particularlism Evaluate research by reputation
Self-interestedness Treat science as a competition
Organized dogmatism Invest career promoting one’s own theories, findings
Quantity
Anderson, Martinson & DeVries, 2007
A liNle something about COS • Est. 2013 • Non-‐profit tech
startup • 4 leading
founda:on funders, > $14M
• Located in CharloNesville, VA
• Team: ~ 25 FT & 20 interns
• Mostly so]ware developers and researchers Mission: Improve openness, integrity, and
reproducibility of research
http://osf.io
Create an account
easy and free!
https://osf.io/settings
Modify Account Settings
Update information
Dashboard
Project Organizer
Project Overview Page
Overview
Using the Wiki
In the menu bar
Wiki history
Add new or edit
Adding Components
Add a new component
Adding Contributors
Select from the results
Choose permissions
Privacy
Uploading Files
Click upload button or just drag and
drop
Versioning
See version history and download
Registering Your Work Choose the registration template
Create a frozen registered version
Sharing Your Work
Create a view-only link
Describe the link use
Option to make
anonymous
Select what parts of the project to share
Unique and permanent IDs Scientific content must be easy to cite and
annotate Approach: GUIDs for all content https://osf.io/e81xl -> RPCB https://osf.io/alh38 -> Tim Errington https://osf.io/ibdv8 -> Coding_Study_1.xslx
Current Add Ons: • Dropbox • Github • Dataverse • Figshare • AmazonS3
Connecting the workflow
Examples of other connec:ons Taking a data management plan and conver:ng it into a living document.
Providing a data repository lookup service and checklist to assist with prepara:on for deposit.
Connec:ng to a sensi:ve video storage service.
Tools used: Qualtrics, Dropbox, Survey Monkey, R OSF features used: version control, collabora:on, wiki for lab notebook and mee:ngs
OSF in the lab
How has the OSF improved your workflow?
Erica Baranski
Q
Q
Q
What tools do you use in your research?
A
A
A
How do you use the OSF?The OSF makes version
control effortless. My PI,my labmates,
and I have access to previous versions of a file at any time -
and the most current version is always readily available.
OPEN SCIENCE FRAMEWORK
osf.io | @OSFramework | #OSFinAction
Tools used: next-‐gen sequencers, pipeline so]ware, custom so]ware OSF features used: version control, file sharing, GitHub and Dropbox integra:on, public sharing.
Problem to solve: teaching undergrads how to make research reproducible and verifiable. OSF features used: organiza:on of documents and data, command files, metadata, and file sharing.
What’s underneath the hood? • Python • Javascript • Git • MongoDB / TokuMx • Ansible • Elas:csearch • OSF API • Rackspace • Linode
Want to join the effort? • Contribute content to SHARE or partner on cura:on of content
• Serve as an Ambassador • Coordinate a reproducible sta:s:cs and prac:ces workshop
• Join the team – hNp://cos.io/jobs
Open Science Framework osf.io
Email: [email protected] Twitter: @OSFramework