Data sharing in neuroimaging: incentives, tools, and challenges
-
Upload
krzysztof-gorgolewski -
Category
Data & Analytics
-
view
2.818 -
download
4
Transcript of Data sharing in neuroimaging: incentives, tools, and challenges
![Page 1: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/1.jpg)
Data sharing in neuroimaging: incentives, tools, and challenges
Chris Gorgolewski Department of Psychology Stanford University
![Page 2: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/2.jpg)
HOW CAN YOU BENEFIT FROM DATA SHARING?
![Page 3: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/3.jpg)
NKI Enhanced
• 329 subjects (will reach 1000) – Representative sample: young and old, some with
mental health history • 1 hour worth of MRI (3T) scanning: – MPRAGE (TR = 1900; voxel size = 1mm isotropic) – 3x resting state scans (645msec, 1400msec, and
2500msec) – Diffusion Tensor Imaging (137 direction; voxel size
= 2mm isotropic) – Visual Checkboard and Breath Holding
manipulations
![Page 4: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/4.jpg)
![Page 5: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/5.jpg)
fcon_1000.projects.nitrc.org/indi/enhanced/
![Page 6: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/6.jpg)
Human Connectome Project • > 500 subjects (will reach 1200)
– Young and healthy (22-35yrs) – 200 twins!
• 1 hour worth of MRI scanning: – State of the art sequences – high temporal and spatial resolution – Resting-state fMRI (R-fMRI) – Task-evoked fMRI (T-fMRI)
• Working Memory • Gambling • Motor • Language • Social Cognition • Relational Processing • Emotion Processing
– Diffusion MRI (dMRI) – MEG and EEG – 7T coming soon
![Page 7: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/7.jpg)
Human Connectome Project
• Rich phenotypical data – Cognition, personality, substance abuse etc.
• Genotyping! (not yet available)
• Methodological developments – Fine tuned sequences – Innovative field inhomogeneity corrections – New preprocessing techniques
• Ready to use preprocessed data
![Page 8: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/8.jpg)
humanconnectome.org
![Page 9: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/9.jpg)
FCP/INDI Usage Survey
Survey Courtesy of Stan Colcombe & Cameron Craddock
FCP/INDI Data Usage Description Master's thesis research 11.94% Doctoral dissertation research 38.81% Teaching resource (projects or examples) 13.43% Pilot data for grant applications 16.42% Research intended for publication 76.12% Independent study (e.g., teach self about analysis) 37.31%
FCP/INDI Users; 10% respondent rate
![Page 10: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/10.jpg)
Growth of the reuse of OpenfMRI datasets
![Page 11: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/11.jpg)
![Page 12: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/12.jpg)
Motivation
• Share your stat maps!
vs.
institutions scientists
![Page 13: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/13.jpg)
Data sharing saves money
$878,988 cost of reacquiring data for each of the
reuses of OpenfMRI datasets
![Page 14: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/14.jpg)
Data sharing fears
• Fear of being scooped • Fear of someone finding a mistake • Misconceptions about the ownership of the
data
![Page 15: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/15.jpg)
Studies sharing data have higher statistical quality
Wicherts JM, Bakker M, Molenaar D (2011) Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results. PLoS ONE 6(11): e26828. doi: 10.1371/journal.pone.0026828
![Page 16: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/16.jpg)
Neuroimaging data sharing hierarchy
Poldrack and Gorgolewski, 2014
![Page 17: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/17.jpg)
Just coordinates?
• Databases such as Neurosynth or BrainMap rely on peak coordinates reported in papers (only strong effects)
![Page 18: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/18.jpg)
Are we throwing money away?
![Page 19: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/19.jpg)
![Page 20: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/20.jpg)
Baby steps
• Everything is a question of cost and benefit – If we keep the cost low even small benefit (or
just conviction that data sharing is GOOD) will suffice
![Page 21: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/21.jpg)
NeuroVault.org simple data sharing
• Minimize the cost! • We just want your statistical maps with
minimum description (DOI) – If you want you can put more metadata, but
you don’t have to
• We streamline login process (Google, Facebook)
![Page 22: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/22.jpg)
NeuroVault.org
Gorgolewski, et al., submitted
![Page 23: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/23.jpg)
Benefits - visualisation
![Page 24: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/24.jpg)
Benefits - decoding
![Page 25: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/25.jpg)
Live demo
![Page 26: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/26.jpg)
Benefits - other
• Private collections • Multiple contributors to one collection • Sharable persistent URLs • Viewer embeddable on your labs website
or your private blog • Improved exposure of your research • Improved reusability of your results
![Page 27: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/27.jpg)
Using NeuroVault…
• Improves collaboration • Makes your paper more attractive • Shows you care about transparency • Takes only five minutes • Gives you warm and fuzzy feeling that you
helped future meta-analyses
![Page 28: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/28.jpg)
Validation and gains in sensitivity
![Page 29: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/29.jpg)
NeuroVault for developers
• RESTful API (field tested by Neurosynth) • Source code available on GitHub
![Page 30: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/30.jpg)
What is NIDM-Results?
![Page 31: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/31.jpg)
Neuroimaging data sharing hierarchy
Poldrack and Gorgolewski, 2014
![Page 32: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/32.jpg)
MAKING DATASHARING COUNT Credit where credit’s due
![Page 33: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/33.jpg)
Quality control
• Share your stat maps!
Complex datasets require elaborate descriptions
![Page 34: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/34.jpg)
• Share your stat maps! How can we appropriately reward extra effort and risk related with sharing data?
![Page 35: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/35.jpg)
Solution – data papers
• Authors get recognizable credit for their work. – Even smaller contributors such as RAs can be
included.
• Acquisition methods are described in detail.
• Quality of metadata is being controlled by peer review.
![Page 36: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/36.jpg)
Gorgolewski, Milham, and Margulies, 2013
![Page 37: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/37.jpg)
• Neuroinformatics (Springer) • GigaScience (BGI, BioMed Central) • Scientific Data (Nature Publising Group) • F1000Research (Faculty of 1000) • Data in Brief (Elsevier) • Journal of Open Psychology Data (Ubiquity
press)
Where to publish data papers?
![Page 38: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/38.jpg)
![Page 39: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/39.jpg)
![Page 40: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/40.jpg)
![Page 41: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/41.jpg)
![Page 42: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/42.jpg)
What makes a good data paper?
• Clear and accurate description of the acquisition protocol.
• Good data organization. • Ease of access to data. • Data quality description. • Fair credit attribution.
![Page 43: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/43.jpg)
How to improve the impact of your dataset?
• Provide preprocessed data. • Reach out to your peers… – …and people outside of your field (ML)
• Build a community around the data.
![Page 44: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/44.jpg)
StudyForrest.org
![Page 45: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/45.jpg)
Repositories
• Field specific – OpenfMRI.org (task based fMRI) – FCP/INDI (resting state fMRI) – COINS
• Field agnostic – DataVerse (Harvard) – Figshare (only small datasets) – DataDryad (fees may apply)
![Page 46: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/46.jpg)
OpenfMRI
• Will host any dataset that has a task based fMRI component
• No fees • Curated and uncurated datasets • Recommended by many journals (including
Scientific Data)
![Page 47: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/47.jpg)
Prepare in advance
• Make sure your consent form includes data sharing
• Decide which database you want to send your data to in advance – Organize your data according to their
requirements
• Work on anonymized data as much as you can
![Page 48: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/48.jpg)
If I haven’t convinced you yet
• Why to share data: – It’s the ethical thing to do (Brakewood and
Poldrack 2013) – The journal might require it (PLoS). – Your funders might require it (NIH). – Track record of data sharing can improve your
chances of getting your next grant.
![Page 49: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/49.jpg)
Sharing data is related to higher citation rate
Piwowar, Day & Fridsma (2007)
Piwowar & Vision(2013)
![Page 50: Data sharing in neuroimaging: incentives, tools, and challenges](https://reader034.fdocuments.us/reader034/viewer/2022051617/55a51f4c1a28ab642a8b45d2/html5/thumbnails/50.jpg)
Acknowledgements
Russell A. Poldrack Jean-Baptiste Poline
Yannick Schwarz Tal Yarkoni
Michael Milham Daniel Margulies
Yannick Schwartz Gael Varoquox
Joseph Wexler Gabriel Rivera Camile Maumet Vanessa Sochat Thomas Nichols MPI CBS Resting state group Poldrack Lab INCF Data Sharing Task Force