"Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote
-
Upload
kaitlin-thaney -
Category
Technology
-
view
1.896 -
download
0
description
Transcript of "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote
![Page 1: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/1.jpg)
kaitlin thaney@kaythaney ; @mozillascience
WSSSPE / 16 nov 2014
designing for truth, scale and sustainability
![Page 2: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/2.jpg)
doing good is part of our code
![Page 3: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/3.jpg)
help researchers use the power of the open web to change science’s future.
![Page 4: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/4.jpg)
(0)
![Page 5: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/5.jpg)
![Page 6: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/6.jpg)
![Page 7: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/7.jpg)
power, performance, scale
![Page 8: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/8.jpg)
our current systems are designed to create
friction.despite original intentions.
![Page 9: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/9.jpg)
current state of science
articlesdata
patents
![Page 10: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/10.jpg)
some have a firehose
articlesdata
patents
![Page 11: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/11.jpg)
traditions last not because they are excellent, but because influential people are averse to change and because of the sheer burdens of
transition to a better state ...
“
“Cass Sunstein
![Page 12: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/12.jpg)
downside of output-driven recognition systems
![Page 13: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/13.jpg)
“There’s greater reward, and more temptation to
bend the rules.”- David Resnik, bioethicist
![Page 14: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/14.jpg)
let’s look at an example
![Page 15: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/15.jpg)
2004-2010$350 million spent
$60m+ for “management”70+ tools created
![Page 16: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/16.jpg)
(1)
![Page 17: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/17.jpg)
the culture of the specialist is changing.lowering barriers to entry.
![Page 18: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/18.jpg)
- access to content, data, code, materials.- emergence of “web-native” tools.- rewards for openness, interop, collaboration, sharing.- push for ROI, reuse, recomputability, transparency.
“web-enabled research”
![Page 19: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/19.jpg)
what do we mean by “open research”?
community technology practices
collaborative interoperable open review
participatory discoverable data management
recognition open tools sharing / reuse
mentorship designed for reuse
documentation / versioning
![Page 20: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/20.jpg)
we’re facing a perception crisis.
at the sacrifice of scientific progress.
![Page 21: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/21.jpg)
Source: Wolkovich et al. GCB 2012.
![Page 22: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/22.jpg)
“... up to 70 percent of research from academic labs cannot be reproduced, representing an enormous waste of money and effort.” - Elizabeth Iorns, Science Exchange
![Page 24: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/24.jpg)
instill best (digital,
reproducible) practice
“research hygiene”
![Page 25: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/25.jpg)
(2)
![Page 26: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/26.jpg)
shifting practice takes a multi-faceted approach.
designing for scale.
![Page 27: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/27.jpg)
research social capital capacity
infrastructure layers for efficient, reproducible research
open toolsstandards
best practicesresearch objectsscientific software
repositories
incentivesrecognition / P&Tinterdisciplinarity
collaborationcommunity dialogue
trainingmentorship
professional devnew policiesrecognition
stakeholders: universities, researchers, tool dev, funders, publishers ...
![Page 28: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/28.jpg)
![Page 29: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/29.jpg)
our systems need to talk to one another.
focus on environments that foster reuse, progress.
![Page 30: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/30.jpg)
![Page 31: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/31.jpg)
code as a research objectwhat’s needed to reuse ?
http://bit.ly/mozfiggit
![Page 32: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/32.jpg)
![Page 33: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/33.jpg)
![Page 34: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/34.jpg)
![Page 35: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/35.jpg)
(community driven)metadata for software discovery: JSON-LD
http://bit.ly/mozfiggit
![Page 36: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/36.jpg)
http://softwarediscoveryindex.org/report/
![Page 37: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/37.jpg)
![Page 38: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/38.jpg)
Instead of cancer driving the development of technology, it was the development of technology that drove caBIG moving into position where this technology could be
adopted by individuals who were interested in cancer.
- Andrea CalifanoColumbia University
“
“
![Page 39: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/39.jpg)
[Their] approach to fulfilling [their] mission was upside down.
- Andrea CalifanoColumbia University
““
![Page 40: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/40.jpg)
(3)
![Page 41: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/41.jpg)
our practices are limiting us.
how to further adoption of open, web-enabled science?
![Page 42: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/42.jpg)
“web-enabled science”- access to content, data, code, materials.- emergence of “web-native” tools.- rewards for openness, interop, collaboration, sharing.- push for ROI, reuse, recomputability, transparency.
![Page 43: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/43.jpg)
“web-enabled science”what’s missing?
- access to content, data, code, materials.- emergence of “web-native” tools.- rewards for openness, interop, collaboration, sharing.- push for ROI, reuse, recomputability, transparency.
![Page 44: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/44.jpg)
current activity:235+ instructors
(60+, training)4000+ learners
![Page 45: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/45.jpg)
![Page 46: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/46.jpg)
rethinking “professional development”
![Page 47: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/47.jpg)
lowering (not exacerbating) barriers to entry
![Page 48: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/48.jpg)
fostering a (sustainable) community of practitioners
![Page 49: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/49.jpg)
(4)
![Page 50: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/50.jpg)
we need to create safe spaces for our software.
designing with sustainability in mind.
![Page 51: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/51.jpg)
“nested sustainability”
KTucker, CC-BY-SA-3.0
![Page 52: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/52.jpg)
![Page 53: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/53.jpg)
We are used to billion-dollar software, and it’s not what we can afford.
I am worried that unless we rein in our expectations, we will do this experiment again and we will get the same result ...
- Joe GrayOregon Health + Science University Center
“
“
![Page 54: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/54.jpg)
1. design with the audience, not individual,
in mind.(be careful of the snowflake syndrome.)
![Page 55: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/55.jpg)
2. design to unlock latent potential of our systems.
(and keep in mind engagement.)
![Page 56: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/56.jpg)
3. rethink how we reward researchers and support
roles.
![Page 57: "Designing for Truth, Scale and Sustainability" - WSSSPE2 Keynote](https://reader034.fdocuments.us/reader034/viewer/2022042715/559446e91a28ab150d8b457e/html5/thumbnails/57.jpg)
4. be mindful of jargon/semantics traps.