Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send...
Transcript of Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send...
![Page 1: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/1.jpg)
Tazro Inutano Ohta DBCLS, ROIS twitter.com/inutano github.com/inutano speakerdeck.com/inutano
![Page 2: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/2.jpg)
RaaS Prototype 📄📄
📄📄
Apache Mesos + Chronos
manager
Node Node Node Node Node
Public/Private Docker Registry
Dockerfiles
workflow.json
📦📦 📦
🔡Data
📦
Storage
post
post/get
transfer
push
pull
run
mount
📡
🔡
User
![Page 3: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/3.jpg)
Research Activity Time Course
Details of Project Design Sampling Primary Data Data Processing
& AnalysisPublicationText, FigsWet Experiments
BioProject BioSample Genbank, DRASMART Protocol
![Page 4: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/4.jpg)
![Page 5: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/5.jpg)
https://www.docker.com/whatisdocker/
![Page 6: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/6.jpg)
Docker
![Page 7: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/7.jpg)
https://mesosphere.com/learn/
![Page 8: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/8.jpg)
![Page 9: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/9.jpg)
🐳
Mesos!Master
🐳Mesos Slave
Node Node Node
🐳!Galaxy
🐳
Aurora🐳
Mesos Slave
🐳 BWA
🐳
samtools
L2VPN
🐳 Docker Container Overlay Cloud
![Page 10: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/10.jpg)
🐳
Mesos!Master 🐳
Mesos Slave
Node Node Node
🐳!Galaxy
🐳
Aurora🐳
Mesos Slave
🐳 BWA
🐳
samtools
L2VPN
🐳 Docker Container
🐳!CLI-
manager
🐳!Chronos
Overlay Cloud w/ RaaS manager
![Page 11: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/11.jpg)
🐳
Mesos!Master 🐳
Mesos Slave
Node Node Node
🐳!Galaxy
🐳 Mesos Slave
🐳 BWA
🐳
samtools
L2VPN
🐳 Docker Container
🐳!CLI-
manager🐳!
super!cool!
scheduler
New Scheduler Required
![Page 12: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/12.jpg)
🐳
Mesos!Master
🐳 Mesos Slave
Node Node Node
🐳!Galaxy
🐳
Aurora🐳
Mesos Slave
🐳 BWA
🐳
samtools
L2VPN
🐳 Docker Container
1 2 3
4
1. Run Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received executer, 4. run docker container
How tools are executed
![Page 13: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/13.jpg)
🐳
Mesos!Master
🐳 Mesos Slave
Node Node Node
🐳!Galaxy
🐳
Aurora🐳
Mesos Slave
🐳 BWA
🐳
samtools
L2VPN
🐳 Docker Container
1: Each node mount NFS. 2: Galaxy has the NFS path as file path in the conf. 3: Mesos Slave Container has a path to NFS as a mounted volume (docker command option -v). 4: Tool Container also has a path to NFS.
NFS
1
2 3
4
How data stored
![Page 14: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/14.jpg)
🐳!Mesos Master
🐳Mesos Slave
Node Node Node
🐳!Galaxy
🐳 Mesos Slave
🐳 BWA
🐳
samtools
L2VPN
🐳 Docker Container
🐳!CLI-
manager
🐳!Marathon
more portability?
🐳!SCS
1
1
![Page 15: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/15.jpg)
![Page 16: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/16.jpg)
![Page 17: Tazro Inutano Ohta - data.dbcls.jpdata.dbcls.jp/~inutano/misc/modules.pdfRun Galaxy tool to send execute info to aurora, 2. aurora passes executer to mesos master, 3. mesos slave received](https://reader030.fdocuments.us/reader030/viewer/2022041214/5e0307d9d9e2ea2f20416efe/html5/thumbnails/17.jpg)