Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

21
on the Yet another on-demand Galaxy cloud, but only powered by Apache CloudStack

description

These slides are presented at the Galaxy Community Conference 2014. https://wiki.galaxyproject.org/Events/GCC2014/Abstracts/Talks#Galaxy_on_the_GenomeCloud_:_Yet_another_on-demand_Galaxy_cloud.2C_but_only_powered_by_Apache_CloudStack

Transcript of Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Page 1: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

on theYet another on-demand Galaxy cloud,

but only powered by Apache CloudStack

Page 2: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 3: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

6 9

2

2

1

1

1014

# GCC 2014 Talks

# GCC 2014 Posters

Korea

Page 4: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

http://genome-cloud.com

Page 5: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

2X more hosts than

GenomeCloud

0

0.5

1

1.5

2

2.5

3

U S E G A L A XY . O R G G E N O ME - C L O U D . C O M

DATA TRANSFER SPEED (MB/S)

Page 6: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 7: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Launch

GenomeCloud2012.12

Start Galaxy setup in servers

• 2013.7

Complete Galaxy system architecture and software stacks•2013.9

Automated and integrated with GenomeCloud•2013.12

Launch

Galaxy on the GenomeCloud

• 2014.01

Page 8: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

OS(Linux [ubuntu v12])

Python

DBMS

[Postgr

eSQL]

HTTP Server

[NGINX]

FTP Server

[ProFTPD]

Ganglia Master

Grid Engine

(Head)

Galaxy

Job

Handler0

Job

HandlerN

Web

Handler0

Web

HandlerNNFS/LVM

NTP

(Server)

HTTP Server

[Apache]

OS(ubuntu v12)

Grid Engine

(Worker)

NTP

(Client)

NFS

(Client)

Ganglia

(slave)

R / R packages

Head Worker

Galaxy

Users

Page 9: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Head

Worker X N

Galaxy

Cluster

Central NFS

/DB/BIO

Galaxy core, tools, user data

Shared storage for Grid Engine

1 2

1

2 Reference genomes data,

Genome data locations

NFS

Page 10: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Clustering

,

Software

setup,

Galaxy

setup

Deploy

head node

Associate

public IP

Create port

forwarding

rule

Create and

attach disk

volumes

Deploy

worker

nodes

1

4

3

2

5

6

Clo

ud

Sta

ck A

PIs

Page 11: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 12: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 13: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

Head

Worker X 15

Galaxy Cluster

Workshop

/BIO

Head

Worker X N

Galaxy Cluster

Research

/BIO X N

100

GB100

GB

Page 14: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 15: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 16: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 17: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)

OS(Linux [ubuntu v12])

DBMS

Nginx

FTP Server

Ganglia Master

Grid Engine

(Head)

Galaxy

NFS/LVM

Apache

OS(ubuntu v12)

Gride Engine

(Worker)

NFS/LVM

(Client)

Ganglia

(slave)

R / R packages

Head Worker

Galaxy

Users

Page 18: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 19: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 20: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)
Page 21: Galaxy on the GenomeCloud (Galaxy Community Conference 2014)