SUMMER VACATION SCHOLARSHIP | IM&T Scientific Computing in the Cloud.

SUMMER VACATION SCHOLARSHIP | IM&T

Scientific Computingin the Cloud

Scientific Computing in the Cloud | Alyssa Biasi2 |

Figure 1.


Server Virtualisation

Figure 2.


On DemandSelf-Service

Figure 3.

Scientific Computing in the Cloud | Alyssa Biasi

Cloud Service Models

Software-as-a-Service (SaaS)• E.g. Gmail, Dropbox

Platform-as-a-Service (PaaS)• E.g. Google AppEngine, Window

Azure

Infrastructure-as-a-Service (IaaS)• E.g. Amazon EC2, Rackspace

5 |

Figure 4.


The Cloud Experience

6 |


Cloud 9 Test Beds

Compute Clusters:

• Burnet• Bragg• Vayu

7 |

Virtual Machines (VMs):

• IM&T Cloud• “Bluetea”• Amazon EC2• Windows Azure• NeCTAR• QERN (QCIF Early Research Node)

Operating System:

Vayu and QERN - CentOS 5.9Compute Clusters - SUSE Linux Enterprise Server 11Virtual Machines - Custom SUSE Linux Enterprise Server 11


Burnet

• Run by the Advanced Scientific Computing (ASC) group

8 |

Machine Type:CPU Type:

Number of Cores: Memory:

File System:

Compute clusterIntel Xeon X5670 at 2.93 GHz175214 TBIBM GPFS


Bragg

• Run by the Advanced Scientific Computing (ASC) group

9 |



File System:

Compute clusterIntel Xeon E5-2650 at 2 GHz 204816.4 TBNFS


Vayu

• National Computational Infrastructure (NCI)

10 |



File System:

Compute clusterIntel Xeon E5540 at 2.53GHz 1193637 TBLustre


IM&T Cloud

11 |


Number of Cores:Memory:

File System:

Cloud VMIntel Xeon X5680 at 3.33 GHz8 (virtual CPUs)32 GBSAS


“Bluetea” - OpenStack

12 |

• Dedicated desktop• Implementation of OpenStack

Figure 5.

Figure 6.


CPU Type:Number of Cores:

Memory:Operating System:

Intel Xeon X5660 at 2.80GHz648 GBUbuntu 12.04.1 LTS (Precise) - Server

“Bluetea”

13 |

The Host:

The VM:Machine Type:

CPU Type:Number of Cores:

Memory:

Cloud VMIntel Xeon X5660 at 2.80GHz4 (virtual CPUs)32 GB


Amazon Elastic Compute Cloud (EC2)

• Amazon web Infrastructure-as-a-Service

14 |



Instance Type:

Cloud VMIntel Xeon E5-2665 at 2.40GHz 8 (virtual CPUs)68.4 GBQuadruple Extra Large



Instance Type:

Cloud VMIntel Xeon E5-2650 at 2.00GHz 16 (virtual CPUs)117 GBHigh Storage Eight Extra Large

First VM:

Second VM:


Windows Azure

• Windows virtual machines• In preview stage

15 |



Cloud VMAMD Opteron 4171 HE 8 (virtual CPUs) 13.8 GB

Note:Required a 10 GB swap file in order to run benchmarking applications.


NeCTAR

• Research Cloud• Australian Government and research organisations partnership

16 |



Cloud VMAMD Opteron 6238 2.9GHz 4 (virtual CPUs)16 GB


QERN

• Queensland Cyber Infrastructure Foundation (QCIF)• Queensland node for NeCTAR• In pre-preview stage

17 |



Cloud VMAMD Opteron 6172 at 2.1GHz8 (virtual CPUs)48 GB


The Results

18 |


Materials Studio

19 |

2 4 80

500

1000

1500

2000

2500

3000

3500

4000

4500

5000

ASC Burnet ASC Bragg IM&T VM BlueteaAmazon EC2 Windows Azure Nectar

Total Number of Cores

Wall Time (s)


Materials Studio - Speedup

20 |

1

1.5

2

2.5

3

3.5

4

4.5

5

5.5

6

2 4 8

Speedup


ASC Burnet ASC Bragg IM&T VM Bluetea

Amazon EC2 Windows Azure Nectar Linear


TMD - Virtual Machines

21 |

2 4 8 160

500

1000

1500

2000

2500

3000

3500

4000

4500

IM&T VM Bluetea Amazon EC2Windows Azure Nectar QERN


Wall Time (s)


TMD

22 |

2 4 8 16 32 64 96 1280

500

1000

1500

2000

2500

3000

3500

4000

4500

ASC Burnet ASC Bragg Vayu IM&T VM Bluetea Amazon EC2 Windows AzureNectar QERN


Wall Time (s)


TMD - Speedup

23 |

2 4 8 16 32 64 96 1280

10

20

30

40

50

60

70

80

90

100

ASC Burnet ASC Bragg Vayu IM&T VM Bluetea Amazon EC2Windows Azure Nectar QERN Linear


Speedup

2 4 8 160

2

4

6

8

10

12

14


Oversubscription

24 |

Total allocated resources are more than the physical resources.

2 4 8 160

500

1000

1500

2000

2500Bluetea 4 Core VM vs. 16 Core VM

16 Cores

4 Cores


Wall Time (s)


Noisy Neighbour

25 |

Sharing resources with computationally heavy ‘neighbour’.

VM 01 VM 02 Stand Alone0

200

400

600

800

1000

1200

1400

1600

1800

2000

TMD Oversubscription - 4 Cores

Wall Time (s)


Thank You.

26 |

Figure 7.


• Figure 1: Duncan, D. Cloud-Computing, digital image, EmpowerCS, “Cloud Computing Mainstream still Two Years away”, Accessed 5th February 2013 <http://www.empowercs.com.au/blog/2012/11/cloud-computing-mainstream-still-two-years-away>

• Figure 2: Sourced from and edited Vmware vSphere, vSphere Host vs.. Virtual Infrastructure , digital image, VMware, Accessed 4th February 2013 <http://www.vmware.com/products/datacenter-virtualization/vsphere/scale-security.html >

• Figure 3: Screenshot taken of Ubuntu OpenStack Dashboard – instance launch.• Figure 4: Czernicki, B. Cloud Service Terms , digital image, Silverlight Hack, “IaaS, PaaS and SaaS

Terms Clearly Explained and Defined”, Accessed 8th February 2013 http://www.silverlighthack.com/post/2011/02/27/IaaS-PaaS-and-SaaS-Terms-Explained-and-Defined.aspx

• Figure 5: OpenStack: The Open Source Cloud Operating System. OpenStack Software Diagram, digital image, OpenStack, Accessed 7th February 2013 http://www.openstack.org/software/

• Figure 6: Morrison, G. What is OpenStack?, digital image, TechRadar, “What on Earth is OpenStack?”, Accessed 6th February 2013 <http://www.techradar.com/au/news/software/what-on-earth-is-openstack-1112804>

• Figure 7: Maheshwari, A. Cloud Rain, digital image, Brainstuck, Accessed 11th February 2013 <http://www.brainstuck.com/2009/08/19/drought/>

27 |

References

http://www.empowercs.com.au/blog/2012/11/cloud-computing-mainstream-still-two-years-away



http://www.vmware.com/products/datacenter-virtualization/vsphere/scale-security.html

http://www.silverlighthack.com/post/2011/02/27/IaaS-PaaS-and-SaaS-Terms-Explained-and-Defined.aspx



http://www.openstack.org/software/



http://www.techradar.com/au/news/software/what-on-earth-is-openstack-1112804



http://www.brainstuck.com/2009/08/19/drought/



SUMMER VACATION SCHOLARSHIP | IM&T Scientific Computing in the Cloud.

Documents

Transcript of SUMMER VACATION SCHOLARSHIP | IM&T Scientific Computing in the Cloud.