Post on 18-Dec-2015
GEC21 Experimenter/Developer Roundtable
(Experimenter)
Paul RuthRENCI / UNC Chapel Hill
pruth@renci.org
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
ADCIRC Storm Surge Model• Finite Element• Very high spatial resolution (~1.2M triangles)• Efficient MPI implementation, scales to thousands of cores• Typically use 256-1024 cores for forecasting applications• Used for coastal flooding simulations
– FEMA flood insurance studies– Forecasting systems– Research applications
3
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
ADCIRC Storm Surge Model on GENI
• Slice attributes– 38 VMs (152 compute cores)– 6 GENI racks– Custom image replicated across testbeds– ExoGENI
• Groups • Storage (1 TB)
– InstaGENI• Shared VLANs• Xen VMs (4 core, 4 GB memory, 30 GB storage)
– Inter-domain • GENI Stitching• ExoGENI Stitching
4
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Demo GENI Slice
…
…
Condor Scheduler
iSCSI Storage
…
…NFS NFS
NFS
NFS
W W W W
W W
W WOVS
InstaGENIExoGENI
5
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Demo GENI Slice
…
…
Condor Scheduler
iSCSI Storage
…
…NFS NFS
NFS
NFS
W W W W
W W
W WOVS
Not just one slice!
3 slices1 Stitcher call4 Omni calls
InstaGENIExoGENI
6
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Demo GENI Slice
InstaGENIExoGENI
7
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Slice 1: ADCIRC-CORE
…
Condor Scheduler
iSCSI Storage
…NFS NFS
NFS
NFS
W W W W
OVS
- 1 call to the stitcher- 5 GENI calls by the stitcher
GENI Calls:1. ExoSM2. Ion3. GPO-IG4. ILL-IG5. WI-IG
InstaGENIExoGENI
8
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Shared VLANs
…
Condor Scheduler
iSCSI Storage
…NFS NFS
NFS
NFS
W W W W
OVS
Perform Operational Action: Create Shared VLANS
InstaGENIExoGENI
9
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Slice 2: Wisconsin Group
…
…
Condor Scheduler
iSCSI Storage
…NFS NFS
NFS
NFS
W W W W
W W
OVS
InstaGENIExoGENI
10
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Slice 2: Illinois Group
…
…
Condor Scheduler
iSCSI Storage
…
…NFS NFS
NFS
NFS
W W W W
W W
W WOVS
InstaGENIExoGENI
11
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Complete Slice(s)
…
…
Condor Scheduler
iSCSI Storage
…
…NFS NFS
NFS
NFS
W W W W
W W
W WOVS
InstaGENIExoGENI
12
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Experiences
• Happy that it works at all!• GENI Stitching
– Failures can cascade– Limited to one stitch per slice per ExoGENI site.– Can restart complicated ExoGEN slice
• InstaGENI– Slow booting compute nodes– Yay! Bigger nodes (4 cores, 30 GB disks)– Shared VLANs are awkwards
• Tools– None of the tools can visualize all aspects of slices
GEC21 Experimenter/Developer Roundtable(Developer)
Victor Orlikowski
Duke University
vjo@duke.edu
14
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
ORCA 5
• Recovery– Should not be seen by users– Restart and redeploy ExoGENI services without
effecting running slices.
• Storage on bare metal• Hybrid mode• Distributed actor registry
15
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Rspec Extension• Storage
– ~5 TB of sliverable storage on most racks– Add an iSCSI target to a slice– Can now be used with Rspecs
<node client_id="egS-storage" component_manager_id="urn:publicid:IDN+exogeni.net:rcivmsite+authority+am" exclusive="false"> <sliver_type name="storage"> <storage:storage resource_type="LUN" do_format="true" fs_param="-F -b 1024" fs_type="ext4" mnt_point="/mnt/storage" capacity="100"/> </sliver_type>
<interface client_id="egS-storage:if0"/> </node>
16
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
RSpec Extension: Groups
• Multiple nodes with shared specification– Same: image, instance type, location, networks
• Templated postboot scripts customize the nodes
<node client_id="eg-node" component_manager_id="urn:publicid:IDN+exogeni.net:bbnvmsite+authority+am" exclusive="false"> <sliver_type name="XOMedium"> <disk_image name="http://geni-images.renci.org/images/standard/centos/centos6.3-v1.0.11.xml" version="776f4874420266834c3e56c8092f5ca48a180eed"/> </sliver_type> <nodegroup:nodegroup count=“10"/></node>
17
The 21st GENI Engineering Conference October 20-23, 2014
Indiana University, Bloomington, IN
Thanks