Rick McGeerChief Scientist, US IGNITE

October 28, 2013

Making GENI Simple for Simple Things: The GENI Experiment Engine

Rick McGeer,Chief Scientist, US IGNITE

3

GENI Experiment Lifecycle

4

GEE Experiment Lifecycle

5

Analog in Commercial World: EC2 vs Google App Engine

• EC2:– Create VM(s)– Install and configure software– Deploy…

• Google App Engine– Write program– Upload

• Not magic!– When you need a VM, you need a VM…– Google App Engine is simple because it makes most decisions for you…

6

TransGeo: A Model TransCloud Application

• Scalable, Ubiquitous Geographic Information System• Open and Public

– Anyone can contribute layers– Anyone can host computation

• Why GIS?– Large and active community– Characterized by large data sets (mostly satellite images)– Much open-source easily deployable software, standard data formats– Computation naturally partitions and is loosely-coupled– Collaborations across geographic regions and continents – Very pretty…

7

TransGeo Sites (May 2013)

8

TransGeo Architecture

9

Opening up TransGEO: The GENI Experiment Engine

• Key Idea: Genericize and make available the infrastructure behind the TransGEO demo– Open to every GENI, FIRE, JGN-X,…experimenter who wants to use it

• TransGEO is a trivial application on a generic infrastructure– Perhaps 1000 lines of Python code on top of

• Key-Value Store• Layer 2 network• Sandboxed Python programming environment• Messaging Service• Deployment Service• GIS Libraries

10

GENI Experiment EngineMcGeer, Mambretti, Bavier, Coady,

• Permanent, Long-Running, Distributed File System• Permanent, Long-Running, GENI-wide Message Service• Permanent, Long-Running, Distributed Python Environment• Permanent, world-wide Layer-2 VLANs on high-performance

networks• All offered in slices• All shared by many experimenters• Model: Google App Engine• Advantage for GENI: Efficient use of resources• Advantage for Experimenters: Up and running in no time

11

GENI Experiment Engine Architecture

12

Staged Rollout• Permanent Layer-2 Network Summer

2013• Shared Fole System based on (Swift)

Summer 2013• First Python Users Fall 2013• Shared Python environment Summer 2014

Thanks!