Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

34
Sponsored by the National Science Foundation GENI Exploring Networks of the Future www.geni.net

Transcript of Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Page 1: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation

GENIExploring Networks of the Future

www.geni.net

Page 2: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 2GENI Introduction www.geni.net

Outline

What is GENI?

How is GENI being used?

Key GENI Concepts

Demo: A simple experiment using GENI

Page 3: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 3GENI Introduction www.geni.net

GENI: Infrastructure for Experimentation

GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

Page 4: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 4GENI Introduction www.geni.net

GENI: Infrastructure for Experimentation

GENI provides compute resources that can be connected in experimenter specified Layer 2 topologies.

Page 5: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 5GENI Introduction www.geni.net

Multiple GENI Experiments run Concurrently

Resources can be shared between slices

Experiments live in isolated

“slices”

Page 6: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 6GENI Introduction www.geni.net

GENI is “Deeply Programmable”

I install software I want throughout my network slice (into routers, switches, …) or control

switches using OpenFlow

OpenFlow part of the experiment not only the infrastructure

Page 7: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 7GENI Introduction www.geni.net

GENI Compute Resources

GENI RacksGENI Wireless compute nodes

Existing Testbeds

Emulab

Planetlab

ORBIT

Page 8: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 8GENI Introduction www.geni.net

Creating and deploying GENI racks

Ilia BaldineRENCIMore resources / rack,fewer racks

Rick McGeerHP Labs

Fewer resources / rack,more racks

Latest addition

Rajesh Narayanan DELL

KC Wang Clemson

Page 9: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 9GENI Introduction www.geni.net

GENI Networking Resources

Networking within a Rack

National Research Backbones(e.g. Internet2)

Regional Networks(e.g. CENIC)

WiMAX Base Stations

4G/3G GENI network

Page 10: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 10GENI Introduction www.geni.net

FederationGENI grows by GENI-enabling heterogeneous infrastructure

Avoid technology “lock in” and grow quickly by incorporating existing infrastructure

Backbone #1

Regional

GENI Rack

GENI Rack

Access#1

CommercialClouds

CorporateGENI suites

Non-USTestbeds

ResearchTestbed

Campus

My experiment runs acrossthe evolving GENI federation.

My GENI Slice

This approach looks remarkably familiar . . .

Page 11: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 11GENI Introduction www.geni.net

GENI Architecture

• Flexible network / cloud research infrastructure

• Also suitable for physics, genomics, other domain science

• Distributed cloud (racks) for content caching, acceleration, etc.

MetroResearch

Backbones

InternetISPU N I V E R S I T YU N I V E R S I T Y

U N I V E R S I T YU N I V E R S I T Y

Regional Networks Campus

g

g

gLegend

GENI-enabled hardware

Layer 3Control Plane

Layer 2Data Plane

Page 12: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 12GENI Introduction www.geni.net

Current GENI buildout

• More WiMAX base stationswith Android handsets

• GENI-enable 5-6regional networks

• Inject moreOpenFlow switchesinto Internet2

• Add GENI Racks to 50-80 locationswithin campuses, regionals, andbackbone networks

GENI Racks serve as programmable routers, distributed clouds, content

distribution nodes, caching or transcoding nodes, etc

Page 13: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 13GENI Introduction www.geni.net

GENI Operations

GMOC: GENI Meta-operation Center• Keeps track of outages• Notification system for resource reservation• Monitors most GENI Aggregates

GMOC Google Calendar keeps track of reservations/outages

Page 14: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 14GENI Introduction www.geni.net

Federation Extends the Reach of GENI and International Peer Testbeds

Initial plan to federate testbeds on five continents

Page 15: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 15GENI Introduction www.geni.net

Testbeds Involved

Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/MonPlenary/

GEC18_brecht_vermeulen_International_Federation.pdf

Page 16: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 16GENI Introduction www.geni.net

Outline

What is GENI?

How is GENI being used?

Key GENI Concepts

Demo: A simple experiment using GENI

Page 17: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 17GENI Introduction www.geni.net

How is GENI being Used?

Research• Future Internet

architectures• Software defined

networking• Large scale evaluation of

smart grid protocols

Education• Over 50 classes using

GENI in all levels• Networking and

Distributed systems classes

• Cloud computing classes• WiMAX classes

As of October 2014, GENI has over 2700 users!

Page 18: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 18GENI Introduction www.geni.net

Outline

What is GENI?

How is GENI being used?

Key GENI Concepts

Demo: A simple experiment using GENI

Page 19: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 19GENI Introduction www.geni.net

GENI: Terms and Definitions

– An experiment uses resources in a slice

– Slices isolate experiments

– Experimenters are responsible for their slices

SliceAbstraction for a collection of resources capable of running experiments

Page 20: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 20GENI Introduction www.geni.net

Slice credentials

Clearinghouse and Aggregates

• Clearinghouse: Manages users, projects and slices– Standard credentials shared via custom API or new Common CH API– GENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI CH

• Aggregate: Provides resources to GENI experimenters– Typically owned and managed by an organization– Speaks the GENI AM API– Examples: PlanetLab, Emulab, GENI Racks on various campuses

Create & Register Slice

Researcher

Aggregate Manager API - listResources - createSliver … Aggregate

ManagerAggregate Resources

users

slices

clearinghouse

projects

Tool

Page 21: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 21GENI Introduction www.geni.net

GENI: Terms and Definitions

• A slice : One or more resources provided by an aggregate– E.g. Bare machines, virtual machines, VLANs

Backbone #1

Backbone #2

GENI Rack#3

GENI Rack#2

Access#1

CommercialClouds

CorporateGENI suites

Other-NationProjects

ResearchTestbed

GENI Rack#1

My GENI Slice

My slice contains slivers from many aggregates.

Page 22: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 22GENI Introduction www.geni.net

Resource Specifications (RSpecs)

• RSpecs: Lingua franca for describing and requesting resources– “Machine language” for negotiating resources between experiment

and aggregate– Experimenter tools eliminate the need for most experimenters to

write or read RSpec

<?xml version="1.0" encoding="UTF-8"?><rspec xmlns="http://www.protogeni.net/resources/rspec/2" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2 http://www.protogeni.net/resources/rspec/2/request.xsd" type="request" > <node client_id="my-node" exclusive="true"> <sliver_type name="raw-pc" /> </node></rspec> RSpec for requesting a single node

Page 23: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 23GENI Introduction www.geni.net

Resource Reservation using RSpecs and the AM API

• Advertisement RSpec: What does an aggregate have?• Request RSpec: What does the experimenter want?• Manifest RSpec: What does the experimenter have?

AggregateManager

Client

ListResources(…)

Advertisement RSpec

CreateSliver(Request RSpec, …)

Manifest RSpec

ListResources(SliceName, …)

Manifest RSpec

Page 24: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 24GENI Introduction www.geni.net

Outline

What is GENI?

How is GENI being used?

Key GENI Concepts

Demo: A simple experiment using GENI

Page 25: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 25GENI Introduction www.geni.net

Access to GENI

For many experimenters:• no new passwords• familiar login screens

Leverage InCommon forsingle sign-on authentication

Experimenters from 304 educational and research institutions have InCommon accounts

GENI Project Office runs a federated IdP to provide accounts for non-federated organizations.

Page 26: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 26GENI Introduction www.geni.net

NTUA is now federated …

1. Choose National Technical University of Athens from the drop down list

2. Use your NTUA username and password to login

Page 27: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 27GENI Introduction www.geni.net

Putting it all Together: Demo

• Demo– Create a slice– Create a sliver at one

aggregate• Two computers (raw PCs),

connected by a LAN

– Install and run software on the machines

– View output of software– Delete sliver

• Experimenter tool: Jacks

server(VM)

client(VM)

Page 28: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 28GENI Introduction www.geni.net

Ways to Get Help

• Sign Up for :

[email protected]

• Use #geni IRC chatroom

• HowTo pages on the GENI

Wiki

http://groups.geni.net/geni/wiki/GENIExperimenter/GetHelp

Page 29: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 29GENI Introduction www.geni.net

Other Important Lists

• geni-announce– GENI news and events

• Experimenters– Announcements of interest to GENI experimenters

• Experimenter-ops– Announcements about infrastructure maintenance

Full list at: http://groups.geni.net/geni/wiki/GENICommunicationChannels

Page 30: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 30GENI Introduction www.geni.net

Answer is

[email protected]

Have a question?

Sarah EdwardsNiky Riga

Vic Thomas

which is an email list which only goes to members of the GPO including…

(However, the archive of the list is public)

Page 31: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 31GENI Introduction www.geni.net

QUESTIONS?

Page 32: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 32GENI Introduction www.geni.net

BACKUP SLIDES

Page 33: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 33GENI Introduction www.geni.net

“At scale” GENI prototype

Campus photo by Vonbloompasha

Build GENI at sufficient scale

Infeasible to build a testbed as big as the Internet

GENI-enabled campuses,students as early adopters

HP ProCurve 5400 Switch

NEC WiMAX Base Station

GENI-enabledequipment

GENI-enable testbeds, commercial equipment, campuses, regional and backbone networks

Page 34: Sponsored by the National Science Foundation GENI Exploring Networks of the Future .

Sponsored by the National Science Foundation 34GENI Introduction www.geni.net

Current GMOC Operational Support

• Monitor and triage problem resolution on the GENI Integrate OpenFlow Core network (Mesoscale)

• Emergency Stop • GENI Experimenter Support • Manage network/systems alarms, outages, maintenances,

– Mesoscale provisioning, maintenance freezes, demo reservations and disruptive experiment reservations (and post-mortem)

• Notifications, Escalation and Reporting • Engineering configuration (Internet2, MOXI, Indiana) and

new Aggregate site, regional and GENI rack turn-up • GMOC Measurement API for GENI Aggregates • Develop new tools for network monitoring and

measurement Modified slide from: http://groups.geni.net/geni/attachment/wiki/GEC18Agenda/RackOpsAndMeasurement/GEC18%20GMOC

%20Presentation.pdf