GEC3 GENI Spiral 1 Control Frameworks Global Environment for Network Innovations Aaron Falk...

GEC3 www.geni.net 1

GENI Spiral 1Control Frameworks

Global Environment for Network Innovations

Aaron Falk ([email protected])

www.geni.netClearing house for all GENI news and documents

mailto:[email protected]

wiki, slides, working group info:http://groups.geni.net

GEC3 www.geni.net 2

Goals for this talk

• Review System Decomposition & Control Framework

• Brief overview of the Spiral 1 Control Framework Clusters

• What do I have to do to integrate into a control framework cluster?

GEC3 3www.geni.net

Goals for this talk




GEC3 4www.geni.net

Control Framework Functions

• Resource allocation– w/ local policy, secure authorization

• Slice management & control

• Logging for forensics & accounting

GEC3 www.geni.net 5

GENI System Decomposition

GEC3 www.geni.net 6

GENIEnd User

GENI Srvc S3

Srvc S3 Internet GW

GENI Srvc S2GENI Srvc S1

DOE Agg Z(federated aggregate)

Comp Z

GENI Admin and Operations

GENI Aggr A

■ Operator■ Admin

Help Desk

■ Admin & Account Tools

Host A1

Host Ax

GENI Comp B

Comp B

Srvc S2 Measure & Store

Srvc S1 Software Storage

● ■ Srvc Mgr

● ■Aggr Mgr with Ops Portal

Admin Oper

● ■ Srvc Mgr

● ■ Srvc Mgr

GENI Clearinghouse

ComponentRegistry

Principal Registry

●■Ticket: Store Query

●■Principal: Register Authen Query

Slice Registry

TicketLog

SoftwareReposit

●■Slice: Register Cred Issue or Tkt Broker Query

●■Soft Mod: Store Get Query

●■Component: Register Query

Research Org A

● Researcher

● ExperimentSupport Tools

Research Org B

● Slice Admin

● PI

LocalPrincipal Registry

EndUser

via Internetor GENI

■ Ops & Mgmt Tools

● ExperimentSupport Tools● Experiment

Control Tools

Experiment Plane

Measurement Plane

● Control Plane

■ Ops and Mgmt Plane

● ■Comp Mgr with Ops Portal

Admin Oper

● ■Aggr Mgr with Ops Portal

Admin Oper

Keep in mind: this is a snapshot of a work-in-progress. Expect it to change. Tell us what’s wrong with it.

Keep in mind: this is a snapshot of a work-in-progress. Expect it to change. Tell us what’s wrong with it.

Slices

GENI Srvc S3

Visualization Service

GENI Srvc S2GENI Srvc S1

Measure & Store

Software Storage

GENIEnd User

EndUser

via Internetor GENI

DOE Aggr Z(federated aggr)

● ■Aggr Mgr

Aggr Z

GENI Aggr A

● ■Aggr Mgr

Research Org A

● Researcher

Research Org B

Host A1

Host Ax

GENI Aggr B

● ■Aggr Mgr

Comp B

GENI Clearinghouse

CompRegistry

Principal Registry



Slice Registry

TicketLog

SoftwareReposit



●■Comp: Register Query

Slice ARecord

Slice BRecord

Sliver

Sliver Sliver

Sliver Sliver

“Sliver”

“Sliver”Slice A

Slice B

“Sliver”

“Sliver” “Sliver” “Sliver”

● Researcher


Support Tools● ExperimentControl Tools

Experiment Plane

Measurement Plane

● Control Plane


GENI Operations & Management


Help Desk & Tools



GEC3 7www.geni.net

Clearinghouse Federation

●ExperControl Tools


EU CompEU-A

EU Admin and Ops Org

EU Clearinghouse(federated network)

Trust

Trust

DOE Aggr Z(federated aggr)

GENI Aggr A

Host A1

Host Ax

GENI Comp B

Comp B

EU CompEU-Z

Research Org EU-A

● Researcher

Research Org EU-B

● Slice Admin

● PI



Link

Link

Route

Route

GENI Clearinghouse

CompRegistry

Principal Registry



Slice Registry

TicketLog

SoftwareReposit



●■Comp: Register Query

● ■ Comp Mgr with Ops Portal

Admin Oper

● ■ Aggr Mgr with Ops Portal

Admin Oper

Research Org A

● Researcher


Research Org B

● Slice Admin

● PI


● ■ Aggr Mgr with Ops Portal

Admin Oper

GENI Operations & Management


Help Desk & Tools



Experiment Plane

Measurement Plane

● Control Plane


Aggr Z

GEC3 8www.geni.net

Goals for this talk




GEC3 9www.geni.net

GENI’s Critical Technical RisksThese risks drive the Prototyping Goals for GENI Spiral 1

GEC3 www.geni.net 10

GENIClearinghouse

Components

Aggregate AComputer Cluster

Components

Aggregate BBackbone Net

Components

Aggregate CMetro Wireless

Create my slice

Critical Risk #1Clearinghouse & control framework is central but never demonstrated

Critical Risk #1Clearinghouse & control framework is central but never demonstrated

Critical Risk #2End-to-end slices across multiple technologies have never been demonstrated

Critical Risk #2End-to-end slices across multiple technologies have never been demonstrated

Key Goals for GENI Spiral 1Drive down the critical technical risks in GENI’s concept


GENIClearinghouse

Components

Aggregate AComputer Cluster

Components


Components


Create my slice

Goal #1Fund multiple, competing teams to develop GENI Clearinghouse technology, encourage strong competition within the first few spirals

Goal #1Fund multiple, competing teams to develop GENI Clearinghouse technology, encourage strong competition within the first few spirals

Goal #2Demonstrate end-to-end slices across representative samples of the major substrates / technologies envisioned in GENI; Spiral 1 employs VLANs as “low hanging fruit”

Goal #2Demonstrate end-to-end slices across representative samples of the major substrates / technologies envisioned in GENI; Spiral 1 employs VLANs as “low hanging fruit”

www.geni.net 12

Components

Aggregate AComputer

Cluster

Components


Components


ReferenceDesign

Spiral 1 integration and trial operationsFive competing control frameworks, wide variety of substrates

Components

Aggregate A1

Computer Cluster

Components

Aggregate A2

Optical Network

Components

Aggregate A3

Metro Wireless

Cluster A

Components

Aggregate B1

Optical Network

Components

Aggregate B2

Sensor Network

Cluster B

Components

Aggregate C1

Computer Cluster

Components

Aggregate C2

Programmable Switches

Cluster C

Components

Aggregate D1

Optical Network

Components

Aggregate D2

Sensor Network

Cluster D

Components

Aggregate E1

Computer Cluster

Components

Aggregate E2

Optical Network

Components

Aggregate E3

Sensor Network

Cluster E

Components

Aggregate E4

Programmable Switches

GEC3

Why five control frameworks?

• The control plane provides a critical capability• We don’t yet have agreement on several high-

level issues– E.g., Aspects of federation, Identity, centralization vs.

distribution of services

• Implementation experience is really important to inform design choices– We want ‘running code’


Cluster A Integration (uses DETER control framework)

• DETER Trial Integration

– DETER security testbed– Emphasis on federation– Clearinghouse, CM

– 100+ nodes at ISI, UC Berkley

• GMOC– Global Research NOC

(Indiana)

GEC3 www.geni.net 14www.geni.net 14

DETERlab – USC/ISI

PoP PoP

DETERlab - Univ of California, Berkeley

Research Org A

● Researcher

● Slice Admin

● PI

GENI Clearinghouse

RegistriesRegistries

●■Services

● ■ Aggr/Comp Mgr



Help Desk




Support Tools


GMOCHerron, Indiana

Univ

DETERWroclawski,

USC/ISI

DETERWroclawski,

USC/ISI


PoP PoP

Experiment Plane

Measurement Plane

● Control Plane


Cluster B Integration (uses PlanetLab control framework)

• PlanetLab– Clearinghouse, CM– 800+ nodes– VINI (virtual topologies)

• Enterprise GENI– GENI VLANs on enterprise nets

• SPP Overlay Nodes– Programmable routers

• GUSH Tools– Experiment design tools

• Provisioning Service– Slice & experiment

management tools• Mid-Atlantic Crossroads

– Regional network with VLAN control plane

• GpENI– Regional network with sliceable

optics & routers

• GMOCGEC3 www.geni.net 15www.geni.net 15

Research Org A

● Researcher

● Slice Admin

● PI

Programmable Switch/Router

Programmable Switch

Regional Optical Network

PoP PoP

GENI Clearinghouse


●■Services

Compute Cluster




Help Desk



● ExperimentSupport

Tools

● ExperimentSupport

Tools

GMOCHerron, Indiana

Univ

PlanetLabPeterson, Princeton

GUSH ToolsAlbrecht Williams

Provisioning ToolsHartman, Univ

Arizona

SPP Overlay Nodes

Turner, Wash Univ

Enterprise GENIMcKeown, Stanford

Mid-Atlantic CrossroadsO’Neil, Univ

Maryland

Regional Optical Network

PoP PoP

GpENISterbenz, Univ Kansas, et al

Experiment Plane

Measurement Plane

● Control Plane


Cluster C Integration (uses ProtoGENI Control Framework)

• ProtoGENI– Clearinghouse, CM– Emulab resources– (370+ nodes)

• CMULab– Home Wireless APs– Emulab cluster– Wireless emulation testbed

• Instrumentation Tools– UK Edulab (compute/store)

• Measurement System– GIMS prototype

• Virtual Tunnels– Dynamic tunnel tools– BGP distribution tools

• GMOC


Compute Cluster ResidentialWireless APs & Wireless Emulation Testbed

Measurement and Storage Service

Research Org A

● Researcher

● Slice Admin

● PI

GENI Clearinghouse


●■Services

Compute Cluster, Programmable Switch

● ■ Aggregate Manager



Help Desk




GMOCHerron, Indiana

Univ

ProtoGENIRegehr, Univ

Utah

ProtoGENIRegehr, Univ

Utah

Instrumentation Tools

Griffioen, Univ Kentucky

Measurement System

Barford, Univ Wisconsin

InstrumentationToolset

Compute Cluster

CMULabAndersen,

Carnegie Mellon

Experiment Plane

Measurement Plane

● Control Plane


Internet GW

Virtual TunnelsFeamster,

GeorgiaTech

Cluster D Integration (uses ORCA Control Framework)

• ORCA/BEN– ORCA resource leasing

software– Metro-Scale Optical Testbed

(BEN)

• Sensor/Actuator Network– CASA (radar, video, weather

sensors)

• Kansei Sensor Network– Wireless sensor network arrays– 3 federated sites each w/~100

sensor nodes

• Vehicular Mobile Network– Programmable nodes with

radios on city busses

• GMOC


GENI Vehicular Mobile Wireless Network

GENI Optical Network

GENI Sensor/Actuator Wireless Network

GENI Sensor Network

Research Org A

● Researcher

● Slice Admin

● PI

GENI Clearinghouse


●■Services




Help Desk




Support Tools● ExperimentSupport Tools

GMOCHerron, Indiana

Univ

ORCA/BENBaldine and

Chase, RENCI and Duke

Vehicular MobileLevine, Univ

Mass

Sensor/ActuatorKurose, Univ

Mass

Kansei Sensor Network

Arora,Ohio State

PoP PoP

Experiment Plane

Measurement Plane

● Control Plane


Cluster E Integration (uses ORBIT control framework)

• ORBIT– Heterogeneous testbed

control, management, & measurement software

– WINLAB wireless testbeds resources (400+ sensor nodes)

– NICTA (Australia) wireless outdoor traffic testbed

• WiMAX– Open, programmable

WiMAX base station

• GMOC


GENI Wireless NtwkResearch Org A

● Researcher

● Slice Admin

● PI

GENI Wireless Metro Network

GENI Clearinghouse


●■Services




Help Desk




GMOCHerron, Indiana

Univ

ORBITGruteser,

Rutgers Univ

WiMAXRaychaudhuri, Rutgers Univ

ORBITGruteser,

Rutgers Univ

Experiment Plane

Measurement Plane

● Control Plane



GENI Spiral 1 Integration: 5 Control Framework Clusters

1578 Overlay Hosting Nodes1578 Overlay

Hosting Nodes

1579 ProtoGENI

1579 ProtoGENI

1595 GpENI1595 GpENI

1646 CMULab1646 CMULab

1609 DETERTrial

Integration

1609 DETERTrial

Integration

1642 Instrumentation

Tools

1642 Instrumentation

Tools

1613 Enterprise

GENI

1613 Enterprise

GENI

1600 PlanetLab

1600 PlanetLab

1658 Mid-Atlantic Crossroads

1658 Mid-Atlantic Crossroads

1602 Sensor/Actuat

or Network

1602 Sensor/Actuat

or Network

1582 ORCA/BEN

1582 ORCA/BEN

1599 Vehicular Mobile

Network

1599 Vehicular Mobile

Network

1660 ORBIT Framework

1660 ORBIT Framework

1601 Virtual Tunnels

1601 Virtual Tunnels

1657WIMAX

1657WIMAX

1663 Digital Object

Registry

1663 Digital Object

Registry

1633 Kansei Sensor Network

1633 Kansei Sensor Network

1628 Measurement

System

1628 Measurement

System

1604 GENI Meta

Operations

1604 GENI Meta

Operations

1643 Programmable

Edge Node

1643 Programmable

Edge Node

1621 GUSH Tools

1621 GUSH Tools

1622 Provisioning

Service

1622 Provisioning

Service

1650 Regional

Opt-In

1650 Regional

Opt-In

1632 Security Architecture

1632 Security Architecture

1645 Million- Node GENI1645 Million- Node GENI

1610 GENI at 4-

Year Colleges

1610 GENI at 4-

Year Colleges

1653 Data Plane

Measurements

1653 Data Plane

Measurements

Cluster A Cluster ECluster D Cluster CCluster B

Key:

Projects with active Spiral 1clearinghouse interfaces

STUDY ALL PICK ONE

1631 Embedded Real-time

Measurements

1631 Embedded Real-time

Measurements

1619 Optical Access

Networks

1619 Optical Access

Networks

Column labels showcommon control framework

Goals for this talk




GEC3 20www.geni.net

www.geni.net 21

What resources can I use?

Components

Aggregate A

Components

Aggregate B

Components

Aggregate C

These

GENIClearinghouse

Researcher

Resource discoveryAggregates publish resources, schedules, etc., via clearinghouses

Early-adopter researcher, not part of the development team

Across any substrate combination in the cluster

Control plane services developed and operated by cluster anchor project

GEC3

www.geni.net 22

GENIClearinghouse

Components

Aggregate A

Components

Aggregate B

Components

Aggregate C

Create my slice

Slice creationClearinghouse checks credentials & enforces policyAggregates allocate resources & create topologies

GEC3

www.geni.net 23

Components

Aggregate A

Components

Aggregate B

Components

Aggregate C

Experiment – Install my software,debug, collect data, retry, etc.

GENIClearinghouse

ExperimentationResearcher loads software, debugs, collects measurements

GEC3

What to do for Spiral 1?

Some example tasks:• Clearinghouse developers

– Share component manager reference code– Develop discovery services, slice control/mgmt tools– Documentation

• APIs• User manuals

• Aggregates– Develop component RSpecs – Adapt component managers to your system– Documentation

• Component programming guides• Measurements

• Integrate, Test, Demo– 6 months for internal development– 6 months to integrate, use, and fix


GEC3 GENI Spiral 1 Control Frameworks Global Environment for Network Innovations Aaron Falk...

Documents

Transcript of GEC3 GENI Spiral 1 Control Frameworks Global Environment for Network Innovations Aaron Falk...