Federating experimental platforms as a playground for the future internet
-
Upload
fibre-project -
Category
Technology
-
view
391 -
download
1
description
Transcript of Federating experimental platforms as a playground for the future internet
Federating experimental platforms as a playground for the future
internet
Serge Fdidahttp://www-rp.lip6.fr/~sf/
UPMC – Sorbonne UniversitésLaboratoire LIP6 – CNRS
France
FIBRE Workshop- Salvador - Nov 27 2012 1
Past and current testbeds success
FIBRE Workshop- Salvador - Nov 27 2012 2
● Do you/we TRUST the results that you/we produce?
● Can you REPRODUCE the conditions for which you obtained these results, or reproduce the results? Or check the robustness of your assumptions?
● Which Solution(s)?
Simulation, Emulation, Testbeds
● A testbed for what type of problem?
One or multiple testbeds?
● What about the environment?
Monitoring, Control and Experimental plane
Why?
FIBRE Workshop- Salvador - Nov 27 2012 3
What is our target?Can we achieve this?
FIBRE Workshop- Salvador - Nov 27 2012 4
Or this, eg FEDERATION
Overlays
Services
Optical
Sensors
Multi-Hopradio
FIBRE Workshop- Salvador - Nov 27 2012 5
Some possible scenario ….
FIBRE Workshop- Salvador - Nov 27 2012 6
The Polymorphic Internet : Some Internet Future(s)
• The Network is a Database (“CCN”)
• The (Access) Network is The (Access) Network is WirelessWireless
• The Network is the People
• The Network is a global Virtualized resource
• And many others … The Social Computer …
• They’re all Federated (Inter-domain)
FIBRE Workshop- Salvador - Nov 27 2012 7
Enabling continuous deployment of New architectures
Virtualized substrate
IP world
Policies
Monitoring
Security/Trust
Federation
FIBRE Workshop- Salvador - Nov 27 2012 8
The Federation Concept!
FIBRE Workshop- Salvador - Nov 27 2012 9
Federation (dictionary definition!)
A federation is a union comprising a number of partially self-governing regions united by a central ("federal") government under a common set of objectives.
FIBRE Workshop- Salvador - Nov 27 2012 10
Why to federate?
● Many benefits …. For users, testbed providers, …
● But also challenges Complexity, Legal and trust issues Policies
● How? Trust testbed owners Describe, control and manage distributed testbeds
resources
● Challenges Modelling and description of the resources Policies, Monitoring, Scheduling, “Scale”, Diversity, …
FIBRE Workshop- Salvador - Nov 27 2012 11
Federation Architecture
● Who is concerned?
● Management Authority
Own the resources
Legal entity
● Operation Engineers
Operate the testbeds and their associated resources
● Experimenters
Motivated by the launch of an experiment across the resources
FIBRE Workshop- Salvador - Nov 27 2012 12
Architecture: Definition (from GENI)
● An aggregate represents a resource or set of resources that can be offered for inclusion in some customer specified topology. These typically fall into the broad categories of Computation, Communication and Storage resources.
● A sliver is a (real or virtual) resource group provided by the aggregate via the “Aggregate Manager” (AM) API.
● A slice is a collection of slivers gathered for a common purpose that are configured into a topology on which to deploy experiments or applications in some degree of isolation from other slices.
FIBRE Workshop- Salvador - Nov 27 2012 13
Federation: main entities
Researchers
Resources
Facility A
Slice Management
Administrative borderAuthority A Authority B
Slice Management
Facility B
FIBRE Workshop- Salvador - Nov 27 2012 14
Federation (1)
Facility A
Slice Management Slice Management
Facility B1. Share user credentials
FIBRE Workshop- Salvador - Nov 27 2012 15
Federation (2,3)
Facility A
Slice Management Slice Management
Facility B1. Share user credentials
2. Share resource descriptions
3. Allow experiments to run across facilities
FIBRE Workshop- Salvador - Nov 27 2012 16
Federation: more than resource integration
Facility A
Slice Management Slice Management
Facility B
Policies
Monitoring
Security
FIBRE Workshop- Salvador - Nov 27 2012 17
PlanetLab nodes worldwide and (insert) PlanetLab nodes located within Europe
PlanetLab Europe testbed
FIBRE Workshop- Salvador - Nov 27 2012 18
PlanetLab Terminology
● Site A site is a physical location where PlanetLab nodes are located (e.g. Fraunhofer Institute or UCL).
● Node A node is a dedicated server that runs components of PlanetLab services.
● Slice A slice is a set of allocated resources distributed across PlanetLab. Slices are assigned to some number of PlanetLab nodes. Slices have a finite lifetime and must be periodically renewed to remain valid.
● Sliver A sliver is a slice running on a specific node. You can use ssh to login to a sliver on a specific node.
● MyPLC: PL control framework
19FIBRE Workshop- Salvador - Nov 27 2012 19
Distributed Virtualization
● As a user you want to isolated from other activities on those nodes on which you run. The PL provides a level of isolation which gives you your own file system, and process control.
● You share CPU cycles and network bandwidth with other active slivers on each node.
● The concept of slice aggregates the presence of your slivers within the system
20FIBRE Workshop- Salvador - Nov 27 2012 20
Nodes
21FIBRE Workshop- Salvador - Nov 27 2012 21
Slices – hujiple_isis
22FIBRE Workshop- Salvador - Nov 27 2012 22
Slices – upmcple_paristr
23FIBRE Workshop- Salvador - Nov 27 2012 23
Slices
24FIBRE Workshop- Salvador - Nov 27 2012 24
Federation (& Legal aspects)
● Local consortium agreement defines responsibilities and liabilities of each partner
● Federation integrates the consortiums into a seamless global authority
● Formal Trust Relationships are the basis for this integration
25FIBRE Workshop- Salvador - Nov 27 2012 25
Global Federation
26
UPMC
EuropePLC
USAPLC
JapanPLC
Princeton
Kyoto
FIBRE Workshop- Salvador - Nov 27 2012 26
In Practice …
What is SFA, OMF, MySlice, …
FIBRE Workshop- Salvador - Nov 27 2012 27
Researchers
Testbeds
What researchers want
Researchers
Testbeds
What researchers want
To have access to a testbed
Researchers
Testbeds
What researchers want
To access many instances of thesame type of testbed / resource
Researchers
Testbeds
What researchers want
To access many instances of thesame type of testbed / resource
• For geographic diversity• For reproducing experiments
Researchers
Testbeds
What researchers want
To access different types oftestbeds and resources
Researchers
Testbeds
What researchers want
To access different types oftestbeds and resources
• For combined experiments• For moving between simulation,
emulation, and the real-world
Researchers
Testbeds
What researchers want
Authority
Researchers
Testbeds
What researchers want
Administrative simplicity:A single place to sign upin order to use all the testbeds
Authority
Researchers
Testbeds
What researchers want
Experimentcontrol tool
Researchers
Testbeds
What researchers want
Ease of access:The ability to use a smallnumber of familiar tools toaccess and control the testbeds
Experimentcontrol tool
Researchers
Testbeds
Where we were recently
Authorities
Tools
Researchers
Testbeds
Where we were recently
Authorities
Tools
✗
Researchers
Testbeds
Where we were recently
Authorities
Tools
✗ ✗ ✗
Researchers
Testbeds
Where we were recently
Authorities
Tools
✗ ✗✗
Researchers
Testbeds
Impossible to agree on whowill be the single trustedauthority at a global scale
Problems to be solved
Researchers
Testbeds
Impractical to scale asingle database to globalscale
Problems to be solved
Researchers
Testbeds
A secure and distributedthin waist
Common API
Researchers
Testbeds
SFA aims to provide a secure common API with the minimum possible fonctionality to enable a global testbed federation
SFA: Slice Facility Architecture
Researchers
Testbeds
Experiment lifecycle
Authorities
Tools
Authenticate
Researchers
Testbeds
Experiment lifecycle
Authorities
Tools
Resource discovery
Researchers
Testbeds
Experiment lifecycle
Authorities
Tools
Resource reservation
Researchers
Testbeds
Experiment lifecycle
Authorities
Tools
Configure resources
Researchers
Testbeds
Experiment lifecycle
Authorities
Tools
Run experiment
Researchers
Testbeds
Experiment lifecycle
Authorities
Tools
Repatriate results
Researchers
Testbeds
Experiment lifecycle
Authorities
Tools
Release resources
Researchers
Testbeds
SFA and the experiment lifecycle
Authorities
Tools
Authenticate Yes*
*This is at the heart of SFA
Researchers
Testbeds
SFA and the experiment lifecycle
Authorities
Tools
Resource discoveryYes*
*Without going into all details
Researchers
Testbeds
SFA and the experiment lifecycle
Authorities
Tools
Resource reservationYes
Researchers
Testbeds
SFA and the experiment lifecycle
Authorities
Tools
Configure resourcesNo*
*Use the tool of your choice
Researchers
Testbeds
SFA and the experiment lifecycle
Authorities
Tools
Run experimentNo*
*Use the tool of your choice
Researchers
Testbeds
SFA and the experiment lifecycle
Authorities
Tools
Repatriate resultsNo*
*Use the tool of your choice
Researchers
Testbeds
SFA and the experiment lifecycle
Authorities
Tools
Release resourcesYes
Naming (slices, users, resources, authorities)
Hierarchical naming space
Authentication and authorization
X.509 certificates and signed credentials
Federation links through the exchange of certificates
Resource descriptions (RSpecs)
Only the language (XML) not the semantics
Standard API (XMLRPC)
To manage objects (users, resources, slices, authorities)
To manage resources (browse, acquire, manifest)
To manage slices (create, delete, start, stop)
60 SFA
FIBRE Workshop- Salvador - Nov 27 2012 60
OMF supports users over the full cycle of their experiments, from description to instrumentation, to
execution and measurement collection and visualization.
OMF/OML software
FIBRE Workshop- Salvador - Nov 27 2012 61
● A common abstraction to help the user browse through and interact with a large amount of data and sources
● Grounded on related work on data integration and large dataset navigation.
● Formulate semantic queries, requesting ltering and annotations
● Propose enhanced visualizations on received results
● Allow to balance homogeneity and heterogeneity in the GUI
MySlice
FIBRE Workshop- Salvador - Nov 27 2012 62
MySlice
FIBRE Workshop- Salvador - Nov 27 2012 63
FIBRE Workshop- Salvador - Nov 27 2012 64
FIBRE Workshop- Salvador - Nov 27 2012 65