PlanetLab Research Activities

Aki Nakao

Univ. of Tokyo / NICT

2

PlanetLabThe largest and most popular overlay network testbed

Currently consists of 863 nodes at 447 sites

800+ Projects/ 1000+ Researchers

JGN2/NICT collocate overlay nodes in Japan

Several Universities in Japan have joined

863 nodes447 sites40+ countries1000+ researchers800+ Projects

Brief History of PlanetLab

PlanetLab 1.0 (2002-3)UNIX account slivers

PlanetLab 2.0 (2003-4)Vserver slivers

PlanetLab 3.0 (2004-2006)PLCAPI 1.0

PlanetLab 4.0 (2007-)MyPLC1.0Federation Idea

PlanetLab 4.2 (2008)Federation (PLE, PLJ, (PLK, PLC,=>PLA?))New Development (RSpec/GENI-wrapper, New Node Type, Monitoring, QA,VINI)

We are here

PlanetLab Consortium

MissionsSupport and enhance the PlanetLab

Overseeing the long-term growth

Designing and evolving its software architecture

Providing day-to-day operational support

Defining policies that govern appropriate use

Users are required to join the consortiumFree for academic/non-profit organization

Annual due for corporate members ($300k-$25k)

Two Aspects

Substrate/test-bed for testing distributed applications

Evaluate the new applications on the real networks

Bridge the deployment gap

Prototyping of new generation network architectures

PlanetLab itself is the running code of slice-based network architecture

5

Deployment GapM

atu

rity

Time

Analysis (MatLab)

Controlled Experiment (EmuLab)

Deployment Study (PlanetLab)

Pilot Demonstration (PL Gold)

Commercial Adoption

Implementation Reality

User & Network Reality

Economic Reality

[http://www.cs.princeton.edu/~llp/planetlab_oct07.ppt]

Target

PlanetWorksCoblitz

New Generation Network and Overlay Network Test-bed

What is Overlay

Network Testbed for ?

7

Creation of Ideas

Evaluation at LabsPublish

Evaluation at Planetary Scale

Acquire Users (Pilot Services)

Establish Innovative Business

Contributions to SocietyNew Generation Network

Our Goals

Overlay Test-beds Enables These

Limitations in Prior Models

Innovation Feedback Cycle

8

CoDeeN: Partial Replication CDN

BBB.COM

client server surrogate

B

B

B

B

A

A

A

A

AAA.COM

C

C

C

C

CCC.COM

redirector

→ PlanetWorks (2007-)

Large File Transfer! Faster than BitTorrent!

→ Coblitz(2007-)

9

Large File Transfer via Coblitz

Coblitz [Park 06]

Server Client

ClientServer

Proxy

HTTP

Multi Path + Cache

Bittorrent [Cohen 03]

Tracker

Info

Peer Peer

Peer

Peer

What made PlanetLab successful?

Centralized trust

Centralized resource control

Decentralized management (unbundled management)

The bandwidth as free

Provide only best-effort service

Make Linux the execution environment

Do not provide distributed OS services (up to users)

Evolve the API

Self-Scaling Architecture[Tom Anderson, Timothy Roscoe, “Learning from PlanetLab”, WORLDS’06]

[Aki Nakao]

Self-Scaling Architecture (as in P2P)

ConsortiumLoosely bound

Membership AgreementDonate a few resources• At least two machines (minimum H/W requirement)• Bandwidth

“Tit-for-Tat” • Resource reciprocity

The more join, the more useful the system getsPrimary incentives in P2P applications

12

PlanetLab Architecture

PLC(PlanetLab Central)

PlanetLab Architecture

The Internet

PlanetLabNode

Resources

MIT

Princeton

CMU

U.C.Berkeley

U.Tokyo

CambridgeStanford

resourcemanagement

Future Directions

(1) Accelerate the deployment of emerging overlay applications (traditional mission)

CDN, routing, measurement, P2P, DHT, streaming, distributed storage,…

(2) Extend PlanetLab architecture itself (towards new generation network architecture)

Federation

Private PlanetLab

Wireless technologies integration

Hardware support (C/D separation)

GENI, VINI13

PlanetLab New Generation

PlanetLabNG = GENI PrototypePlanetLab 4.2 + geniwrapper

PLC wrapper: prototype done, integration underwayNM wrapper: prototype in progress

Wrapper includes…interfacesnamespacessecurity mechanisms

Migration planseed registries from PLC’s DBCurrent and new interfaces coexistunbundle PLC over timeexperiment with peering

Overview, Deconstructing PLC and Meeting Notes (Larry Peterson)]

[PlanetLab Developer's MeetingMay 13-14, 2008 (Princeton University)

PlanetLab Research Activities on JGN2

JGN2/NICT PlanetLab Collocation

PlanetLab Japan (PLJ) Federation (>PLAsia?)

Private PlanetLab : CORE

16

Public PlanetLab and Private PlanetLab

Birth of Private PlanetLab (enabled by MyPLC)PlanetLab → Public PlanetLabPrivate PlanetLab

Smaller-scale, experimental PlanetLab-like environment

From JGN2/NICT stand pointPublic PlanetLab Activity

JGN/NICT CollocationPLJ Federation

Prvate PlanetLab ActivityCORE (Utokyo/NICT)

17

JGN2/NICT PlanetLab Collocation

JGN2/NICT CollocationPrinceton has donated machines

PIs: NICT/UTokyo Researchers

18

Research Activity Matrix

Public PlanetLab Private PlanetLab (CORE)

OverlayResearch

Wide-Area Distributed Network ServicesSORA (Overlay Routing)

Disruptive Network ServicesCDN+DHT

OverlayEducation

Class ProjectsRoute Visualization

Disruptive Class ProjectsOpenProxy

Test-bedEnhancement

FederationPlanetLab/OneLab/PLJ

FederationCORE FederationAmbitious EnhancementXen-Enabled PlanetLab

19

SORA OverviewSORA makes Routing-Overlay scalable…

SORA: One-Hop Striping Routing

SORA: One-Hop Striping Routing

Enabling Single-Home Multipath

21[SORA++, J. R. Lane and A.Nakao, under submission]

22

Research Activity Matrix

Public PlanetLab Private PlanetLab (CORE)

OverlayResearch

Wide-Area Distributed Network ServicesSORA (Overlay Routing)

Disruptive Network ServicesCDN+DHT

OverlayEducation

Class ProjectsRoute Visualization

Disruptive Class ProjectsOpenProxy

Test-bedEnhancement

FederationPlanetLab/OneLab/PLJ

FederationCORE FederationAmbitious EnhancementXen-Enabled PlanetLab

23

Xen-Enabled Private PlanetLab

MyPLC

Database

PLC API

Boot Server

Web Server

New Node

VServer Kernel

VMM Framework API Server

VServerWrapper

New Node

Xen Kernel

VMM Framework API Server

XenWrapper

Communicate

Control

As Xen NodeAs VServer

Node

Control

Control

Communicate

Control

Control

Control

Xen VMVServer

VM

24

Research Activity Matrix

Public PlanetLab Private PlanetLab (CORE)

OverlayResearch

Wide-Area Distributed Network ServicesSORA (Overlay Routing)

Disruptive Network ServicesCDN+DHT

OverlayEducation

Class ProjectsRoute Visualization

Disruptive Class ProjectsOpenProxy

Test-bedEnhancement

FederationPlanetLab/OneLab/PLJ

FederationCORE FederationAmbitious EnhancementXen-Enabled PlanetLab

25

CORE: Private PlanetLab

CORE

Collaborative Overlay Research Environment Overlay test-bed based on “Private PlanetLab” Provision resources for mission critical services Features we would like to have… Custom hardware to optimize overlay forwarding PoP/Core collocation (nodes “inside” network) Custom hardware to optimize overlay forwarding Federation (e.g. PlanetLab, OneLab) Target overlay research Not just on distributed system apps More on network core architectures Utilize both private & public environments Local v.s. Global / Provisioned v.s. Best-Effort

New Generation Perspectives to Overlay Network

- Testbed for prototype and evaluate a new generation network design- Evolutional nature of overlay network to incorporate into the design

• 10 sites, 52 servers• Multi-Homed

Kyutech

Sendai

Tsukuba

Tokyo

NaganoKanazawa

Nagoya

OsakaKeihanna

Kochi

Okayama

Kitakyushu

Fukuoka

Sapporo

Hiroshima U.

Kochi-techOsaka U.

NICT Koganei

NICT Otemachi

U. Tokyo

Tohoku U.

Sapporo Medical U.

NII

Current:

26

Federation

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

Sli

ver

nodes

slices

slices

nodes

Non-authoritativecaches

PLCAPIcalls

PlanetLab One PlanetLab Two

PlanetLab Future Activities in JapanPublic, Two kinds of Privates

Private PlanetLabto develop Infrastructure

Public PlanetLab (Federated)

PLC

PLC

PLC

PLC

Private PlanetLabto develop Services

Federation

•Local •Richer Resources•Less Restricted Policy•Small Business

MembersNAKAO Akihiro (Project Leader)YAMAMOTO Shu (KDDI)NAKAUCHI KiyohideOZAKI RyotaNISHIDA Yuji

Joined from abroad…Kurt TUTSCHK (Germany)Aun HAIDER (New Zealand)Yufeng WANG (China)Richard Potter (U.S.)Du Ping (China)…inviting more researchers3 more candidates (foreign)

MURATA Masayuki (Advisory)

ATA Shingo

OHZAHATA Satoshi

KAMEI Satoshi (NTT Lab)

KAWAHARA Ryoichi (NTT Lab)

Eng LUA (NTT Lab)

ENOMOTO Nobuyuki (NEC)

FUJINAMI Makoto (NEC)

NISHIKI Ken’ya (Hitachi)

SATOH Hiroki (Hitachi)

MATSUI Susumu (Hitachi)

SHUDO Kazuyuki (Utagoe/NICT)

KDDI Lab people

Research Lab Location

Hakusan, Tokyo (near Utokyo)

3-Floors (3F, 4F, 6F)

30

Conclusion

Public PlanetLab Private PlanetLab (CORE)

OverlayResearch

Wide-Area Distributed Network ServicesSORA (Overlay Routing)

Disruptive Network ServicesCDN+DHT

OverlayEducation

Class ProjectsRoute Visualization

Disruptive Class ProjectsOpenProxy

Test-bedEnhancement

FederationOneLab Federation

FederationPLJ(PLA) FederationAmbitious EnhancementXen-Enabled PlanetLab

Need to fill these cells with more research items!!