PlanetLab Research Activities

Aki NakaoUniv. of Tokyo / NICT

2

PlanetLabThe largest and most popular overlay network testbedCurrently consists of 863 nodes at 447 sites800+ Projects/ 1000+ ResearchersJGN2/NICT collocate overlay nodes in JapanSeveral Universities in Japan have joined

863 nodes447 sites40+ countries1000+ researchers800+ Projects

Brief History of PlanetLabPlanetLab 1.0 (2002-3)

UNIX account sliversPlanetLab 2.0 (2003-4)

Vserver sliversPlanetLab 3.0 (2004-2006)

PLCAPI 1.0PlanetLab 4.0 (2007-)

MyPLC1.0Federation Idea

PlanetLab 4.2 (2008)Federation (PLE, PLJ, (PLK, PLC,=>PLA?))New Development (RSpec/GENI-wrapper, New Node Type, Monitoring, QA,VINI)

We are here

PlanetLab Consortium

MissionsSupport and enhance the PlanetLabOverseeing the long-term growthDesigning and evolving its software architectureProviding day-to-day operational supportDefining policies that govern appropriate use

Users are required to join the consortiumFree for academic/non-profit organizationAnnual due for corporate members ($300k-$25k)

Two Aspects

Substrate/test-bed for testing distributed applications

Evaluate the new applications on the real networksBridge the deployment gap

Prototyping of new generation network architectures

PlanetLab itself is the running code of slice-based network architecture

5

Deployment GapM

atur

ity

Time

Analysis (MatLab)

Controlled Experiment (EmuLab)

Deployment Study (PlanetLab)

Pilot Demonstration (PL Gold)

Commercial Adoption

Implementation Reality

User & Network Reality

Economic Reality

[http://www.cs.princeton.edu/~llp/planetlab_oct07.ppt]

Target

PlanetWorksCoblitz

New Generation Network and Overlay Network Test-bed

What is OverlayNetwork Testbed for ?

7

Creation of Ideas

Evaluation at LabsPublish

Evaluation at Planetary Scale

Acquire Users (Pilot Services)

Establish Innovative Business

Contributions to SocietyNew Generation Network

Our Goals

Overlay Test-beds Enables These

Limitations in Prior Models

Innovation Feedback Cycle

8

CoDeeN: Partial Replication CDN

BBB.COM

client server surrogate

B

B

B

B

A

A

A

A

AAA.COM

C

C

C

C

CCC.COM

redirector

→ PlanetWorks (2007-)

Large File Transfer! Faster than BitTorrent!

→ Coblitz(2007-)

9

Large File Transfer via Coblitz

Coblitz [Park 06]

Server Client

ClientServer

Proxy

HTTP

Multi Path + Cache

Bittorrent [Cohen 03]

Tracker

Info

Peer Peer

Peer

Peer

What made PlanetLab successful?Centralized trustCentralized resource controlDecentralized management (unbundled management)The bandwidth as freeProvide only best-effort serviceMake Linux the execution environmentDo not provide distributed OS services (up to users)Evolve the API

Self-Scaling Architecture[Tom Anderson, Timothy Roscoe, “Learning from PlanetLab”, WORLDS’06]

[Aki Nakao]

Self-Scaling Architecture (as in P2P)

ConsortiumLoosely bound

Membership AgreementDonate a few resources• At least two machines (minimum H/W requirement)• Bandwidth

“Tit-for-Tat” • Resource reciprocity

The more join, the more useful the system getsPrimary incentives in P2P applications

12

PlanetLab Architecture

PLC(PlanetLab Central)

PlanetLab Architecture

The Internet

PlanetLabNode

Resources

MIT

Princeton

CMU

U.C.Berkeley

U.Tokyo

CambridgeStanford

resourcemanagement

Future Directions

(1) Accelerate the deployment of emerging overlay applications (traditional mission)

CDN, routing, measurement, P2P, DHT, streaming, distributed storage,…

(2) Extend PlanetLab architecture itself (towards new generation network architecture)

FederationPrivate PlanetLabWireless technologies integration Hardware support (C/D separation)GENI, VINI

13

PlanetLab New GenerationPlanetLabNG = GENI PrototypePlanetLab 4.2 + geniwrapper

PLC wrapper: prototype done, integration underwayNM wrapper: prototype in progress

Wrapper includes…interfacesnamespacessecurity mechanisms

Migration planseed registries from PLC’s DBCurrent and new interfaces coexistunbundle PLC over timeexperiment with peering

Overview, Deconstructing PLC and Meeting Notes (Larry Peterson)]

[PlanetLab Developer's MeetingMay 13-14, 2008 (Princeton University)

PlanetLab Research Activities on JGN2

JGN2/NICT PlanetLab CollocationPlanetLab Japan (PLJ) Federation (>PLAsia?)Private PlanetLab : CORE

16

Public PlanetLab and Private PlanetLab

Birth of Private PlanetLab (enabled by MyPLC)PlanetLab → Public PlanetLabPrivate PlanetLab

Smaller-scale, experimental PlanetLab-like environment

From JGN2/NICT stand pointPublic PlanetLab Activity

JGN/NICT CollocationPLJ Federation

Prvate PlanetLab ActivityCORE (Utokyo/NICT)

17

JGN2/NICT PlanetLab CollocationJGN2/NICT Collocation

Princeton has donated machinesPIs: NICT/UTokyo Researchers

18

Research Activity Matrix

Public PlanetLab Private PlanetLab (CORE)

OverlayResearch

Wide-Area Distributed Network ServicesSORA (Overlay Routing)

Disruptive Network ServicesCDN+DHT

OverlayEducation

Class ProjectsRoute Visualization

Disruptive Class ProjectsOpenProxy

Test-bedEnhancement

FederationPlanetLab/OneLab/PLJ

FederationCORE FederationAmbitious EnhancementXen-Enabled PlanetLab

19

SORA OverviewSORA makes Routing-Overlay scalable…

SORA: One-Hop Striping Routing

SORA: One-Hop Striping Routing

Enabling Single-Home Multipath

21[SORA++, J. R. Lane and A.Nakao, under submission]

22

Research Activity Matrix

Public PlanetLab Private PlanetLab (CORE)

OverlayResearch

Wide-Area Distributed Network ServicesSORA (Overlay Routing)

Disruptive Network ServicesCDN+DHT

OverlayEducation

Class ProjectsRoute Visualization

Disruptive Class ProjectsOpenProxy

Test-bedEnhancement

FederationPlanetLab/OneLab/PLJ

FederationCORE FederationAmbitious EnhancementXen-Enabled PlanetLab

23

Xen-Enabled Private PlanetLab

MyPLC

Database

PLC API

Boot Server

Web Server

New Node

VServer Kernel

VMM Framework API Server

VServerWrapper

New Node

Xen Kernel

VMM Framework API Server

XenWrapper

Communicate

Control

As Xen Node As VServer Node

Control

Control

Communicate

Control

Control

Control

Xen VM VServer VM

24

Research Activity Matrix

Public PlanetLab Private PlanetLab (CORE)

OverlayResearch

Wide-Area Distributed Network ServicesSORA (Overlay Routing)

Disruptive Network ServicesCDN+DHT

OverlayEducation

Class ProjectsRoute Visualization

Disruptive Class ProjectsOpenProxy

Test-bedEnhancement

FederationPlanetLab/OneLab/PLJ

FederationCORE FederationAmbitious EnhancementXen-Enabled PlanetLab

25

CORE: Private PlanetLab

CORE

Collaborative Overlay Research Environment Overlay test-bed based on “Private PlanetLab” Provision resources for mission critical services Features we would like to have… Custom hardware to optimize overlay forwarding PoP/Core collocation (nodes “inside” network) Custom hardware to optimize overlay forwarding Federation (e.g. PlanetLab, OneLab) Target overlay research Not just on distributed system apps More on network core architectures Utilize both private & public environments Local v.s. Global / Provisioned v.s. Best-Effort

New Generation Perspectives to Overlay Network

- Testbed for prototype and evaluate a new generation network design- Evolutional nature of overlay network to incorporate into the design

• 10 sites, 52 servers• Multi-Homed

Kyutech

Sendai

Tsukuba

Tokyo

NaganoKanazawa

Nagoya

OsakaKeihanna

Kochi

Okayama

Kitakyushu

Fukuoka

Sapporo

Hiroshima U.

Kochi-techOsaka U.

NICT Koganei

NICT Otemachi

U. Tokyo

Tohoku U.

Sapporo Medical U.

NII

Current:

26

Federation

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

Sliv

er

nodes

slices

slices

nodes

Non-authoritativecaches

PLCAPIcalls

PlanetLab One PlanetLab Two

PlanetLab Future Activities in JapanPublic, Two kinds of Privates

Private PlanetLabto develop Infrastructure

Public PlanetLab (Federated)

PLC

PLC

PLC

PLC

Private PlanetLabto develop Services

Federation

•Local •Richer Resources•Less Restricted Policy•Small Business

MembersNAKAO Akihiro (Project Leader)YAMAMOTO Shu (KDDI)NAKAUCHI KiyohideOZAKI RyotaNISHIDA Yuji

Joined from abroad…Kurt TUTSCHK (Germany)Aun HAIDER (New Zealand)Yufeng WANG (China)Richard Potter (U.S.)Du Ping (China)…inviting more researchers3 more candidates (foreign)

MURATA Masayuki (Advisory)

ATA ShingoOHZAHATA Satoshi

KAMEI Satoshi (NTT Lab)KAWAHARA Ryoichi (NTT Lab)Eng LUA (NTT Lab)ENOMOTO Nobuyuki (NEC)FUJINAMI Makoto (NEC) NISHIKI Ken’ya (Hitachi)SATOH Hiroki (Hitachi)MATSUI Susumu (Hitachi)SHUDO Kazuyuki (Utagoe/NICT)KDDI Lab people

Research Lab Location

Hakusan, Tokyo (near Utokyo)

3-Floors (3F, 4F, 6F)

30

Conclusion

Public PlanetLab Private PlanetLab (CORE)

OverlayResearch

Wide-Area Distributed Network ServicesSORA (Overlay Routing)

Disruptive Network ServicesCDN+DHT

OverlayEducation

Class ProjectsRoute Visualization

Disruptive Class ProjectsOpenProxy

Test-bedEnhancement

FederationOneLab Federation

FederationPLJ(PLA) FederationAmbitious EnhancementXen-Enabled PlanetLab

Need to fill these cells with more research items!!