opencord.org

CORD: Central Office Re-architected as a Datacenter

Sachin Vasudeva(Adapted from Ali Al-Shabibi)

Open Networking Lab

Service Provider Driven

Residential / Mobile / EnterpriseResidential / Mobile / Enterprise

Collaborators and Contributors

Economies of a datacenter

Infrastructure built with a few commodity building blocks

using open source software and white-box switches

Agility of a cloud provider

Software platforms that enable rapid creation of new services

CORD Aims to Deliver

• Introduction to CORD

• Service Composition in CORD

• ONOS-based Services in CORD

Outline

Design Philosophy

SDN NFV

Cloud

XaaS

XaaS – Everything-as-a-Service

Design Philosophy Tangible Value

SDN NFV

CloudExtends the agility of micro-services to the access network

Supports legacy VNFs and

pushes the limits of disaggregation

Interconnects VNFs and is

a source of innovative services

XaaS

Cloud Economies and Agility

Large number of COs

Evolved over 40-50 years

Huge source of CAPEX/OPEX

Problem: Today’s Telco Central Offices (COs) are huge source of CAPEX/OPEX

• Fragmented non-commodity hardware.• Physical install per appliance per site• Nearly 300+ unique deployed appliances.

BNG

FirewallDPI

CDNMessageRouter

CarrierGrade NAT

Session BorderController

PE RouterSGSN/GGSN/PDN-GW

Source: AT&T

and their design/infrastructure is not geared for programmability, agility

GP

ON

(Access)

RO

AD

M

(Core

)

Commodity Servers, Storage, Switches, and I/O

PON

OLT

Leaf-Spine

Fabric

PON

OLT

e.g., AT&T Open GPON

48-port, 1RU, I/O Box

CORD – Hardware Architecture

CORD POD

Spine-2Spine-1

Leaf-3

Leaf-1

Compute-1

Compute-3

OLT-1

Leaf-4

Leaf-2

Compute-2

Head-Node-1

Head-Node-2

Head-Node-3

OLT-2

1Gbps

Management Network

40Gbps

3x40Gbps

Sizing is Configurable From a partial rack to 16 racks!

CORD Rack

Head NodesOLTs

Compute Nodes

Fabric Switches

ONTs

CORD – Software Architecture

CORD POD

Controller

Operator Directives: Design Time & Runtime

Customer

AccountsInventory Analytics

Allocation

Policy…

CORD – Service Graph

Controller

Operator Directives: Design Time & Runtime

Customer

AccountsInventory Analytics

Allocation

Policy…

vOLT

Controller

vSG

Controller

vRouter

Residential

Subscribers

Controller

Controller

vCDN

Controller

OpenStack ONOS

Controller Controller

Monitoring

XOS

ONOS

Access-as-a-Service

Subscriber-as-a-Service

Internet-as-a-Service

CDN

OpenStack / Docker

vSG vCDN

CORD – Software Stack

vOLT vRouterMulticast

Control

Fabric

ControlVTN

Ceilometer

Monitoring-as-a-Service

Scalable Services Run in

OpenStack VMs and Docker Containers

Control Applications

Hosted by ONOS

Multi-Tenant

Services

Assembled

by XOS

Legacy Central Office

Residence Central Office

CPE ONU OLTETH AGG BNG

BackboneNetwork

CPE – Customer Premises Equipment

OLT – Optical Line Termination

BNG – Broadband Network Gateway

Disaggregation

Residence Central Office

CPE ONU OLTETH AGG BNG

BackboneNetwork

CPE – Customer Premises Equipment

OLT – Optical Line Termination

BNG – Broadband Network Gateway

vSG

vOLT

vRouter

Disaggregation

Residence Central Office

CPE ONU OLTBackboneNetwork

CPE – Customer Premises Equipment

OLT – Optical Line Termination

BNG – Broadband Network Gateway

vSG

vOLT

vRouter

Switching Fabric

BNGETH AGG

Today: Linux Container

Plan: E2-based NF Chain

RO

AD

M(C

ore)

PONOLTs

BBUs

MobilevBBU. vMME,vSGW, vPGW,

vCDN

ResidentialvOLT, vSG,

vRouter, vCDN

EnterprisevCarrierEthernet,vOAM, vWanEx,

vIDS

Metro Ethernet

Domains: Residential/Mobile/Enterprise

CORD Controller

Reference Implementation

CORD POD

An open virtualized service

delivery platform that provides

cloud economies and agility.

From Access-as-a-Service

to Software-as-a-Service.

Hardware Blueprint

Bill of Materials– OCP Servers

– OCP Switches

– OCP Access Blades

Assembly Instructions– …

Testing Infrastructure– …

Open Source Software

Core Components– OpenStack

– Docker

– ONOS

– XOS

Access Services– R: vOLT, vSG, vRouter

– E: vOAM, vCE,…

– M: vBBU, vPGW,…

– …

Other Services– Monitoring

– …

Configured for Different Domains:

Residential, Enterprise, Mobile

Ciena and Radisys

to provide turnkey

CORD PODS

GPON

ONT

AT&T U-verse

AT&T Trial

Spine-2Spine-1

Leaf-1b

Leaf-1a

Compute-1

Compute-3

OLT-1

Leaf-2b

Leaf-2a

Compute-2

Head-Node-1

Head-Node-2

Head-Node-3

OLT-2

Laptop NetGear

CORD Controller

vOLT

Controller

vSG

Controller

vRouter

Controller

Controller

vCDNONOS

Controller Controller

Monitoring

Customer Care

Portal

Operator

Portal

Controller

OpenStack

Residential

Subscribers

Access the Internet

Stream (Cached) Video

Watch TV

opencord.org

ONOS-based ServicesvOLT & vRouter

Software - vOLT

PMC vOLT

OMCI

• Runs either in a container or VM• Exposes an OpenFlow interface north to

ONOS • Controlled by vOLT suite of applications on

ONOS• Converts OpenFlow messages into OMCI

to provision the ONU• Enables the OLT to pass 802.1X and IGMP

packets to ONOS- to implement client/ONU authentication; and- to implement IGMP snooping

CPE boot and Authentication

IO

IO

Metro CoreLink

IO

AccessLink

SpineSwitches

Leaf Switches

RADIUS

Co

ntr

ol

Data

PONOLT

MACs

Commodity hardware

CORD Software Stack = XOS + ONOS + OpenStack

vOLT ONOS App

ONTSimple CPE

GPON

CPE (re)boots

Dataplane Configuration

Home

NetworkCPE OLT

No VLAN Default VLAN (0) Q-in-Q

• OLT double tags packets from customer

• C-tag identifies the customer

• S-tag identifies the OLT the customer is connect to

• OLT also meters customer connections

• OLT maintains group information to handle multicast

traffic

?

Spinning Up a vSG

IO

IO

Metro CoreLink

IO

AccessLink

SpineSwitches

Leaf Switches

Co

ntr

ol

Data

PONOLT

MACs

Commodity hardware

CORD Software Stack = XOS + ONOS + OpenStack

vOLT

ONTSimple CPE

GPONvSG

Authentication has been

successful. A vSG is now

needed.

• vRouter interfaces between a CORD POD and the upstream network

• Communicates with upstream routers and provisions connectivity between CORD and upstream network

• Requirements vary for different deployments

• Implemented as an ONOS network control function

vRouter Service in CORD

You might have thought about VNF like this…

28

vRouter

Data Plane

Control Plane(OSPF, BGP ..)

VNF = vRouter VM

VNFM(VNF Manager)

Management(CLI, SNMP, NETCONF)

Data Plane

Control Plane(OSPF, BGP ..)

Management(CLI, SNMP, NETCONF)

Problem

Hair pinning

Embedded control plane complexity for scale-out

29

vRouter

vRouterVM

CPDP

VNF

VNF

VNF

DP

DP

DP

DP

CP

DP

This is how we implement vRouter…

Me

troR

ou

ter

ONOS Controller Cluster

vRouterControl

vOLTControl

OverlayControl

Underlay Control

MulticastControl

XOS (Orchestrator)

vSG

vSG

vSG

VNF

VNF

VNFVNF

VNF VNFVNF

VNF VNF VNFVNF

VNF

OVS OVS OVS OVS OVS

White Box White Box

White Box

White Box

White Box White Box White Box White Box

White Box White Box White Box

White Box

White Box

White Box

White Box

White Box

vRouter

Quagga

BGP/OSPF

CORD vRouter Implemented as a big distributed router

Presents entire CORD infrastructure as a single router to outside world30

R,E,M-Access

CORD Provides Cloud Economies and Agility

Fully Exploits Micro-Services (Access-as-a-Service)

Fully Exploits Disaggregation (vOLT vSG vRouter)

Fully Exploits SDN (overlay, underlay, services)

CORD is Catalyzing an Ecosystem

Active Developer Community (Carriers and Vendors)

Two Partners Providing Integration (Ciena, Radisys)

Summary