FIBRE on AmLightEnabling experimentation over a

production SDN backbone

Marcos Schwarz

RNP Brazilian Academic Research and Education Network

Internet2 Global Summit, Washington DC, April 27th 2015

Evolution of FIBRE: a large-scale Future Internet testbed facility

• Original objective: design, implement and validate a shared large-scale testbed to support experimental research in Future Internet.

• Studies began in 2008, inspired by GENI (USA) and by the FIRE (Future Internet Research and Experimentation) program of the EU

• Funding provided 2011-2014 through the 2010 1st Coordinated Call in ICT between Brazil and the EU, supporting a single FI testbed project, FIBRE (FI testbed/experimentation between Brazil and Europe).

• FIBRE includes 10 nodes in Brazil and 3 in the EU. The follow-on FIBRE2 project is being funded in Brazil to support the operation, maintenance and expansion of the existing testbed, for use by the approved project on “experimental platforms” selected in the 2014 3rd CC.

• On-going conversations were initiated in 2013 to promote the international federation of the FI testbeds, including FIBRE.

Federation (international)

3

to Eu

rope

Federation (Brazil)

4

UFFUFSCar

UNIFACS

UFPE

UFG

UFPA

RNP/NOC

USPCPqD UFRJ

Wireless experimental facility

OFELIA Control FrameworkOMF

UFRJ

UFF

RNP

UFPEUFPA UNIFACS

OMFOCF

UFG

OMFOCFUFSCar

USP

CPqD

OMFOCF

OMFOCF

PoP-BAPoP-PA

PoP-GO PoP-DF

PoP-RJ

PoP-Pe

PoP-SP

NOCOMF

OCF

OCFOCF

OCF

OCF

USA

Spain

UK

OCF

OCF

AMPATH

OCF

Architecture

5Situation as of Feb 2015

Europe Interconnection

6VLAN Translation

PoP-DF

Barueri-SP (Terremark)

RedCLARA Cisco Catalyst 3750

RedIRIS

Cisco Catalyst 3750

CESCA

Cisco Catalyst 3750

PoP-SP

RNP MX480 Internet2

Miami, USA (Terremark)

UnivBris

ANSP XMR

10.0.0.6/30

VLAN RNP - i2Cat (689)

Brocade CES 2024

RNP MX480

FIBRE SWPoP-DF

FIBRE SWRNP

10.0.0.5/30

AMPATH XMR

689

689

689

i2Cat

10.0.0.1/30

VLAN RNP <-> UnivBris (458 / 404 / 900)

CiscoCatalyst 3750

Gateway

458 458 458

404

GÉANT404

689 689

689

689

458

458

458

689

689

900458

JANET 900

9004082

689689

10.0.0.2/303220

FIBRE-BR Islands3220

Bristol Island4082

i2cat Island40824082

Routing

FIBRE Backbone @ RNP

7

Data Plane - March/2015

AMPATH

FIBRE-RJFIBRE-SP

FIBRE-GO

RNP-GO

RNP-RJ

FIBRE-DF

RNP-DF

FIBRE-BA

FIBRE-PE

RNP-PE

FIBRE-PA

RNP-SP RNP-BA

RNP-PA

AMPATH Interconnection

8

FIBRE Backbone @ RNPFIBRE Backbone @ AmLight AMPATH Island

AMPATH1

AMPATH2

Chile1

Chile2

AmLight SDNFIBRE Slice

VLAN Range: 100-400

ANSP

Pica8

VMs Server

FIBRE-SP

RNP-SP

Software Architecture

9

Technical details and issues

• Interconnection solutions• RNP backbone: slice of dedicated OpenFlow switches interconnected through

L2VPNs (MPLS+QinQ) over a non-OpenFlow backbone• AmLight backbone: slice of a production SDN backbone of virtualized Brocade

OpenFlow switches

• Production vs Experimentation mindset• How to provide the same features and experience of a dedicated experimental

facility but keeping the stability and availability of a production environment?

• FIBRE slices on production OpenFlow Switches• Packtins (Reactive mode) are disabled on AmLight switches• Specific flows wre installed per slice to restore reactive behavior• FlowVisor Topology Discovery service required untagged LLDP packets using reactive

mode of OpenFlow

• Layer 2 Tunnels vs SDN virtualization• Moving the overhead from the data to the control plane

Thank you / ObrigadoMarcos Schwarz marcos.schwarz @ rnp.brRNP

www.facebook.com/fibre.project

www.fibre.org.br

FIBRE Overhead Comparison

12