v

Big Data with Cumulus

David Sinn

April 22, 2015

cumulusnetworks.com 2

Cumulus Networks: Making Networks Accessible

Vision Bringing the Linux Revolution to Networking

Mission To enable high capacity networks that are easy to

deploy and affordable helping customers realize the full promise of the software-defined data center.

cumulusnetworks.com 3

Big Data in the Data Center

Super-compute Clusters of x86 servers. Ultra-low latency Large scale east/west traffic

Distributed Storage/MapReduce Dynamic workloads, so locality is difficult

Costly Legacy Deployments

cumulusnetworks.com 4

Traditional BigData Deployments

Layer-2 based Constrained east/west High port costs Variable Latency Host resiliency

demands Closed protocols

cumulusnetworks.com 5

L3: A better design

ECMP based Fat Tree

East/west bandwidth

Better Failure Handling

Scalable: No Bottlenecks

Simple Feature Set

Open Protocols!

LEAF

SPINE

cumulusnetworks.com 6

Big Data Improvements

Stop worrying about locality Full bandwidth is available between any pair of

servers Location becomes irrelevant for performance Keep replicas as far away from each other as

possible

Faster recovery Plenty of core bandwidth to re-replicate after failure Host HA becomes a lower level concern

7

Unified Management

Converged administration Same automation tools for managing servers

now available for the network

cumulusnetworks.com

Layer 3 Fabric

Servers

Switches

CumulusNetworks.com 8

Cumulus Innovation Focus – Apps for the networking infrastructure

Don’t re-invent the wheel, but smoothen the ride

ONIE – Unmanned Install ZTP – Zero Touch Provisioning PTMd – Cable fault detection Unnumbered Interfaces – IP management Network Virtualization – Minimize physical changes Dual Home hosts – Simplified Networks

hardware

Cumulus Linux

routing

gangliabridging

hardware

operating system

app app app

Cumulus Networks and Partner Confidential 9

Automation Workflow

Installation Framework PXE & ONIE to install the OS’s Anisble to install the applications and configure

the nodes

bare metal server

Server OS

app

app

app

BIOS and PXEbare metal

switch

Network OS

app

app

app

Boot Loader and ONIE

Similar to installing a server OS using PXE

Network OSBoot Loader and

ONIE

boot into

Boot Loader and ONIE

boot into

ONIE looks for and installs network OS image

cumulusnetworks.com 10

Demo

Cumulus Customer Workbench

2-Spine + 2 Leaf• OSPF Unnumbered with PTM

2-Ubuntu Servers• Hortonworks Hadoop• HDFS & YARN• Server 1: master + worker• Server 2: worker

cumulusnetworks.com 11

Ansible

Example Automation Process

Network Define topology Install license Configure OSPF Unnumbered & PTM Start networking

cumulusnetworks.com 12

Ansible Continued

Server Setup Create users, setup networking Install packages and dependencies Deploy site specific Hadoop Config Start HDFS & YARN

Enjoy Your BigData Cluster

cumulusnetworks.com 13

Demo

Let’s switch to the demo

CumulusNetworks.com 14

The Data Center Network with Cumulus Linux

Open AffordableResponsive

Unlock Your Choices. Disaggregation of hardware and

software

Choice of best-in-class platforms and tools

Inherently flexible – with no vendor lock-in

Vast resources in the Linux community

Serve the Business Better. Rapid, accurate services with

automation – provisioning in minutes instead of days

Orchestration via server tools

Accelerated innovation via DevOps, open source, and broad solution ecosystem

Save as You Grow. Scalable, affordable capacity in

layer 2, layer 3 or layer 3 overlay networks

>50% CapEx savings with industry-standard hardware running Cumulus Linux

Opex savings through automation, use of server tools and simpler expansion

cumulusnetworks.com 15

© 2015 Cumulus Networks. Cumulus Networks, the Cumulus Networks Logo, and Cumulus Linux are trademarks or registered trademarks of Cumulus Networks, Inc. or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. The registered trademark Linux® is used pursuant to a sublicense from LMI, the exclusive licensee of Linus Torvalds, owner of the mark on a world-wide basis.

Thank You!

Unleashing the Power of Open Networking