Deep Dive QFX5100 & Virtual Chassis...

1 Copyright © 2012 Juniper Networks, Inc. www.juniper.net

Deep Dive QFX5100 & Virtual Chassis Fabric

Washid Lootfun Sr. System Engineer [email protected]

QFX5100 product overview

QFX5100 Series • Next Generation Top of rack switches

– Multiple 10GbE/40GbE port count options

– Supports multiple data center switching architectures

• New Innovations: – Topology-Independent In-Service Software

Upgrades – Analytics – MPLS – GRE tunneling

Low Latency Rich L2/L3 features including MPLS

SDN ready

QFX5100-24Q

24 x 40GbE QSFP+ 2 expansion slots for

4 x 40GbE QSFP modules

Max 104 x 10GbE 2.56 Tbps

throughput 1U fixed form factor

QFX5100-48S

48 x 1/10GbE SFP+ 6 x 40GbE QSFP+ Max 72 x 10GbE

ports 1.44 Tbps


QFX5100-96S

96 x 1/10GbE SFP+ 8 x 40GbE QSFP+ Max 104 x 10GbE

ports 2.56 Tbps


QFX5100-48T

48 x 10GT 6 x 40GbE QSFP+ Max 72 x 10GbE

ports 1.44 Tbps


Low latency │ Rich L2/L3 feature set │ Optimized FCoE

QFX5100 Series

QFX5100-48s

48 x 1/10GbE SFP+ interfaces 6 x 40GbE QSFP interfaces

Mgmt0 (RJ45)

Mgmt1 (SFP)

Console USB

4+1 redundancy fan tray, color coded (orange: AFO, blue: AFI), Hot-swappable

1+1 redundancy 650W PS color coded, hot-swappable

Front side (port side) view

QFX5100-96s

Supports two port configuration modes: 96 x 10GbE SFP plus 8 x 40GbE interfaces 104 x 10GbE interfaces

1.28Tbps (2.56Tbps full duplex) switching performance New 850W 1+1 redundant color-coded hot-swappable power supplies 2+1 redundant color-coded hot-swappable fan tray

96 x 1/10GbE SFP+ interfaces 8 x 40GbE QSFP interfaces


QFX5100-24Q

24 x 40GbE QSFP interfaces Two hot-swappable 4x40GbE QSFP modules


Mgmt0 (RJ45)

Mgmt1 (SFP)

Console USB



Same FRU side configuration as QFX5100-48S

QFX5100-24Q

Port configuration has 4 modes, mode change requires reboot

1. Default (Fully Subscribed mode): 1. Doesn’t support QIC 2. Maximum 24x40GbE interfaces or 96x10GbE interfaces; line rate performance for all packet sizes

2. 104-port mode 1. Only first 4x40GbE QIC are supported with last 2 40GbE interfaces disabled; first 2 QSFPs work as 8x10GbE 2. 2nd QIC slot cannot be used; no native 40GbE support. 3. All base ports can be changed to 4x10GbE ports (24x4=96), so total is 104x10GbE interfaces

3. 4x40GbE PIC mode 1. All base ports can be channelized 2. Only 4x40GbE QIC is supported; works in both QIC slots but can’t be channelized. 3. 32X40GbE or 96X10GbE + 8X40GbE

4. Flexi PIC mode 1. Support all QICs but QIC can’t be channelized 2. Only base port 4-24 can be channelized. Also supports 32x40GbE configuration

24 x 40GbE QSFP interfaces Two hot-swappable 4x40GbE QSFP modules

Front side (port side) view (Same FRU side configuration as QFX5100-24S

QFX5100-24Q Default (Fully Subscribed mode): Option 1….

• Doesn’t support QIC • Maximum 24x40GbE interfaces or 96x10GbE interfaces • Line rate performance for all packet sizes

Doesn’t support QIC 24 x 40GbE QSFP interfaces 96x10GbE OR

QFX5100-24Q 104-port mode: Option 2….

24 x 40GbE QSFP 96x10GbE Doesn’t support QIC Support QIC Work as 8x10G

All base ports can be changed to 4x10GbE ports (24x4=96), so total is 104x10GbE interfaces

OR

1. Only first 4x40GbE QIC are supported with last 2x40GbE interfaces disabled; first 2 QSFPs work as 8x10GbE

2. 2nd QIC slot cannot be used; no native 40GbE support. 3. All base ports can be changed to 4x10GbE ports (24x4=96), so total is 104x10GbE interfaces

QFX5100-24Q 4x40GbE PIC mode: Option 3….

Only 4x40GbE QIC No Channelized

All base ports can be channelized

32X40GbE OR 96X10GbE + 8X40GbE

1. All base ports can be channelized 2. Only 4x40GbE QIC is supported; works in both QIC slots but can’t be channelized. 3. 32X40GbE or 96X10GbE + 8X40GbE

QFX5100-24Q 4x40GbE Flexi PIC mode: Option 4….

4x40GbE QIC No Channelized

4-24 ports can be channelized

32X40GbE OR 96X10GbE + 8X40GbE

1. Support all QICs but QIC can’t be channelized 2. Only base port 4-24 can be channelized. Also supports 32x40GbE configuration

1U 48-port 1/10GT Switch Wire-rate performance on all ports 48 – 10GBASE-T ports and 6 – 40GbE

QSFP ports 40GbE QSFP interface can be

converted to 4 x 10GbE interfaces 720 Gbps switching performance (or

1.44 Tbps duplex) Two management ports Cat5e, Cat6 and Cat6a

Software Parity with QFX5100-48S MPLS (L2VPN, L3VPN) L2/L3 Support

Introducing QFX5100 10GBASE-T

QFX5100 – Rear View Redundant power modules Redundant cooling modules

SKU 10GbE ports 40GbE ports Total 10/40GbE ports Cooling Power supply

QFX5100-48T 48 6 48/6 AFO/AFI AC QFX5100-48T-DC 48 6 48/6 AFO/AFI DC

QFX5100-48T

6 x 40GbE QSFP+ 48 x 100M/1GbE/10GbE RJ-45 Console

Mgmt0 (RJ45)

Mgmt1 (SFP)

Mgmt1 (SFP)



• Fixed Configuration • dept1 RU height • ~22 inches in depth

• Redundant Hardware

• Hot-Swappable PSU • N+1 FANs

• Airflow

• Front-to-Back • Back-to-Front

• SKU information

• Ships with 2 PSUs • AC and DC options • Existing QFX optics

support

Air Flow Through QFX5100

Air In Airflow Through QFX5100 Air Out Airflow Through QFX5100

Do Not Install Components with Different Airflow or Wattage in the Switch

Advanced JUNOS SOFTWARE ARCHITECTURE Provides the foundation for advanced functions • ISSU (In-Service Software Upgrade). ENABLE HITLESS UPGRADE • Other Juniper applications for additional service in a single switch • Third-party application • Can bring up the system much faster

Linux Kernel (Centos)

Host NW Bridge KVM

JunOS VM

(Active)

JunOS VM

(Standby)

3rd Party Application Juniper Apps

Junos VM (Master) Junos VM (Master) Junos VM (Backup) Junos VM (Master)

QFX5100 Hitless operations Dramatically Reduces Maintenance Windows

Network Resiliency

Net

wor

k P

erfo

rman

ce QFX5100 Topology-

Independent ISSU

Competitive ISSU Approaches

Data Center Efficiency During Switch Software Upgrade

High-Level QFX5100 Architecture

x86 Hardware Broadcom Trident II

Kernal Based Virtual Machines

Broadcom Trident II

PFE PFE

Linux Kernel

Virtual Chassis Fabric

Virtual Chassis Fabric What and Why

Simple Flat Architecture

Deterministic low latency Predictable performance

Simple Operations

“1” switch to manage Plug-and-play

Flexible PoD

L2, L3, FCoE, MPLS on any port 1/10/40GbE in one pod

Building Blocks

QFX5100, QFX3500, QFX3600, EX4300

Simplify network architecture Complex Network

Architecture Multi tier architecture

Virtual and physical are separate world

Leaf 1 Leaf 3 Leaf 2 Leaf 16

Leaf 4

Spine 1 Spine 2 Spine 3 Spine 4

Any-to-Any

1.8 usec

Simple Flat Architecture

Deterministic Low Latency Predictable performance

Simplified operation

Simple Operations “1” switch to manage Plug-and-play

Too many switches to manage Various management tools

Complex Operations

Access

Aggregation

Core

Application flexibility

Custom PODs

Dedicated network for each application Unpredictable performance

Dedicated network for each application Predictable performance

Common POD

L4/L7 Services

FC SAN FC

Storage

FC Gateway

L2/L3 Core Switch

L2/L3 Access Switch

L2, L3, FCoE, MPLS on any port

1GbE/10GbE/FCoE servers

3rd party L2/L3 switch aggregation

Standard L4/L7 service

Resilient Control & Data plane

Active Hot- Backup Eligible-RE Control Plane Redundancy Dual RE (routing engine) redundancy

Resilient In-Band Control plane

GRES ,NSR, NSB

uplink redundancy

1 RU, 48 SFP+ & 1 QIC

Data Plane Redundancy

O VM VM VM

vSwitch

Virtual Server

O VM VM VM

vSwitch

Virtual Server

Server multi-homing

Active-active uplink forwarding

server multi-homing

uplink redundancy

Redundant Routing engines

Eligible-RE

Intelligent spine nodes & intelligent leaf nodes

Distributed Forwarding

DATA PLANE – MULTI-PATH LOCAL SWITCHING

Backup RE Candidate RE Candidate RE

• All Fabric links active-active • Traffic load balanced on all links • 1.8usec inter rack latency

Master RE

• In rack switching • 550nsec in rack latency • 16 way server multi-homing

DEPLOYMENT FLEXIBILITY

VCF with 2 spine nodes

10G 10G 10G

QFX5100-24Q

1 2 18

10G 10G

3 4

QFX5100-48S

1 2

2 X uplinks

18 x 10GE racks 936 x 10GE ports 6:1 oversubscription

10G 10G 10G

QFX5100-24Q

1 2 16

10G 10G

3 4

1 2 3 4

QFX5100-24Q QFX5100-96S 8 X uplinks

16 x 10GE racks 1,536 x 10GE ports 3:1 oversubscription

VCF with 4 spine nodes

40G

2 or 4 Spin node deployments

10GbE POD 1/10/40GbE POD 1GbE POD Spine QFX5100-24Q QFX5100-24Q QFX5100-48S

Leaf

QFX5100-48S

QFX5100-24Q

QFX5100-96S

QFX3500 & QFX3600

QFX5100-48S

QFX5100-24Q

QFX5100-96S

QFX3500 & QFX3600

EX4300

EX4300

10/40GbE spine and 1/10/40GbE leaf nodes

1,10,40GbE – all in one fabric

10GbE 1/10/40GbE 1GbE 40GbE 10GbE

Compatibility matrix PLATFORM SPINE NODE LEAF NODE

QFX5100-24Q ✓ ✓

QFX5100-48S ✓ ✓

QFX5100-48T ✗ ✓*

QFX5100-96S ✗ ✓*

QFX3500 ✗ ✓

QFX3600 ✗ ✓

EX4300 ✗ ✓

Scales to 32 members

* Roadmap, refer to roadmap slide

EX4300, QFX3500, QFX3600 and QFX5100 members

Virtual Chassis Fabric (up to 20 members)

Optimized for 1/10/40GbE environments

Data Center Switching Fabric Architectures one switch, any deployment

Spine-Leaf / MC-LAG

… EX4300, QFX3500, QFX3600

or QFX5100 leafs

EX9200 or QFX5100 spines

EX4300, QFX3500, QFX3600 or QFX5100 members

Virtual Chassis (up to 10 members)

Optimized for 1GbE environments

QFabric (up to 128 nodes)

QFX3500, QFX3600 or QFX5100 nodes

Optimized for 10/40GbE environments

OPEN

ARC

HITEC

TUR

ES JU

NIPER

ARC

HITEC

TUR

ES M

anaged as a Single Switch

Layer 3 Fabric / CLOS

L3 Fabric

EX4300, QFX3500, QFX3600 or QFX5100 members

Juniper QFX5100 Family QFX5100-24Q QFX5100-48S QFX5100-96S

Deep Dive QFX5100 & Virtual Chassis...

Documents

Transcript of Deep Dive QFX5100 & Virtual Chassis...