LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E:...

18
© 2019 Juniper Networks Confidential LEVERAGING 400 GBE JJ Jamison JET Meeting May 21, 2019 Improving Network Economics While Driving Performance -.

Transcript of LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E:...

Page 1: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

LEVERAGING 400 GBE

JJ Jamison

JET Meeting

May 21, 2019

Improving Network Economics While Driving Performance

-.

Page 2: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

ETHERNET SPEEDS t•-11.6TbE

1T-+------+------+------+-----+---.111111oP,-,-­, ... __ , 800GbE

400G-------------" 10 OG -+-------1-------1-------1

~ ~ 40G--a-------1------~ ...., ~ 10G-+-----+----~ cu cu a. 1G------u, ~ C ·- 100M -----...J

10M 1980 1990 2000 2010

Standard Completed

2020 2030

Ethernet Speed

-, ~-' Possible Future Speed

Page 3: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

DRIVERS FOR 400GBE

-.

Page 4: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

WHAT DRIVES JUNIPER’S SOLUTIONS FOR R&E NETWORKS?

The drivers for the solutions we position, and I evangelize, for R&E networks come from other markets.

Fast/Reliable/Low Cost Routers (Carriers)*

IPv6 (Carriers)

Multicast (Wall Street)

Express Path on Firewalls (Wall Street)

perfSONAR (read 3rd party apps) on routers and switches (Social Media)

Node Slicing in R&E Peering Points (Carriers)

400 GE for R&E Networks (Datacenters)

Page 5: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

TRENDS DRIVING 400 GE UPTAKE IN DATA CENTERS

• High Compute Intensive Applications to be run extremely fast on parallel clusters

• Proliferation of Devices resulting in exponential growth of internet data traffic

• Enterprise workloads (Compute and Collaboration)

• Consumer workloads (Video Streaming and Social Networking)

• Digital Transformation of businesses across the entire global spectrum

• Data Center Applications Requirements of HyperScalars:

• Facebook relies on improved User Experience in spite of ever-growing traffic

• Amazon relies on Cost control – Minimum Cost incurred per Gigabyte of internet traffic

•Google, Baidu, Alibaba and Tencent – All rely on Faster Response to queries

Rapid Adoption Forecast: A Dell’ Oro Research Report forecasts 400G to comprise 20% of data-center switching revenue by 2020*

Page 6: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

TRENDS THAT WILL BE DRIVING 400GE UPTAKE IN R&E

• Elephant Flows

• Massive instruments dumping ridiculous amounts of data where the preference is not to process locally*

• Massive instruments dumping ridiculous amounts of data that is to expensive to process locally

• Proliferation of Science DMZs and DTNs

• More Elephants and Bigger Elephants on the Horizon100 G 100 G 100 G 100 G 100 G

400 G

Page 7: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

ECONOMICS OF 400GBE*

-.

Page 8: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

WITH OPTICS ECONOMIES OF SCALE ARE NOT COMPELLING

• Traditionally, Costs of Optical Transceivers driven down solely by Volume Economies of Scale. Suppliers Depend on Demand for more optics to drive down costs.

• In contrast, 100 times larger silicon chip supply chain benefited from shared

• design methodologies

• automated wafer manufacturing

• shared packaging approaches

• common test infrastructure

to deliver unparalleled economies of scale for computing and networking equipment. (Moore’s Law)

• Juniper has been successful in lowering cost per bit of its own product portfolio, but dependent on vendors to lower cost of optical interconnects.

• So Juniper acquired Aurrion Inc. in 2016 to build in-house silicon photonics technology.

Page 9: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

SILICON PHOTONICS

• Silicon photonics leverages benefits of silicon chip ecosystem:

• Shared design methodologies

• Outsourced wafer manufacturing to achieve economies-of-scale.

• Juniper’s Differentiation:

• Integration of all photonic elements of an optical transceiver— lasers, detectors etc. — within a single silicon photonics die.

• Integrating Indium phosphide materials into a silicon process flow right on the silicon wafer gives us the ability to amplify or generate light on chip.

• The ability to incorporate all optical components within a single, common silicon die fundamentally changes and simplifies how an optical transceiver can be assembled and tested, dramatically reducing costs.

Page 10: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

“OPTO-ASIC”

Juniper Networks’ silicon photonics enabled “Opto-ASIC,” a fully integrated transceiver package (left), surface mounted to module board (center left), board assembly placed within module housing with fiber attached (center right), and final QSFP module assembly (right).

,. I,

Page 11: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

“OPTO-ASIC” FUTURES

• Juniper’s fully integrated “Opto-ASIC” transceiver

• densely packages electronic and photonic die in a single, low-cost package

• completely agnostic to being packaged in existing module form factors (QSFP, QSFP-DD, OSFP, COBO, etc.)

• Network processors (PFEs: Packet Forwarding Engines)

• Packet Processing capabilities keep increasing exponentially

• But, are limited by ability to push that much bandwidth in and out of them electrically –Shannon’s Law*

• Throughput Increase – Possible by integrating photonics & network processor on one Package

• Juniper’s Silicon Photonics technology offers immense potential:-

• Integration into the PFE, along with Penta Silicon and Triton Silicon, improves scaling performance at the line card and system level, to enable petabit-per-sec total system capacity

• Combining silicon photonics technology with network processors increases system level capacity and performance while decreasing power consumption

* Shannon's law: defines the theoretical maximum rate at which error-free digits can be transmitted over a bandwidth-limited channel in the presence of noise.

Page 12: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

400GBE IN R&E (SO FAR)

-.

Page 13: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

JUNIPER 400 GE @ SC18

Juniper

MX10008

Internet2

MX960

SCinet NOCInternet2 Dallas PoP400 S Akard

Juniper

PTX 10003

100 GE

400GE

400 GE

4 x 100 GE4 x 100 GE

6,100 feet

Juniper

QFX 10003

QSFP56-DDQSFP-100GBASE-LR4 QSFP-100GBASE-LR4

mgmtmgmt

QFX-SFP-1GE-LX

I perfS♦NAR

Page 14: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks ConfidentialKBHCCD D326 IDF

SCinet

NOC 2450

CalTech 1413

Akard St. POP, Dallas

General Conference Support

StarLight 2851 SCinet DNOC 2644 SCinet DNOC 4026SCinet DNOC 2316SCinet DNOC 1034SCinet DNOC 420

Chicago, IL

10 Gigabit Ethernet

40 Gigabit Ethernet

100 Gigabit Ethernet

400G DCI

1 Gigabit Ethernet

Wi-Fi Access Point

Network Architecture

v18 - November 10, 2018

Lance Hutchinson

800G DCI

DWDM OTN

400 Gigabit Ethernet

noc-att-1

Botsink 5100

3617

-A:

Le

no

vo

845

-A:

ET

RI

92

7-A

: X

ilin

x

100

5-A

: P

urd

ue U

niv

ers

ity

10

15-A

: P

ION

IER

10

27

-A:

Vir

gin

ia T

ec

h

12

04

-A:

Mig

hig

an

Sta

te U

niv

.

12

17

-A:

Ge

org

ia I

ns

titu

te o

f Te

ch

no

log

y

12

26-A

: F

uji

tsu

Lim

ite

d

22

7-A

: C

lem

so

n U

niv

ers

ity

313-A

: E

mu

Te

ch

no

log

y

32

1-A

: D

-Wav

e S

ys

tem

s

32

7-A

: N

ICT

32

7-B

: N

ICT

34

5-A

: N

ati

on

al

Ins

t. o

f In

form

ati

cs

42

7-A

: To

ky

o I

ns

t. o

f Te

ch

.

527-A

: O

ne S

top

Sys

tem

s

53

9-A

: C

ore

Hiv

e C

om

pu

tin

g

605

-A:

Ne

tAp

p

63

1-A

: R

ed

Riv

er

Co

mp

ute

r C

o.

739

-A:

Ins

t o

f In

du

str

ial

Sci.

Un

iv. o

f To

ky

o

16

04-A

: G

oo

gle

1608

-A:

Pe

ng

uin

Co

mp

uti

ng

161

3-A

: P

an

asa

s

162

8-A

: F

rau

nh

ofe

r IT

WM

181

6-A

: L

ou

isia

na S

tate

Un

iv.

182

8-A

: U

niv

. o

f U

tah

2019

-A:

Ma

thW

ork

s

20

22

-A:

Ari

sta

20

28

-A:

Pit

tsb

urg

h S

up

erc

om

pu

tin

g C

tr.

212

5-A

: S

ilic

on

Mec

han

ics

220

6-A

: S

tan

ford

Un

ivers

ity

221

8-A

: P

GI

22

26

-B:

Un

iva

Co

rpo

rati

on

240

0-A

: In

dia

na U

niv

ers

ity

24

06

-A:

Ad

ap

tiv

e C

om

pu

tin

g

240

9-A

: A

IST

241

3-A

: C

ray

24

17-A

: N

VID

IA

24

25-A

: C

olf

ax

In

tern

ati

on

al

24

29-A

: H

PE

2609

-A:

NA

SA

28

03-A

: C

isco

Sys

tem

s

2806

-A:

Ora

cle

282

4-A

: A

MD

300

6-A

: S

up

erm

icro

30

13

-B:

SD

SC

30

25-A

: B

rig

ht

Co

mp

uti

ng

320

7-A

: M

ell

an

ox T

ec

hn

olo

gie

s

321

3-A

: D

DN

Sto

rag

e

32

23-A

: In

tel

240

0-B

: In

dia

na U

niv

ers

ity

240

0-C

: In

dia

na U

niv

ers

ity

240

0-D

: In

dia

na U

niv

ers

ity

240

0-E

: In

dia

na U

niv

ers

ity

32

23-B

: In

tel

18

33

-A:

Kin

g A

bd

ull

ah

Un

iv.

of

Sc

ien

ce

an

d T

ec

h.

18

38-A

: M

arv

ell

/Ca

viu

m

18

47-A

: G

EA

NT

20

41

-A:

SU

RF

223

8-A

: R

EN

CI

22

47-A

: In

tern

et2

243

3-A

: D

ep

art

me

nt

of

En

erg

y

243

9-A

: K

IST

I

27

44

-A:

Un

ive

rsit

y o

f To

kyo

28

33-A

: A

ltair

283

8-A

: E

xtr

em

e N

etw

ork

s

284

7-A

: C

ien

a

2855

-B:

Infi

ne

ra

285

8-A

: N

ati

on

al E

nerg

y T

ec

hn

olo

gy

Lab

.

30

43-A

: C

ors

a

30

47-A

: H

ua

wei

30

54

-A:

We

ka.i

o

32

33

-A:

NE

C

32

38

-A:

Re

d H

at

32

51

-A:

SU

SE

34

33

-A:

IBM

3447

-A:

AW

S

36

27

-A:

HL

RS

36

35-A

: N

CS

A

36

43

-A:

Na

t’l

Cen

ter

for

HP

C

365

1-A

: S

Cin

et

37

07-A

: Te

xas

Ad

v C

om

p C

tr

37

16

-A:

Un

v.

of

Te

xas

at

Dall

as

38

31

-A:

Six

Nin

es I

T

3907

-A:

Van

de

rbil

t U

niv

ers

ity

391

7-A

: Tex

as A

&M

Un

iv.

39

53

-A:

So

uth

ern

Me

tho

dis

t U

niv

.

40

47

-A:

Ly

da

Hil

l D

ep

art

me

nt

of

Bio

info

rma

tic

s,

UT

So

uth

we

st

Me

dic

al

Ctr

.

42

01

-A:

Glo

bu

s

4211-B

: U

niv

ers

ity

of

Ma

ryla

nd

4211

-C:

Un

ivers

ity o

f M

ary

lan

d

422

7-A

: Q

um

ulo

, In

c.

424

1-A

: H

PC

Syste

ms

, In

c.

43

27

-A:

Str

on

g B

ox

Da

ta S

olu

tio

ns

44

01-A

: R

utg

ers

Un

ivers

ity

44

17

-A:

Inte

rdy

sc

ipli

na

ry C

en

tre

fo

r M

ath

em

ati

ca

l

an

d C

om

pu

tati

on

al

Mo

de

lin

g,

Un

iv.

of

Wa

rsa

w

63

9-A

: P

ure

Sto

rag

e

160

0-A

: N

imb

ix,

Inc

.

202

5-A

: S

Cin

et

45

31-A

: A

ltair

45

35

-A:

Qu

mu

lo,

Inc

.

2851

-A:

Sta

rLig

ht

2851

-B:

Sta

rLig

ht

2851

-D:

Sta

rLig

ht

285

1-E

: S

tarL

igh

t

285

1-F

: S

tarL

igh

t

285

1-I

: S

tarL

igh

t

28

51-J

: S

tarL

igh

t

2851

-K:

Sta

rLig

ht

285

1-L

: S

tarL

igh

t

344

2-A

: M

icro

so

ft

3056

-A:

Tech

Da

ta C

orp

30

33

-A:

CS

RA

dnoc2644-dci

Waveserver AI

netbeez-1g-d4026

eth0

dnoc420-rtr

7280SR2140.221.237.253/32

54/1

25

26

27

28

29

30

31

32

53/1

100G Tester

XGS2-HSL

dnoc1034-rtr

SLX 9540140.221.237.252/32

54

25

26

27

28

29

53

dnoc2316-rtr

7280SR2140.221.237.251/32

54/1

14

53/1

dnoc2644-rtr

SLX 9540140.221.237.250/32

54

30

53

dnoc420-faucet

C9500-32C

1

2

dnoc4026-rtr

QFX5110140.221.237.249/32

0/0/51

0/0

/20

0/0/50

dnoc4026-dci-[1-2]

NCS 2006

1/4/1 1/5/1

dnoc1034-dci

BTI 71081/1/1 1/1/71/1/2

dnoc420-dci

ACX 6360

0/0/12 0/0/150/0/13 0/0/14

4645

ps-zotac-d4026

eth0

44

netbeez-1g-d2644

eth0

44

netbeez-1g-d2316

eth0

ps-10g-3

eth10g

4846 6

netbeez-1g-d1034

eth0

44

netbeez-1g-d420

eth0

44

dnoc2316-dci-[1-2]

NCS 2006

1/4/1 1/6/11/5/1

booth1413-dci-ws[1-3]

Waveserver

1-6

1-7

1-8

2-5

2-6

2-7

1-5

2-8

3-5

dnoc2316-faucet

Cisco C9500-48Y4C

52

12 1 13 2 3 4 14 5 6

dnoc2644-faucet

SBx908 GEN2

601

10

1

dnoc4026-faucet

Noviflow 2122

1

3 4 5 12 6 7

15

16

17

19

20

21

22

23

24

25

26

27

28

29

30 2 31

32 3 4 533

0/0

/21

0/0

/23

0/0

/26

0/0

/27

0/0

/28

0/0

/25

0/0

/0

0/0

/29

0/0

/30

0/0

/31

0/0

/1

0/0

/32

50

1

20

1

31

32

33

34

35

38

39

40

411 25

26

27

28

29 2

1/3 1/4 1/5

ps-zotac-d420

eth0

46

2/2/7 2/2/8 2/2/9 2/2/10 2/2/7 2/2/9

1

booth2851-dci-wsai

Waveserver AI

1/2

3-7

141

3-M

: C

alT

ec

h C

AC

R

dnoc1034-faucet

AT x950-28XSQ

1 2

ps-zotac-d1034

eth1

1/1/6

101

booth1413-dci-wsai

Waveserver AI

1/2

3-6

0/0

/33

1/8

36

37

31

39

-A:

Mic

roso

ft

eth1

47

eth1g

ps-10g-2

eth10g eth1g

47

eth1

eth0

46 47

prime

Prime Applianceem0

wlc2

model

nic1

nic2

wlc1

model

nic1

nic2

SWIDF-B1

EX3300140.221.246.9

0/1/3

SWIDF-B2

EX3400140.221.246.10

0/1/3

SWIDF-CEAST

EX3400140.221.246.2

0/2/3

SWIDF-CWEST

EX3400140.221.246.3

0/2/3

SWIDF-OLDMDF

EX3400140.221.246.13

0/2/3

SWIDF-D167

EX3400140.221.246.4

0/2/3

SWIDF-D175

EX3400140.221.246.5

0/2/3

SWIDF-ARENA

EX3300140.221.246.6

0/1/3

SWIDF-C2

EX3400140.221.246.14

0/2/3

SWIDF-C3

EX3400140.221.246.15

0/2/3

SWIDF-C4

EX3400140.221.246.16

0/2/3

SWIDF-C6

EX3400140.221.246.17

0/2/3

SWIDF-C7

EX3400140.221.246.18

0/2/3

SWIDF-C8

EX3400140.221.246.19

0/2/3

SWIDF-D1

EX3400140.221.246.20

0/2/3

SWIDF-D2

EX3400140.221.246.21

0/2/3

SWIDF-D3

EX3400140.221.246.22

0/2/3

SWIDF-D4

EX3400140.221.246.23

0/2/3

SWIDF-D5

EX3400140.221.246.24

0/2/3

SWIDF-D6

EX3400140.221.246.25

0/2/3

SWIDF-D7

EX3400140.221.246.26

0/2/3

SWIDF-D8

EX3400140.221.246.27

0/2/3

SWIDF-D9

EX3400140.221.246.28

0/2/3

SW-CLUST2

EX3300140.221.246.90

0/1/3

SW-CLUST3

EX3300140.221.246.91

0/1/3

SWIDF-E5

EX3400140.221.246.29

0/2/3

SWIDF-E6

EX3400140.221.246.30

0/2/3

SWIDF-E8

EX3400140.221.246.31

0/2/3

SWIDF-E9

EX3400140.221.246.32

0/2/3

SWIDF-F2

EX3400140.221.246.34

0/2/3

SWIDF-F3

EX3400140.221.246.35

0/2/3

SWIDF-F4

EX3400140.221.246.36

0/2/3

SWIDF-F5

EX3400140.221.246.37

0/2/3

SWIDF-F6

EX3400140.221.246.38

0/2/3

SWIDF-D221

EX3400140.221.246.39

0/2/3

SWIDF-MA306

EX3300140.221.246.41

0/1/3

SWIDF-CBALLF

EX3400140.221.246.11

0/2/3

SWIDF-CBALLB

EX3400140.221.246.12

0/2/3

SWIDF-NEWMDF

EX3400140.221.246.42

0/2/3

SWIDF-A107

EX3300140.221.246.7

0/1/3

SWIDF-GRIFFIN

EX3300140.221.246.8

0/1/3

SWIDF-WG120

EX3300140.221.246.40

0/1/3

SWNOC-1

EX3300140.221.246.128

0/1/3

SWNOC-2

EX2200140.221.246.129

0/0/22

SWNOC-3

EX2200140.221.246.130

0/0/22

SWNOC-4

EX2200140.221.246.131

0/0/22

SWNOC-5

EX2200140.221.246.132

0/1/3

SWNOC-6

EX2200140.221.246.133

0/0/23

SWNOC-7

EX2200140.221.246.134

0/0/23

SWNOC-8

EX2200140.221.246.135

0/0/23

SWNOC-9

EX2200140.221.246.136

0/0/23

SWNOC-10

EX2200140.221.241.137

0/0/23

SWNOC-11

EX2200140.221.241.138

0/0/23

SWNOC-12

EX2200140.221.241.139

0/0/23

0/1/0

0/0/45

0/0/46

0/0/47

0/0/45

0/0/44

0/0/43

0/0/42

0/0/41

0/0/40

0/0/46

SWIDF-F1

EX3400140.221.246.33

0/2/3

pbx-ixi-1

Vision E4049

50

pbx-corsa2

NSE 720017

1

pbx-corsa1

NSE 720016/32

1

tap

tap

tap

tap

tap

tap

tap

tap

tap

tap

conf-fw

SRX 4600

1/0/0

1/0/1

C0

6-L

EA

RN

C0

7-T

elia

tap

noc-res-[1-5]

R-Scope

0 1 2 3

noc-ixia-dist

Vision ONE

49

50

51

52

17 18 19 20

16/32

17

17-18

19-20

tap

noc-infoagg-[1-2]

R730xd

eth0

0

noc-secnre-sandia

Dell R730

em0

Security VMs

sec-exabgp

sec-scanner

sec-bhr

sec-webserver

45

0/1/0

0/1/1

pbx-taps

FlexTaps

4

utd-nre-dell

5148F-ON

C3

2

C3

4

100G Tester [1-2]

FTB 2-PRO

100G Tester [1-3]

T-BERD 5800-100G

noc-wan-ws-[1-4]

Waveserver

1_5 1_7 4_5 4_72_5 2_7 3_5 3_7

akard-wan-wsai

Waveserver AI

C2

7

C2

8

C2

9

C30

C3

1

C3

3 C17

C14

C08

C1

0

C1

2

C2

3

C25

C2

0

1/8 1/9 1/3 1/4 1/5 1/6 1/7

C2

6

C09

C11

C13

C1

5

C1

8

C19

C2

1

C2

4

C2

2

C3

7

1/10

C1

6

C3

6

C04

C02

C35

C0

5

C0

3

C0

1

C38

ciena-waveserver-chicago[1-4]

Waveserver

800

G

2/Common

2/Common

akard-wan-400g

QFX10003

1/0/7 1/0/81/0/5 1/0/6

noc-wan-400g-1

PTX10003

1/0/5 1/0/61/0/7 1/0/8

C40

noc-wan-infinera

XT/S-3624

C4

1

1.9

T

akard-wan-infinera

XT/S-3600

1-A-2-3 1-A-2-4 1-A-2-9 1-A-2-101-A-2-5 1-A-2-6 1-A-2-7 1-A-2-8 1-A-2-11 1-A-2-12 1-A-2-17 1-A-2-181-A-2-13 1-A-2-14 1-A-2-15 1-A-2-16 1-A-2-191-A-2-1 1-A-2-2

1-A-L1

1-A-2-3 1-A-2-4 1-A-2-9 1-A-2-101-A-2-5 1-A-2-6 1-A-2-7 1-A-2-8 1-A-2-11 1-A-2-12 1-A-2-17 1-A-2-181-A-2-13 1-A-2-14 1-A-2-15 1-A-2-16 1-A-2-191-A-2-1 1-A-2-2

1-A-L1

noc-ixia-100g

Vision E100

25

26

9 11 13 151-rx 3 5 7

noc-taps

FlexTaps5/T 6/T 7/T 8/T1/T 2/T 3/T 4/T

80

0G

noc-wan-wsai

Waveserver AI

1/3 1/4 1/91/5 1/6 1/7 1/8 1/10

2/Common

C39

2/Common

C2

7 S

tarlig

ht

C28

Sta

rlig

ht

C2

9 S

tarlig

ht

C3

0 S

tarlig

ht

C3

1 S

tarlig

ht

C3

2 S

tarlig

ht

C3

3 S

tarl

ight

C3

4 S

tarlig

ht

C3

7 I

2 S

ing

ap

ore

C3

8 P

acW

ave

C4

0 I2

IP

/TR

CP

S2

C41

I2 A

LS

2

C35

I2 I

P/T

R C

PS

C3

6 I

2 A

LS

C01

ES

ne

t Testb

ed

C0

2 E

Sn

et Te

stb

ed

C03

ES

ne

t IP

C0

4E

Sn

et IP

C3

9 E

Sn

et/S

tar/

IU

C0

5 L

EA

RN

C0

8 N

AS

A/N

RL

C0

9 N

AS

A/N

RL

C1

0 N

AS

A/N

RL

C11

NA

SA

/NR

L

C12

NA

SA

/NR

L

C1

3 N

AS

A/N

RL

C1

4 L

SS

T

C1

5 L

SS

T

C1

6 P

ac W

ave

C1

7 C

EN

IC

C1

8 P

ac W

ave

C19

CE

NIC

C20

Ca

ltech

C21

Ca

ltech

C22

Tra

nsP

AC

C23

Sta

rlig

ht

C24

Sta

rlig

ht

C25

Sta

rlig

ht

C2

6 S

tarlig

ht

noc-wan-400g-2

QFX5220

1/0/0 0/1/0 0/2/0

Spectrum provided by

3218

-A:

De

ll3

3

C43

C4

4

ns0140.221.249.254

eth10g

ns1140.221.249.250

eth10g

ns2140.221.249.246

eth10g

its0140.221.250.70

eth10g

its1140.221.250.71

eth10g

its2140.221.250.72

eth10g

its-nas140.221.250.73

eth10g

owamp140.221.250.111

monitor140.221.250.101

DevOps VMs

repo

scinet

syslog

LibreNMS

XYMon

perfSONAR

kiosk

meas-displays

ndt

scdl

rancid

1_5 1_74_5 4_72_5 2_73_5 3_7

USC Booth 1403

b1403-400g

400G Switch

1/2/1-2

ferst

eth0

netbeez-wifi-noc

eth0

netbeez-1g-noc

eth0

booth2851-dci-ncs1k

NCS 1002

conf-rtr

MX960140.221.239.255/32

2001:0468:1f07:ffff::0255/128

11/2/10/2/1

3/0/8

3/0/6

3/0/7

0/0/9

11/0/9

0/1/9

4/0/0 3/0/11 4/0/0 7/0/0

8/0/6

8/0/7

2/0/0

9/1/3

2/0/5

2/0/1

9/0/4

2/1/1

2/1/2

9/0/5

2/1/3

9/0/6

2/1/4

9/0/7

2/1/5

2/1/6

2/1/7

9/0/8

2/1/8

9/0/9

2/1/9

9/0/10

2/1/10

2/0/4

9/1/5

8/3/1

2/0/11

2/0/7

2/0/10

9/0/3

2/1/0

9/1/4

9/0/2

2/0/3

9/1/2

9/0/1

2/0/2

9/1/1

9/0/0

2/0/9

9/1/0

2/1/11

2/0/8

9/0/11

2/0/6

8/3/2 3/3/2

7/3/0

noc-dci-ncs1k

NCS 1002

0/0/4

0/0/10

0/0/1

0/0/0

0/0/14

line

noc-rtr-2

NCS5508140.221.239.252/32

2001:0468:1f07:ffff::0252/128

0/0/0/12

0/0/0/13

0/4/0/12

0/4/0/13

0/0/0/6

0/0/0/0 0/2/0/0 0/4/0/0 0/4/0/50/0/0/3 0/4/0/20/2/0/20/0/0/2 0/4/0/10/2/0/10/0/0/1 0/4/0/30/2/0/3 0/2/0/50/0/0/4 0/2/0/4 0/4/0/40/0/0/5

rack0-sw

EX3300

0/1/3

rack[2-9]-sw

EX3300

9/0/16 9/0/17 2/1/2

line

netbeez-wifi-d4026

eth0

47

netbeez-wifi-d2644

eth0

45

netbeez-wifi-d2316

eth0

4745

netbeez-wifi-d1034

eth0

45

netbeez-wifi-d420

eth0

noc-taps

calient-S320

S320

2.5.7 2.7.3

2.1.1 1.1.41.1.31.8.8 1.8.3 1.8.41.8.5 1.1.5

2.6.52.6.4 2.7.2

noc-rtr-1

MX10008140.221.239.253/32

2001:0468:1f07:ffff::0253/128

2/2/3

0/3/0

0/3/1

4/3/0

4/3/1

4/1/12/0/00/0/0 4/0/02/0/20/0/2 4/0/1 4/0/22/0/10/0/1 4/0/32/0/30/0/3 2/1/10/1/1 2/1/00/1/0

9/0/149/0/139/0/129/0/15

netbeez-wifi-conf

eth0

netbeez-1g-conf

eth0

0/4/0

2/4/0

4/4/0

6/4/0

tnoc-dtn-echo1

1U DTNp1p1 p4p1

tnoc-dtn-echo2

2U GPU DTNp1p1 p4p1

noc-dtn-dell[1-2]

R740xdp1p1 p4p1 p1p1 p4p1

0/1/1 0/2/0

9/1/3 0/1/2

2/1/0

11/2/0

129

0/2/3

4/2/0

0/0/0/10

0/2/0/10

0/2/0/12

0/2/0/13

2/3/0

2/3/1

0/4/0/8

noc-sw-slx9540-[1-2]

SLX 9540140.221.237.240

1_53

2_53 2_54

1_54

0/4/0/14

0/0/0/9

0/4/0/9

0/2/0/9

0/0/0/11

0/2/0/11

0/2/2

0/2/1

4/1/2

2/2/2

2/2/1

4/2/1

2/2/0 0/2/0

noc-sw-qfx5110-[1-3]

QFX5110140.221.237.244

1_0/0/50

2_0/0/50

3_0/0/50 3_0/0/51

1_0/0/51

2_0/0/51

1/6/1

b2851-400g

400G Switch

1

noc-sw-7280sr2-[1-2]

7280SR2140.221.237.246

1_53/1

2_53/1 2_54/1

1_54/1

4.3.4

4.3.3

noc-corsa

NSE 7200

37

33

8/0/5 3/0/5

11/1/8

eth0

11/1/9

eth0

4/2/3

noc-fw

SRX 56000/1/0

0/3/0

0/2/20/2/1

4137

9/T

17

2

noc-wan-spirent

N4U 12-port 100G Tester

2 3 4 5 6 7 8 9 10 11 121

5.5.1 5.5.2 5.5.3 5.5.4 5.5.5 5.5.6 5.5.7 5.5.8 5.6.1 5.6.45.6.35.6.2

1.1.2 1.8.71.1.6 1.1.7 1.1.8 1.2.1 1.2.2 1.3.21.2.4 1.2.6 1.2.7 1.2.8 1.3.1 1.1.11.8.61.7.3 1.8.21.7.81.7.61.7.4 1.8.11.7.71.7.5 1.3.5 1.7.11.2.3 1.2.5 1.3.6 1.7.21.3.3 1.3.4

noc-taps

2.5.1

2.5.8

2.5.3

2.6.3 2.6.6

2.5.2

2.6.82.6.7

2.5.4

2.5.6

2.6.22.6.1

2.5.5

4/1/0

3.3.1 3.3.7 3.4.5 3.5.23.3.4 3.4.73.4.13.3.3 3.4.63.3.83.3.2 3.4.83.4.2 3.4.43.3.5 3.4.3 3.5.13.3.6 3.5.4 3.5.3

b1413-400g

400G Switch

21

32

7-C

: N

ICT

371

6-D

: U

nv.

of

Te

xa

s a

t D

all

as

371

6-C

: U

nv.

of

Te

xa

s a

t D

all

as

2

6/1/2

1/6 1/7

6/2/1 4/2/2

0/1/2

0/2/0/70/4/0/290/4/0/6 0/2/0/29 0/2/0/64/1/36/1/3 6/2/0 0/0/0/7 0/4/0/7 0/4/0/27 0/4/0/28 0/0/0/226/3/3

noc-dci-bti

BTI 7208

1-2/2/2 1/1/6

1/1/1

1/1/2

1/1/7

0/0/0/24 0/2/0/24

0/4/0/24

0/0/0/8 0/2/0/8

noc-dci-ncs2k-[1-3]

NCS 2006

1/4/1

2/4/1

3/4/7

3/4/9

1/5/12/5/1

3/4/8

3/4/10

3/2/9

3/2/7 7/line2/line 2/2/12/6/1

noc-faucet

Noviflow 32x100G Tofino140.221.237.239/32

18

10

7

21

6 15 11

12

34

noc-dtn-z9264

Z9264F1/13 1/621/52

1/15 1/481/1

1/29

1/46

1/3

em0 em0 em0em0 1/34

1/36

6/2/2

6/2/3

6/3/1

6/3/0

6/3/2

line

0/0/7

0/0/11

0/0/3

0/0/15

0/4/0/26

0/2/0/26

0/0/0/26

0/0/0/23

line

0/0

/1

0/0

/3

0/0

/4

0/0

/7

0/0

/10

0/0

/11

0/0

/0

0/0

/14

0/0

/15

6/0/0 6/1/06/0/2 6/0/36/0/1 6/1/1 0/0/0/28 0/0/0/290/0/0/27 0/2/0/27 0/2/0/28

noc-dci-ws[1-3]

Waveserver129

2_5 2_81_81_5 3_5

2_6

2_7

1_7

1_6

3_7

3_6

2.7.1

noc-dci-wsai

Waveserver AI

1/5

1/3

3/2

3/1

2

1/7

1/4

1/6

4/3/0

1/1

1

1/1

2/1/3

noc-dci-6360

ACX 63600/1/6-7

0/0/13

0/0/14 1

0/0/12

2/1/2

1-tx

1/1/0

2.1.2

C4

2 L

EA

RN

100

G p

S

0/2/0/23

1/8

0/0/15

0/1/6-7

40

01-A

: 2C

SR

I

383

5-A

: R

ub

rik

0/0

/34

0/0

/24

0/0

/35

18

0/0/0

1/0/0

0/0/0

0/0/0

®

poseidon-controller

Poseidon

14

1

11/0/7

11/0/8

utd-ncs2006

NCS 20064/15/1/1

48

21

utd-nre-dell2

R730en1 en2

3 4 5 6

utd-nre-dell1

R840en1 en2 en1 en2

1/0/0

2.1.1 1.8.6

4/5/2

4/5/3

4/4/3

42

377

5-A

: L

uc

d0/0

/22

SW-CLUST1

EX3400140.221.246.43

0/1/1

0/2/1

0/2/0

perfsonar-100g

100g Tester p6p2

p6p1

0/4/0/30

0/4/2

0/1/8

sage2-noc

eth0

0/1/3

noc-400g

400G Switch

2 3

4

1

5 6

141

3-A

: C

alT

ec

h C

AC

R

141

3-B

: C

alT

ec

h C

AC

R

141

3-C

: C

alT

ec

h C

AC

R

141

3-D

: C

alT

ec

h C

AC

R

141

3-E

: C

alT

ec

h C

AC

R

141

3-F

: C

alT

ec

h C

AC

R

141

3-G

: C

alT

ec

h C

AC

R

141

3-H

: C

alT

ec

h C

AC

R

14

13

-I:

Ca

lTec

h C

AC

R

141

3-K

: C

alT

ec

h C

AC

R

2851

-C:

Sta

rLig

ht

2851

-G:

Sta

rLig

ht

2851

-H:

Sta

rLig

ht

perfsonar-conf

eth1

eth0 0/1/7

3

385

4-A

: A

lgo

-Lo

gic

0/0

/2

0/0

/8

0/0

/9

9;inet 1~!C18 DaUas,1 hpc

TX inspires.

Page 15: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

400 GE UPTAKE IN R&E NETWORKS IN 2019

Juniper Account Teams and PLM have had conversations about 400 GE 2019 deployments with:

• A major Supercomputer Center

• Research universities planning on upgrading their WAN access

• Research universities planning 400 GE Science DMZs

We also have had early 400 GE planning conversations with several R&E Network providers

400 GE is coming to R&E Networks this year!

Page 16: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

PLANS FOR 2 X 400 GE @ SC19*

Juniper

MX10008

IndianaUniversity

MX960

SCinet NOC DenverIndiana University

CienaWaveserver

100 GE

400GE

800GDWDM

400 GE

1 x 400G Bloomington to Chicago over an OLS

4 x 100 G DWDM Chicago to Denver

1,066 mi

QSFP56-DD

CienaWaveserver400 GE

QSFP56-DD

V V I I

perfS. NAR perfS♦NAR

Page 17: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

© 2019 Juniper Networks Confidential

THANK YOU /QUESTIONS?

Page 18: LEVERAGING 400 GBE · 2019-06-11 · 2851-A: StarLight 2851-B: StarLight 2851-D: StarLight 2851-E: StarLight 2851-F: StarLight 2851-I: StarLight 2851-J: StarLight 2851-K: StarLight

"Any opinions, findings, conclusions or recommendations

expressed in this material are those of the author(s) and do not

necessarily reflect the views of the Networking and Information

Technology Research and Development Program."

The Networking and Information Technology Research and Development

(NITRD) Program

Mailing Address: NCO/NITRD, 2415 Eisenhower Avenue, Alexandria, VA 22314

Physical Address: 490 L'Enfant Plaza SW, Suite 8001, Washington, DC 20024, USA Tel: 202-459-9674,

Fax: 202-459-9673, Email: [email protected], Website: https://www.nitrd.gov