Network futures: AARNet4, Science DMZ, SDN library/Resources and... · 0 2 4 6 8 10 12 1 8 15 22 29...

AARNet Copyright 2015

Network futures: AARNet4, Science DMZ, SDN

David Wilde


David Wilde



David Wilde Network Architect, AARNet

THETA // QuestNet 12 May 2015


AARNet4


Brisbane

Canberra

Melbourne

Perth

Darwin

Sippy Downs

Gladstone Rockhampton

Mackay

Cairns

Townsville

Armidale

Geraldton

AARNet POP < 1 Gbps < 2.5 Gbps < 10 Gbps WDM Transmission

KEY

4

AARNet4 – National

Hobart

Murchison Radio-Astronomy Observatory

Sydney Adelaide

Alice Springs

100Gbps Optical Network

100Gbps Capable Juniper MX Routers


Singapore

Seattle

Palo Alto San Jose

Los Angeles

Honolulu Muana

Auckland

5

Sydney Perth

AARNet4 - International

Suva

Guam


6

AARNet4 – network services

• Connectivity up to 10 or nx10Gbps

Routed access to internet and global R&E networks

• Point-to-point or multipoint VPLS

Layer 2 VPN

• Multipoint, your own IP addressing

Layer 3 VPN


7

Supporting the AARNet Portfolio

It used to be about the plumbing, now it’s so much more…


AARNet4 customer migration

8

5

6

7

5

8

7

38

0

5

10

15

20

25

30

35

40

In the queue Designdiscussioncomplete

Proposal issued ServiceAgreement

issued

Deploymentunderway

Completelymigrated

All institutions


Science DMZ


10

RDSI : cloud storage for researchers

“Enabling researchers to use, reuse and manipulate significant data collections” https://www.rdsi.edu.au/node-statuses

www.rdsi.edu.au

https://www.rdsi.edu.au/node-statuses

http://www.rdsi.edu.au/


11

RDSI : cloud storage for researchers

“Enabling researchers to use, reuse and manipulate significant data collections” https://www.rdsi.edu.au/node-statuses

https://www.rdsi.edu.au/node-statuses


The problem: data sharing


The problem:

13

Brisbane-Melbourne (30ms)

Perth-Sydney (50ms)

NYC- London (75ms) Perth-LAX (160ms!)

Image: ESNet


14 14

Latency…

14


15 15

Latency…

15


The solution: Science DMZ


17

The solution: “Friction free networking”

2. Dedicated systems for data transfer

3. Performance and network measurement tools

4. Security mechanisms designed for high performance

1. Network devices selected for high performance applications


18

The solution: “Friction free networking”

Tionette Stoddard - February 14, 2010 - Source: Richard Heathcote/Getty Images North America


Science DMZ and RDSI


20

Standard campus connection


21

Campus connection with Science DMZ


22

Science DMZ deployment

22

AARNet backbone network

APL NAP #2

APL NAP #1

RDSINode

Node network infrastructure

NodeAPL

AARNet Layer 3

Inter-Node VPN

PE1 APL-NTU1

PE2

PerfSonar 2PerfSonar 1

Node Storage

BES-1

BES-2

DTN 1

APL-NTU2

DTN 2


Primary Node

Secondary Node

Inter-node VPN

AARNet 4 Routed Access

23

RDSI : high speed network connectivity


24 24

PerfSonar

24


25 25

DTN : Aspera + Globus Online

25


26

Moving forward: Science DMZ on your campus?


SDN


28

The AARNet SDN testbed

SDN switch

Sydney

Melbourne

Perth

Seattle


29

The AARNet SDN testbed


30

The ANZSDN testbed

Successful LIEF grant >> 9 universities + CSIRO + AARNet


31

Useful links

AARNet SDN testbed: Contact me: [email protected] (More info coming soon on www.aarnet.edu.au …)

LIEF-funded ANZSDN testbed: Talk to Vijay Sivaraman (UNSW): [email protected] https://sites.google.com/site/anzsdntestbed/

SDN in general: Get involved! http://www.anzsdn.net/ http://www.meetup.com/Australian-SDN-Meetup

mailto:[email protected]

http://www.aarnet.edu.au/


https://sites.google.com/site/anzsdntestbed/

https://sites.google.com/site/anzsdntestbed/

http://www.anzsdn.net/

http://www.meetup.com/Australian-SDN-Meetup


David Wilde [email protected]



33

Spare slides


34

Components

Data transfer nodes: Dell Poweredge 720XD, 64GB RAM, 2 x SSD, 2 x 3.4GHz 8-core CPU 3 x Mellanox Connect3 VPI card (10/40 ethernet 10/40/56 IB)

PerfSonar: 2-blade Supermicro + Mellanox NICs PerfSonar Toolkit; MadDash dashboard

Data transfer tools: Aspera, Globus/GridFTP

Border edge switch: Juniper EX4550; Cisco 6800/NX6K/NX5K; Dell Force10


35

Research Drivers: “Really Big Data”

Square Kilometre Array Large Hadron Collider

Climate Change Data Genomics Data


36

Other research projects Catlin Global Reef Record

Global research on greenhouse gases

Disease transmission among lizards

Historical newspaper record

https://www.rdsi.edu.au/use-cases

https://www.rdsi.edu.au/use-cases


Challenges


38 38

Latency

38

0

2

4

6

8

10

12

1 8 15 22 29 36 43 50 57 64 71 78 85 92 99 106

113

120

127

134

141

148

155

162

169

176

183

190

197

204

211

218

225

232

239

246

253

260

267

274

281

288

Series1

Solution: tightly manage the DTN: NIC drivers, OS updates … Careful choice of TCP congestion avoidance algorithm


39

Compatibility of storage architectures & vendors


Inter-node VPN


40



Inter-node VPN


41


Solution: Science DMZ architecture + L3VPN for inter-Node traffic


42

User tools & familiarity

Images: fasterdata.es.net and pinterest.com

Command line tools

Typical Australian researcher

=


43

User tools & familiarity Solution: keep it simple => Focus on one tool (eg. Aspera) => Many users just want a mapped drive … although non-web authentication an issue => Partner with eResearch organisations for training and outreach

=


Moving forward


45

Improved integration with other projects


46

Improved integration with other projects


47

Better integration with cloud providers


48

Add SDN for more flexibility…


Brisbane

Canberra

Melbourne

Perth

Darwin

Sippy Downs


Mackay

Cairns

Townsville

Armidale

Geraldton


KEY

49

Increased bandwidth

Hobart


Sydney Adelaide

Alice Springs



Brisbane

Canberra

Melbourne

Perth

Darwin

Sippy Downs


Mackay

Cairns

Townsville

Armidale

Geraldton


KEY

50

Increased bandwidth

Hobart


Sydney Adelaide

Alice Springs


Network futures: AARNet4, Science DMZ, SDN library/Resources and... · 0 2 4 6 8 10 12 1 8 15 22 29...

Documents

Transcript of Network futures: AARNet4, Science DMZ, SDN library/Resources and... · 0 2 4 6 8 10 12 1 8 15 22 29...