The PRPv1 Architecture Model

Panel PresentationBuilding the Pacific Research PlatformQualcomm Institute, Calit2 UC San Diego

October 16, 2015

Pacific Reseach Platform Strategic ArcPRPv1 Architecture Model

2

Presenters: Phil Papadopoulos, UC San Diego Tom Hutton, San Diego Supercomputer Center Eli Dart, ESnet Erik McCroskey, UC Berkeley

Abstract: The PRPv1 architecture as it stands now, mid-October 2015 moving to a routed Layer 3 implementation in time for CENIC 2016 in March; what does CalREN need to do?

John Hess, CENIC, will give an introduction covering PRPv0, followed by a panel discussion of the PRPv1 architecture model, goals, challenges, and opportunities moving forward.

PRPv0 - An experiment including:

CaltechCENIC / Pacific WaveESnet / LBNLNASA Ames / NRENSan Diego State UniversitySDSCStanford UniversityUniversity of WashingtonUSC

UC BerkeleyUC DavisUC IrvineUC Los AngelesUC RiversideUC San DiegoUC Santa Cruz

3

PRPv0: March 2015

The PRPv0 experiment concentrated on the regional aspects of the research data movement challenge.

High-performance interconnection among campus Science DMZs

A mesh of perfSONAR toolkit instances

perfSONAR MaDDash -- Measurement and Debugging Dashboard

Flash I/O Network Appliances (FIONAs) and Data Transfer Nodes (DTNs)

GridFTP file transfers to quantify throughput, with results reflected on MaDDash

CalREN HPR / AS2153

A partial mesh of bilateral BGP sessions across the Pacific Wave distributed exchange

4

5

PRPv0 Topology

PRPv0: Transfer Results from March 2015 DTNs loaded with Globus

Connect Server suite to obtain GridFTP tools.

cron-scheduled transfers using globus-url-copy.

ESnet-contributed script parses GridFTP transfer log and loads results in an esmond measurement archive.

FDT – developed by Caltech in collaboration with Polytehnica Bucharest

6

FIONA – Flash I/O Network Appliance:Linux PCs Optimized for Big Data on DMZs

FIONAs Are Science DMZ Data Transfer Nodes &Optical Network Termination Devices

UCSD CC-NIE Prism Award & UCOPPhil Papadopoulos & Tom DeFantiJoe Keefe & John Graham

Source: John Graham and Tom DeFanti, Calit2

Cost $8,000 $20,000

Intel Xeon Haswell Multicore

E5-1650 v3 6-Core

2x E5-2697 v3 14-Core

RAM 128 GB 256 GB

SSD SATA 3.8 TB SATA 3.8 TB

Network Interface 10/40GbEMellanox

2x40GbE Chelsio+Mellano

x

GPU NVIDIA Tesla K80

RAID Drives 0 to 112TB (add ~$100/TB)

UCOP Rack-Mount Build:

8

Pacific Research Platform: A Regional Science DMZPRP: October 2015

Funded UCSD/UCB $1M/yr 5 years + UCOP + CENIC

NSF ACI-1540112,and ACI-1541349