HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4...

15
HEPNET and HEP Computing Randall Sobie University of Victoria Randall Sobie University of Victoria 1

Transcript of HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4...

Page 1: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

HEPNETandHEPComputing

RandallSobieUniversityofVictoria

RandallSobieUniversityofVictoria 1

Page 2: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

HEPNET/Canada

• HEPnet/Canadaisresponsiblefornationalandinternationalnetworkconnectivityforthesubatomicphysicscommunity– Establishedin1990– FundedwithanNSERCMRSawarduntilMarch2020

• HEPnet organization:– Directors:Ogg 1990-1994;Karlen 1994-2004;andSobie 2004-present– TechnicalManager:Gable(2006-2015)andSeuster (2016-present)– IPPAdvisoryCommittee:Tafirout,Warburton,Virtue

• Activities– ConnectingCanadiansitestotheHEPnetworks– Networkmonitoringandtroubleshooting– CollaboratingwithCanadianandinternationalnetworkorganizations– InternationalrepresentationoftheCanadiancommunity(e.g.WLCG,ICFA)– NetworkR&Dprojects

RandallSobieUniversityofVictoria 2

Page 3: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

Canada’sresearchnetwork

RandallSobieUniversityofVictoria 3

National 100Gbackbone(with100Gbackup)

Internationalpeering(Seattle,Chicago,NYC,Montreal)

Provincialorganizationsprovidelinkstothe

universitiesandlaboratories

DedicatedHEPnetworks

Page 4: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

Transatlanticnetwork– ANA300

RandallSobieUniversityofVictoria 4

Montreal-AmsterdamlinkusedfortheLHCOPNtraffic

LHCONEtrafficmaymovesoon

Page 5: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

Transpacificnetwork

RandallSobieUniversityofVictoria 5

INTERNATIONALNETWORKS

At Indiana University5

NextSteps – Guam?

5

Current Transpacific 100G links

Page 6: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

Futuretranspacificnetwork

RandallSobieUniversityofVictoria 6

INTERNATIONALNETWORKS

At Indiana University8

NextSteps – Guam?

8

Near future Transpacific 100G links

Page 7: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

RandallSobieUniversityofVictoria 7

DedicatednetworkforLHCTier-0toTier-1traffic

Page 8: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

LHCONE(WLCGprivateroutednetwork)

RandallSobieIPP/Victoria 8

10-100GvirtualprivatenetworklinkingtheT0,T1sandT2s

PrivatenetworkforLHCandHEP

OtherapprovedHEPexperimentsincludeBelleII

NotshownisthenewconnectiontoGEANTinMontreal

NeedtoaddWaterlootoLHCONE

Page 9: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

RandallSobieUniversityofVictoria 9

ESnet USA

MAN LAN (New York)

BNL-T1

Internet2 USA

Harvard

CANARIE Canada UVic

SimFraU

TRIUMF-T1

UToronto

McGill

PNWG (Seattle)

ASGC Taiwan

ASGC-T1

KREONET2 Korea

KNU

DFN Germany

DESY

RWTH DE-KIT-T1

GARR Italy

CNAF-T1

RedIRIS Spain

RENATER France IN2P3

(10 sites) WIX

(Washington) CC-IN2P3-T1

CEA (IRFU)

SLAC

GLakes NE SoW

Geneva

FNAL-T1

UFlorida PurU

UWisc

NetherLight (Amsterdam)

CENIC USA

ASGC2

Wup.U

Pacificwave (Los

Angeles)

Vanderbilt

MIT

AGLT2 UM AGLT2

MSU Indiana GigaPoP

UNL

GSI

GLORIAD (global) KIAE/

Kurchatov T1

ICEPP U Tokyo

NCU NTU

SINET Japan

PNU KCMS

KISTI –T1

NKN India

CERN

TIFR

CSTNet/CERNet2 China

IHEP-ATLAS

IHEP-CMS

GÉANT

UCSD

JANET UK

KEK T1

PNNL-T1

TEIN (proposed) INFN

(7 sites)

PIC-T1

LHCONE VRF domain UChi

Chicago Communication links: 1, 10, 20/30/40, and 100Gb/s

Regional R&E communication nexus or link/VLAN provider

LHCONE VRF aggregator network Sites that manage their own LHCONE routing

See http://lhcone.net for details.

UNL

5 April 2015 – WEJohnston, ESnet, [email protected]

PNU

Belle II Tier 1/2

CUDI Mexico UNAM yellow outline

indicates LHC+Belle II site } KEK

IC

LHC Tier 1/2/3 ALTAS and CMS

LHC ALICE or LHCb

KIT

INFN Napoli

INFN Pisa

ARNES Solvenia

SiGNET

LHCONE: A global infrastructure for the High Energy Physics (LHC and Belle II) data management

CESNET Czech

praguelcg2

NORDUnet Nordic

NDGF-T1 NDGF-T1b

NDGF-T1c

RoEduNet Romania

NIHAM NIPNE x3

ISS ITIM UAIC

CERN

India Korea

CERN

PacWave (Sunnyvale)

CIC OmniPoP (Chicago)

Starlight (Chicago)

MREN (Chicago)

RNP Brazil

CBPF

SAMPA (USP)

HEPGrid (UERJ)

GÉANT Europe

Caltech UChi (MWT2)

UIUC (MWT2)

IU (MWT2)

NL-T1

SURFsara Nikhef

Netherlands

CERN (CERNLight)

Geneva

CERN-T1

KISTI Korea

TIFR India

AMPATH (Miami)

Page 10: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

10RandallSobieUniversityofVictoria

Canadian traffic to Internet2

TRIUMF

CanadiantraffictoGEANT(1of3links)

Page 11: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

RandallSobieUniversityofVictoria 11

ESNet viaSeattle(includestraffictoAsia)

CanadiantraffictoKEK

Page 12: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

Networkmonitoring

RandallSobieUniversityofVictoria 12

HEPNEToperatesasetof”perfSonar”networkmonitoringsystems

Theinformationisfedbacktoacentralmonitoringsystem.

Usedfornetworkstatusbutalsobeinginvestigatedforjobscheduling

HEPNEThasordered3newsystemsinApril2017

Page 13: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

Changinglandscapeofcomputing

• ATLASTier-1centre inprocessofmovingfromTRIUMFtoSFU– CFIproposaldecisiondueinJune– Basicnetworkinfrastructureinplace(LHCONEandLHCOPN)– https://indico.cern.ch/event/578986/contributions/2579134/attachments/1456907/2248613/TRIUMF_T1_GDB.pdf

• ATLASTier-2centres atSFUandWaterloo– ATLAScloudproduction(CERN,ComputeCanada,commercial,privateclouds)

• BelleIIcomputingalmostentirelycloudbased– Usenewtechnologies– cloudandobjectstorage– NeedforTier-1(cloud)resourcesin2020(separateCFIapplicationforT1?)

• IPPWhiteComputerhighlightedwiderangeofcomputingrequirements– http://www.ipp.ca/pdfs/SAP-WhitePaper-Submitted.pdf

RandallSobieUniversityofVictoria 13

Page 14: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

RandallSobieUniversityofVictoria 14

2

Possible change of computing model

Picture: Simone Campana, Ian Bird - WLCG

“Consolidate storage in few locations to decrease costs”CFICyberinfrastructureProject– distributeddataandcloudforHEP

High-speednetworksopeningnewoptionsforcomputingLHCONEmeetingatBNLinApril2017

Page 15: HEPNET and HEP Computing · Transatlantic network –ANA 300 Randall Sobie University of Victoria 4 Montreal-Amsterdam link used for the LHCOPN traffic LHCONE traffic may move soon.

Summary

• Activeperiodwithmanychangesandnewprojects

• Otheractivities– Establishedpeeringwithcommercialcloudproviders(e.g.AmazonEC2,MicrosoftAzure)– IPV6networkaddressspace– Refreshofnetworkmonitoring(perfSonar)hardware– NetworkR&Defforts– cloudnetworktunnels– Terabit/secondnetworksin5years?

• Networksareenablingnewwaysofusingourresources– Futurewillseecontinueddecouplingofcomputeandstorage– Intelligentuseofnetworkinfrastructure

RandallSobieUniversityofVictoria 15