PRACE | In Service to HPC

1 www.prace-ri.euThe Partnership for Advanced Computing in Europe | PRACE

PRACE | In Service to HPC

Chair of the PRACE Council

Thomas Lippert

http://www.prace-ri.eu/



OVERVIEW




PRACE | Services▶ Open access to leadership HPC systems for EU researchers

▶ Peer Review at European level – science led (SSC)

▶ Operation of a unified set of services

▶ Architectural variety meeting all sorts of algorithmic needs

▶ Support of Industry on European HPC systems (… SHAPE)

▶ Training by PTCs, Seasonal Schools, SoHPC, etc

▶ Application Enabling by HLSTs, Preparatory Access, support for CoEs

▶ Market Watch on HPC procurement/prototyping, infrastructure workshops




Who is Servicing HPC ?




MareNostrum: IBMBSC, Barcelona, Spain#25 Top 500

JUWELS (Module 1): Bull Sequana

GAUSS @ FZJ, Jülich, Germany #26 Top 500

JOLIOT CURIE : Bull SequanaGENCI/CEA, Bruyères-le-Châtel, France #40 Top 500

NEW ENTRY 2018/2019SuperMUC NG : Lenovo cluster GAUSS @ LRZ, Garching, Germany #8Top 500

Hazel Hen: Cray GAUSS/HLRS,

Stuttgart, Germany#30 Top 500

MARCONI: LenovoCINECA, Bologna, Italy#19 Top 500

Piz Daint: Cray XC50CSCS, Lugano, Switzerland#5 Top 500

PRACE | Tier-0 Systems 2018

NEW ENTRY 2018

NEW ENTRY 2018

Close to 110 Pflops cumulatedpeak performance

Close to 110 Petaflops cumulated peak

performance




The European HPC Systems Map (t.b.p.)26 PRACEMembers

BelgiumBulgariaCyprusCzech RepublicDenmarkFinlandGreeceHungaryIrelandIsraelLuxembourgNetherlandsNorwayPolandPortugalSlovakiaSloveniaSwedenTurkeyUnited Kingdom

FranceGermanyItalySpainSwitzerland




European Provisioning Pyramid

EUTier-0

NationalTier1

RegionalTier-2




▶ Ancestor 2002 – DEISA Project (Victor Alessandrini, F)

▶ First Ideas 2003 – HPC-Euro Interest Group (Hugh Pilcher Clayton, UK)

▶ Closing in 2006 – HPC in Europe Task Force (HET) (Kimmo Koski, FL)

▶ ESFRI 2006 – HPC on the Roadmap

▶ PRACE MoU 2007 (Alain Lichnewsky, F, Achim Bachem, D)

▶ PRACE Signature 2010 (Achim Bachem, D)

▶ PRACE II 2016 (Anwar Osseyran, NL)

PRACE | Milestones




PRACE | Implementation Projects

▶ PRACE-IP projects accelerate the implementation of the PRACE RI

▶ IP Projects supported by EC with >100 Million €

2008

PRACE RI

2009 2010 2011 2012

PRACE Initiative

PRACE-PP PRACE-1IP PRACE-3IP

PRACE-2IP

20142013 2015 2016 2017 2018PCP

PRACE-4IPPRACE-5IP

2019




PRACE | Achievements

▶ 688 scientific projects enabled

▶ 110 Petaflops of peak performance on 7 Tier-0 systems

▶ >21 billion since 2010 - 63% led by PI not from HM

▶ >50 companies supported

▶ >12 000 people trained through PRACE Training




HIGHLIGHTS




▶ Identification of gravitational wave signals

from merging black holes

▶ Model signals across the parameter space of

plausible binary mergers ≧ 7 dimensions!

▶ Model Input: solutions of Einstein’s Equations

▶ 1 point in parameter space ~ O(105) CPU hours

▶ Templates for analysis: LIGO/Virgo detectors

Modelling GravitationalWave Signals

Lead Institution: UIB (Spain) - collaborators from UK, Germany, India; 33 Mio Core hrs

Modelsfor Nobles




Mare Nostrum @ BSC – 2017

OPAMare

Nostrum2016

p9+Volta

Mare Nostrum

6480Skylake

3456 nodes394 TB RAM, 830 TB SSD

14 PB disktape storage n/a




▶ Excitonic Insulator Phase: instability of a zero gap semiconductor against tendency of mutually attracting electrons and holes to form bound pairs

▶ Idea: W. Kohn in 1968, but observation of EIP still elusive▶ Finally Proved on CINECA systems by ab initio simulations

(QMC): below a critical temperature the exciton phase is present theoretically, EIP is realized in zero gap carbon nanotubes (CNT)

Carbon Nanotubes as Excitonic Insulators

Carbon nanotubes as excitonic insulators, D. Varsano, S. Sorella, D. Sangalli, M. Barborini, S. Corni, E. Molinari and M. Rontani NatureCommunications8, 1461 (2017)

ForefrontSimulation




Marconi @ CINECA – 2017

OPA

Marconi4608

Shkylake

Marconi3600KNL

Marconi1440

Broadwell

6600 server nodes560 TB memory

15 PB disk60 PB tape storage




▶ Convection needs km-scale resolution

▶ Significant improvements in representation of diurnal cycle, heavy precipitation and clouds

▶ COSMO model scales to 5300 GPU accelerated nodes, runs 2-3x faster than on TaihuLight(present #1 on Top500)

Convection ResolvingClimate Simulations

World Record inCode Acceleration

PI: Christoph Schaer, ETH, Convection-resolving Climate on GPUs (gpuCLIMATE), 170 Million core-hours




Piz Daint @ CSCS – 2016

Cray Aries

Piz Daint5320

Haswell + Tesla


10 PB disktape storage

Piz Daint2862

Broadwell




▶ Renault: New optimization methods based on 20 million d.o.f. finite elements mesheswith 200 different parameters

▶ Anticipate new security rules (EuroNCAP6)▶ Impossible with existing Renault R&D facilities

▶ World premiere:

5 years lead for

Biggest Crash Optimization Ever

42 million core hours allocated on the CURIE Tier-0 (GENCI)

Push Competitivenessof European Industry




Curie @ GENCI – 2013

Mellanox IB QDRCurie188

Westmere + Tesla

Curie1440

Nehalem

Curie10080

Sandy Bridge






HPC Welding- A SHAPE Project

SHAPE: SME HPC Adoption Programme in Europe

PRACE Brings SMEs to HPC

▶ Simulation of multi-layered welding lines▶ Close collaboration with office of welding

and DYNAmore supporting LS-DYNA▶ The SME gained significant

knowledge and experience in HPC▶ The SME sees high

commercial benefit as to better cost estimates




Hazel Hen @ HLRS – 2015

Cray Aries

Hazel Hen15424Haswell


10 PB disktape storage




▶ Solving an 80 year old riddle▶ Understanding the mass difference

of proton and neutron by simulation of the fundamental theory, QCD

▶ 80 years after the experimental detection: simulation on JUQUEEN

Daß ich erkenne, was die Welt, imInnersten zusammenhält

PI: Zoltán Fodor, Ab inition calculation of the neutron-proton mass difference, Science 347 (2015) 1452-1455, 150 Mio core hours.

Results for Textbooks

That I may understand whatever,Binds world’s inner core togetherFaust, J. W. Goethe




JUQUEEN @ JSC – 2012

BGQ 5D Torus

JUQUEEN28672

Power BQC

28672 nodes448 TB memory





▶ How to evaluate the black hole EHT data?

▶ Simulate about 60 k magneto-hydro-dynamical models of the space around the event horizon

▶ Highly efficient, well parallelized numerical implementation on SuperMUC

▶ Essential to understand physics separated from background

Black Hole Simulations EnablingBreakthroughObservations




SuperMUC @ LRZ – 2015

MellanoxIB QDR

SuperMuc360

KNL

SzperMUC210752Haswell

SuperMUC19252

Sandy Bridge



MellanoxIB FDR

MellanoxIB FDR




PRACE | Scientific Case 2018“Future Infrastructures and operations will need to be much more diverse to support HPC, Data Science and different types of accelerators - but we also need to avoid fragmentation.”

PRACE Scientific Case PRACE SSC




PRACE | Scientific Case 2018▶ Scientific applications demand

▶ by factors more compute cycles▶ augmented memory bandwidth & I/O

▶ New methods grow exponentially ▶ scaling by ensembles, deep learning, stat. models

▶ Software & algorithms ▶ PRACE & Europe need most ambitious strategy to

develop the SW part of next-generation computing




PRACE | EuroHPC




PRACE in the EuroHPC EraPosition Paper

▶ Status Analysis▶ Impact Analysis▶ PRACE in the EuroHPC Era

− Creating synergies− Evolution of PRACE Services− Towards a partnership

▶ http://www.prace-ri.eu/prace-eurohpc-positionpaper/Published 7 January, 2019



http://www.prace-ri.eu/prace-eurohpc-positionpaper


Consultations are starting▶ PRACE & EuroHPC Consultations starting▶ PRACE SSC has met EuroHPC INFRAG yesterday▶ High-level meeting of EuroHPC and PRACE planned in June▶ Formation of Working Groups▶ Topics

▶ Access▶ Training▶ Applications▶ Funding▶ and more




www.prace-ri.eu



PRACE | In Service to HPC

Documents

Transcript of PRACE | In Service to HPC