PRAKTICK VOD DO SUPERPOTAE ANSELM Infrastruktura, pstup a
podpora uivatel David Hrb 2013-09-27
Slide 2
Intro What is the supercomputer Infrastructure Access to
cluster Support Log-in http://www.it4i.cz/files/hrbac.pdf
http://www.it4i.cz/files/hrbac.pptx
Slide 3
Why Anselm 6000 name suggestions The very first coal mine at
the region The very first to have a steam engine Anselm of
Canterbury
Slide 4
Early days
Slide 5
Future - Hal
Slide 6
What is a supercomputer Bunch of computers Having a lot of CPU
power Having a lot of RAM Local storage Shared storage High-speed
interconnected Message Process Interface
Type of Nodes 180 compute nodes 23 GPU accelerated nodes 4 MIC
accelerated nodes 2 fat nodes
Slide 12
General Node 180 nodes 2880 cores in total two Intel Sandy
Bridge E5-2665, 8-core, 2.4GHz processors per node 64 GB of
physical memory per node one 500GB SATA 2,5 7,2 krpm HDD per node
bullx B510 blade servers cn[1-180]
Slide 13
GPU Accelerated Nodes 23 nodes 368 cores in total two Intel
Sandy Bridge E5-2470, 8-core, 2.3GHz processors per node 96 GB of
physical memory per node one 500GB SATA 2,5 7,2 krpm HDD per node
GPU accelerator 1x NVIDIA Tesla Kepler K20 per node bullx B515
blade servers cn[181-203]
Slide 14
MIC Accelerated Nodes Intel Many Integrated Core Architecture 4
nodes 64 cores in total two Intel Sandy Bridge E5-2470, 8-core,
2.3GHz processors per node 96 GB of physical memory per node one
500GB SATA 2,5 7,2 krpm HDD per node MIC accelerator 1x Intel Phi
5110P per node bullx B515 blade servers cn[204-207]
Slide 15
Fat Node 2 nodes 32 cores in total 2 Intel Sandy Bridge
E5-2665, 8-core, 2.4GHz processors per node 512 GB of physical
memory per node two 300GB SAS 3,515krpm HDD (RAID1) per node two
100GB SLC SSD per node bullx R423-E3 servers cn[208-209]
Lustre File System Clustered OSS object storage server MDS
meta-data server Limits in petabytes Parallel - striped
Slide 19
Slide 20
Slide 21
Slide 22
Slide 23
Stripes Stripe count Parallel access Mind the script processes
Stripe per gigabyte lfs setstripe|getstripe
Slide 24
Slide 25
Quotas /home 250GB /scratch no quota lfs quota u hrb33
/home
Slide 26
Slide 27
Access to Anselm Internal Access Call - 4x a year 3 rd round
Open Access Call 2x a year 2 nd round
Slide 28
Proposals Proposals undergoing evaluation Scientific Technical
Economical Primary Investigator List of co-operators
Slide 29
Login Credentials Personal certificate Signed request
Credentials encrypted Login Password Ssh keys Password to the
key
Slide 30
Credentials lifetime Active project(s) or affiliation to
IT4Innovations Deleted 1 year after the last project Announcement 3
months before the removal 1 month before the removal 1 week before
the removal
Slide 31
Support Bug tracking and trouble ticketing system Documentation
IT4I internal command line tools IT4I web applications IT4I android
application End-user courses
Documentation https://support.it4i.cz/docs/anselm-cluster-
documentation/ https://support.it4i.cz/docs/anselm-cluster-
documentation/ Still evolving Changes almost every day
Slide 36
Slide 37
IT4I internal command line tools It4free Rspbs Licenses
allocation Internal in-house scripts Automation to handle the
credentials Cluster automation PBS accounting
Slide 38
IT4I web applications Internal information system Project
management Project accounting User management Cluster
monitoring
Slide 39
Slide 40
Slide 41
IT4I android application Internal tool Considering the release
to end-users Features News Graphs Feature requests Accounting
Support Nodes allocation Jobs status
Slide 42
Slide 43
Log-in to Anselm Finally! Ssh protocol Via anselm.it4i.cz
login1.anselm.it4i.cz login2.anselm.it4i.cz
Slide 44
Slide 45
Slide 46
Slide 47
Slide 48
Slide 49
Slide 50
Slide 51
Slide 52
Slide 53
VNC ssh anselm L 5961:localhost:5961 Remmina Vncviewer
127.0.0.1:5961