Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev...

22
Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU

Transcript of Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev...

Page 1: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

Experience of xrootd monitoring for ALICE at RDIG sites

G.S. Shabratova JINRA.K. Zarochentsev SPbSU

Page 2: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

Xrootd Monitoring

• Static monitoring - Bdii • Dynamic monitoring – Monalisa and “xRootd

federation monitoring”

Page 3: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

2 xrootd BDII versions(from Claudiu Schiaua ( [email protected]))

• Xrootd information service (xis) 2009• glite-info-provider-SE_xrootd (gip) 2010

Page 4: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

xis

• http://niham.nipne.ro/xis/xis.install.html• 2-d xrootd serivce on xis server :

root://xishost: 2194• Xrootd clients on xrootd servers.• Xrootd client on information provider (bdii

server)

Page 5: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

gip

• http://indico.cern.ch/getFile.py/access?contribId=0&resId=0&materialId=slides&confId=77435

• http://niham.nipne.ro/NIHAM-repo/instr.html Xrootd client on gip and bdii server Scheme:GlueSALocalID=xroot:SA

>ClueVOinfoLocalID=xroot:VOID:alice

Page 6: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

xrootd in ldap

Page 7: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

DPM and xrootd in BDII

http://gstat2.grid.sinica.edu.tw/gstat/site/RU-SPbSU/treeview/bdii_site/alice23.spbu.ru/

http://gstat2.grid.sinica.edu.tw/gstat/ldap

DPM

XROOTD

Page 8: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

RDIG monitoring

http://rocmon.jinr.ru:8080

Page 9: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

Requirements to dynamic monitoring

• Transfers details:– Host out (ip)– Host in (ip)– Size of file– Number of files

• Statistic details:– Size of packages for host out (in) by time– Errors

Page 10: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

Proposed Architecture to Monitoring & Control the Xrootd in ALICE

Long HistoryDB

MonALISA

Network Monitoring

ApMon

XROOTDSERVER

SystemMonitoring

MonaLisaXrootd Repository

Aggregated Data

Alerts

Actions

Xroootd Monitoring and Control, Harish Arora, Cern

ControlModule

Control / Update

MonALISA

Network Monitoring

ApMon

XROOTDSERVER

SystemMonitoring

ControlModule

MonALISA

Network Monitoring

ApMon

XROOTDSERVER

SystemMonitoring

ControlModule

Page 11: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

MonALISA on http://alimonitor.cern.ch/display

Page 12: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

MonALISA on http://alimonitor.cern.ch/display

Page 13: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

MonALISA on http://alimonitor.cern.ch/display

Page 14: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

MonALISA from gui client

• GUI client from alimonitor.cern.ch:

• Or form http://monalisa.caltech.edu/monalisa.htm :

Page 15: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

MonALISA from gui client

Page 16: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

MonALISA from console

• Need:– Monalisa Repository from

http://monalisa.caltech.edu/:

– And monalisaWSClients :

Page 17: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

MonALISA from console

• Result:

Page 18: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

xRootd federation monitoring

• 17 July 201215.45-16.00ATLAS Off-Grid Sites (Tier-3) Monitoring A.S. Petrosyan, D.A. Oleynik, S.D. Belov, J. Andreeva, I.S. Kadochnikov (on behalf of the ATLAS collaboration)

Page 19: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

Data flow for XRootD• Both summary and detailed events

gatherer implemented as Linux daemon• Summary data goes directly to Ganglia• File transfer data can be stored in local

PostgreSQL and then presented via Ganglia

• Detailed data can be delivered to ActiveMQ directly

• Data being sent to global level:• Domain from, host and ip address• Domain to, host and ip address• User• File, size• Bytes read, written• Time transfer started and finished

1917.07.2012 GRID'2012, JINR, Dubna

Page 20: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

Conclusions:• Bdii monitoring works, but not supported and

rarely used• Monalisa monitoring works, but can not

monitor separate transfer• “xRootd federation monitoring” – we wait it in

the near future.

Page 21: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

Many thanks:

• Sergey Belov• Daniil Oleynik• Artem Petrosyan• Andrey Kiryanov• And etc

Page 22: Experience of xrootd monitoring for ALICE at RDIG sites G.S. Shabratova JINR A.K. Zarochentsev SPbSU.

Questions?