Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj...

28
Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR

Transcript of Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj...

Page 1: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Computing and Internet Resources for INO at TIFR

ASET Colloquium ( INO series )23 July 2010

Nagaraj Panyam, DHEP TIFR

Page 2: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

2

Plan of talk

INO web portal Collaboration tools Network Computing resources INO Simulation PC-Farm

Page 3: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

3

INO Web Portal

INO Web Portalhttp://www.ino.tifr.res.in

AttractiveWell laid out

Industryand

Vendors

AcademicContent

MultimediaRestrictedContent

Members' ProfilesCareers

Calendar of Events

About INO

Page 4: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

4

Other features of INO Web portal

Multimedia: Embedded JWPlayer for streaming video of recorded

talks sliding photo galleries (php + javascript)

Upload module for vendors to submit their interests

Upload module for JRF positions

Online applications for INO-Grad2009, INO-Grad2010 (appln form, photo, recommendation letters)

News and announcements

RSS Module to display the RSS feeds from New Scientist

Page 5: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

5

Page 6: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

6

New look Portal

Under

Development

Page 7: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

7

INO Wiki

Implemted using Joomla!, a popular Content Management System

All about INO activities Electronics, Magnet, RPC...

The place for information, documentation, Howto's, Writups, etc..

Public content, password accessed content Joomla! is based on PHP, MySql

Page 8: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

8

Joomla! as INO Wiki

Page 9: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

9

2. Collaboration tools for INO

Page 10: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

10

Collaboration Tools

INO is an open collaboration Communication and documentation - two very

important elements of successful collaboration Share news, announcements, ideas, data, drafts

of papers, mailing lists, keep in close contact Work Logs: Every bit of work, success/failure,

to be recorded Preserving all developments, especially source

codes

Page 11: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

11

Managing Conferences, Workshops..

Indico - a popular conference management utility, (CERN, SISSA..)

Indico server at INO since 2006 – Win07, RPC2007, IWPSD2007,

Optoschool2008, Workshop on Physics at LHC (2009), IDS-NF Meet, Nufact2010, Lepton Photon-2011

Data on RAID6 filesystem Data back up regularly, standy server

Page 12: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

12

Discussion Forum

Discussion forum - an indispensable component of collabotation

HyperNews (hypernews.org, SLAC), implemented for INO in Sep 2008

Multiple forums for different interests Restricted access, moderated account creation Posting by email as well as login to website 106 members from various Univs/Insts in India

Page 13: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

13

Work logs for the collaboration

Detailed work logs and documentation – absolutely essential in experiments

INO work on several fronts, multiple rooms, multiple organizations

Need to track work, daily basis Implemented a web based Electronic log books

Page 14: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

14

ELOG

“Web log”, by Stefan Ritt (PSI, Zurich) Multiple e-logbooks, time stamped entries,

attachments, WYSIWYG editor, tables, searches, threads

Chosen for its simplicity and features - its own webserver, secure connections over SSL, no database required, data in plain ASCII format

Password protected, over SSL

Data on RAID6 filesystem, also backed up regularly

Page 15: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

15

INO's ELOG

Page 16: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

16

INO Mailserver

Dedicated mail server ([email protected]) Mail server for INO members Required for mail enabled packages (Indico,

Elog, Hypernews) IMAPS: for secure access to mailbox with from

inside and outside TIFR

Page 17: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

17

3. Networks

Page 18: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

18

INO Network: Geographical issues

C Block 1st Floor

C Block Gnd Floor

Server Room

D Block 3rd Floor

C Block 2nd Floor

DAQ Lab

D Block 4th Floor

DAQ Lab

RPC Lab Near Animal House

TIFR LAN

MTNL SwitchRoom

(Brahmagupta)

Optical Fiber cableCommissioned

by INO

Page 19: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

19

INO LAN within TIFR LAN: Why?

Different centers of activity and DAQ Common place of data storage, shared home

directories, analysis, repositories, printers Limited supply of public IP numbers Network enabled DAQ components Need for keeping some hosts behind firewall Outgrown the 100Mbps network of TIFR

Page 20: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

20

Private LANs and Gigabit LANs

Room C217RPC Prototype Stack,

DAQseveral desktops, Data analysis, disk

storage, printer

Room D423RPC testing, desktops..CAT5E

CABLE

Pvt LAN

Students' HALL

Cblock 1st Floor

CG18B in CCServer Room -

Disk servers, DNSComputing Farm

C130Comm

onRoom

Gigabit PVT LAN

Page 21: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

21

4. Computing Systems for Physics Work

Page 22: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

22

Desktops and Computing

Large number of students on different steps of academic ladder (VSRP to PostDocs, Staff)

Common (HEP) physics packages Similar versions of packages for all Identical software environment Provide enough disk space Preserving the work after students move out

Page 23: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

23

Desktop Environment

Linux based desktops,uniform version of Scientific Linux (recompiled RHEL, maintained by CERN+FNAL)

Desktops as a Linux “cluster” distributed username-password common shared home directories

DNS, networked printers, single webserver for everybody's personal homepages

Wifi, too ( with suggested precations)

Page 24: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

24

Cluster services

Homedir: NFS shared RAID6 filesystem RAID ≠ Backup: so homedir backed up every

midnight (three previous backups always available.)

NIS for same username on all desktops Print server for identically named print queues Serving software packages, INO data All servers on gigabit network in CG18B

Page 25: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

25

INO Simulation Cluster

Set of compute nodes, on private gigabit LAN

96 CPU Cores - All Xeons (the old single core, dual and new quad cores) – all rack mounted 1U servers

All computed nodes behind a Master

Common home directories, common software product instances

Enhanced access by extending Gigabit network to Students Hall on 1st floor

Ganglia Monitoring, Batch queue system

Page 26: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

26

Software repository

Large number of physics packages Often, same product has different “instances”

(versions and flavors 32 or 64 bit, gcc version) Use of UPS/UPD (Unix Product Support, a

Fermilab product) maintain multiple instances may products invoke any instance, resolving dependencies

Working to modify UPS/UPD for INO specific products

Page 27: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

27

The many packages

ROOT

CERN

Pythia

Lepto

QtROOT

CERN-Source

Octave

Mathematica

Nuance

Genie

QT4

GEANT4

Matlab

BigStack

LAMPS

Page 28: Computing and Internet Resources for INO at TIFR ASET Colloquium ( INO series ) 23 July 2010 Nagaraj Panyam, DHEP TIFR.

Nagaraj Panyam, DHEP TIFRASET Colloquium, 23 July 2010

28

Thank you

Acknowledgements:

Noopur Srivastava Web Design, PHP

Asmita RedijDeepak SamuelTarak Thakore

Installation of physics packages