Lower Storage projects Alexander Moibenko 02/19/2003.

11
Lower Storage projects Alexander Moibenko 02/19/2003

Transcript of Lower Storage projects Alexander Moibenko 02/19/2003.

Page 1: Lower Storage projects Alexander Moibenko 02/19/2003.

Lower Storage projectsAlexander Moibenko

02/19/2003

Page 2: Lower Storage projects Alexander Moibenko 02/19/2003.

Enstore

Fermilab Mass Storage System● General Mass Storage● D0 Mass Storage ● CDF Mass Storage

Page 3: Lower Storage projects Alexander Moibenko 02/19/2003.

Hardware

● 3 STK Robotic Storage Libraries● 1 AML-2 Robotic Storage Librarie● 27 9940A Tape Drives● 12 9940B Tape Drives● 9 IBM LTO Tape Drives● 6 9840 Tape drives● 4 Mammoth-2 tape drives

Page 4: Lower Storage projects Alexander Moibenko 02/19/2003.

Developers

● Eileen Berman● Chih-Hao Huang● Alexander Moibenko● Michael Zalokar

Page 5: Lower Storage projects Alexander Moibenko 02/19/2003.

Hardware (cont-d)

● 53 mover nodes● 18 server nodes

Page 6: Lower Storage projects Alexander Moibenko 02/19/2003.

Software components

● Linux OS for servers and movers● Pyhton as main language● C where needed performance● ftt as low level tape tool● libdb as internal DB● postgres as accounting DB● apache web server

Page 7: Lower Storage projects Alexander Moibenko 02/19/2003.

Software (cont-d)

● Freeware plot tools● Freeware Imaging tools● Custom system monitoring● Custom system installation / upgrade tools● No licensed products.● Client code for Linux, IRIX, SunOS, OSF1

Page 8: Lower Storage projects Alexander Moibenko 02/19/2003.

Data Storage Infrastructure

user

Robotic Library

DCache

Enstore

Page 9: Lower Storage projects Alexander Moibenko 02/19/2003.

Enstore Structure (major comp-s)

User

pnfsFile clerk Volume clerk

Library mgr.mover

Page 10: Lower Storage projects Alexander Moibenko 02/19/2003.

Enstore Structure (addl. Comp)

● Inquisitor● alarm server● event relay● accounting server

Page 11: Lower Storage projects Alexander Moibenko 02/19/2003.

Project Status

● All components in production. Need feature additions, bug fixes.

● Movers run with the rate of tape drive● More than 600 TB of data stored● More than 8 TB/day average transfer● Major development: accounting module, enstore

data presentation, migration of tape drive statistics off central DB

● New storage resources