The Virtual Data Toolkit
-
Upload
ruth-johnston -
Category
Documents
-
view
25 -
download
0
description
Transcript of The Virtual Data Toolkit
VDT 1
The Virtual Data Toolkit
Alain Roy
VDT 2
What is the VDT?
• A packaging of software– Grid software (Globus, Condor-G…)– Virtual data software (Chimera)– Utilities
• An easy installation mechanism– Pacman: installs and configures it all– RPM: for some of the software
VDT 3
Who makes the VDT?
• Grid Physics Network (GriPhyN)– Constructs the VDT
• International Virtual Data Grid Laboratory (IVDGL)– Testing and hardening
Very tight collaboration between GriPhyN and IVDGL
VDT 4
Who makes the VDT? (2)
• Core VDT Team:– Miron Livny: The boss– Alain Roy– Carey Kireyev
• VDT Testing– Xin Zhao– Brian Moe
• Pacman– Saul Youssef
VDT 5
Who uses the VDT?• GriPhyN collaborators
– USCMS: In use today– USAtlas: In use today– LIGO: Will use soon– SDSS: Will use soon
• European Data Grid (Including INFN)– Uses subset of software (patched)– Uses just RPMs– Strong collaboration and feedback
• LCG
VDT 6
What exactly is in VDT?• VDT 1.1.8:
– Globus 2.2.4 + advisories + patches– Condor & Condor-G 6.5.1– MyProxy– Chimera/Pegasus– RLS– GLUE Schema– CA Certificates– Fault Tolerant Shell– EDG’s Make Gridmap– EDG’s CRL Update– ClassAds– Netlogger
VDT 7
Pacman Installation
• Goal: – Type a single command– Everything downloads– Everything installs– Everything is configured– No questions asked
• We’re close:– A few questions if you’re root– Basic configuration, may need changing
VDT 8
Pacman Installation (2)
• Download Pacman– http://physics.bu.edu/~youssef/pacman/
• Install VDT– cd <install-directory>– pacman -get VDT-Server– pacman -get VDT-Client– ls
condor/ globus/ post-install/ setup.sh
edg/ gpt/ replica/ vdt/
ftsh/ perl/ setup.csh vdt-install.log
• Use
VDT 9
Pacman post-installation
• Post-install directory:– Notes on configuration choices made– Instructions for editing configuration
• Configuration scripts:– Globus configuration (different from EDG)– Condor configuration
VDT 10
RPM Installation
• Subset of whole VDT– Globus– Condor-G
• Nice RPMs:– We repackage Globus– A dozen Globus RPMs, not hundreds
• No configuration• No post-installation help
VDT 11
Testing
• VDT team is building test suite• Interaction with LCG testing group• Working with NMI* to leverage:
– NMI test suite• Stress testing• Application testing (CMS pipeline)
– NMI test infrastructure
* NMI = NSF Middleware Initiative– http://www.nsf-middleware.org
VDT 12
Support
• Send us questions or problems– We will solve them if we can– We will interact with the developers, if
necessary
VDT 13
Interaction with EDG/LCG
• EDG and LCG get Globus and Condor-G RPMs from VDT
• We do what we can to solve problems and get changes to Globus and Condor
• We want to make a great package for EDG/LCG!
VDT 14
VDT’s Future
• Access to new versions– Globus 3.0
• Extra VDT to help early adopters• Will not supplant main version for a while
• Helping You– What can we do to make life easier
for you?
VDT 15
Where do you learn more?
• http://www.griphyn.org/vdt• Support:
– [email protected]– Alain Roy: [email protected]– Miron Livny: [email protected]