Post on 22-Dec-2015
Virt
ual L
ab A
Mst
erda
m
VLAM-G Project
VLAM-G developers team
Computer Architecture and Parallel Systems GroupDepartment of Computer Science
Universiteit van Amsterdam
National Institute for Nuclear and High Energy Physics
Institute for Atomic and Molecular Physics
Virt
ual L
ab A
Mst
erda
m
Outline
Introduction Objectives VLAM-G Principles VLAM-G Architecture VLAM-G & DASII VLAM-G Application Examples Conclusions
Virt
ual L
ab A
Mst
erda
m
VLAM-GVirtual Laboratory AMsterdam
A collaborative analysis environment
for applied experimental science
Grid and VLAM is about sharing resources:
physical equipment (remote experimentation)Data & Information repositories
Virt
ual L
ab A
Mst
erda
m
Virtual Lab.
Application Layer
Grid Layer
Virt
ual L
ab A
Mst
erda
m
Objectives & realization Methods
• Enable VLAM-G users to define, execute, and monitor their experiments• Provide to VLAM-G users:
location independent experimentation,familiar experimentation environmentassistance during their experimentsEasy way to bring/port new/existing applications to the Grid
•Developing application prototypes to check ideas and to learn
Virt
ual L
ab A
Mst
erda
m
• Application layer
Case studies
Provides VLAM-G modules
• Middle layer (Top)
Hides the details of the Grid
Offers an information management system
Objectives & realization Methods
Virt
ual L
ab A
Mst
erda
m
Virt
ual L
ab A
Mst
erda
mVLAM-G Architecture
VLAM-G Client
collaboration
Assistant
VIMCO
Grid/Globus Services
PFT DBRTS DB
Resource A Resource B
M1
M2
Mn
RTS
Module Repository
SessionManager
Virt
ual L
ab A
Mst
erda
mVLAM-G Run Time System on
DAS-2
DAS-2
NIKHEF
VU
RTSM
VL module 5
VL module 4
VL module 2
VL module 3
VL module 1VLAM-G GUI
RTSM
VL module 1
- VLAM-G Run Time System Manager
- VLAM-G experiment module
VLAM-G GUI - VLAM-G Graphical User Interface
Virt
ual L
ab A
Mst
erda
m
Node 0
Job management on DAS-2
Node N
Node 2
Node 3
Node 1...
SM
PBSover
Globus
Subcluster (e.g. at NIKHEF)
node
node
node
node
node
node
node
node
node
Other subclusters:
...
RTSM
VL module 1
VL module 5
GUI
PBSover
Globus
Subcluster (e.g. at NIKHEF)
Other subclusters:
VL module 2
VL module 4
VL module 3
VIMCO
App. DBRTS DB
Virt
ual L
ab A
Mst
erda
mProcess Flow Template
(PFT)• Used as a blueprint for a specific type of
experiments
• PFT is designed offline by the experts in each scientific domain
• It is the main interface used by the VLAM-G users to perform a specific experimentation in the VLAM-G environment.
• It Guides the user while performing the experiment.
Virt
ual L
ab A
Mst
erda
m
The PFT (cont.)
PFT (GUI)
VIMCO RTS
Expressive MACS EFC
Application databasesResource A
Compose the experiment(GUI)
Define the context f the experiment(GUI)
Experiment Editor
Virt
ual L
ab A
Mst
erda
mProcess Flow Template
Owner
Empty
Literature
Extraction
Conversion
Q. Ctrl
DC Analys.
Sample
Treatment
Treated sample
Surface Scan Raw Data
Data CubeInterpretation
Photograph
Settings
Apparatus
Data Cube
Cerf. Tool
Ana Tool
Virt
ual L
ab A
Mst
erda
mStatus of the VLAM-G
Prototype The first Beta-release is almost ready This release will contain:
A tool to load modules in the VLAM-G database
A list of modules that can selected and used C/C++ API to write VLAM-G modules Support for the MACS and DNA array
experiments It should be conform to the Globus security It is going to be running on DAS-2
Virt
ual L
ab A
Mst
erda
m
The histogram demo
This demo. is about running jobs on different Grid enabled machines using the VLAM-G environment.
Two modules: Slider Visualization
Virt
ual L
ab A
Mst
erda
m Histogram demo
Virt
ual L
ab A
Mst
erda
m
Floating ball experiment
This experiment is about controlling remote external devices using the VLAM-G environment.
Two modules: controller Visualization
Virt
ual L
ab A
Mst
erda
mFloating ball experiment
Virt
ual L
ab A
Mst
erda
m
The MRI scan experiment
This experiment is about running jobs on different Grid enabled machines using the VLAM-G environment.
Four modules: MRI scanner Converter to NetCDF Visualization Modules: 2D and 3D
Virt
ual L
ab A
Mst
erda
mRMI Scan experiment
Virt
ual L
ab A
Mst
erda
mMACS (Material Analysis
of Complex Surfaces)
• Remote experimentation (-beam)
• Data storage
• Meta-data analysis (combine data from different sources)
Virt
ual L
ab A
Mst
erda
mMACS lab Devices
--beam beam
FTMSFTMSTOF-SIMSTOF-SIMS
FTIR FTIR scoopscoop
Virt
ual L
ab A
Mst
erda
m
What is needed?
• High speed network
• Huge computing power
• Analytical Instruments / Data
• Micro-beam, FTIR, TOF-SIMS, …
• Capable database, generic data format
• Software (“The glue”) The Virtual Laboratory env. “ VLAM-G”
Virt
ual L
ab A
Mst
erda
m
VL databaseVL databaseSamplSamplee
Meta-data analysis
Virt
ual L
ab A
Mst
erda
mExperiment Process Flow
Template
ObjectObject Photo_ImagPhoto_Imagee
LiteratureLiterature
OwnerOwner
SampleSample
Sample_ExtractionSample_Extraction
Treated_SampleTreated_Sample
Sample_TreatmentSample_Treatment
Material_AnalysisMaterial_AnalysisPhysics_DevicePhysics_Device
File_ConversionFile_ConversionConversion_ToolConversion_Tool
Data CubeData Cube Data CubeData CubeDC_AnalysisDC_Analysis
Analysis_ToolAnalysis_Tool
Results_ObservationsResults_Observations
Virt
ual L
ab A
Mst
erda
mDemo3: MACSLab Exp
Virt
ual L
ab A
Mst
erda
mConclusions
VLAM-G: a science portal for exp. analysis Workflow support for
Bio-informatics, Materials Scienceand Biomedical Simulation & Visualisation
Seamless access to distributed resources
Resource Management: based on Globus Content Management: VLAM-G middleware Current status: preparing the beta-release of
the VLAM-G toolkit.
Virt
ual L
ab A
Mst
erda
m
Where to find about the VLAM-G projects
VLAM-G home page http://www.dutchgrid.nl/VLAM-G