DoSon Grid Computing School, 2007 1 Current State of Grid Computing Researches and Applications in...
-
Upload
allan-waters -
Category
Documents
-
view
217 -
download
3
Transcript of DoSon Grid Computing School, 2007 1 Current State of Grid Computing Researches and Applications in...
DoSon Grid Computing School, 2007DoSon Grid Computing School, 2007 11
Current State of Grid Current State of Grid Computing Researches and Computing Researches and
Applications in VietnamApplications in Vietnam
Vu Duc ThiVu Duc Thi11, Nguyen Thanh Thuy, Nguyen Thanh Thuy22, Tran Van , Tran Van LangLang33
11Institute of Information TechnologyInstitute of Information Technology22Hanoi University of TechnologyHanoi University of Technology
33Institute of Information Technology HCMCInstitute of Information Technology HCMCOn behalf of the members of the VNGrid ProjectOn behalf of the members of the VNGrid Project
22
OutlineOutline
• Researches on grid computing in VietnamResearches on grid computing in Vietnam– Centers for High Performance ComputingCenters for High Performance Computing– HPC/GC Research activitiesHPC/GC Research activities
• Towards a grid infrastructure for VietnamTowards a grid infrastructure for Vietnam– VNGrid projectVNGrid project– The aimsThe aims– Planed activitiesPlaned activities
• Initial results: Initial results: – data grid for meteorology data grid for meteorology – data grid for bioinformaticsdata grid for bioinformatics
• ConclusionConclusion
33
Grid computing in VietnamGrid computing in Vietnam• Initial step Initial step
– since a few last yearssince a few last years– several HPC centers in Hanoi and several HPC centers in Hanoi and
HCM CityHCM City Hanoi University of Technology, Hanoi University of Technology,
19991999 Institute of Information Technology, Institute of Information Technology,
HCM City, 1996 research, 2000 HCM City, 1996 research, 2000 systemsystem
Vietnam National University, Hanoi, Vietnam National University, Hanoi, 20052005
Vietnamese Institute of Vietnamese Institute of Mathematics, 2004Mathematics, 2004
HCM City University of Technology, HCM City University of Technology, 20032003
Le Quy Don University of Le Quy Don University of Technology, 2001Technology, 2001
Centers for HPC
44
MilestonesMilestones
2001 2002 2003 2004 2005 2006
First center for HPC at HUT
300 GFlops
computing center at VNU (max)
Other HPC centers are
founded
First national conference on HPC and grid computing in
HCM city
BK Grid Group
atHUT
BioGrid Group at
IOIT-HCM
TEIN2-VN Project
(Trans-Eurasia Information Network)
VNGrid Project
University of TechnologyUniversity of Technology
55
Encountered IssuesEncountered Issues
• Not yet HPC centers of Tera Flops Not yet HPC centers of Tera Flops
• Not yet a common networking Not yet a common networking infrastructure to connect HPC centers infrastructure to connect HPC centers
• High performance Computing and High performance Computing and Grid computing rest in academic Grid computing rest in academic researches.researches.
• Not yet HPC/GC large scale Not yet HPC/GC large scale applications.applications.
66
Activities doneActivities done
• Building grid portalsBuilding grid portals– BKGrid (HUT)BKGrid (HUT)– Grid iPortal (VNU-HCM)Grid iPortal (VNU-HCM)
• Experimenting with applications onExperimenting with applications on– Meteorology (HUT, VNU-Hanoi)Meteorology (HUT, VNU-Hanoi)– Bioinformatics (IOIT-HCM)Bioinformatics (IOIT-HCM)– Geology (Vietnamese Institute of Mathematics)Geology (Vietnamese Institute of Mathematics)
• Participating in international gridsParticipating in international grids– Pragma (IOIT-HCM 2006, HUT soon)Pragma (IOIT-HCM 2006, HUT soon)– APGrid (Vietnamese Institute of Mathematics)APGrid (Vietnamese Institute of Mathematics)
• Participating in international HPC/GC workshops, conf.Participating in international HPC/GC workshops, conf. - APAN- APAN - PRAGMA- PRAGMA
77
VNGrid ProjectVNGrid Project
• Financed by Ministry of Science and Technology of Vietnam
• A two year project, to be finished in 2009• 5 partners in the project
– IOIT in Hanoi– IOIT in HCM City– HUT– VNU in Hanoi– Le Quy Don University of Technology
88
The aims of VNGrid (1)The aims of VNGrid (1)
• Building a cyber-infrastructure to Building a cyber-infrastructure to connect five partners in VN-Gridconnect five partners in VN-Grid
• Deploying advanced grid Deploying advanced grid technologies to improve the technologies to improve the performanceperformance– Resource monitoring and discoveringResource monitoring and discovering– Scheduling and brokeringScheduling and brokering
hard to reach the objective!hard to reach the objective!
99
The aims of VNGrid (2)The aims of VNGrid (2)
• Experimenting grid-based applications Experimenting grid-based applications onon– Bioinformatics,– Meteorology,– Virtual Reality,– Cryptography.
•Being connected to other grid systems in the region and over the world
1010
Planned activitiesPlanned activities
• Selecting the common technology solution for the whole VNGrid– suitable for the infrastructure in Vietnam– Via TEIN2
• Establishing necessary security policy
• Developing and deploying some grid applications
• Building a VNGrid Portal
• Connecting VNGrid to PRAGMA and some others
1111
Attended resultsAttended results
• Establishing VNGrid initial infrastructure for Establishing VNGrid initial infrastructure for Grid RD and application community in Grid RD and application community in VietnamVietnam
• Assembling separated HPC centers in VietnamAssembling separated HPC centers in Vietnam• Reinforcing researches on grid computing in Reinforcing researches on grid computing in
VietnamVietnam• Towards applying GC in industrial domainsTowards applying GC in industrial domains• Opening a new opportunity for collaboration Opening a new opportunity for collaboration
with partners outside Vietnam: HPC, storage with partners outside Vietnam: HPC, storage and content resources!!!and content resources!!!
1212
Apllication 1: BioinformaticsApllication 1: Bioinformatics
• Deploying grid technologies for Gene Mapping (IOIT-HCM)– Use Haplotype Pattern Mining (HPM), and
Density Based Spatial Clustering of Application with Noise (DBSCAN) to specify the locations of genetic diseases
• Performing Blast and gene prediction in Grid computing environment using iGridPortal (HCM City College of Natural Sciences)
1313
Apllication 2: Meteorological Apllication 2: Meteorological ForecastForecast
• Using agent Using agent technologies to technologies to deploy grid deploy grid servicesservices– An agent has An agent has
responsible for responsible for calling calling appropriate appropriate services services following user following user requirementsrequirements
Globus ToolkitGRAM MDS 3 Grid FTP
ClusterPBS
ClusterPBS
BKGrid Portal
SecurityService Information
ServiceWeka
Resource Broker Agent
HPC Service
Fedora Core 1
1414
Application 2: BKGrid and Application 2: BKGrid and Meteorological Forecast (cont)Meteorological Forecast (cont)
•Applying the HPC and Grid Computing for climate forecast (HUT, VNU-Hanoi)– Deploying the MM5 model
•Exploiting resources on APGrid to run a model for climate forecast (Vietnamese Vietnamese Institute of MathematicsInstitute of Mathematics)– Deploying the HRM model
1515
Intial results: data grid for Intial results: data grid for meteorology at HUTmeteorology at HUT
• Weather forecasting plays an important Weather forecasting plays an important role in the society role in the society – for agriculture, commerce, catastrophe for agriculture, commerce, catastrophe
preventing, etc. preventing, etc.
• There are different institutions in Vietnam There are different institutions in Vietnam working on the meteorology problems but working on the meteorology problems but the cooperation is not easy forthe cooperation is not easy for– sharing local observation datasharing local observation data– sharing hardware and software resources on sharing hardware and software resources on
computing weather forecast datacomputing weather forecast data
1616
A data grid portal for A data grid portal for meteorologymeteorology• Building a data grid for sharing Building a data grid for sharing
meteorological datasets is a suitable meteorological datasets is a suitable solution in Vietnam for:solution in Vietnam for:– Exploiting resources from different HPC centersExploiting resources from different HPC centers– Providing a central and easy access point to all Providing a central and easy access point to all
meteorological data via a grid portalmeteorological data via a grid portal– Offering a reliable mean for storing and sharing Offering a reliable mean for storing and sharing
meteorological data for research purposemeteorological data for research purpose– Public access to climate forecast websitePublic access to climate forecast website
1717
System architectureSystem architecture
Locally meteo-data
Global meteo-data
GrADS server
Administrator
Users
Data Grid
Http
`
``
`
`
Grid portal(gridsphere based)
`
``
`
`
`
``
`
`
MM5 Modeling System
HRM Modeling System
WRF Modeling System
User
Group
1818
Weather forecast modelingWeather forecast modeling• Model used for Model used for
weather weather forecasting: forecasting: MM5.MM5.
• It can be run on It can be run on a cluster for the a cluster for the high high performanceperformance
1919
Deployment of MM5 modelDeployment of MM5 model
• MM5 model already deployed MM5 model already deployed automatically in a cluster with 3 automatically in a cluster with 3 datasets each daydatasets each day– Downloading periodically global Downloading periodically global
meteorology data from the AVN sitemeteorology data from the AVN site– Combining with local observation data Combining with local observation data
on modelingon modeling– Configuring easily the modeling process Configuring easily the modeling process
via a configuration filevia a configuration file– Fault tolerance implemented to make Fault tolerance implemented to make
the service more reliablethe service more reliable
2020
Data grid servicesData grid services
• Data grid as a virtual container for Data grid as a virtual container for storing data and easy access laterstoring data and easy access later
• Basic services provided: Basic services provided: – Replicating data in several nodesReplicating data in several nodes– Searching data based on metadataSearching data based on metadata– Transferring data between nodesTransferring data between nodes
2121
PrototypePrototype
2222
ConclusionConclusion
• Grid Computing brings chances to Grid Computing brings chances to developing countries as Vietnam. We need:developing countries as Vietnam. We need:– Computing Resources and HPCComputing Resources and HPC– Storage Resources and Data in applications, Storage Resources and Data in applications, – QoS networking service.QoS networking service.– Grid toolsGrid tools– CollaborationCollaboration
Shortage of resources and only initial steps done, Shortage of resources and only initial steps done, more co-operations needed!more co-operations needed!
2323
ConclusionConclusion
• We would like to join grid computing We would like to join grid computing communities in communities in – APANAPAN– TEINTEIN- EGEE GRidEGEE GRid- PRAGMAPRAGMA
• It is important to have more and It is important to have more and more Grid-based applications!more Grid-based applications!
DoSon Grid Computing School, 2007DoSon Grid Computing School, 2007 2424
Thank you very much Thank you very much for your attention!for your attention!