Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan...
-
Upload
jackeline-ways -
Category
Documents
-
view
214 -
download
0
Transcript of Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan...
![Page 1: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/1.jpg)
www.csiro.au
Towards Service Oriented GeoscienceSEE Grid and APAC Grid
Dr Robert Woodcock
Mr Ryan Fraser
Division of Exploration and Mining
![Page 2: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/2.jpg)
2
Outline
• The “geoscience” modelling workflow
• Inefficiencies
• The Solid Earth and Environment Grid
• The APAC (Geoscience) Grid
• Putting it all together: pmd*CRC Modelling Workflow
![Page 3: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/3.jpg)
3
What is the role of:
• Competency contrasts?
• Permeability?
• Pore fluid pressure & flow fields?
Modelling Workflow
Define the geological problem
Build the model
Run the model
View and Interpret Results
Iterate to achieve Understanding
Report and feed into knowledge base
…Must be repeatable, robust and timely
very weak
strong
weak
strong
Tensile failure
mod. strong
mod. strong
mod. strong
mod. strong
Block model of dilation: showing impact of Fault set “A” Dip variation
![Page 4: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/4.jpg)
4
Inefficiencies in the Workflow
Information is scattered across:
Organisations – company, geological survey, etc
Resources – different hardware and software platforms
Geography – geological surveys in each state and territory
Cost of data integration is high, in some situations exceeding all other costs
• Computational resources:
Different architectures suit different numerical codes better
Are often available but outside your organisations direct control
Are setup in different ways
Cost of adapting an investigators specific toolkit to use multiple sites is often prohibitive
Can these issues be removed?
![Page 5: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/5.jpg)
5
The SEE Grid Community
Working together (loosely) to develop a toolkit for interoperability for the Solid Earth and Environmental Sciences
Together… because our information and services need to be shared more easily to achieve our goals
Loosely… because ultimately we are separated by political and economic boundaries
Toolkit… because our World is dynamic and we need tools that can be reconfigured and chained together quickly to answer our questions
…in this context we must reduce the barriers to becoming a part of the community
![Page 6: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/6.jpg)
6
Data Structures
Proprietary Software
Versions of Software
Client
Pre-competitive geoscience data - The trouble is…
![Page 7: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/7.jpg)
7
XML
GML/XMML
Client
Our aim…
![Page 8: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/8.jpg)
8
PIRSAWeb Feature Service (WFS)
Common Interface Binding – GML/XMML
GA Geochemistry
Feature Data Source
DOIRGeochemistry
FeatureData Source
DOIRWeb Feature Service (WFS)
GAWeb Feature Service (WFS)
Geoserver (Open Source)
PostGIS (Open Source)
OraclePostGIS (Open Source)
CLIENT APPLICATIONS
DATA ACCESS SERVICES
DATA SOURCES
WebMap Composer
GA Reports Application
PIRSA Geochemistry
FeatureData Source
Little or no change required here
Translation to standards here
![Page 9: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/9.jpg)
9
Common Interface Binding – GML/XMML
WebMap Composer
GA Reports Application
PIRSAWFS
DOIRWFS
GAWFS
NTGSWFS
MRTWFS
NRMWFS
NSWDPIWFS
VICDPIWFS
?FracSIS
pmd*CRCModel Tools
CLIENTS
DATA SOURCES
DATA SERVICES
![Page 10: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/10.jpg)
10
Features – Geoscience Community (XMML & GeoSciML)
Borehole collar location shape collar diameter length operator logs related observations …
Fault shape surface trace displacement age … Ore-body
commodity deposit type host formation shape resource estimate …
Observation location subject/specimen/station property/theme method operator date/time result (+ type/reference
system/scale/classification) …
Basin? formations shape – time
dependent resource estimate …
![Page 11: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/11.jpg)
11
A user makes a request and gets back GML based data which can be ….
Rendered into a map layer AND queried by a user or….
… formatted into a report or ….
… read and used by any enabled application
Slides courtesy Stuart Girvan – Geoscience Australia
How would you use an interoperable service?
![Page 12: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/12.jpg)
12
Web Map Interface (courtesy of Social Change Online)
Bounding Box
Known Layers
![Page 13: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/13.jpg)
13
Tabular Reports by Source(courtesy of Geoscience Australia)
![Page 14: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/14.jpg)
14
Desktop Visualisation (courtesy of Fractal Technologies)
![Page 15: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/15.jpg)
15
Client
The Grid Application… Service Interactions
Resource Registry
Data Management Service
HPC Repository
LoginJob
MonitorRun
SimulationEdit Problem Description
Local Repository
Archive Search
Geology S.A
Geology W.ARock Prop.
N.S.W
Rock Prop. W.A
Information
Authentication Job Management Service
Finley ServiceFastfloRT Service
User
Workflow...
Computation
Community Infrastructure
Physical Resource Physical Resource
![Page 16: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/16.jpg)
16
Grid Technology Layers
Data and Information
Infrastructure
Application Portals
Visualisation3-D models
Data andKnowledge
Portals
e-Science and e-Geoscience Layer
Community-specific Knowledge Environments and Networks for Research and Education
Customised for discipline- and project specific applications
eg, ESDN, Geochronology, Palaeontology, Oceanography, Groundwater
Networks,Communications
High performance
computing
High VolumeStorage
Middleware Architecture
Base Computing TechnologiesAPAC Grid
pmd*CRC
SEE Grid
![Page 17: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/17.jpg)
17
Traditional Mechanical Modelling Workflow
• “Powerful” desktop computes several models at a time
•Limitations are in the order of ~2 models per week.
• Models (mesh + data files) are individually and labouriously constructed
• The manual process is error prone
• Results are manually visualised one at a time.
• Screenshots are manually taken and made into “movies”.
• Very little, if any, standardised data archiving is done. This results in potential confusion or loss of the originating conditions of the experiments, making it unrepeatable in the long term.Slide courtesy of Robert Cheung and Warren Potma
![Page 18: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/18.jpg)
18
New Refined Workflow
•Parameterised template or wizard driven model geometry/mesh creation.
•Boundary condition & model properties parameter sweep utilities
•automatically creates a “family” of model, data files based on varying a set of parameters.
• Inversion algorithms
•determine input parameters of future iterations automatically based on the user ranking of previous results.
Automated generation of visualisations
Automated movie generation
Automated archiving
3D Time varying volume visualisation
Parameterised Geometry Creation
Multi-site data storage via Storage Resource Broker
Slide courtesy of Robert Cheung and Warren Potma
![Page 19: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/19.jpg)
19
Results to Date
For one Investigator, on one investigation:
•500 Models in 4 months (100x more!)
• Inversion/parameter sweep algorithms – semi-automated model creation; faster, less errors
• Automated post-processing/visualisation – all views X all timescale X all models await the investigator automatically
• Automated archiving – metadata searchable, more accurate store of experimental conditions, delivered to your store!
![Page 20: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/20.jpg)
20
Conclusion
Major modelling inefficiencies have been removed by:
• Integrating the pmd*CRC geoscience modelling workflow
with the:
• Solid Earth and Environment Grid, and
• APAC (Geoscience) Grid
![Page 21: Www.csiro.au Towards Service Oriented Geoscience SEE Grid and APAC Grid Dr Robert Woodcock Mr Ryan Fraser Division of Exploration and Mining.](https://reader035.fdocuments.us/reader035/viewer/2022062511/5518cf14550346a61f8b5bd4/html5/thumbnails/21.jpg)
www.csiro.au
Thank You
Exploration and Mining
Name Dr Robert Woodcock
Title Principle Software Engineer
Phone +61 8 6436 8780
Email [email protected]
Web www.csiro.au
www.seegrid.csiro.au
Contact CSIRO
Phone 1300 363 400
+61 3 9545 2176
Email [email protected]
Web www.csiro.au
Name Mr Ryan Fraser
Title Software Engineer
Phone +61 8 6436 8760
Email [email protected]