Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10,...
-
Upload
cornelius-hodge -
Category
Documents
-
view
214 -
download
1
Transcript of Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10,...
![Page 1: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/1.jpg)
Workflow in Grid Systems Workshop
Dave Berry, Research ManagerUK National e-Science Centre
GGF10, Mar 2004
![Page 2: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/2.jpg)
Outline: Welcome
WelcomeAimsProgramme
“E-Science Workflow Services”BackgroundStructureIssues arising
![Page 3: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/3.jpg)
AimsReport on current work
Find areas of agreementIdentify open issues
Look for opportunitiesResearchDevelopmentCollaboration
OutcomesSample workflowsCP&E special issueInput to RGs and WGs ?
![Page 4: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/4.jpg)
Morning Session
TalksArchitectureApplications
Possible panel topics:ScriptingSecurityDebuggingConstraint Modelling
DiscussionIssues
![Page 5: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/5.jpg)
Afternoon session
TalksLanguages (esp. BPEL)Tools & Enactment
Possible panel topics:Adaptive enactmentWorkflow inferenceEvent-driven enactmentIncorporating devices & human input
DiscussionOutcomes
![Page 6: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/6.jpg)
Outline:“E-Science Workflow Services”
WelcomeAimsProgramme
“E-Science Workflow Services”BackgroundStructureIssues arising
![Page 7: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/7.jpg)
E-Science Workflow Services
> 90 participantsIndustryUK e-ScienceInternational e-Science
OrganisersDave Berry (NeSC)Savas Parastatidis (NEReSC)
Written report In progressUK e-Science Series
December 3-5, 2003
![Page 8: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/8.jpg)
e-Science Institute
e-Science Institute
![Page 9: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/9.jpg)
Speakers
IndustryWfMC, WS-Choreography
UK e-ScienceMyGrid/Taverna, GeoDise, DiscoveryNet, DAME, ICENI, Planning, RealityGrid, JIGSA, OGSA-DAI, Triana, AstroGrid
International e-ScienceChimera/Pegasus, BIRN, Kepler/Ptolemy, Thetis, Narada
ResearchOperational research, Workflow and VO’s
![Page 10: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/10.jpg)
Breakout Sessions
Scientific Workflow Requirements
Carole Goble
Protocols in Scientific Workflows
John Brooke
Workflow Languages and Engines
Matthew Addis
![Page 11: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/11.jpg)
User requirementsReflect the modelling paradigm of the scientist.
Varies between experiments, disciplines
Which user would that be?Creators, users, auditors, validators (I know if its right when I see it)Biologists cf. bioinformaticians, and transitioning between
Different users, different environmentsAppropriate levels of abstraction.
User models -> workflow models
Simple to use & intuitive creation, deployment, execution and debugging environments
![Page 12: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/12.jpg)
A Scientist Writes…
“Work in my problem solving environment so that I don’t need to change the way I work.”
![Page 13: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/13.jpg)
Scientific Workflow lifecycles
Incrementally exploratory prototypesGot the data, now get the Nature paper before the next guy
Large scale productionGot the idea, now get the data for many experiments, teams, communities
Migration from one to the otherCapture of prototype for later non-interactive replay in a parameterised fashion
Different parts of the lifecycle May use different environments and policiesDifferent sorts of users will interact
![Page 14: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/14.jpg)
User interaction
Creation & DiscoveryBy example, plagiarism, drag and drop
Collaborative multi-user interaction in creationReusing workflows -> modularisationReusing workflows with different parameters and dataComposing workflows from different areas, disciplines and scales“eXtreme team workflow creation”
Single User interaction with workflow executionChoice between paths of execution in specific statesParameter modification mid-run
Collaborative multi-user interaction during execution?
![Page 15: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/15.jpg)
Characterising Scientific Workflows
Very large amounts of dataFiles, streams, database queriesGridFTP, http, ftp, sockets …Sometimes it's the computation that needs to be moved to the data
Data model and typesMetadataProvenance
DriversScientific questions, outcomes and vanityMore creators than users in science?
![Page 16: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/16.jpg)
Enactment Stack
Goals
Abstract flows
Concrete flows
Process execution
Service descriptions
Messages
Communications
Po
licies a
nd
secu
rity
On
tolo
gie
s, me
tad
ata
, de
scriptio
ns,
info
rma
tion
service
s
![Page 17: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/17.jpg)
Workflow vs. Service“Perform” document
Transformed result of query 2
Stored procedure
Result of query 1 OGSA-DAI
Service
![Page 18: Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.](https://reader036.fdocuments.us/reader036/viewer/2022062721/56649f1d5503460f94c34ac2/html5/thumbnails/18.jpg)
Questions?
Presentations from the workshop: http://www.nesc.ac.uk/action/esi/con
tribution.cfm?Title=303