Goalnet: Intelligence in
Workflow Orchestration
Zhiqi Shen
Nanyang Technological University
June, 2007
Background
• Web services support interoperable machine
to machine interaction over the internet;
• Workflows describe tasks and execution
procedures;
• Business process modeling; and
• System integration.
Challenges
• Web services are not always available;
• Web service needs to be selected
dynamically;
• Many workflows available defined using
different tools;
• Process execution path is decided on the
runtime; and
• Decision making is required.
Our Solution
•
•
•
•
•
Goal oriented modeling;
Decision making on goals and actions;
User interaction;
Agent mediation and monitoring;
Goal Net modeling tool
– Process modeling
– Agent modeling
Overview of Goal Net
Composite Goal
Atomic Goal
Transition
Root Goal
Intelligence for Decision Making
•
•
•
•
Process modeling
Web service/workflow orchestration
Goal selection and action selection
Multiple decision making mechanisms
support
• User interaction
Agent based System
• Agent system
generation
• Development platform
available
– Goal Net Designer
– Agent Creator
– Goal Net Loader
Composite Goal
Atomic Goal
Transition
Root Goal
GoalNet Designer - Process Modeling Tool
Workflow/Web Service Orchestration
• Tasks in transitions
– Workflows
– Web services
– Functions
• Services selected by agents during runtime
• Execution path (goal pursuit) is decided at
the runtime
Proposed Architecture for The
Bio-Manufacturing Domain
Grid/web services
Grid/web services
Bio-Manufacturing Grid
Objective is to reduce time from biomedical research
to mass production of diagnostic kits.
The system integrates workflows and supply chain
processes using the Grid
• Collection, storage and tracking of bio-samples
• Sequencing of the genomes of samples
• Design and Fabrication of DNA chips to test samples
• Analysis of results
• Making cost effective diagnostic kits via genes identified
New Requirement for BioManufacturing
Individual Low-level BioSystems are available
Existing Tools for Low-level
Workflow Orchestration - Taverna
Existing Tools for Low-level Workflow
Orchestration - Kooplatform
Grid based Bio-Manufacturing
Key IT components:
1. GoalNet: Developed at MC3/NTU choreographs grid
workflow engines and processes.
2. KOOPlatform: Developed by KOOPrime for
orchestration of laboratory and bioinformatics
processes
3. FPGA card, a system developed by Progeniq
4. Taverna, the leading European bio-grid workflow
system developed by MyGrid project
5. Computing and Visualization components: Microarray
Genome Mapper (developed by NYP), PCL and CS4
(developed by I2R)
Integrated Bio-Manufacturing Process using Goal Net
Manufacturing Diagnosis Kits
Initial State
Initialization
Sample Collected
Viral/
Bacterial/
Pathogen
Isolate
Sample
Precessing
Sample Processed
DNA
Sequencing
Goal Achieved
DNA Sequencing Resutls
Gap
Filling
Sample
Processing
Recloning
/Amp
Filling Results
Obtained
New Data
Obtained
DNA
Sequencing
Homology
Search with
GridBlast
Finish
Similarity Results
Diagnosis Kits
Manufactured
Chromo
Walking
New Sample
Obtained
System Initialized
Probe
List Prep
Probe List
Prep Ready
Probe
Design
Annotation Completed
Probe Designed
Generate
Experiment
Generate
Experiment
Sequence
Annotation
Sequence
Annotation
Experiment Generated
Diagnosis Kits
Manufacturing
Designed
Microarray
Discovery
Clinical
Sample
Prep
Clinical Sample Prep Ready
Microarray
Data
Management
Primer
Design
Microarray
Discovered
Data Nomalized
Microarray
Visualization
Microarray
Visualized
Hits List Generated
Hits List
Generation
A Typical Bio-Manufacturing Workflow
Viral/Bacterial/Pathogen isolate
Recloning/ Amp
Sample Processing
Chromo Walking
DNA Sequencing
Gap Filling
Homology Search w GRIDBLAST
Primer Design
Sequence Annotation
Probe Design
Probe List Prep
Clinical Sample
Prep
Generate Experiment
Microarray Data Mgt
Microarray Discovery
Microarray Visualization
Hits List Generation
Goalnet
Diag Kits Manufacturing
Taverna
KOOPlatform
Proposed Architecture for The
Bio-Manufacturing Domain
Grid/web services
Fig. 2 Architecture of the proposed system
Grid/web services
Goal Net Process – 1
Calling Kooplatform Plate Editor
Screen Shots of our System – 2
Contig Result
Goal Net Process – 3
Calling Taverna CompareXandY
Goal Net Process – 4
Calling Kooplatform Array Normalization
Goal Net Process – 5
Calling Kooplatform Class Discovery
Screen Shots of our System – 6
Genome Result
Conclusion
• Mechanism for service and workflow
orchestration
• Intelligent decision making according to the
runtime situation
• Agent based integration and monitoring
• Design and development platform
Thank You!