VLAM-G Project

VLAM-G Project
Virtual Lab AMsterdam
VLAM-G developers team
Computer Architecture and Parallel Systems Group
Department of Computer Science
Universiteit van Amsterdam
National Institute for Nuclear and High Energy Physics
Institute for Atomic and Molecular Physics
Virtual Lab AMsterdam
Outline
•
Introduction
•
Objectives
•
VLAM-G Principles
•
VLAM-G Architecture
•
VLAM-G & DASII
•
VLAM-G Application Examples
•
Conclusions
VLAM-G
Virtual Laboratory AMsterdam
Virtual Lab AMsterdam
A collaborative analysis environment
for applied experimental science
Grid and VLAM is about sharing resources:
physical equipment (remote experimentation)
Data & Information repositories
Application Layer
Virtual Lab.
Virtual Lab AMsterdam
Grid Layer
Objectives & realization
Methods
Virtual Lab AMsterdam
• Enable VLAM-G users to define, execute, and
monitor their experiments
• Provide to VLAM-G users:
location independent experimentation,
familiar experimentation environment
assistance during their experiments
Easy way to bring/port new/existing applications to
the Grid
•Developing
and to learn
application prototypes to check ideas
Objectives & realization
Methods
Virtual Lab AMsterdam
•
•
Application layer

Case studies

Provides VLAM-G modules
Middle layer (Top)

Hides the details of the Grid

Offers an information management
system
Virtual Lab AMsterdam
VLAM-G Architecture
VLAM-G
Client
Module
Repository
SessionManager
Virtual Lab AMsterdam
M1
collaboration
Assistant
RTS
M2
Mn
VIMCO
Grid/Globus Services
RTS DB
Resource A
Resource B
PFT DB
VLAM-G Run Time System on
DAS-2
VL module 2
VL module 4
VU
Virtual Lab AMsterdam
VLAM-G GUI
RTSM
VL module 1
VL module 5
NIKHEF
VL module 3
RTSM - VLAM-G Run Time System Manager
VL module 1
- VLAM-G experiment module
VLAM-G GUI
- VLAM-G Graphical User Interface
DAS-2
Job management
on DAS-2
Other subclusters:
VL module 1
GUI
node
Node 0
Virtual Lab AMsterdam
VL module 2
Node 2
SM
VL module 4
VIMCO
RTSM
Node 1
node
Node 3
PBS
over
Globus
RTS DB
node
App. DB
...
node
node
VL module 5
node
Node N
node
node
Subcluster (e.g. at NIKHEF)
node
VL module 3
Virtual Lab AMsterdam
Process Flow Template
(PFT)
•
Used as a blueprint for a specific type of
experiments
•
PFT is designed offline by the experts in each
scientific domain
•
It is the main interface used by the VLAM-G
users to perform a specific experimentation in
the VLAM-G environment.
•
It Guides the user while performing the
experiment.
The PFT (cont.)
PFT (GUI)
Virtual Lab AMsterdam
Compose the experiment
(GUI)
Define the context f the experiment
(GUI)
Experiment Editor
RTS
VIMCO
Expressive
Resource A
MACS
EFC
Application databases
Process Flow Template
Literature
Owner
Photograph
Empty
Virtual Lab AMsterdam
Interpretation
Extraction
Settings
Apparatus
Surface Scan
Data Cube
Sample
Treatment
Treated sample
Raw Data
DC Analys.
Ana Tool
Conversion
Cerf. Tool
Q. Ctrl
Data Cube
Virtual Lab AMsterdam
Status of the VLAM-G
Prototype
•
The first Beta-release is almost ready
•
This release will contain:

A tool to load modules in the VLAM-G database

A list of modules that can selected and used

C/C++ API to write VLAM-G modules

Support for the MACS and DNA array
experiments

It should be conform to the Globus security

It is going to be running on DAS-2
Virtual Lab AMsterdam
The histogram demo

This demo. is about running jobs on
different Grid enabled machines using the
VLAM-G environment.

Two modules:

Slider

Visualization
Virtual Lab AMsterdam
Histogram demo
Virtual Lab AMsterdam
Floating ball experiment

This experiment is about controlling
remote external devices using the VLAMG environment.

Two modules:

controller

Visualization
Virtual Lab AMsterdam
Floating ball experiment
Virtual Lab AMsterdam
The MRI scan experiment

This experiment is about running jobs on
different Grid enabled machines using the
VLAM-G environment.

Four modules:

MRI scanner

Converter to NetCDF

Visualization Modules: 2D and 3D
Virtual Lab AMsterdam
RMI Scan experiment
Virtual Lab AMsterdam
MACS (Material Analysis
of Complex Surfaces)
•
Remote experimentation (m-beam)
•
Data storage
•
Meta-data analysis (combine data from
different sources)
Virtual Lab AMsterdam
MACS lab Devices
m-beam
TOF-SIMS
FTMS
FTIR mscoop
What is needed?
• High speed network
Virtual Lab AMsterdam
• Huge computing power
• Analytical Instruments / Data
• Micro-beam, FTIR, TOF-SIMS, …
• Capable database, generic data format
• Software (“The glue”)
 The Virtual Laboratory env. “ VLAM-G”
Virtual Lab AMsterdam
Meta-data analysis
Sample
VL database
Experiment Process Flow
Template
Owner
Literature
Photo_Image
Object
Virtual Lab AMsterdam
Sample_Extraction
Sample
Results_Observations
Sample_Treatment
Treated_Sample
Physics_Device
Conversion_Tool
Material_Analysis
File_Conversion
Data Cube
Analysis_Tool
DC_Analysis
Data Cube
Virtual Lab AMsterdam
Demo3: MACSLab Exp
Conclusions
VLAM-G: a science portal for exp. analysis
•
Virtual Lab AMsterdam
•
•
Workflow support for
Bio-informatics, Materials Science
and Biomedical Simulation & Visualisation
Seamless access to distributed resources
•
Resource Management: based on Globus
•
Content Management: VLAM-G middleware
•
Current status: preparing the beta-release
of the VLAM-G toolkit.
Virtual Lab AMsterdam
Where to find about the
VLAM-G projects
VLAM-G home page

http://www.dutchgrid.nl/VLAM-G