Grid Information Services
The Globus Project
Argonne National Laboratory
USC Information Sciences Instutute
http://www.globus.org/
MDS-2 Service Architecture
VO-specific Aggregate Directories
discovery (GRIP?)
?
A
A
lookup (GRIP)
registration (GRRP)
R
R
R
R
standard Resource Description services

Dynamic Registration via Reg. Protocol (GRRP)

Resource Inquiry via Info. Protocol (GRIP)
– Co-located with resource on network

Resource Discovery (via GRIP or other)
– Using GRIP allows resource/directory hierarchy
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
2
Soft-state Registration

Periodic notification
– “Service/resource is available”
– Expected-frequency metadata

Automatic directory construction
– Add new resources to directory
– Invite resources to join new directory

Self-cleaning
– Reduce occurrence of “dead” references
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
3
MDS-2 Implementation

Grid Information Service (GRIS)
– Provides resource description
– Modular content gateway

Grid Index Information Service (GIIS)
– Provides aggregate directory
– Hierarchical groups of resources

Lightweight Dir. Access Protocol (LDAP)
– Standard with many client implementations
– Used for GRIP (and GRRP currently)
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
4
MDS-2.1 External Software Stack

OpenLDAP 2.0.x (.14)
– Implements LDAPv3 protocol
– Client and server components

Cyrus-SASL
– Generic security
– We provide loadable SASL/GSS plugin

Globus GSI
– Provides GSS-API interface to PKI
– Shared library used by our SASL plugin
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
5
MDS-2.1 Internal Software

Wrappers/tools
– Simplify typical idioms

Feature-specific GRIS providers
– Resource-specific information probes
– Modular interface to GRIS

LDAP server “backend” modules
– GRIS provider dispatch/caching
– GIIS implementation

SASL/GSS plugin
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
6
MDS-2.1 GRIS Providers

grid-info-cpu reports CPU/load info

grid-info-fs reports filesystem info

grid-info-mem reports RAM/VM info

grid-info-net reports NIC/net info

grid-info-os reports OS info

grid-info-platform reports arch. info

grid-info-merged merges all host info*

Extensible for other sources, e.g. GRAM
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
7
Configuration files for Registration
dc-n1.isi.edu
GIIS
grid-info-site-policy.conf
grid-info-resource-register.conf
grid-info-resource-ldif.conf
GRIS
dc-n2.isi.edu
grid-info-resource-register.conf
grid-info-resource-ldif.conf
October 12, 2001
GRIS
Intro to Grid Computing and Globus Toolkit™
8
Example
GRIS on dc-n2 registers with GIIS on dc-n1













dn: Mds-Vo-Op-name=register, Mds-Vo-name=site, o=grid
regtype: mdsreg2
reghn: dc-n1.isi.edu
regport: 2135
regperiod: 600
type: ldap
hn: dc-n2.isi.edu
port: 2135
rootdn: Mds-Vo-name=local, o=grid
ttl: 1200
timeout: 20
mode: cachedump
cachettl: 30
dc-n2.isi.edu: $GLOBUS_LOCATION/etc/grid-info-resource-register.conf
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
9
New Information Providers



Decide what information to publish into MDS
Create a program that implements the IO
interface requirements of a GRIS Information
Provider
Enable the information provider for an MDS
installation
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
10
New Information Providers

Decide what information to publish into MDS
– OID: conflict avoidance
> OID Registered with IANA Private Enterprise Numbers
 http://www.iana.org/cgi-bin/enterprise.pl
 1.3.6.1.4.1.3536.* Globus OID subspace
 1.3.6.1.4.1.3536.2.* Globus Info Services OID subspace
 1.3.6.1.4.1.3536.2.6.* MDS OID subspace
> ISI will delegate sub-trees of the Globus Info Srvcs OID space
 mailto:[email protected]
 OR, register your own with IANA
– Object Naming: conflict avoidance
> ISI will coordinate prefix naming. Request a prefix from:
 mailto:[email protected]
– Schema
> Data Modeling problem
> LDAP schema syntax problem
> $GLOBUS_LOCATION/etc/grid-info-resource.schema
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
11
New Information Providers

Create your program
– Any language. The only requirements are the
I/O interface of your program:
> Must be callable by fork and exec from the slapd process

You can pass in arguments to your program
> Must return data in LDIF format
October 12, 2001

Data returned must match the LDAP schema

RFC 2849
Intro to Grid Computing and Globus Toolkit™
12
GRIS Host Objects
CPU
hn= hostname
RAM
DISK
CPU
VM
OS
NET
software=OS
OS
dev group=CPUs
CPU
CPU
dev group=memory
RAM
dev=cpu 0 dev=cpu 1
CPU
CPU
VM
dev=RAM
RAM
October 12, 2001
dev=VM
VM
dev group=disk
DISK
dev group=net
NET
dev=/scratch1
DISK
dev=eth0
NET
Intro to Grid Computing and Globus Toolkit™
13
GRIS Structural Class Hierarchy
Mds
Attr: Mds-validfrom (like createtime)
Attr: Mds-validto (accuracy metadata)
Attr: Mds-keepto (discard metadata)
MdsHost
MdsDevice
MdsDeviceGroup
MdsSoftwareDeployment

Every MDS object: name, time metadata
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
14
Summary


The Grid problem: Resource sharing &
coordinated problem solving in dynamic, multiinstitutional virtual organizations
Grid architecture emphasizes systems problem
– Protocols & services, to facilitate interoperability
and shared infrastructure services

Globus Toolkit™: APIs, SDKs, and tools which
implement Grid protocols & services
– Provides basic software infrastructure for suite of
tools addressing the programming problem
October 12, 2001
Intro to Grid Computing and Globus Toolkit™
15