Euclid
Consortium
Euclid
ST Status : Data Model & EMA mockup
Maurice Poncet (CNES)
on behalf of EC SGS System Team
Euclid CSWG OUSIM joint Meeting,
Barcelona
July 9-10 2012
1
System Team
Euclid
Consortium
System Team main work packages are :
• Architecture & Performance
• Monitoring & Control
• Processing & Data distribution orchestration
• Data Model (J.M. Delouis)
• EMA (O.R. Williams)
• Data Transfers
• Infrastructure Abstraction Layer (IAL)
• Common Tools (inc. Collab. Dev. platform)
Euclid CSWG OUSIM joint Meeting,
Barcelona
July 9-10 2012
2
Data Model
Euclid
Consortium
• Definition of I/F between (or inside) pipelines
• Defined by OUs pairs (input/output)
• From textual description to formal description
(SWG -> OU -> SDC)
• Formal description allows for
– Unambiguous description
– Automation
– Validity check
– Facilitate S/W development and maintenance
– Configuration management
• Naming conventions (type, unique id, some semantic
info.)
Euclid CSWG OUSIM joint Meeting,
Barcelona
July 9-10 2012
3
Metadata/Data
Euclid
Consortium
• Distinction between :
– Metadata (data description)
• XML files (text !)
• Structure described by XML Schema
– Generic information (type, creator, date, location,…)
– Specific information depending on type
• Stored at EMA
– Data
• Format :
– FITS files
–…
• Stored at SDCs (+ for prototype where storage is available &
accessible)
• Data location (e.g. URL) stored at EMA
Euclid CSWG OUSIM joint Meeting,
Barcelona
July 9-10 2012
4
Data Model Status
Euclid
Consortium
•
First draft release available (dictionary)
•
Formal description
– basic types (dictionary, should be in line with system product tree)
– Interfaces (TBD based on dictionary)
•
Configuration management under SVN (RSSD)
– Model tree (one custodian per leaf)
– Release, Work, Archive
•
CCB (Change Control Board)
– One delegate per OU/SDC, EMA, PO+ WP Lead
– Next in September
•
Working groups on hot topics
– FITS/Data model
– Catalog description (N. Apostolakos)
– Instrument Model (E. Jullo)
– IVOA reuse
Euclid CSWG OUSIM joint Meeting,
Barcelona
July 9-10 2012
5
CCB members
Euclid
Consortium
- LE1 / SOC & SDC-FR & SDC-IT (P. Osuna + M. Frailis)
- VIS / SDC-FR (C.Grenet)
- NIR / SDC-IT (?)
- SIR / SDC-IT (L. Paioro)
- EXT / SDC-NL (O.R Williams)
- EXT / SDC-DE (R. Henderson)
- SIM / SDC-ES (C. Neissner)
- MER / SDC-IT (J. Koppenhoefer)
- SPE / SDC-FR (J.C Meunier)
- SHE / SDC-GB (R. Collins)
- PHZ / SDC-CH (P. Dubath)
- LE3 / SDC-FR (No One)
- EMA (A. Belikov)
- PO:CM (O. Mansutti)
- DM-WP (J.M. Delouis)
Euclid CSWG OUSIM joint Meeting,
Barcelona
July 9-10 2012
6
EMA Mock Up Status
Euclid
Consortium
• EMA mock up available in September
• Main functions :
– Ingestion of metadata
– Browser
– Query interface
– Location of data (either SDC, or lab, …)
Euclid CSWG OUSIM joint Meeting,
Barcelona
July 9-10 2012
7
For SIM prototypes
Euclid
Consortium
• Contribute to the data model
– Textual description
– Formal description (one custodian per OU/SDC pair)
• Register the products
– Generate metadata for products
– Submit them to EMA mockup for ingestion
• Use the EMA mockup to retrieve data
Euclid CSWG OUSIM joint Meeting,
Barcelona
July 9-10 2012
8
For more information
Euclid
Consortium
• System Team : Ch. Dabin
• Data Model : J.M. Delouis
• EMA Mock Up : A. Belikov
• System Team on Redmine
http://euclid.roe.ac.uk/projects/sgsst
• Data model under SVN
http://euclid.esac.esa.int/svn/EC/SGS/ST/4-2-05DM/schema
Euclid CSWG OUSIM joint Meeting,
Barcelona
July 9-10 2012
9
Questions ?
Euclid CSWG OUSIM joint Meeting,
Barcelona
Euclid
Consortium
July 9-10 2012
10