Implementing ESS standards for reference
metadata and quality reporting at Istat
Work Session on Statistical Metadata
Topic (i): Metadata standards and models
Giorgia Simeoni, Istat
Unit «Quality, audit and harmonisation»
[email protected]
6 May 2013
Contents
1. Project background
2. SIDI/SIQual architecture and contents
3. ESS standards for reference metadata and quality reporting
4. Project objectives and outline
5. The quality reports subsystem design
2
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Project background
ESS reference metadata and quality reporting conceptual harmonisation:
- Euro-SDMX Metadata Structure (ESMS)
- ESS Standard for Quality Reports Structure (ESQRS)
National implementation in progresssupported by SDMX compliant IT
tools (Metadata Handler)
SIDI/SIQual - Istat official system for reference metadata and quality
indicators documentation – includes a lot of information required from
ESMS and ESQRS
Project: to enhance SIDI/SIQual in order to produce ESS standard
metadata files and quality reports in compliance with SDMX technical
standards
3
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
SIDI/SIQual
Istat official information system for documenting quality and
reference metadata of the statistical production processes
SIDI «input» system, SIQual for consultation
SIDI first implementation in 2001, later converted in a webbased architecture
SIQual first release in 2005, English version released in 2008
SIDI/SIQual is the reference metadata component of the Unified
System of Metadata currently under development at Istat
4
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
SIDI/SIQual architecture
SIDI
SIQual
internet
Reference metadata
Staff
Management
ETL
National
Statistical
Programme
Management
metadata
Input GUI
Reference metadata
Quality indicators
SIQual
intranet
Reference metadata
Quality indicators
Dissemination
website
Product quality report
ARMIDA
(Validated
microdata)
Process quality report
DARC
(Administrative
archive)
IT Application
Catalogue
5
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Quality reporting
Short
method.
note
SIDI/SIQual contents
CONCEPTUAL METADATA
Themes
Units
….
DOCUMENTS REPOSITORY
Regulations, Manuals
Questionnaires
Documents (field
operations, methods,
standards, …)
OPERATIONS
Phases
Operations
Sub-operations
IN-DEPTH DOCUMENTATION:
Sampling design
Index production methodology
…
GENERALISED SOFTWARE
Phases
QUALITY CONTROL ACTIONS
Software
Phase/Non sampling Errors
Preventing
Monitoring
Evaluating
STANDARD QUALITY INDICATORS
Process oriented
Product oriented
6
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
ESS standards for reference metadata and quality
reporting
Euro SDMX Metadata Structure
1
Concept Name
Contact
7
Concept Name
Confidentiality
15
Concept Name
Timeliness and punctuality
1.1
Contact organisation
7.1
Confidentiality - policy
15.1
Timeliness
1.2
Contact organisation unit
7.2
Confidentiality - data treatment
15.2
Punctuality
1.3
Contact name
1.4
Contact person function
8.1
Release calendar
16.1
Comparability - geographical
1.5
Contact mail address
8.2
Release calendar access
16.2
Comparability - over time
1.6
Contact email address
8.3
User access
1.7
Contact phone number
1.8
Contact fax number
9
10
Frequency of dissemination
Dissemination format
8
Release policy
16
17
Comparability
Coherence
17.1
Coherence - cross domain
17.2
Coherence - internal
18
19
Cost and burden
2
Metadata update
2.1
Metadata last certified
2.2
Metadata last posted
10.3
On-line database
19.1
Data revision - policy
2.3
Metadata last update
10.4
Micro-data access
19.2
Data revision - practice
Statistical presentation
10.5
Other
3
10.1
News release
10.2 Publications
Statistical processing
Accessibility of documentation
20.1
Source data
11.1
Documentation on methodology
20.2
Frequency of data collection
11.2
Quality documentation
20.3
Data collection
Quality management
20.4
Data validation
12.1
Quality assurance
20.5
Data compilation
12.2
Quality assessment
20.6
Adjustment
11
3.1
Data description
3.2
Classification system
3.3
Sector coverage
3.4
Statistical concepts and definitions
3.5
Statistical unit
3.6
Statistical population
3.7
Reference area
13
3.8
Time coverage
13.1
User needs
3.9
Base period
13.2
User satisfaction
Unit of measure
Reference period
Institutional mandate
13.3
Completeness
14.1
Overall accuracy
6.1
Legal acts and other agreements
14.2
Sampling error
6.2
Data sharing
14.3
Non-sampling error
4
5
6
20
Data revision
12
14
Relevance
Accuracy and reliability
7
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
21
Comment
ESMS Example
ESS standards for reference metadata and quality
reporting
ESS Standard for Quality Reports Structure
8
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Project objectives and outline
Project:
•
Enhancing SIDI/SIQual in order to be compliant with the ESS conceptual
and technical standards for reference metadata files and quality reports.
Frameworks:
•
•
Istat multi-year innovation strategy Stat2015
Eurostat Grant co-funding “Implementing the SDMX Istat strategy”
Organisation:
• Start: second half of December 2012
• Duration: for 2 years
• Main phases:
1. The design phase. Main output expected: the document of
requirements for the SIDI/SIQual enhancement (6 months devoted);
2. The software development, including requirement analysis, detailed
design, realisation and test (1 year devoted)
3. The implementation process, the first metadata files and quality
reports will be produced via the new subsystem
9
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Project objectives and outline
Main advantages:
Exploit the already available information
Reduce reporting burden for survey managers
Avoid inconsistencies in metadata and quality reporting
Improve the metadata asset
Enhance internal system to be compliant to international
technical standards
Facilitate next re-use
Improve internal coordination, harmonisation and centralised
monitoring
10
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Project objectives and outline
1.The design phase: four steps to collect requirements
The first step: mapping between ESMS and ESQRS and SIDI/SIQual
contents
- Based on standard ESS Guidelines
- Exercise of compilation from SIDI/SIQual
Example for ESMS concept «Statistical Unit»
ESMS
ESMS
Concept
Name
3,5 Statistical unit
Concept
Code
STAT_UNIT
Descriptions
Entity for which
information is sought and
for which statistics are
ultimately compiled.
SIDI
Represen
tation
Text
ESS Guidelines
List the basic units of statistical
observation for which data are
provided. These observation units
(e.g. the enterprise, the local
unit, private households,...) can
be different from the reporting
units used in the underlying
statistical surveys.
11
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
SIDI
Sidi concept,
if available
SQL Query
Output example
(LFS)
Observation
units
select
R3_T_UN_STAT.NOME_UNITA_ENG
from r6_indagine, r3_t_un_stat,
r17_ind_t_ust where
R3_T_UN_STAT.CODICE_UNIT_STT
STC=R17_IND_T_UST.CODICE_UNI
T_STTSTC and
r6_indagine.codice_indagine=r17_ind
_t_ust.codice_indagine and
R17_IND_T_UST.TIPO_UNITA_STATI
STICA in (2,3,4,5,7,8) and
r6_indagine.codice_indagine="Survey
_code"
Persons,
Persons aged 15
and over
Project objectives and outline
1.The design phase
The second step: analysis of NRME functionalities, available Metadata
Structure Definitions, already filled in metadata files and quality reports
Main inputs obtained:
- «Input» compliance with SDMX artifacts and concepts is needed
- Functionalities to be implemented to support compilation (e.g: copy of
a previous edition, re-use of single items, …)
- …
12
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Project objectives and outline
1.The design phase
The second step: analysis of NRME functionalities, available Metadata
Structure Definitions, already filled in metadata files and quality reports
Difficulties: two levels “Domain” customisation
1. At Metadata Structure Definition level: introduction of Domain specific
concepts
Example
This case can be managed through a more generalised software
implementation, that will also facilitate the software reuse and higher its
flexibility for changing requirements
13
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Project objectives and outline
1.The design phase
The second step: analysis of NRME functionalities, available Metadata
Structure Definitions, already filled in metadata files and quality reports
Difficulties: two levels “Domain” customisation
2. Within sub-concept level: introduction of different html tables in
Example
different domains
10.2. Dissemination format - Publications
10.2. Dissemination format - Publications
The solution to this issue is still under
Dissemination at national level
evaluation, suggestions?
Dissemination at national level :
publications
Reference
year
Statistical
yearbook
Thematic
publications
XXXX
XXXX
Name of
national paper
publications
Text
Name of
national
electronic
dissemination
Text
For XXXX, please report any scheduled
action plan, specifying the implementation
date.
14
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Project objectives and outline
1.The design phase
The third step: involvement of stakeholders
• At national level
• Contacts with Eurostat
The fourth step: drafting the requirements’ document
15
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Project objectives and outline
2. The software development:
•
•
Design by Istat IT experts
Realisation outsourced
3. The implementation process:
•
•
Under definition a proposal for the governance to be then approved by the
top management
The production of metadata files and quality reports with the new
subsystem should be centrally supported
16
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
Quality reporting subsystem building blocks
Euro-SDMX registry
SDMX artifacts
import
functionalities
(6)
SDMX
Metadata set
(5)
WS (8)
GUI template
management (7)
GUI for metadata
files compilation (4)
GUI
Enhancement (1)
SIDI Metadata &
quality indicators
GUI
Pulling out
procedures (2)
Enhancement to be
compliant to SDMX
artifacts (3)
Enhancement for
ESMS/ESQRS contents not
included (1)
SEP
Quality
reports (8)
SIDI Reference Metadata
& Quality indicators DB
17
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013
ETL
Web Browser
SIQual
(8)
Eurostat
(NRME or EDAMIS)
Thank you for your attention!
Comments and suggestions are welcome
[email protected]
18
Implementing ESS standards for reference metadata and quality reporting at Istat
Giorgia Simeoni – Geneva, 6 May 2013