Centre of Excellence
on Data Warehousing
Harry Goossens
Background & History
ESSnet on Datawarehousing
(2010 – 2013)
Centre of Excellence on DWH
(since 2013)
2
Centre of Excellence on DWH
Started as pilot
 Ensure sustainability of the work,
results and acquired expertise of the
preceding S-DWH projects
 Active dissemination of the deliverables:
 Support and facilitate projects of member states
implementing ESSnet results
Overview CoE DWH – MWG, April 7, Luxemburg
3
Centre of Excellence on DWH
Main Goals
 Identifying relevant projects and support requests
 Support, consultancy and/or expert reports
– Ad hoc & on request of member states
 Maintain the knowledge and expertise repository on the CROS portal
– Best practice cases
– Experts network
 Further elaborating ‘living deliverables’
 S-DWH Manual
 Active dissemination of results, knowledge and new developments.
Overview CoE DWH – MWG, April 7, Luxemburg
4
Short Recap: S-DWH Definition
A central ‘statistical data store’ for managing all available
data of interest, regardless of its source, enabling the NSI to:
 produce necessary information (= statistics !)
 (re)use available data to create new data / new outputs
 execute analysis and perform reporting
 A warehouse approach to statistics:
Provide an architectural model
of the statistical data flow,
from data collection to statistical output.
Overview CoE DWH – MWG, April 7, Luxemburg
5
Why S-DWH ? The Challenges
Integration &
re-use available
data sources
Decrease costs
&
admin burden
Shorter life cycle,
Quicker delivery
Overview CoE DWH – MWG, April 7, Luxemburg
Statistical
Production
Increase
efficiency &
flexibility
Rapidly
changing
info-demand
6
Why S-DWH ? The goal
External
data
sources
Make optimal
use of all
available data
sources
(existing & new)
Data
Collection
Reusing
Statistical
Data
Overview CoE DWH – MWG, April 7, Luxemburg
7
The layered architecture of the S-DWH
Distinguishes
S-DWH
Overview CoE DWH – MWG, April 7, Luxemburg
8
CoE DWH: Status
 Developed from a pilot into a stable entity
- 3rd operational year, started januari 2016
 Positive Assessment over first 2 years
 FPA for sustainable frame of operation
- 4-year horizon
Overview CoE DWH – MWG, April 7, Luxemburg
9
Results
 1st line help desk function established on CROS Portal
 Inventory of needs & relevant S-DWH projects in MS
 Inventory of tools and solutions developed for a S-DWH
which could be used for exchange and sharing knowledge
 Handbook further elaborated into S-DWH Manual
 Knowledge and expertise repository on CROS Portal up-todate
- BP-case renewed & revised
- Integrated glossary
- Specialists network, pool of experts
Overview CoE DWH – MWG, April 7, Luxemburg
10
Results
 2 succesfull Workshops
- Helsinki 2014:
21 NSIs, ECB / 41 participants
- Dublin 2015:
23 NSIs, Bundesbank / 45 participants
 15+ Consultations and support actions
 Communication & exchange platform on CROS portal
https://ec.europa.eu/eurostat/cros/content/centre-excellence-datawarehousing_en
Overview CoE DWH – MWG, April 7, Luxemburg
11
Support actions
 CSO Ireland:
− Architecture and Metadata
− Review Corporate Data Vault
 Destatis Germany:
− Metadata support
 CSO Poland
− General advise on S-DWH topic
− Active participator in projectteam
 Australian Bureau of Statistics (ABS):
− Layered S-DWH Architecture basis corporate architecture
Workshop CoC on DWH , Helsinki, 24 – 25 September2014
12
Support actions
 Bundesbank Germany:
− Review of ‘House of Microdata’ concept
− Support and advice for developtment metadata model
 NISRA Nothern Ireland
− Presenting BP-case in Dublin
− Ad-hoc advice
 Statistics Serbia
− BP-case of metadriven IST system
− Regional Support meeting planned
 INE Portugal
− BP-case SIMSTAT, partner in CoE
Workshop CoC on DWH , Helsinki, 24 – 25 September2014
13
Lessons learned
 Work in progress, stable but slowly
 Most NSI still in early stage of (re)design,
but growing practice experiences to share
 Availability of resources
 Different format & more flexibility needed
 Need for exchanging expertise and
experiences still higly actual
Overview CoE DWH – MWG, April 7, Luxemburg
14
Assessment
Overview CoE DWH – MWG, April 7, Luxemburg
15
Assessment
Overview CoE DWH – MWG, April 7, Luxemburg
16
Future
 Main recommendations assessment
− Importance of network, knowledge exchange
 Keep actively contacting NSIs and institutions
 Keep elaborate BP-cases
− Support & Consultancy higly effective, continue !
 Workplan 2016
− Regional support meetings
− Finalise S-DWH Manual (Memobust-style)
− Newsletter
− Promoting CoE DWH (ICES, Modernisation WS)
Overview CoE DWH – MWG, April 7, Luxemburg
17
C0E DWH
Thank you !
Harry Goossens
[email protected]