Centre of Excellence on Data Warehousing. Harry Goossens

Transcription

1 Centre of Excellence on Data Warehousing Harry Goossens

2 Background & History ESSnet on Datawarehousing ( ) Centre of Excellence on DWH (since 2013) 2

3 Centre of Excellence on DWH Started as pilot Ensure sustainability of the work, results and acquired expertise of the preceding S-DWH projects Active dissemination of the deliverables: Support and facilitate projects of member states implementing ESSnet results 3

4 Centre of Excellence on DWH Main Goals Identifying relevant projects and support requests Support, consultancy and/or expert reports Ad hoc & on request of member states Maintain the knowledge and expertise repository on the CROS portal Best practice cases Experts network Further elaborating living deliverables S-DWH Manual Active dissemination of results, knowledge and new developments. 4

5 Short Recap: S-DWH Definition A central statistical data store for managing all available data of interest, regardless of its source, enabling the NSI to: produce necessary information (= statistics!) (re)use available data to create new data / new outputs execute analysis and perform reporting A warehouse approach to statistics: Provide an architectural model of the statistical data flow, from data collection to statistical output. 5

6 Why S-DWH? The Challenges Integration & re-use available data sources Decrease costs & admin burden Statistical Production Increase efficiency & flexibility Shorter life cycle, Quicker delivery Rapidly changing info-demand 6

7 Why S-DWH? The goal External data sources Make optimal use of all available data sources (existing & new) Data Collection Reusing Statistical Data 7

8 The layered architecture of the S-DWH Distinguishes S-DWH 8

9 CoE DWH: Status Developed from a pilot into a stable entity - 3rd operational year, started januari 2016 Positive Assessment over first 2 years FPA for sustainable frame of operation - 4-year horizon 9

10 Results 1st line help desk function established on CROS Portal Inventory of needs & relevant S-DWH projects in MS Inventory of tools and solutions developed for a S-DWH which could be used for exchange and sharing knowledge Handbook further elaborated into S-DWH Manual Knowledge and expertise repository on CROS Portal up-todate - BP-case renewed & revised - Integrated glossary - Specialists network, pool of experts 10

11 Results 2 succesfull Workshops - Helsinki 2014: 21 NSIs, ECB / 41 participants - Dublin 2015: 23 NSIs, Bundesbank / 45 participants 15+ Consultations and support actions Communication & exchange platform on CROS portal 11

12 Support actions CSO Ireland: Architecture and Metadata Review Corporate Data Vault Destatis Germany: Metadata support CSO Poland General advise on S-DWH topic Active participator in projectteam Australian Bureau of Statistics (ABS): Layered S-DWH Architecture basis corporate architecture Workshop CoC on DWH, Helsinki, September

13 Support actions Bundesbank Germany: Review of House of Microdata concept Support and advice for developtment metadata model NISRA Nothern Ireland Presenting BP-case in Dublin Ad-hoc advice Statistics Serbia BP-case of metadriven IST system Regional Support meeting planned INE Portugal BP-case SIMSTAT, partner in CoE Workshop CoC on DWH, Helsinki, September

14 Lessons learned Work in progress, stable but slowly Most NSI still in early stage of (re)design, but growing practice experiences to share Availability of resources Different format & more flexibility needed Need for exchanging expertise and experiences still higly actual 14

15 Assessment 15

16 Assessment 16

17 Future Main recommendations assessment Importance of network, knowledge exchange Keep actively contacting NSIs and institutions Keep elaborate BP-cases Support & Consultancy higly effective, continue! Workplan 2016 Regional support meetings Finalise S-DWH Manual (Memobust-style) Newsletter Promoting CoE DWH (ICES, Modernisation WS) 17

18 C0E DWH Thank you! Harry Goossens