Metadata and Infrastructure for Researchers from a perspective of an NSI. C-G Hjelm Research and Development at Statistics Sweden

Size: px

Start display at page:

Download "Metadata and Infrastructure for Researchers from a perspective of an NSI. C-G Hjelm Research and Development at Statistics Sweden"

Evangeline Nicholson
6 years ago
Views:

1 Metadata and Infrastructure for Researchers from a perspective of an NSI C-G Hjelm Research and Development at Statistics Sweden

2 The coming minutes Metadata and Microdata from a perspective of an NSI Metadata and Microdata from a perspective of a researchers Legal basis/legislation on Microdata in the Nordic countries Nordic smorgasbord Data Warehouse Solutions of today MONA The lifecycle for a research project Cooperation with the Swedish Research Council An example within the Public Domain Solutions of tomorrow Federation

3 Metadata and Microdata from a perspective of an Nordic NSI

4 How an NSI see Microdata and Metadata Production of statistics Periodical statistics (year, month etc) Metadata for statistical production No longitudinal Microdata or Metadata Documentation primary for production and archiving Microdata is (only) the base for the aggregated statistics

5 Metadata and Microdata from a researchers perspective Microdata!!! Longitudinal perspective on both Microdata and Metadata Documentation essential on process data / paradata Searchable Metadata Linkable to other materials Metadata standard ISO 11179

6 Legal basis/legislation Swedish legislation regarding Microdata Statistics Acts Personal Data Acts Secrecy Act

7 Statistics Act Data collected for statistical purposes may be used for the production of statistics research purposes public planning

8 Confidentiality main rule Data obtained for statistical purposes are confidential Access may be granted in forms which do not allow direct or indirect identification of persons or of other data subjects like enterprises

9 Confidentiality - exception Confidential data may be released to a third party for the purpose of statistical surveys or research.

10 Confidentiality The obligation of confidentiality will also according to the law or by imposition of a duty of nondisclosure apply to the recipient of the data.

11 Nordic smorgasbord Data Warehouse

12 Data collection Administrative registers Postal questionnaires?! Other electronic transfers Interviews Telephone Face-to-face

13 The Swedish Register system a goldmine for researchers Swedish for Immigrants Causes of Death Adults Education Supplementary Benefits Upper Secondary School Vehicles - privately owned Form 9 Persons nominated and elected Teachers Education Higher education Personal Income and Assets Population Activity Persons Enrolled in Education Population and Housing Census Register Register Income Verifications Employment Private sector - wages Longitudinal Income County Councils - wages Longitudinal Welfare Ecclesiastical Districts - wages Persons entering Labour Market Municipalities - wages Second Generation Register Civil Servants - wages Fertility Occupational Register Geographical Database Standardised Accounts Real Estate Price Monthly Tax Returns Restoration of Buildings VAT Register New Construction of Buildings Foreign Trade One or Two Dwelling Buildings Real Estate Business Vehicles - company owned Multi Dwelling Buildings Register Register Agricultural Register Industrial Real Estate Register of Business Statistics Agricultural real Estate Register of Schools Dwellings Municipality Register

14 Data Warehousing vision Metadata Process data Dissemination Direct collection Input data Observation data Target data Macro data Presentation data Publishing Admin data Preprocessing Base register Publication data Raw data Micro data Macro data

15 Today

16 The MONA system Microdata ON-line Access)

17 Advantages and basis of MONA Statistics Sweden and other authorities has distributed Microdata to research institutions in Sweden for many years by CD-ROM and other medias Today there are new needs to distribute Microdata primary larger volumes We wont control over distributed data Secure system User friendly system Users don t need their own infrastructure

18 Advantages and basis of MONA - continued Extended and better documentation suitable for researcher Faster and cheaper Increased level of service Increased choice of place to perform the research research is no longer local Increased possibilities to build common used databases for different disciplines Increased secondary use of Microdata

User statistics of MONA Started winter 2005 2010

19 User statistics of MONA Started winter around 650 registered users (500 active) demanding and creative users Round 25-30% increasing per year The users are researchers (75%) and Public Offices (25%)

20 MONA some technical buzzwords Server based design - Microsoft Terminal Services / Windows OS - User have their own desktops - Only screen updates are transferred - No cut and paste between sessions - in PGP for result files Användare Användare Internet Användare Security - SSL tunnel RSA Secure ID - Domain logon and reauthentication with security token Mikrodata Databaser Excel /Word Brandvägg Applications (present) SAS Egna data Super Cross - SAS, SPSS, GAUSS, R, TSP, Super Cross, STATA, LISREL, GAMS, WinRats, SQL Query Analyzer and Microsoft Office SPSS SQL

21 Public certificate

22 MONA domain Internet File, SQL, Application and RSA Servers SAN https SSL Reverse Proxy (PortWise) Domain Controller and Terminal Servers

23 Structure of data in MONA Structured data layer (Data Warehouse) Views (filter) in SQL Server User-1 User-2 User-n

normal archiving For academic replication This part is

24 The lifecycle for a research project Often ends with the archiving of the project this includes the data For normal archiving For academic replication This part is often forgotten in the research community and in the NSI s

25 Cooperation with the Swedish Research Council

26 Cooperation with the Research Community Funding to Statistics Sweden from the Swedish Research Council (public authority that handles most of the research funds in Sweden) with evaluation in summer SEK (ax ) per year Evaluated in April 2009

classifications for researchers on the selected registers available via Internet Quality

27 Activities and projects Access to the MONA system Service to researchers Selection of structured registers available for researchers Suitable metadata, documentation and classifications for researchers on the selected registers available via Internet Quality indicators on register data Routines for handling researchers data after the ending of the project

28 Multimode Interviewing Capability in the Public Domain - an example open solutions in Metadata and Interviewing

29 MMIC (Multimode Interviewing Capability) Source:

30 Participating studies

31 Metadata (SHARE)

32 Tomorrow

33 Solutions of tomorrow federation?

34 Examples of reports

35 International reports

36 DISC reports

37 Questions and Thank You for Your time

NordMAN: The Nordic Microdata Access Network

INTERACTION WITH USERS SESSION D NordMAN: The Nordic Microdata Access Network C-G Hjelm Statistics Sweden Anton Örn Karlsson Statistics Iceland NordMAN: The Nordic Microdata Access Network C-G Hjelm 1,