New technologies of data collections supporting transformation from traditional to combined and register-based censuses (PL)
|
|
- Daniela Brown
- 5 years ago
- Views:
Transcription
1 New technologies of data collections supporting transformation from traditional to combined and register-based censuses (PL) Janusz Dygaszewicz Central Statistical Office of Poland THE CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION Eurostat
2 Long-term history (tradition) of Polish statistics first countrywide population census in Poland (based on registers!! ) The register of nobility and burghers The parish register of births and deaths establishment of Central Statistical Office (CSO) Almost 100 years of continued existence and development of CSO Poland. 2
3 In Mixed Model for Population and Housing Census Combining Census a combination of data from administrative sources (full survey covering basic demographic variables) with data acquired from ad-hoc 20% sample survey. 3 3
4 Data collection channels in 2011 Census Round Administrative Sources Including spatial data reference registers Self-enumeration by Internet CAII (CAWI) Computer Assisted Internet Interview Telephone Interview Face-to-face Interview with respondents executed by the census enumerators CATI - Computer Assisted Telephone Interview (Call Center) Registered on hand-held terminals with usage GPS and GIS service CAPI - Computer Assisted Personal Interview 4 4
5 CAxI CAXI CAxI CAII/CAWI - Computer Assisted Internet Interview, CAPI - Computer Assisted Personal Interview, CATI - Computer Assisted Telephone Interviewing. 5 5
6 NSP 2011 full scale survey (short form - 15 questions) Full-scale survey: 1) Data from administrative register Master Record 2) Data acquired using the CAII method 3) Data supplemented using CATI and CAPI method Administrative and non-administrative systems The CAII method Data sumplementation (CAPI and CATI) 6 6
7 NSP 2011 sample survey (long form - about 100 questions) Sample survey: 1) Data from administrative register Master Record 2) Data acquired using: The CAII method The CAPI method 3) Data supplemented using CATI method The CAPI method Sample survey Administrative and non-administrative systems The CAII method The CATI method The supplementation of data 7 7
8 Census organisation 8 8
9 The project timetable National Population and Housing Census Start of preparation IV-V.2010 Trial census NSP 2011 IV-VI.2011 NSP 2011 IX-X.2009 Trial Census PSR 2010 Agriculture Census 2010 IX-X.2010 PSR End of project 9 9
10 Organization NSP central controllers 32 managers of the WCZS and the WCC 571 voivodship controllers 642 statistical interviewers around 2800 gmina leaders around census enumerators 10 10
11 DATA ACQUISITION 11 11
12 On-line channels for data collection System Architecture Census Completeness Management Map Server Operational Microdata Base CAPI CAII CATI 12 12
13 The architecture of a CAII/CAWI method ZKS OBM Online electronic questionnaire system Offline questionnaire Downloading the application file Internet Browser Online Electronic media Online method Offline method 13 13
14 Self-enumeration by Internet filling the questionnaire by the respondent Identification Used to confirm the identity of the respondent. Entering identification data in a questionnaire(f.ex.: PIN, NIP, first name, last name) or additional authentication qualities (f.ex. a place of birth, mother s maiden name) Establishing a password which jointly with PIN was the basis of authentication within 14 days 14 14
15 Self-enumeration by internet course of action in completing the survey by person In case of full scope survey person fulfilled his/her questionnaire, and could also specify adults who lived in the same apartment (proxy) In case of sample survey the dwellings questionnaires were completed in the first place. Later were fulfilled personal questionnaires. After authorization the census form was available for 14 days for multiple access
16 Typical person using selfenumeration A man Age: about 24 years old A city inhabitant Secondary degree 16 16
17 17 17
18 CATI Computer Assisted Telephone Interview scheduled as the first or the second (following CAII) channel of collecting data; working posts of telephone interviewers located in separated Call Center studies; telephone interviewers provided with professional equipment
19 CATI in National Census distributed Call Centers SIP Stations telephone interviewers/consultants - technology Interactive Inteligence - utility applications prepared by CSO in Poland The system worked from 8.04 to (84 days) in hours /2 shifts Hotline or (22)
20 The most significant functionality of Call Center Confirming the identity of the interviewer/census enumerator Hotline Interviewing Arranging visits by census enumerators 20 20
21 CAPI Computer Assisted Personal Interview the third channel of data collection in the case of failure to obtain a complete set of data via CAII and CATI channels direct interviews in households (first or second channel) where such a way of proceeding results from adopted methodology or whose members has not expressed consent for a telephone survey
22 The architecture of a CAPI method ZKS OBM Dispatching application - server - Communication server Map server Management of a terminal WAN CSO Dedicated APN Mobile network Dispatching application - client - Mobile application Cryptographic SIM card Module GPS 22 22
23 Field enumeration management Supervisor Regional (NUTS2) level Responsibilities: Address Point and Census Area management Enumerator monitoring Census Progress Localization and trail Emergency situation management Providing help for enumerators Providing necessary information to enumerators 23 23
24 24 24
25 25 25
26 HH - Mobile terminal with GPS HTC Touch Pro2 Screen touch-screen size 3,6 resolution 480 x 800 pixels sliding, tilting - convenient usage sliding, 5-rows QWERTY keyboard GSM/GPRS/EDGE/UMTS/HSPA GPS module camera - 3,2 MP Windows Mobile
27 Enumerator Visiting all assigned holdings Filling electronic questionnaires Daily synchronisation Contact with the supervisor in terms of task scheduling Adding newly identified holdings 27 27
28 Enumerator 28 28
29 Enumerator 29 29
30 Enumerator Alarm procedure In emergency situations, enumerators have a possibility of sending an alarm signal to their supervisors Alarm notice is sent to the supervisor application and via SMS to the supervisor 30 30
31 ADMINISTRATIVE REGISTERS 31 31
32 The use of administrative sources in censuses The usage of administrative sources in the census: direct source of research data, source of information to create a list of entities covered by the census frame (address-housing survey), in addition, a source of information for : imputation, data estimation, comparison the quality of the data
33 The conditions of using administrative data by the Polish official statistics Legal issues, related to the access and use of data, including especially the identifiable and personal microdata Public relations public trust and acceptance of administrative data linkage and re-use, primarily collected for other purposes, in official statistics Organisational issues, related to the statistical survey management process and to the work organisation changes Methodological issues methods ensuring optimal quality of output data, including definition consistency of the official statistics system with the information systems of public administration Technical issues, concerning the use of new technologies, including especially the information and communication technologies 33
34 Registers - data acquisition Data Owners: Ministry of Finance, Ministry of Interior and Administration, Ministry of Justice, Agricultural Social Insurance Fund, National Health Fund, Agency for Restructuring and Modernisation of Agriculture, Agricultural and Food Quality Inspection, Agency for Geodesy and Cartography, State Fund for Rehabilitation of Disabled Persons, County Offices, Commune Offices, Regional Offices, Telcoms, Energy Suppliers, Office For Foreigners, Social Insurance Institution, Housing Managers, 34 34
35 Key administrative sources used in the Polish official statistics population registration system tax system economic activity information system farming activity information system social security system social insurance system health insurance system real estate information system education information system vehicle and vehicle owners information system 35
36 Data quality -measures- 1. Measuring the quality of administrative registers timeliness of data methodological compatibility completness identification standards used in the registry usefulness compatibility of data in administrative sources to data obtained in the study/survey 2. Measuring the quality in processing of data registers excessive coverage error rate incomplete coverage error rate subjective indicator of completness objective indicator of completness imputation rate data correction index integration data from various sources index 36 36
37 CENSUS Data Processing Infrastructure 37 37
38 Data processing Stages: Data acqusition, Source data collection and preparation, Source data loading and correction, Census Frame preparation, Master Record generation, CAxI data colection, Golden Record generation, Export to Analitycal Microdatabase, Data processing, Information Analisys, Product generation, Dissemination. 38
39 Architecture solution Registry 1 Registry 2 Registry n XML TXT Stage I Preparatory works Files ETL Tools CAXI Stage II Data acquisition Statistical Files Operational Microdata Base Questionnaires Golden Record Stage III Results compilation Analytical Microdata Base SDMX Metadata Metadata Metadata XML Metadata server Portal 39 39
40 Administrative sources The process of data processing started from collecting administrative sources from data administrators registers in the field defined by the appropriate legal Acts. The Polish statistics has the right to access all unit data stored in information sources of the public and commercial sectors. The obtained data include necessary identifiers and personal data supporting the process of merging (linking) 40 unit data from different sources.
41 Operational Microdata Base The basic structure of data in the OMB is a layer. It is a set of records, each of which relates to one census unit (a person, a dwelling, a household). The records include the values of census attributes derived from source data collected from respondents or defined in a different way (e.g. in the process of imputation). Layer can differ between one another with a set of attributes whose values are presented in a given layer. In the first step of processing, before beginning the census, on the basis of source sets and the census frame the layer referred to as a Master Record was created, consisting of the initial value of the selected subset of census attributes. The values from this layer were transferred to the CAPI, CATI and CAII processes for personalization electronics questionnaires
42 Operational Microdata Base After completing the census with the use of the CAPI, CATI and CAII processes, on the basis of information collected in the processes proper layers in the database are created. The layer which have already been saved in the system can serve as the basis for creating new, internal layer in which new attributes (derived from the existing ones) can be added. Collection and processing of data was done in the OMB, which contained personalized data on the census unit, together with the value of characteristics obtained from administrative sources and from other channels (CAII, CATI, CAPI) 43
43 Operational Microdata Base The Operational MicroData Base (OMB) - system included hardware-system-tool infrastructure (computer hardware, system software, tool software) and application software (computer programs that are the result of programming work). This base enabled the inclusion of data transmitted in electronic form through four informational channels by entities and to conduct further data processing. In the OMB processes connected with the control, correction, and linking of data, up to their complete cleansing took place. Next, depersonalized data (as the Golden Records) were transferred to the Analytical Microdata Base (AMB)
44 Data acquisition Registry 1 XML TXT CAXI Questionaries Registry 2 Registry n Files ETL Tools Statistical Files Operational Microdata Base Golden Record Analitycal Microdata Base SDMX Metadata Metadata Metadata XML Metadata server Portal 45 45
45 Files format: Data acquisition Flat files, XML files, Local Databases XML files integration, 46 46
46 TRANSFORMATION TO STATISTICAL REGISTER 47 47
47 Source data collection and preparation Registers loading into data laboratory envroiment, Denormalization, Standarization, Deduplication, Validation, Data completion, Vocabulary validation and automatic correction, Statistical files (register) generation, 48 48
48 Source data collection and preparation Registry 1 XML CAXI TXT Questionaries Registry 2 Registry n Files ETL Tools Statistical Files Operational Microdata Base Golden Record Analitycal Microdata Base SDMX Metadata Metadata Metadata XML Metadata server Portal 49 49
49 Transform data Data processing in the production environment consisting of: profiling create a raport on the data quality, unification/standardization of data, parsing (separation) or combining variables, standardization with schemes, conversion, validation, deduplication, data integration
50 ETL process scheme PROFILING A Register B Register C Register E X T R A C T D A T A T R A N S F O R M D A T A STANDARDIZATION PARSING CONVERSION VALIDATION DEDUPLICATION INTEGRATION STATISTICAL REGISTER L O A D D A T A ANALYTICAL BASE 51 51
51 The data transformation model from administrative sources into statistical data sets Preliminarypreparation of an administrative register 1) Importing 2) Mapping 3) Simple deduplication 4) Denormalisation Data transition The processing of identification and address variables The processing of substantive variables Validation and adjustment Integration Complex deduplication The selection of statistical variable value frommany registers STATISTICAL DATA SET 52
52 The data transformation model from administrative sources into statistical data sets Preliminary preparation of an administrative register Importing data sets Mapping excluding excessive variables from further processing, and labelling the remaining ones in accordance with an agreed standard Simple de-duplication removing identical records from the data set De-normalisation creating a flat table with a specific substantive content 53
53 The data transformation model from administrative sources into statistical data sets Data transition cleaning obtaining a set of coherent data, containing standardised variables which are accurate in substantive terms Validation and adjustment verifying the processing outcome based on suitable rules, i.e. checking the meeting requirements for data coherence, accuracy and standardisation generating a data quality improvement report further processing or re-cleaning the data set 54
54 The data transformation model from administrative sources into statistical data sets Data set integration with the reference set (e.g. with a previously given list of units individuals, real estate, farms, enterprises the statistical business register or an administrative register) Complex de-duplication eliminating recurrent units parallel but not identical obtaining one record for a given entity without losing other information Selection of the statistical variable value from multiple registers 55
55 The data transformation model from administrative sources into statistical data sets A statistical data set comprises a certain population determined in the reference table, together with a number of entity-specific descriptive variables, the values of which represent the synthesis of information included in multiple registers the outcome of data quality improvement, upon transformation of the source data set into a statistical one, may be illustrated statistically 56
56 Census Frame preparation Citizens, buildings and dwelling list preparing, Citizens, buildings and dwelling list and statistical data integration, Census Frame preparing. Goal Frame Preparation, Random Sample preparation, 57 57
57 CAxI Registry 1 XML CAXI TXT Questionaries Registry 2 Registry n Files ETL Tools Statistical Files Operational Microdata Base Golden Record Analitycal Microdata Base SDMX Metadata Metadata Metadata XML Metadata server Portal 58 58
58 GOLDEN RECORD 59 59
59 Golden Record generation Registry 1 XML TXT CAXI Questionaries Registry 2 Registry n Files ETL Tools Statistical Files Operational Microdata Base Golden Record Analitycal Microdata Base SDMX Metadata Metadata Metadata XML Metadata server Portal 60 60
60 Golden Record generation Integration with Census Frame and CAxI data, Validation, Correction, Operational Imputation, Transfer proper values to Golden Record, Registers 1..n CAxI OMB Layers Golden Record AMB 61
61 Export to Analitycal Microdata Base Transition Tables Preparing, Golden Records anonymisation, Transfer to Analitycal Microdatabase, 62 62
62 Export to Analitycal Microdata Base Registry 1 XML CAXI TXT Questionaries Registry 2 Registry n Files ETL Tools Statistical Files Operational Microdata Base Golden Record Analitycal Microdata Base SDMX Metadata Metadata Metadata XML Metadata server Portal 63 63
63 The main objectives of AMB Preparation and dissemination census data for statistical analysis Dissemination of analytical and reporting platform for development of census data collected and preparation of statistical products for national and international users. Supporting for process of creation and dissemination statistical products 64 64
64 Analytical Microdata Base cont. In the Analytical Microdata Base took place the following processes: data integration, validation, automatic correction, imputation, calibration, creation a new secondary variables and new statistical units (i.e. families and households). ETL processes in OMB and AMB were repeatedly executed until the approval by the methodologists. In the next step, processes concerning creation multidimensional objects - OLAP Cubes (domestic needs), and Hypercube (60 HC) and Quality Hypercube (in accordance with international requirements - Eurostat) were made
65 Concept solution GOLDEN RECORD NSP 2011 ETL - transfer to base - validation - correction - imputation - weighting - calibration - transformation - quality indicators, - calculation of the secondary variables, APPLICATION OF INTERNAL USERS ANALYTICAL MODEL MULTIDIMENTIONAL STRUCTURES APPLICATION OF EXTERNAL USERS REPORTS, ANALYSES DISSEMINATION DATA SDMX STATISTICAL PRODUCTS FILES TO EUROSTAT REPOSITORY OF DATA AND METADATA 66 66
66 Data processing in AMB In order to realize the process of "Data Processing, a series of ETL jobs were divided into the following steps (using the SAS Data Integration Studio tools): S00: load source data from Golden Record NSP 2011 (8 tables: Buildings, Dwellings, Collective living quarters, Persons, Emigrants after 2002, Homeless, Households, Families), S01: copy the relevant objects, Households, Families, S02: execution of the automatic data correction, S03: Validation tables of Golden Record, S04: execution of manual data correction, S05: weighing data S06: data calibration and imputation 67 67
67 Data processing in AMB S07: control reports S08: calculation of derived variables S09: calculating rules on the basis of dictionaries S09a: adding the secondary variables S10: transformation data to the analytical model (facts tables and dimension tables, cubs for national purposes) S11: creation and loading hypercubes for Eurostat S12: validation of hypercubes and creation quality hypercubes for Eurostat S13: transformation of operational metadata S14: enumeration of quality indicators S15: preparation aggregates for the Geostatistics Portal 68 68
68 Instead of a conclusion Census in 2002 Census thousands of census enumerators 120 mln of questionnaires 18 thousands of census enumerators 0 questionnaires tons of papers At the end shredding census questionnaires 0 tons of papers ca. 50 mln less better data the more reliable results statistical surveys in the future 70
69 Methodological CSO work on the use of administrative registers for the 2021 National Census (NSP 2021) conducted within: Improvement of the use of administrative sources (ESS.VIP ADMIN WP6 Pilot studies and applications) 1.X IX.2016 Improvement of the use of administrative sources (ESS.VIP ADMIN WP6 Pilot studies and applications) Initial identification of administrative registers as data sources for the 2021 National Census (NSP 2021) Improvement of: method for assessing the quality of administrative registers assumptions for creating identifiers for linking data from administrative registers assumptions for getting variable values using many administrative registers assumptions to derive new variables from the administrative registers methods of building a list of address and dwelling linking information about people, dwellings and buildings methods of data integration from different sources methods of data imputation and calibration using data from administrative registers and surveys methods of generalizing results based on combinations of data from different sources at different levels, territorial cross-section methods of assessing the quality of estimates - generalized results methods of improving the quality of the spatial location of buildings in a statistical frame. 71
70 Thank you for your attention 72
METADATA MANAGEMENT AND STATISTICAL BUSINESS PROCESS AT STATISTICS ESTONIA
Distr. GENERAL 06 May 2013 WP.13 ENGLISH ONLY UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS EUROPEAN COMMISSION STATISTICAL OFFICE OF THE EUROPEAN UNION (EUROSTAT)
More informationBusiness Case for Industrialisation in Statistics Estonia: Small Example of a Large Trend
Business Case for Industrialisation in Statistics Estonia: Small Example of a Large Trend MSIS 2013 Allan Randlepp Tuulikki Sillajõe Outline Business case for Population and Housing Census 2011 (PHC 2011)
More informationTowards a Web-based multimode data collection system for household surveys in Statistics Portugal:
Towards a Web-based multimode data collection system for household surveys in Statistics Portugal: a report and discussion of the first experiences Pedro Lima Maria José Fernandes Wiesbaden 4-5 September
More informationPre-Census Planning. Population Census Data Dissemination and Use. Department of Statistics, MALAYSIA
Population Census 2000 Department of Statistics, MALAYSIA Seminar on Population Census Data Dissemination and Use 10 12 Nov. 2003 Pretoria, South Africa Malaysia 1 Data Dissemination and Use Pre-Census
More informationMANAGING STATISTICAL DEVELOPMENT AND INFORMATION TECHNOLOGY IN THE STATISTICAL SYSTEM OF MALAYSIA
SIXTH MANAGEMENT SEMINAR FOR HEADS OF NATIONAL STATISTICAL OFFICES IN ASIA AND THE PACIFIC. 28 30 MAY 2007, HONG KONG, CHINA 1. Introduction MANAGING STATISTICAL DEVELOPMENT AND INFORMATION TECHNOLOGY
More informationDATA INTEGRATION AT THE NATIONAL LEVEL
DATA INTEGRATION AT THE NATIONAL LEVEL SERGEY EGORENKO DEPUTY HEAD, FEDERAL STATE STATISTICS SERVICE (ROSSTAT) 11-13 DECEMBER 2017 BANGKOK, THAILAND CENTRALIZED SYSTEM OF THE STATE STATISTICS WITH ELEMENTS
More informationOn the Design and Implementation of a Generalized Process for Business Statistics
On the Design and Implementation of a Generalized Process for Business Statistics M. Bruno, D. Infante, G. Ruocco, M. Scannapieco 1. INTRODUCTION Since the second half of 2014, Istat has been involved
More information2011 INTERNATIONAL COMPARISON PROGRAM
2011 INTERNATIONAL COMPARISON PROGRAM 2011 ICP DATA ACCESS AND ARCHIVING POLICY GUIDING PRINCIPLES AND PROCEDURES FOR DATA ACCESS ICP Global Office November 2011 Contents I. PURPOSE... 3 II. CONTEXT...
More informationFeatures of Case Management Systems
Features of Case Management Systems Vesa Kuusela Social Survey Unit Statistics Sa Finland & Working group set by BCLUB Outline Characteristics of different data collection organisations Case management
More informationOverview of UNSD World Census Programme Use of Technology in Censuses. Meryem Demirci United Nations Statistics Division
1 Overview of UNSD World Census Programme Use of Technology in Censuses Meryem Demirci United Nations Statistics Division Experiences, good practices and challenges for the National Statistical Systems
More informationStatistical Business Register In Mongolia
Statistical Business Register In Mongolia B.Bayarmaa NRSO of Mongolia Research question and scope of study Research question 1 Improving BR is one of the priority areas for building statistical infrastructure.
More informationBusiness Architecture concepts and components: BA shared infrastructures, capability modeling and guiding principles
Business Architecture concepts and components: BA shared infrastructures, capability modeling and guiding principles Giulio Barcaroli Directorate for Methodology and Statistical Process Design Istat ESTP
More informationMetadata and Infrastructure for Researchers from a perspective of an NSI. C-G Hjelm Research and Development at Statistics Sweden
Metadata and Infrastructure for Researchers from a perspective of an NSI C-G Hjelm Research and Development at Statistics Sweden The coming minutes Metadata and Microdata from a perspective of an NSI Metadata
More informationEconomic and Social Council
United Nations Economic and Social Council Distr.: General 27 January 2014 ECE/CES/2014/1 Original: English Economic Commission for Europe Conference of European Statisticians Sixty-second plenary session
More informationA Blaise Editing System at Westat. Rick Dulaney, Westat Boris Allan, Westat
A Blaise Editing System at Westat Rick Dulaney, Westat Boris Allan, Westat Introduction Editing and delivering survey data pose challenges often quite separate from developing Blaise applications for data
More information2011 INTERNATIONAL COMPARISON PROGRAM
2011 INTERNATIONAL COMPARISON PROGRAM 2011 ICP DATA ACCESS AND ARCHIVING POLICY GUIDING PRINCIPLES AND PROCEDURES FOR DATA ACCESS ICP Global Office June 2011 Contents I. PURPOSE... 3 II. CONTEXT... 3 III.
More informationPolicy Group on Statistical Cooperation
EUROPEAN COMMISSION EUROSTAT Directorate E: Agriculture and Environment Statistics- Statistical Cooperation Unit E-4: Statistical Cooperation with European and Mediterranean countries Doc. PGSC/2006/13
More informationIntegration of INSPIRE & SDMX data infrastructures for the 2021 population and housing census
Integration of INSPIRE & SDMX data infrastructures for the 2021 population and housing census Nadezhda VLAHOVA, Fabian BACH, Ekkehard PETRI *, Vlado CETL, Hannes REUTER European Commission (*ekkehard.petri@ec.europa.eu
More informationFeatures of Case Management in CAI Systems
Features of Case Management in CAI Systems Vesa Kuusela, Social Survey Unit, Statistics Finland and CMS working group set by the Blaise Corporate License Users Board (BCLUB) 1. Introduction A Case Management
More informationCoE CENTRE of EXCELLENCE ON DATA WAREHOUSING
in partnership with Overall handbook to set up a S-DWH CoE: Deliverable: 4.6 Version: 3.1 Date: 3 November 2017 CoE CENTRE of EXCELLENCE ON DATA WAREHOUSING Handbook to set up a S-DWH 1 version 2.1 / 4
More informationPrivacy and Security Aspects Related to the Use of Big Data Progress of work in the ESS. Pascal Jacques Eurostat Local Security Officer 1
Privacy and Security Aspects Related to the Use of Big Data Progress of work in the ESS Pascal Jacques Eurostat Local Security Officer 1 Current work on privacy and ethics in Big data Privacy Confidentiality
More informationGeneric Statistical Business Process Model
Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (METIS) Generic Statistical Business Process Model Version 3.1 December 2008 Prepared by the UNECE Secretariat 1 I. Background 1. The Joint
More informationData Migration Plan (40) Fingrid Oyj
1 (40) Fingrid Oyj FI10728943, VAT reg. 2 (40) Table of Contents Definitions... 5 1 Summary... 6 2 Introduction... 7 2.1 Datahub... 7 2.2 Members of the data migration plan... 8 2.3 Datahub's data migration
More informationDenver SAS User Group. SAS Enterprise Data Integration and Data Quality. John Motler Sales Engineer. January 13, 2010
Denver SAS User Group SAS Enterprise Data Integration and Data Quality John Motler Sales Engineer January 13, 2010 Gartner Market Validation Data Quality Tools June 2009 Data Integration Tools September
More informationINTEROPERABILITY OF STATISTICAL DATA AND METADATA AMONG BRAZILIAN GOVERNMENT INSTITUTIONS USING THE SDMX STANDARD. Submitted by IBGE, Brazil 1
SDMX GLOBAL CONFERENCE 2009 INTEROPERABILITY OF STATISTICAL DATA AND METADATA AMONG BRAZILIAN GOVERNMENT INSTITUTIONS USING THE SDMX STANDARD Submitted by IBGE, Brazil 1 Abstract Since 1990, the Brazilian
More informationWORKING GROUP ON PASSENGER MOBILITY STATISTICS
Document: PM-2003-05/EN Original: English "Transport Statistics" WORKING GROUP ON PASSENGER MOBILITY STATISTICS Luxembourg, 24-25 April 2003 Jean Monnet Building, Room M5 Beginning 0:00 am Database and
More informationEuropean Conference on Quality and Methodology in Official Statistics (Q2008), 8-11, July, 2008, Rome - Italy
European Conference on Quality and Methodology in Official Statistics (Q2008), 8-11, July, 2008, Rome - Italy Metadata Life Cycle Statistics Portugal Isabel Morgado Methodology and Information Systems
More informationCopernicus Space Component. Technical Collaborative Arrangement. between ESA. and. Enterprise Estonia
Copernicus Space Component Technical Collaborative Arrangement between ESA and Enterprise Estonia 2 Table of Contents 1 INTRODUCTION... 4 1.1 Purpose and objectives... 4 1.2 Scope... 5 1.3 References...
More informationCitizen Information Project
Final report: Annex 2: Stakeholders' processes, systems and data 2A: Overview Version Control Date of Issue 14 th June 2005 Version Number 1.0 Version Date Issued by Status 1.0 14/06/2005 PJ Maycock Final
More informationThe NIH Collaboratory Distributed Research Network: A Privacy Protecting Method for Sharing Research Data Sets
The NIH Collaboratory Distributed Research Network: A Privacy Protecting Method for Sharing Research Data Sets Jeffrey Brown, Lesley Curtis, and Rich Platt June 13, 2014 Previously The NIH Collaboratory:
More informationBusiness microdata dissemination at Istat
Business microdata dissemination at Istat Daniela Ichim Luisa Franconi ichim@istat.it franconi@istat.it Outline - Released products - Microdata dissemination - Business microdata dissemination - Documentation
More informationThe ODP Focal Point leads their agency s contribution to ensuring the NSDP meets e-gdds requirements on an ongoing basis.
Focal Point Guide 2 PREFACE The African Development Bank (AfDB) and the International Monetary Fund (IMF) have collaborated to provide an Open Data Platform (ODP) for African countries and regional organizations.
More informationWithin the meanings of applicable data protection law (in particular EU Regulation 2016/679, the GDPR ):
Privacy Policy Introduction Ikano S.A. ( Ikano ) respects your privacy and is committed to protect your Personal Data by being compliant with this privacy policy ( Policy ). In addition to Ikano, this
More informationCountryData Workshop Technologies for Data Exchange. Reference Metadata
CountryData Workshop Technologies for Data Exchange Reference Metadata Metadata According to the ISO; Metadata is data that defines and describes other data. Perhaps, better visualized as layers within
More informationThe State of Missouri
NASCIO 2013 Recognition Awards Nomination The State of Missouri Hazardous Substance Site Locator Project Initiation and Completion Dates: 04/29/13 to 12/01/13 Category: Digital Government: Government to
More informationIMPLEMENTING STATISTICAL DOMAIN DATABASES IN POLAND. OPPORTUNITIES AND THREATS. Central Statistical Office in Poland
IMPLEMENTING STATISTICAL DOMAIN DATABASES IN POLAND. OPPORTUNITIES AND THREATS. Central Statistical Office in Poland Agenda 2 Background Current state The goal of the SDD Architecture Technologies Data
More informationDDI metadata for IPUMS I samples
DDI metadata for IPUMS I samples Wendy Thomas Workshop Integrating Global Census Microdata : Dublin Ireland, 58th ISI What is DDI DDI is a metadata standard d focused ocusedprimarily on microdata from
More informationMetadata and classification system development in Bosnia and Herzegovina
>> Metadata and classification system development in Bosnia and Herzegovina 23. april 2012 Mogens Grosen Nielsen Statistics Denmark Outline of introduction to metadata project in Bosnia and Hercegovina
More information2010 INTEGRATED E-CENSUS ARCHITECTURE IN THE REPUBLIC OF KOREA 1
Distr. GENERAL Working Paper No.14 6 May 2009 ENGLISH ONLY UNITED NATIONS STATISTICAL COMMISSION and ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS EUROPEAN COMMISSION STATISTICAL
More information86.1% of the population aged 16 to 74 have used the Internet in the last three months. 72.1% do it on a daily basis
07 November 2018 Survey on Equipment and Use of Information and Communication Technologies (ICT) in Households. Year 2018 86.1% of the population aged 16 to 74 have used the Internet in the last. 72.1%
More informationPUBLIC AND PRIVATE ENTITY PARTNERSHIP IMPLEMENTING THE PROJECTS OF VILNIUS, KAUNAS AND PANEVĖŽYS COUNTY POLICE HEADQUARTERS
PUBLIC AND PRIVATE ENTITY PARTNERSHIP IMPLEMENTING THE PROJECTS OF VILNIUS, KAUNAS AND PANEVĖŽYS COUNTY POLICE HEADQUARTERS Vilnius 28-29 September 2019 http://infrasummit.eu/ THE REASONS FOR SELECTING
More informationState Planning Organization Information Society Department
Information Society Department - October TR. Information Society Department Information Society Strategy Duration / Pro- Post- 1 Formulating the Information Society Strategy All Public Institutions Universities
More informationNew IT solutions for item list management and data validation. 4 th Inter-Agency Coordinating Group Meeting October 23-25, 2017 Washington, DC
New IT solutions for item list management and data validation 4 th Inter-Agency Coordinating Group Meeting October 23-25, 2017 Washington, DC Eurostat s PPP System Eurostat s PPP system supports the full
More informationFederal Statistics, Multiple Data Sources, and Privacy Protection: Next Steps
Federal Statistics, Multiple Data Sources, and Privacy Protection: Next Steps Robert Groves, Georgetown University and Chair of Committee on National Statistics Washington, DC October 20, 2017 Panel on
More informationNational Data Sharing and Accessibility Policy-2012 (NDSAP-2012)
National Data Sharing and Accessibility Policy-2012 (NDSAP-2012) Department of Science & Technology Ministry of science & Technology Government of India Government of India Ministry of Science & Technology
More informationProposals for the 2018 JHAQ data collection
EUROPEAN COMMISSION EUROSTAT Directorate F: Social statistics Unit F-5: Education, health and social protection DOC 2017-PH-02.2 Proposals for the 2018 JHAQ data collection Item 2.2 of the Agenda Meeting
More informationMarket Information Management in Agent-Based System: Subsystem of Information Agents
Association for Information Systems AIS Electronic Library (AISeL) AMCIS 2006 Proceedings Americas Conference on Information Systems (AMCIS) December 2006 Market Information Management in Agent-Based System:
More informationThe Labour Cost Index decreased by 1.5% when compared to the same quarter in 2017
Q1-11 Q1-09 Q2-09 Q3-09 Q4-09 Q1-10 Q2-10 Q3-10 Q4-10 Q1-11 Q2-11 Q3-11 Q4-11 Q1-12 Q2-12 Q3-12 Q4-12 Q1-13 Q2-13 Q3-13 Q4-13 Q1-14 Q2-14 Q3-14 Q4-14 Q1-15 Q1-12 Q1-13 Q1-14 Q1-15 Q1-16 Q1-17 Q1-18 Q1-11
More informationUse of GIS/GPS for supporting field enumeration
Regional Workshop on the Use of Technology in Population and Housing Censuses in Arab countries, Use of GIS/GPS for supporting field enumeration Palestine January 2018 Old censuses In census 1997 and 2007,
More informationMission Antyodaya Android Mobile Application
User Manual Version 1.0.1 Date of Release 28.09.2017 Contents 1 Installation of Mobile Application... 3 2 Starting Application... 4 3 User Verification... 8 4 Login Process... 10 5 User Dashboard... 12
More informationPrivate sector s engagement in the implementation of the Sendai Framework
Private sector s engagement in the implementation of the Sendai Framework Palais des Nations, Geneva, 2 May 2017 Oz Ozturk, PricewaterhouseCoopers Content: Introduction Key messages Sendai Framework and
More informationGhana experience in the integration of administrative data in the production of official statistics"
Ghana experience in the integration of administrative data in the production of official statistics" 23-25 APRIL, 2018 UNECA, ETHIOPIA Presentation Outline OVERVIEW OF ACTIVITIES ON ADMINISTRATIVE AND
More informationKey Features of Computer-Assisted Telephone Interview in Singapore Census Asia-Pacific Regional Workshop on the Use of Technology in Population and
Key Features of Computer-Assisted Telephone Interview in Singapore Census Asia-Pacific Regional Workshop on the Use of Technology in Population and Housing Censuses Bangkok, Thailand, 24 26 January 2018
More informationEUROSTAT and BIG DATA. High Level Seminar on integrating non traditional data sources in the National Statistical Systems
EUROSTAT and BIG DATA High Level Seminar on integrating non traditional data sources in the National Statistical Systems Santiago, Chile, October 1-2, 2018 1 Table of contents About Eurostat What is the
More informationPathways CIC Privacy Policy. Date Issued: May Date to be Reviewed: May Issued by Yvonne Clarke
Prepared by: M Franklin Issued: May 2018 Pathways Community Interest Company Review due: May 2020 Pathways CIC Privacy Policy Version 0.3 Approved by: Yvonne Clarke Approval date: 21.05.2018 Pathways CIC
More informationWE ARE COMMITTED TO PROTECTING YOUR PERSONAL DATA
WE ARE COMMITTED TO PROTECTING YOUR PERSONAL DATA In accordance with the new Regulation (EU) 2016/679 on the protection of personal data (GDPR), we ask you to give your consent on the use of Cookies, for
More informationBusiness Model for Global Platform for Big Data for Official Statistics in support of the 2030 Agenda for Sustainable Development
Business Model for Global Platform for Big Data for Official Statistics in support of the 2030 Agenda for Sustainable Development Introduction This note sets out a business model for a Global Platform
More informationOverview of the Multi-Payer Claims Database (MPCD)
Overview of the Multi-Payer Claims Database (MPCD) Genesis of the MPCD The MPCD project is one of a number of initiatives related to comparative effectiveness research (CER) funded by the American Recovery
More informationCharting the Progress of Smart City Development in Shanghai
Charting the Progress of Smart City Development in Shanghai Xueguo Wen Executive Vice President of Shanghai Academy 2017 TM Forum 1 C ONTENTS Current situation Experience and outlook Strategic cooperation
More informationElders Estates Privacy Notice
15A Bath Street, Ilkeston Derbyshire. DE7 8AH 01159 32 55 23 info@eldersestates.co.uk 31 Market Place, Ripley Derbyshire. DE5 3HA 01773 30 44 44 info@eldersestates.co.uk Elders Estates Privacy Notice Introduction
More informationLiving Costs and Food Survey
UK Data Archive Study Number 8351 - Living Costs and Food Survey, 2016-2017 Living Costs and Food Survey 2016-17 Living Costs and Food Survey Volume A: Introduction April 2016 to March 2017 Great Britain
More informationA new international standard for data validation and processing
A new international standard for data validation and processing Marco Pellegrino (marco.pellegrino@ec.europa.eu) 1 Keywords: Data validation, transformation, open standards, SDMX, GSIM 1. INTRODUCTION
More informationSAC PA Security Frameworks - FISMA and NIST
SAC PA Security Frameworks - FISMA and NIST 800-171 June 23, 2017 SECURITY FRAMEWORKS Chris Seiders, CISSP Scott Weinman, CISSP, CISA Agenda Compliance standards FISMA NIST SP 800-171 Importance of Compliance
More informationWhat information do we collect online and how is it used?
Thirty-One Gifts LLC - Privacy Policy This Privacy Policy is intended to assist you in understanding what personal information we gather about you when you visit Thirty-One Gifts online, how we use and
More informationLinkage of main components of GSBP model through integrated statistical information system.
Linkage of main components of GSBP model through integrated statistical information system. Helena Glaser- Opitzova 1, Ľudmila Ivančikova 2, 1 the Statistical Office of the SR, Bratislava, Slovakia; helena.glaser-opitzova@statistics.sk
More informationCornell University Program on. Mission Statement
Cornell University Program on Applied CaRDI Spring Research Roundtable April 6, 2009 Web: http://pad.human.cornell.edu Email: PADInfo@Cornell.edu Mission Statement The (PAD) --through h its skills in demographics,
More informationData Security Standards
Data Security Standards Overall guide The bigger picture of where the standards fit in 2018 Copyright 2017 Health and Social Care Information Centre. The Health and Social Care Information Centre is a
More informationMetadata Management in the FAO Statistics Division (ESS) Overview of the FAOSTAT / CountrySTAT approach by Julia Stone
Metadata Management in the FAO Statistics Division (ESS) Overview of the FAOSTAT / CountrySTAT approach by Julia Stone Metadata Management in ESS 1. Introduction 2. FAOSTAT metadata collection 3. CountrySTAT
More informationData Partnerships to Improve Health Frequently Asked Questions. Glossary...9
FAQ s Data Partnerships to Improve Health Frequently Asked Questions BENEFITS OF PARTICIPATING... 1 USING THE NETWORK.... 2 SECURING THE DATA AND NETWORK.... 3 PROTECTING PRIVACY.... 4 CREATING METADATA...
More informationOutline of Presentation
DATA DISSEMINATION STRATEGIES IN MALAYSIA Department of Statistics, Malaysia Outline of Presentation Data Dissemination Mode Data Dissemination Strategies in ICT Strategic Plan (ISP) Databases Assessing
More informationInnovative solutions for data capturing strategies
Innovative solutions for data capturing strategies Cecilia Colasanti 1, Manuela Murgia 1 1 Istat, cecilia.colasanti@istat.it, manuela.murgia@istat.it Abstract The Italian National Statistics Institute
More informationOrganization/Office: Secretariat of the United Nations System Chief Executives Board for Coordination (CEB)
United Nations Associate Experts Programme TERMS OF REFERENCE Associate Expert (JPO) INT-021-14-P014-01-V I. General Information Title: Associate Expert in Interagency Coordination / Special to the Director
More informationSecurity Survey Executive Summary October 2008
A government technology Executive Survey Summary: HP Security Survey Executive Summary October 2008 Produced by: In Partnership With: Introduction Information is paramount to the survival of government
More informationChapter 17: INTERNATIONAL DATA PRODUCTS
Chapter 17: INTERNATIONAL DATA PRODUCTS After the data processing and data analysis, a series of data products were delivered to the OECD. These included public use data files and codebooks, compendia
More informationSCAD Wraps up Events Marking the World Statistics Day
Press release Date 23/10/2010 SCAD Wraps up Events Marking the World Statistics Day Statistics Centre - Abu Dhabi (SCAD) yesterday concluded its celebration of the World Statistics Day, in which the centre
More informationStandardizing and industrializing a business process the dissemination use case Annex 1
Standardizing and industrializing a business process the dissemination use case Annex 1 Alessio Cardacino - (alcardac@istat.it) ESTP Course Information standards and technologies for describing, exchanging
More informationPRIVACY POLICY. We are committed to protect your personal data, while you visit our Website (hereinafter called the Website ).
PRIVACY POLICY We are committed to protect your personal data, while you visit our Website https://peppeshoes.com/ (hereinafter called the Website ). We kindly ask you to read this document every time
More informationSingapore s Smart Nation Initiative
2016/SMEMM/011 Agenda Item: 3.2.2 Singapore s Smart Nation Initiative Purpose: Information Submitted by: Singapore 23 rd Small and Medium Enterprises Ministerial Meeting Lima, Peru 9 September 2016 Singapore
More informationAMPS Snapshot: User Registration External Users
Do You Need an AMPS Account? How to Prepare for AMPS Account Registration Not an employee of DLA or DFAS? If you cannot authenticate your identity with a smart card, you can still obtain an AMPS account
More informationCONFERENCE OF EUROPEAN STATISTICIANS Workshop on Statistical Data Collection. Session 5 24 September 2018
CONFERENCE OF EUROPEAN STATISTICIANS Workshop on Statistical Data Collection 10-12 October 2018, Geneva, Switzerland Session 5 24 September 2018 The Actions Taken To Enable The Administrative Records To
More informationClientTouch User Guide (Abridged)
ClientTouch User Guide (Abridged) For ClientTouch Version 3.2 This abridged edition of the ClientTouch User Guide contains all of the instruction steps of the full User Guide. It does not contain the tutorial
More informationINFORMATION TECHNOLOGY DATA MANAGEMENT PROCEDURES AND GOVERNANCE STRUCTURE BALL STATE UNIVERSITY OFFICE OF INFORMATION SECURITY SERVICES
INFORMATION TECHNOLOGY DATA MANAGEMENT PROCEDURES AND GOVERNANCE STRUCTURE BALL STATE UNIVERSITY OFFICE OF INFORMATION SECURITY SERVICES 1. INTRODUCTION If you are responsible for maintaining or using
More informationEUROPASS DIPLOMA SUPPLEMENT TO HIGHER TECHNICAL VOCATIONAL TRAINING
EUROPASS DIPLOMA SUPPLEMENT TO HIGHER TECHNICAL VOCATIONAL TRAINING TITLE OF THE DIPLOMA (ES) Técnico Superior en Desarrollo de Aplicaciones Web TRANSLATED TITLE OF THE DIPLOMA (EN) (1) Higher Technician
More informationMetadata: an Integral Part of Statistics Canada s Data Quality Framework 1
Metadata: an Integral Part of Statistics Canada s Data Quality Framework 1 Marcelle Dion 2 Director General Agriculture, Technology and Transportation Statistics Branch Statistics Canada 13 th Floor Section
More informationVariables System the bridge between metadata and dissemination Teodora Isfan, Methodology and Information Systems Department, Statistics Portugal 1
Proceedings of Q2008 European Conference on Quality in Official Statistics Variables System the bridge between metadata and dissemination Teodora Isfan, Methodology and Information Systems Department,
More informationSANMINA CORPORATION PRIVACY POLICY. Effective date: May 25, 2018
SANMINA CORPORATION PRIVACY POLICY Effective date: May 25, 2018 This Privacy Policy (the Policy ) sets forth the privacy principles that Sanmina Corporation and its subsidiaries (collectively, Sanmina
More informationDRAFT. Amendment to Chapter 102 Taxation Article I In General, by adding a new Section titled Omitted Real Property Assessments.
ATTACHMENT #1 Regular LF&A Meeting of August 13, 2007 DRAFT Amendment to Chapter 102 Taxation Article I In General, by adding a new Section 102-4 titled Omitted Real Property Assessments. Sec. 102-4 Omitted
More informationDRI: Preservation Planning Case Study Getting Started in Digital Preservation Digital Preservation Coalition November 2013 Dublin, Ireland
DRI: Preservation Planning Case Study Getting Started in Digital Preservation Digital Preservation Coalition November 2013 Dublin, Ireland Dr Aileen O Carroll Policy Manager Digital Repository of Ireland
More informationNEMSIS Update and Strategic Vision
NEMSIS Update and Strategic Vision Karen E Jacobson, BA, NREMT-P October 11, 2010 NASEMSO Annual Meeting Data Managers Council NEMSIS TAC Staff States are being contacted to update the information on the
More informationBT Assure Cloud Identity Annex to the General Service Schedule
1 Defined Terms The following definitions apply, in addition to those in the General Terms and Conditions and the General Service Schedule of the Agreement. Administrator means a Customer-authorised person
More informationWebsite Privacy Policy
Website Privacy Policy We are very sensitive to privacy issues. The purpose of this Website Privacy Policy is to let you know how Associated Underwriters Insurance, but not limited to, Associated Underwriters
More informationPRINCIPLES AND FUNCTIONAL REQUIREMENTS
INTERNATIONAL COUNCIL ON ARCHIVES PRINCIPLES AND FUNCTIONAL REQUIREMENTS FOR RECORDS IN ELECTRONIC OFFICE ENVIRONMENTS RECORDKEEPING REQUIREMENTS FOR BUSINESS SYSTEMS THAT DO NOT MANAGE RECORDS OCTOBER
More informationGovernment Resolution No of February 15, Resolution: Advancing National Regulation and Governmental Leadership in Cyber Security
Government Resolution No. 2443 of February 15, 2015 33 rd Government of Israel Benjamin Netanyahu Resolution: Advancing National Regulation and Governmental Leadership in Cyber Security It is hereby resolved:
More informationThe Corporate Website and the Product Websites are together referred to hereafter as the website.
PRIVACY POLICY Version July 2018 The website www.advanzia.com (hereafter, the Corporate Website ) and the following associated websites listed below: www.gebuhrenfrei.com www.free.at www.cartezero.fr www.advanziakonto.com
More informationTRNC e-government Program
TRNC e-government Program Agenda 2 About e-government e-government System Requirements Standards Used Strategy of TRNC e-government Projects & Status Stakeholders Statistics Experiences Goals Outputs of
More informationIndicator Framework for Monitoring the Council Recommendation on the integration of the long-term unemployed into the labour market
The Employment Committee Indicators Group working group on the Long Term Unemployed Indicator Framework for Monitoring the Council Recommendation on the integration of the long-term unemployed into the
More informationPRIVACY POLICY OF.LT DOMAIN
PRIVACY POLICY OF.LT DOMAIN Status Up-to-date version Date 2018-05-25 CHAPTER I GENERAL PROVISIONS 1. Privacy policy of.lt domain (hereinafter Privacy Policy) stipulates conditions of processing, legal
More informationVietnam: Current status of IT Policy and IT flagship Projects
Vietnam: Current status of IT Policy and IT flagship Projects Mr. Nguyen Phu Tien Deputy Director General Authority of Information Technology Application Ministry of Information and Communications, Vietnam
More informationEU projects for ehealth new ehealth activities in EU
EU projects for ehealth new ehealth activities in EU Judita Kinkorová MEDICAL FAIR ehealth Days BRNO May 14, 2013 CONTENT e-health definition e-health in EU presidency actions CZ presidency 2009, e-health
More informationDELIVERABLE D12.6/12.7 IECM Database Extension & User Interface with Tabulator
Project N : 262608 ACRONYM: Data without Boundaries DELIVERABLE D12.6/12.7 IECM Database Extension & User Interface with Tabulator WORK PACKAGE 12 Implementing Improved Resource Discovery for OS Data REPORTING
More information