WITH EDIT QUICK USER GUIDE EHIS WAVE2 DATA VALIDATION EUROPEAN COMMISSION EUROSTAT. Date:13/11/2015 Version: 2.2 Author: Bogumil DUNAJ

Transcription

1 EUROPEAN COMMISSION EUROSTAT Directorate B: Corporate statistical and IT services Unit B-3: IT and standards for data and metadata exchange QUICK USER GUIDE EHIS WAVE2 DATA VALIDATION WITH EDIT Date:13/11/2015 Version: 2.2 Author: Bogumil DUNAJ Eurostat Validation Team Page 1

2 Contents 1. Starting Logging - credentials Launching the automatic validation flow Creating manually Validation Job/Task Executing validation job/task (selection of the file and parameters) Browsing the completed job Job details: and icon Example: Job summary statistics - distribution of validation errors/warnings: Example: Detailed error report Example of calculated Ratios Contact details... 7 Page 2

3 1. Starting Start server : Start menu -> Edit 2013 version > Start Server Go to the login page: Start menu -> Edit 2013 version > Login 2. Logging - credentials User: EHISUser password: EHISUser Launching the automatic validation flow Click the blue triangle next to the EHIS_Wave2 validation flow - Select an input data file check the field separator (should be a semicolon), all variables in header should be written in UPPERCASE - Enter the ISO code of the reporting country (uppercase) - Click "Start" Page 3

4 4. Creating manually Validation Job/Task Select Jobs -> Create Job from the menu. 5. Executing validation job/task (selection of the file and parameters) - Select the data file to be validated check the field separator (should be a semicolon), all variables in header should be written in UPPERCASE - Enter the ISO code of the reporting country (uppercase) - Click Execute Job Page 4

5 6. Browsing the completed job 7. Job details: and icon Please click on the following icon to: - open a page with the distribution of errors and warnings from the selected report - export the detailed report (in a.csv format to browse use Excel or any text editor) Page 5

6 8. Example: Job summary statistics - distribution of validation errors/warnings: 9. Example: Detailed error report VC_SK3 validation rule name MESSAGE:SK3 incorrect SEVERITY:Error Record number Auxiliary data ROW_ID PID SK VC_WGT MESSAGE:WGT incorrect SEVERITY:Error (checked the separator and precision) ROW_ID PID WGT VC_checkMissingVariables MESSAGE:Some variables contain blank/empty character SEVERITY:Error ROW_ID PID ============ END REPORT =============== Page 6

7 10. Example of calculated Ratios Ratios MESSAGE:Ratios SEVERITY:Info NAME RATIO RECORDS INFO 1. incomplete (key variables) 2. incomplete (plain) 3. incomplete (adjusted) 4. proxy 5. reference month is autumn 6. extreme weights 0.00% % % % % % 1 Ratios_missing_for_each_variable MESSAGE:Percentage of records with the value -1 calculated for each variable SEVERITY:Info NAME RATIO RECORDS AC1A 15.02% ( 927 / 6173 ) AC1B 14.81% ( 914 / 6173 ) AC1C 13.49% ( 833 / 6173 ) 11. Contact details The share of which cannot be treated as completed as at least one of the key variables includes the missing value: Percentage of records with at least one value equal to -1 in at least one of the following variables: PID, HHID, PRIMSTRAT, PSU, WGT, PROXY, REFYEAR, REFMONTH, INTMETHOD, SEX and AGE Percentage of records for which: a) at least one of the following variables include a missing value (NULL OR -1): PID, HHID, PRIMSTRAT, PSU, WGT, PROXY, REFYEAR, REFMONTH, INTMETHOD, SEX and AGE, or: b) more than 50 % of all other variables in the record include missing value (NULL OR -1). The denominator is the same for each record and is equal to the total number of variables - 11 ( = 140) Percentage of records for which: a) at least one of the following variables include a missing value (NULL or -1): PID, HHID, PRIMSTRAT, PSU, WGT, PROXY, REFYEAR, REFMONTH, INTMETHOD, SEX and AGE, or: b) more than 50 % of all other variables in the record (relevant to the specific interview) include missing value (NULL or -1). The numerator and denominator need to be adjusted to remove variables for which proxy are not allowed provided that the record include (PROXY = 2 OR 3) and variables for which derogations were granted (see the list of countries and respective variables at the end of this document). The share of proxy : Percentage of records with the values of PROXY variable equal to any of 2 or 3. Records with values -1 are excluded from denominator REFMONTH is September-December at least for some records (EHIS Regulation, art. 4, par. 3): Percentage of records with the values of REFMONTH variable equal to any of 9, 10, 11 or 12. Records with values -1 are excluded from denominator Percentage of records with the value of WGT variable out of the following range: < average value of WGT / 3 ; 3 * average value of WGT >. Records with values -1 are excluded from denominator If you encounter any technical problems please contact: Estat-Validation@ec.europa.eu Page 7