Document for item 4.2 of the agenda

Transcription

1 EUROPEAN COMMISSION EUROSTAT Directorate F: Social Statistics Unit F-3: Labour market statistics and lifelong learning Doc.: Eurostat/F3/LAMAS/33/17 WORKING GROUP LABOUR MARKET STATISTICS Document for item 4.2 of the agenda SDM DSD version 2.1 for JVS October 2017 AMPERE Building Luxembourg LAbour MArket Statistics working group 10-11/10/2017 Page 1

2 Summary: the aim of this document is to inform the LAbour MArket Statistics (LAMAS) Working Group (WG) of (1) the state of play as regards JVS transmissions in SDM - DSD version 2.0 and (2) the limited changes introduced in DSD version 2.1 as well as (3) the plans to switch to this new version in production. I. BACKGROUND Eurostat has engaged in a general overhaul of the existing Data Structure Definitions used for Job Vacancy Statistics and the Labour Cost Index. One of the aims pursued was to move from JVS- (or LCI-) specific code lists to international standards that would pave the way for easy transmission of the corresponding datasets between Member States and international organisations. Member States started testing the new SDM DSD version (2.0) as of April/May 2016 and most of them implemented them in production in the 2 nd half of Deleted: standards On the output side, Eurostat adopted SDM DSD version 2.0 for its transmissions to ECB starting in September By the end of 2016, ECB asked for limited changes in SDM DSD version 2.0 that implied creating a new version (SDM DSD version 2.1). In 2017, international organisations (ILO, OECD, ECB, Eurostat) launched a project to define Data Structure Definitions for all flows of aggregated data between institutions, in the field of labour market statistics. This project should result in common standards adopted at international level, for the exchange of labour market statistics including job vacancies. However, as the experience gathered in Europe for JVS fed into this project, the impact on SDM DSD for JVS should remain minimal. Deleted: standard Deleted: s II. STATE OF PLAY The table below provides an overview of the transmission of JVS data in SDM for reference quarter 2017Q1 due in June LAbour MArket Statistics working group 10-11/10/2017 Page 2

3 Table 1: Transmission of JVS data, reference quarter 2017Q1 Csv COMPACT_SDM file (DSD COMPACT_SDM file (DSD file version 1.0) version 2.0) Errors BE BG CZ DK DE EE IE EL ES FR IT CY LV LT LU HR HU MT NL AT PL PT RO SI SK FI SE UK NO MK CH LAbour MArket Statistics working group 10-11/10/2017 Page 3

4 As shown in table 1, all countries but one (Germany) have adopted the SDM for their JVS transmissions. In the case of Germany, JVS data are not transmitted by the statistical office but by an agency of the Labour Ministry (IAB) whose IT department has not allowed installing the SDM converter reason why csv are still used. Among the 30 countries that use SDM, 5 (NL, FI, UK, NO, CH) of which 3 Member States are still using the old DSD that date back to One year after its introduction, a vast majority (24/28) of Member States are now transmitting JVS data using SDM DSD version 2.0. Deleted: now Deleted: standards Deleted: standards Deleted: in This good result should be somewhat mitigated by the fact that a number of transmissions include errors which delay JVS production. In 9 cases (BE, DE, CY, LV, HU, MT, AT, SE, NO) of which 8 Member States, even the final transmission includes errors that had to be fixed by Eurostat before loading the data. In the next production rounds, Eurostat expects that these IT errors will be corrected at source, with the help of STRUVAL programmes that will be integrated with Edamis. III. CHANGES INTRODUCED IN SDM DSD version 2.1 The changes introduced in the new version of SDM DSD concern one dimension (seasonal adjustment) and two attributes (unit of measure and embargo time) as described in the following text. Seasonal adjustment As regards seasonal adjustment, the only change consists in using the code list CL_ADJUSTMENT (version ESTAT 1.4 of the SDM Registry) instead of CL_SEASONAL_ADJUST (version ESTAT 1.0). Deleted: r The reason for this change is the need to have a code: '_Z' for cases where seasonal adjustment is not applicable. It has no impact on the content of the SDM message as the concept mnemonic (SEASONAL_ADJUST) remains unchanged. Unit_measure The concept mnemonic used for units was changed from 'Unit' to 'Unit_measure' in accordance with version 1.0 of the SDM glossary (see at ) LAbour MArket Statistics working group 10-11/10/2017 Page 4

5 Embargo_time With the new version, it will be possible to specify an embargo date and time at the observation level. Such feature will be used by Poland that wished to flag their flash estimates until they are released nationally. It must be noted that this attribute is not mandatory meaning that for most countries this change will have no impact in practice. In addition to the above changes, the description of the statistical concepts was revised in order to clarify their meaning and purpose (see: "Doc 33 Item 4.2 SDM 2.1 for JVS Annex - guidelines - track changes.docx"). Other changes Switching from SDM DSD version 2.0 to SDM DSD version 2.1 is an opportunity to minor issues regarding: - Filling under <ID> the exact filename used for Edamis transmissions; - Change the test status from 'True' to 'False' - Change the name of the contact person from 'Toriya Sghir' to 'Piotr Ronkowski' In addition, it is proposed to use this opportunity to rename Edamis flows for both data and metadata, replacing in particular "JVC" by "JVS" as follows: JVC_02_Q => JVS_02_Q JVC_ESQRS_A => JVS_ESQRS_A The ESS Metadata Handler (ESSMH) will be adapted accordingly. These changes would take place on 16 October so that the new flows can be used for the next transmission of JVS data (Q3) and the next provision of quality reports (August 2018). To avoid confusion, countries would then be asked not to send files to ESSMH on 12 and 13 October. It must be noted that both the access rights and the existing files will be automatically transferred from the old JVC domain to the JVS one, both in Edamis and in ESSMH. Impact The impact of the switch to SDM DSD version 2.1 for JVS will be very limited as shown in the example next page taken from: "Doc 33 Item 4.2 SDM 2.1 for JVS Annex - guidelines - track changes.docx". Changes are highlighted in red fonts. Formatted: Justified Formatted: English (U.K.), English (U.K.), English (U.K.) Formatted: Justified Formatted: Justified Formatted: Font: Times New Roman, 12 pt, Font color: Auto Formatted: Font: Times New Roman, Font color: Auto Deleted: below Deleted: LAbour MArket Statistics working group 10-11/10/2017 Page 5

6 <?xml version="1.0" encoding="utf-8"?> <!-- Created with SDM Converter v > <CompactData xmlns=" xmlns:jvs="urn:sdmx:org.sdmx.infomodel.keyfamily.keyfamily=estat:jvs:2.1:compact" xmlns:xsi=" xsi:schemalocation=" SDMMessage.xsd urn:sdmx:org.sdmx.infomodel.keyfamily.keyfamily=estat:jvs:2.1:compact ESTAT_JVS_Compact.xsd"> <Header> <ID>JVS_02_Q_ BE_2014_0004_V0001</ID> <Test>false</Test> <Truncated>true</Truncated> <Prepared> T14:01: :00</Prepared> <Sender id="be1"> <Contact> <Name xml:lang="en">statbel</name> <Name>Charles Philippe</Name> <Department>6401</Department> fgov.be.be</ > </Contact> </Sender> <Receiver id="4d0"> <Name xml:lang="en">eurostat</name> </Contact> <Name xml:lang="en"> Piotr Ronkowski </Name> < > </Contact> </Receiver> <DataSetID>JVS_02_Q </DataSetID> </Header> <jvs:dataset> <jvs:series FREQ="Q" REF_AREA="BE" REGION="BE" SEASONAL_ADJUST="S" INDICATOR="OCC" ACTIVITY="F" SIZECLASS="GE10" OCCUPATION= _T UNIT_MEASURE ="PN" UNIT_MULT="0" TIME_PER_COLLECT="A" TIME_FORMAT="P3M"> <jvs:obs TIME_PERIOD="2010-Q1" OBS_VALUE=" " OBS_STATUS="A" CONF_STATUS="F" EMBARGO_TIME=" T14:10:07"/> <jvs:obs TIME_PERIOD="2010-Q2" OBS_VALUE=" " OBS_STATUS="A" CONF_STATUS="F"/> </jvs:series> </jvs:dataset> </CompactData> Part 1, metadata Part 2, the general information Part 3, the data Part 1, the metad Formatted: Dutch (Netherlands) Examples An example of SDM transmission of job vacancy statistics is provided in document: "Doc 33 - Item SDM 2.1 for JVS - Annex 2 - JVS test file". Deleted: 2.1 LAbour MArket Statistics working group 10-11/10/2017 Page 6

7 IV. TIMETABLE Given the very limited changes caused by the switch from SDM DSD version 2.0 to SDM DSD version 2.1, it is proposed to proceed as follows: - Before end of October: countries re-send their JVS data for reference quarter 2017Q2 according to the SDM DSD version 2.1. SDM files should be sent to the box ESTAT-VACANCY-STATISTICS@ec.europa.eu and not via edamis. Eurostat validates SDM files. - Mid-November: countries of which SDM files are successfully validated use the SDM DSD version 2.1 standard for their transmission of flash data for 2017Q3. Transmissions in SDM DSD version 1.0 are no longer accepted. - Mid-December: countries of which SDM files are successfully validated use the SDM DSD version 2.1 standard for their transmission of the final 2017Q3 data. Transmissions in SDM DSD version 1.0 are no longer accepted. Deleted: format Deleted: 2.1 Deleted: 2.1 Deleted: V. PROPOSAL The LAMAS is invited to take note of: - The (limited) changes introduced in SDM DSD version 2.1 standards compared with SDM DSD version 2.0 as regards JVS transmissions; - The proposal to send test transmissions to Eurostat before the end of October 2017; - The proposal to switch to SDM DSD version 2.1 standards in JVS production as from reference quarter 2017Q3. Formatted: Font: Bold Formatted: Font: Bold Formatted: Font: Bold LAbour MArket Statistics working group 10-11/10/2017 Page 7