A Data Structure Definition for Eurostat's short-term business

statistics

Jan Planovsky, EurostatSDMX Global Conference

Bangkok, 28-30 September 2015

Contents

• What is Eurostat's STS?

• Current data transmissions

• Preliminary consultations

• Draft STS DSD

• Conclusions

2

3

Who are we?

...

... S D M X , M o d e ls,S tan d ards

Hubertus CloodtT e a m L ea d er

C la ss if ica tio n s,C o d e L is ts

Ana FrancoT e a m L ea d er

U nit B5:C entra l data and m etadata servicesJan P lanovsky

H e a d o f U n it

D ir B : M ethodology; corporate sta tistica l and IT service sEm anuele B aldacci

D ire c to r, C IO

...

...

S T S T e amHakan LindenT e a m L ea d er

... ...

U nit G 3: Short-term business sta tistics and tourismAugust G ötzfried

H e a d o f U n it

D ir G : G loba l business sta tisticsM aria H elena F igueira

D ire c tor

Eurosta t (D irectorate G enera l o f the European C om m ission)W alter R aderm acher

4

What is Short-term business statistics doing?

• Four monthly news releases Industrial producer prices Volume of retail trade Industrial production Index of production in construction

• Eight "Principal European Economic Indicators" (PEEIs)

In addition to the above four: Industry - Import prices Construction – Building permits Services – Turnover Services – Producer prices (SPPI)

• Other short-term indicators (trade turnover, labour costs, …)

5

Current STS data transmissions

• ~5000 data files - in 40 data flows - per year from EU and EFTA Member States and from the accession countries

• All files in structured GESMES/TS (SDMX-EDI)

• All files follow the same structure: 13 fields (dimensions, attributes and observations)

• A tool in MS to create valid files (Genedi)

6

Why SDMX-ML?

• Objective: a single data transmission format in ESS

• Machine-to-machine readability

• Facilitates data sharing and exchange with ECB and international organisations

• Modern tools: XML instead of EDIFACT based

• Support available from Eurostat's IT data and metadata management units

7

Preliminary consultations• With International Organisations (OECD, IMF, ILO): to

learn from them Several web meetings 2015 Q1-Q2

• With EU and EFTA Members States and the candidate countries: to learn from them and to improve acceptability A web meeting to present the draft DSD May-2015

An online survey to collect the MS' comments 2015 Q3-Q4

• Formal approval by Nov-2015

• Technical work carried out by Eurostat's data and metadata management unit between the consultations

8

Message from International Organisations

• Code lists: build on the the existing ones

https://registry.sdmx.org/content.html

• Need to be created: INDICATOR: specific for

STS (PROD, TOVT, EMPL,…) ACTIVITY: NACE rev. 2.0 +

special aggregates (e.g. F_CC112,…)

BASE_YEAR: 2000,…,2020,…,?

9

STS Data Structure Definition

• One DSD for all STS files' 40 flows

• Validations: constraints to be applied at the level of flows [ADJUSTMENT="Y"] not allowed for prices etc.

• SDMX v. 2.1, p.34-43:http://sdmx.org/wp-content/uploads/2013/07/SDMX_2_1_SECTION_6_TechnicalNotes-march-2013.doc

FREQ

REF_AREA

ADJUSTMENT

STS_INDICATOR

STS_ACTIVITY

STS_INSTITUTION

BASE_YEAR

TIME_PERIOD

TIME_FORMAT

OBS_VALUE

OBS_STATUS

OBS_CONF

OBS_PRE_BREAK

15 UNIT

14 UNIT_MULT

11 COMMENT_OBS

12 EMBARGO_TIME

17 TRANSFORMATION

13 COMMENT_DSET

STS - from GESMES/TS to SDMX-ML01 FREQ

02 REF_AREA

03 ADJUSTMENT

04 INDICATOR

05 ACTIVITY

STS_INSTITUTION

06 BASE_YEAR

07 TIME_PERIOD

18 TIME_FORMAT

08 OBS_VALUE

09 OBS_STATUS

10 CONF_STATUS

OBS_PRE_BREAK

19 COMMENT_TS

16 DECIMALS For dissemination

Not needed for indices

Not needed

Never used

11

Conclusion

• Target: One DSD for all STS data transmissions with reporting countries and data users, available in Global Registry

• Based on the existing STS Key Family (GESMES/TS)

• A draft STS DSD is under validation

• Learning from experience (Eurostat's horizontal unit, ESS MS and International Organisations)

12

Questions?

Thank you for your attention.