National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th...
Transcript of National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th...
![Page 1: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/1.jpg)
National Accounts implementation stories
7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea
Daniel SURANYI, Eurostat [email protected]
![Page 2: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/2.jpg)
National Accounts implementation stories
What you will hear today…
• Implementation of SDMX for National Accounts
• Business Case
• Governance
• Use case national implementation
• Use case international data cooperation
• Summary: state of play SDMX-NA
![Page 3: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/3.jpg)
National Accounts implementation stories
• Implementation of SDMX for National Accounts
• Business Case
• Governance
• Use case national implementation
• Use case international data cooperation
• Summary: state of play SDMX-NA
![Page 4: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/4.jpg)
Why SDMX for National Accounts?
Within the organisation
Across organisations
Internationally
![Page 5: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/5.jpg)
Why SDMX for National Accounts?
Within the organisation
Across organisations
Internationally
Within the organisation
Across organisations
Internationally
![Page 6: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/6.jpg)
National Accounts business needs
Within the organisation
Across organisations
Internationally
• Main trigger: new methodology • SNA 93 SNA 2008
• ESA 95 ESA 2010
• Business process reengineering • Corporate production
systems
• Integration of production chains
• Harmonised coding
![Page 7: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/7.jpg)
National Accounts business needs
Within the organisation
Across organisations
Internationally
• Cross-domain integration
• Balance of Payments
• Foreign Direct Investment
• Reengineering of data exchange
• Standardisation
• Improved validation
• Reuse of tools
![Page 8: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/8.jpg)
National Accounts business needs
Within the organisation
Across organisations
Internationally
• Data quality • 1 country 1 year 1 GDP
• Shared validation rules
• Shared responsibilities
• Lowering reporting burden • 1 data flow from
national to international
• International cooperation • Inter-Agency Group on
Economic and Financial Statistics = SDMX Sponsors
• Example: PGI Website http://www.principalglobalindicators.org
![Page 9: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/9.jpg)
BOP National Accounts
Main Aggregates
Sector Accounts
Supply & Use Input / Output
GFS
FDI
![Page 10: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/10.jpg)
BOP National Accounts
Main Aggregates
Sector Accounts
Supply & Use Input / Output
GFS
FDI
![Page 11: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/11.jpg)
BOP National Accounts
Main Aggregates
Sector Accounts
Supply & Use Input / Output
GFS
FDI
SDMX
![Page 12: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/12.jpg)
National Accounts
•SNA 2008
•ESA 2010
•Other NA related domains
FDI statistics
Other domains
Balance of Payments
Statistics
Cross Domain Concepts and
Code Lists Shared
Concepts and Code Lists
![Page 13: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/13.jpg)
• 2 global SDMX implementation projects
• …for National Accounts (SNA2008 / ESA 2010)
• …for Balance of Payments (BPM6) and Foreign Direct Investment (BMD4)
• 2 project steering groups and 2 technical groups
• Running from 2011 until 2013
• Publication of V1.0 DSDs in September 2013
• Steering groups Ownership Group
Background
![Page 14: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/14.jpg)
• Mandated by SDMX Sponsors in January 2014 • As a single OG for NA & GFS, BOP and FDI
• Representation of management from content and SDMX side
• Oversees maintenance of SDMX artefacts • Mandated technical groups
• 1 on BOP and FDI; 1 on NA and GFS
• Close cooperation with IAG Task Force
international data cooperation (TFIDC)
Ownership Group (OG)
![Page 15: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/15.jpg)
Maintenance Agreement
• MA will only apply changes agreed upon by OG
• Change requests may lead to…
• Structural changes: major release (e.g. SNA2025 )
• Annual maintenence release (regular case)
• Fast-track maintenance release (only for small changes limited to selected dataflows) (subject to review during next annual release)
![Page 16: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/16.jpg)
State of Play
• V1.1 published in Jan 2014 • V1.2 in April 2014 in SDMX Global Registry
• V1.3 fast-track release for NA Sector Accounts (to fix a mistake in one code list)
• V1.4 regular release currently in preparation • Support for coding Euro Area 19 • Inclusion of IMF GFSM coding • Support for SNA93 in the context of international
data cooperation • Support for additional dataflows (e.g. GNI, EDP) • Minor additions to existing code lists
• Next OG meeting: November 2014
![Page 17: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/17.jpg)
SDMX-NA Governance
• Maintenance Agency: Eurostat
• Ownership Group:
• Active: ECB, Eurostat, IMF, OECD, UNSD
• Passive: BIS, World Bank
• Published in the global registry:
• http://registry.sdmx.org
• Annual maintenance cycle (April-April)
• SDMX-NA maintenance page:
• http://sdmx.org/?page_id=1498
![Page 18: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/18.jpg)
Data Structure Definitions (DSDs)
DSD ID
NA_...
DSD Title Tables in transmission programs from
2014
MAIN Main aggregates ESA / OECD: 1, 3, 5, 20, 22
SEC Sector accounts
and government
finance
ESA / OECD: 2, 6, 7, 8, 9, 11, 26, 27, 28
ECB: MUFA, GFS
EDP: 1, 2, 3, 4
OECD: 119, 7HH, 7II, PSD
G20: Recommendation 15
SU Supply / use and
input / output
ESA : 15, 16, 17, 18, 19
REG Regional statistics ESA: 10, 12, 13
PENS Pension schemes ESA: 29
![Page 19: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/19.jpg)
National Accounts implementation stories
• Implementation of SDMX for National Accounts
• Business Case
• Governance
• Use case national implementation
• Use case international data cooperation
• Summary: state of play SDMX-NA
![Page 20: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/20.jpg)
Who?
What?
When? Who?
Where? How?
What?
ESA 2
010 T
P
SDMX-NA
![Page 21: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/21.jpg)
Technical Integration
National statistical organisations
International organisations
National databases
(Mapping)
Source
Source
Source
SDMX Data Structure
Defintions & Data Flows
National data sources
Metadata driven process based on SDMX standards and tools Full automation of the data exchange possible
![Page 22: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/22.jpg)
Data provider view: One goal – different possibilities
Webforms Online data collection tools
SDMX-ML file
Database export
SDMX Converter SDMX-ML file
Database SDMX Reference Infrastructure
SDMX-ML file
SDMX Web Service
Same DSD
Same Format
Excel sheets
SDMX Converter SDMX-ML file
![Page 23: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/23.jpg)
SDMX process flow and supporting tools
Non-SDMX
local data
NSI Map /
Recode Extract Transform SDMX file
Disseminate / Transmit
NSI software
NSI software
SDMX Converter
Processing for sending
Push
SDMX Converter
SDMX-RI
Mapping Assistant
Test client Web client
Processing for sending
NSI Web service
Push
Pull / Hub
NSI development
NSI software Push / Pull
/ Hub
NSI developed software Eurostat tools
![Page 24: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/24.jpg)
SDMX Reference Infrastructure https://webgate.ec.europa.eu/fpfis/mwikis/sdmx/index.php/SDMX_Reference_Infrastructure_SDMX-RI
Data Provider Data Collector
Non-SDMX local database
SDMX data set
SDMX Registry
DSD
SDMX-RI
Mapping Assistant
Web Svc
Test Client
Web Client
![Page 25: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/25.jpg)
Data Validation Process
Before/During Transmission (“First Level”)
- Covered by SDMX today
- Format Check (SDMX-ML)
- Code Check (SDMX DSD)
After Transmission ( “Second Level”)
- Not yet covered by SDMX
- Detailed value check
- Mirror check
- …
![Page 26: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/26.jpg)
National Accounts implementation stories
• Implementation of SDMX for National Accounts
• Business Case
• Governance
• Use case national implementation
• Use case international data cooperation
• Summary: state of play SDMX-NA
![Page 27: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/27.jpg)
International Data Cooperation Background
General objectives • Reduce reporting burden on NSIs
• More efficient use of resources in
International Organisation (IO)
• Ensure high quality and consistency
of data of official statistics
• Improve global data exchange and dissemination
SDMX provides • technical/statistical standards
• new exchange modes (hubs)
• clear rules and responsibilities
![Page 28: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/28.jpg)
SDMX Web Services
A possible data sharing model
EU OECD
other than EU World other than OECD
Eurostat - ECB
OECD
IMF, UN, WB, BIS, other IOs
U S E R S
![Page 29: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/29.jpg)
The necessary pre-conditions
• SDMX maintenance agreements Ownership and maintaining agency to be defined (normally between the international organisations)
• Internationally agreed data validation
Data validation rules and SDMX data validation standards (beyond file structure validation)
• Streamlined data exchange processes Frequency and timeliness for data dissemination, data quality management etc.
![Page 30: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/30.jpg)
International Data Cooperation in National Accounts
• IAG: Interagency Group on Economic and Financial Statistics
• BIS, ECB, Eurostat, IMF, OECD, World Bank
• same organisations as SDMX Sponsors
• IAG Task Force International Data Cooperation
• TFIDC, co-chaired by Eurostat and IMF
• Pilot 1 on GDP and population
• Pilot 2 on Sector Accounts
![Page 31: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/31.jpg)
TFIDC – State of Play
• Pilot 1 on GDP and population
• Data flow template agreed, based on NA_MAIN DSD
• Monthly data exchange, senders: Eurostat, OECD, IMF
• Some minor technical issues: e.g. SDMX header compatibility SDMX TWG
• Go live planned for Q1/2015
• Pilot 2 on Sector Accounts
• First tests successful, based on NA_SEC DSD
• Lessons learned from pilot 1
• Pilot to kick off Q1/2015
![Page 32: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/32.jpg)
TFIDC – Next steps
• Agreement on detailled validation rules • Eurostat / OECD agreement as basis
• Support for SNA 93 data exchange • Change request pending in Ownership Group
• Improvement on data exchange frequency • Monthly PUSH not enough to meet objectives
• Discussion on future topics • Plans for dissemination using global DSDs
• PULL mode, improved data coverage…
![Page 33: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/33.jpg)
National Accounts implementation stories
• Implementation of SDMX for National Accounts
• Business Case
• Governance
• Use case national implementation
• Use case international data cooperation
• Summary: state of play SDMX-NA
![Page 34: National Accounts implementation stories - oecd.org · National Accounts implementation stories 7th Meeting of the Expert Group on SDMX 27-30 October 2014, Seoul, Korea Daniel SURANYI,](https://reader030.fdocuments.us/reader030/viewer/2022041216/5e04b33b62d72e2c05363a03/html5/thumbnails/34.jpg)
SDMX-NA : Here & Now
• Governance operational Ownership Group • Harmonised development with BOP/FDI ensured
• National implementation projects on-going • Various tools and possibilities available
• International Data Cooperation • Promising projects for improving official statistics
globally
• SDMX-NA as showcase implementation project