Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a...

18
Data Processing Software for IMTS Markie Muryawan – [email protected] United Nations Statistics Division © 2016

Transcript of Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a...

Page 1: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Data Processing Software for IMTS

Markie Muryawan – [email protected]

United Nations Statistics Division

© 2016

Page 2: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

2

Reminder: Implementation Plan

Design Understanding IMTS 2010

Input Institutional Arrangement

Process Algorithm Software

Output Dissemination Platform

Evaluate Quality Report Template

Page 3: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Introduction

• Eurotrace is a data management and

processing software, usually used for IMTS, in

conjunction with ASYCUDA

• Eurotrace is Open Source Application (2014)

• Designed for:

– Managing trade data

– Implementing processing and checking algorithm

– Editing and aggregating data

– Calculating derived trade indicators

– And can be extended through modules… 3

Page 4: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

4

Derived Data

Source Dataset

Classification

Plan

4. Target of Data

dissemination

Statistical Office

Statistics Users

2. Provider of Data

Trade Statistics data

Supplier,

Customs,

Statistical Office

Data

Editor

3. Validity Check and

Quality Control

Data Coders,

Data Controller

1. Define External Trade

Statistical Database

Expert of Nomenclatures and/or

Trade Information System

Page 5: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Managing Classification

5

WWW

Nomenclatures

DBMS

Page 6: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Flexible storage design

6

Nomenclatures

DBMS

Data

• Free number of dimensions• Free number of datasets

Page 7: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Control Procedure

Nomenclatures

DBMS

Data

Automatic

Correction

Error table

ValidationAlgorithm

Database

Text Files

Page 8: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Data Editing

8

Nomenclatures

DBMS

Data

Error table

Editor

Autonomous extraction filesfor correction and visualisation.

Viewing tools : easily define extractions

Page 9: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Data Aggregation

9

Nomenclatures

DBMS

Data

COMEXTBrowser

Transcodification

Page 10: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Screenshot – data design

10

Page 11: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Screenshot – data validation

11

Together all the

parameters in the

different

Tabs constitute an

algorithm capable of

Making a wide variety

of validations and

actions

Page 12: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

More on data validation

12

6 types of rules supported:

� Validation

� Action

� Deletion

� Invariant

� Warning

� Transcodification

Page 13: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

But, W.A.I.T

• EUROTRACE is not data dissemination system

• Fortunately …. There are alternatives software

that work in conjuction with EUROTRACE:

– PC: Comext (Eurostat)

– Web: WebComext (Eurostat), PX-Web (Statistics

Sweden)

• Countries have been implementing these data

disseminations system

13

Page 14: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Eurotrace User Community

• In February 2016, UNSD, Eurostat, African Union, CARICOM, COMESA, ECOWAS and other interested parties decided to form EUROTRACE User Community (EUROTRACE-UC).

• The main goals of this user community are as follows:– To identify common issues and agree on setting the

priority on features for improvement and addition

– To maintain list of issues including the status of resolution

– To fulfill the needs of training and capacity building in countries by pooling available resources

14

Page 15: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

http://comtrade.un.org/eurotrace/

15

Page 16: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Example: ideas for improvement

16

Page 17: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

17

Page 18: Data Processing Software for IMTS - United Nations · 2016-09-30 · Introduction •Eurotrace is a data management and processing software, usually used for IMTS, in conjunction

Thank you

[email protected]