1 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Data Quality Measures and Related Stress Factors:

A conceptual framework to account for differences in statistical environments

at country and international levels

Robert Mayo

2 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Data Quality monitoring and feedback system

3 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Essential Components of Data Quality at Dissemination

Essential Components of Data Quality at Dissemination

4 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Essential Components of Data Quality at Dissemination

• Accuracy and Reliability• Transparency and Metadata;• Standard Classifications;

5 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

FAOSTAT and international classifications

ISICISIC

HSHS SITCSITC

CPCCPC

FAOSTAT

6 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

The integration of FAO into international Classifications

HSHS SITCSITC

CPCCPCISICISIC

FAOClassifications

FAOClassifications

7 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Essential Components of Data Quality at Dissemination

• Accuracy and Reliability• Transparency and Metadata;• Standard Classifications;• Timeliness;• Comparable Data Domains

8 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Inputs

Trade

Production

Food and non Food

Resources

Econ

om

ics

Trade

Input Prices

Output Prices

Trade Prices

Prices

Comparable Domains

Consumption

10 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Essential Components of Data Quality at Dissemination

• Accuracy and Reliability• Transparency and Metadata;• Standard Classifications;• Timeliness;• Comparable Data Domains;• Accessibility

• Scope and Coverage;• Data update schedule;• Estimates, Calibrations and Analytical Indicators

Adding Additional Value to Data

11 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Measuring Overall Quality in the Statistical Process

• Absolute and Relative Quality

• Comparing across National Offices• Comparing across International Offices• Comparing over time

12 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Measuring Overall Quality in the Statistical Process

• Prepare summary measure of data quality – at the dissemination point;

• Select “Benchmark” statistics office;

• Prepare Data Quality Index with “Benchmark” statistics office as base;

13 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Country Data Quality Index

CountryQuality

Year 2002=100

2000 2001 2002 2003 2004 2005

A 93 95 100 103 103 105

B 70 75 75 80 80 80

C 70 77 75 70 65 65

14 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Data Quality monitoring and feedback system

15 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Stress Factors

• Population (number), • Geographical size (sq kms), • Education (completion rate), • Income (gross national income), • Environment (e.g. recent natural disasters, conflict)

16 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Stress Factor deflator/inflator

CountryStress Factors

Year

2000 2001 2002 2003 2004 2005

A 1.00 1.00 1.00 1.00 1.00 1.00

B 1.10 1.15 1.15 1.15 1.20 1.20

C 1.10 1.10 1.05 1.10 1.30 1.35

17 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Adjusted Country Data Quality Index

CountryQuality

Year 2002=100

2000 2001 2002 2003 2004 2005

A 93 95 100 103 103 105

B 77 86 86 92 96 96

C 77 85 79 77 85 88

18 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Summary

• Focus on Essential Components of data quality – at the dissemination point;

• Recognize value adding items;

• Select Benchmark Quality level;• Measure and Adjust Data Quality for Stress

19 27-28 May 2006Conference on Data Quality for International Organizations

FOOD AND AGRICULTURE ORGANIZATIONOF THE UNITED NATIONS

Data Quality Measures and Related Stress Factors

Thank you