SQUARING THE QUALITY CIRCLE - United Nations · SQUARING THE QUALITY CIRCLE Towards a Quality...

12
SQUARING THE QUALITY SQUARING THE QUALITY CIRCLE CIRCLE Towards a Quality Framework for Towards a Quality Framework for International Official Statistics International Official Statistics Conference on Data Quality for International Organizations, Wies Conference on Data Quality for International Organizations, Wies baden, baden, Germany, 27 Germany, 27-28 May 2004 28 May 2004

Transcript of SQUARING THE QUALITY CIRCLE - United Nations · SQUARING THE QUALITY CIRCLE Towards a Quality...

SQUARING THE QUALITY SQUARING THE QUALITY CIRCLECIRCLE

Towards a Quality Framework for Towards a Quality Framework for International Official StatisticsInternational Official Statistics

Conference on Data Quality for International Organizations, WiesConference on Data Quality for International Organizations, Wiesbaden, baden, Germany, 27Germany, 27--28 May 200428 May 2004

Scope of paper:Scope of paper:1.1. To investigate the relationships between To investigate the relationships between

the UN Fundamental Principles of the UN Fundamental Principles of Official Statistics, the IMF Data Quality Official Statistics, the IMF Data Quality

Assessment Framework and the draft Assessment Framework and the draft Declaration of Principles for Declaration of Principles for

International Official StatisticsInternational Official Statistics2.2. To explore how progress towards a To explore how progress towards a

Quality Framework for International Quality Framework for International Official Statistics could be madeOfficial Statistics could be made

DESA/UNSD 3

Do the Fundamental Principles apply to Do the Fundamental Principles apply to International Official Statistics?International Official Statistics?

•• ECE paper ‘Towards a statistical system’ raises the ECE paper ‘Towards a statistical system’ raises the question: how to achieve formal recognition of the question: how to achieve formal recognition of the

applicability of the FPOS to International statistics?applicability of the FPOS to International statistics?

•• Quality definitions and quality assessment frameworks for Quality definitions and quality assessment frameworks for nationalnational statistics have been establishedstatistics have been established

•• Similar definitions and frameworks for Similar definitions and frameworks for internationalinternationalstatistics do not yet existstatistics do not yet exist

DESA/UNSD 4

National and international statistics are different National and international statistics are different in many respectsin many respects

•• Different legislative environmentDifferent legislative environment•• No collection from primary data providers, but from No collection from primary data providers, but from

countriescountries•• Standard setting by international statisticians, working Standard setting by international statisticians, working

with countrieswith countries•• Coordination among the agencies Coordination among the agencies •• Agencies estimate values for nonAgencies estimate values for non--responding countriesresponding countries•• Agencies harmonize dataAgencies harmonize data•• Agencies make regional and global estimatesAgencies make regional and global estimates•• Etc.Etc.

DESA/UNSD 5

Structure of the paperStructure of the paper

•• Part 1: Relationships between existing Part 1: Relationships between existing instrumentsinstruments

•• Part 2: Detailed comparison between DQAF Part 2: Detailed comparison between DQAF and DPIS (Annex 1)and DPIS (Annex 1)

•• Part 3: DPIS process and comparison Part 3: DPIS process and comparison between DPIS en FPOSbetween DPIS en FPOS

•• Part 4: From DPIS to QFIS and IDDSPart 4: From DPIS to QFIS and IDDS

DESA/UNSD 6

Principles, Frameworks, Principles, Frameworks, StandardsStandards

•• Principles: the philosophical underpinningPrinciples: the philosophical underpinning

•• Frameworks: instruments to assess practicesFrameworks: instruments to assess practices

•• Standards: agreed quality measuresStandards: agreed quality measures

DESA/UNSD 8

DQAFDQAF

•• DQAF is based on the Fundamental DQAF is based on the Fundamental PrinciplesPrinciples

•• PrerequisitesPrerequisites•• IntegrityIntegrity•• Methodological soundnessMethodological soundness•• Accuracy and reliabilityAccuracy and reliability•• ServiceabilityServiceability•• AccessibilityAccessibility

•• Holistic approach to qualityHolistic approach to quality

DESA/UNSD 9

Declaration of Principles (DPIS)Declaration of Principles (DPIS)

•• Based on FPOSBased on FPOS•• FPOS text adapted to the international situationFPOS text adapted to the international situation•• Taking account of agreed interpretation of FPOS (see Taking account of agreed interpretation of FPOS (see

DQAF), basic recommended practices were addedDQAF), basic recommended practices were added•• Rev. 2 now under consideration of the drafting groupRev. 2 now under consideration of the drafting group•• Issues: Issues: I.I. Principles or Principles & Practices?Principles or Principles & Practices?II.II. Are the recommended practices acceptable?Are the recommended practices acceptable?III.III. Will the organizations agree to sign up?Will the organizations agree to sign up?•• Next stepsNext steps

DESA/UNSD 10

Comparison DQAF with Comparison DQAF with proposed DPIS practicesproposed DPIS practices

•• Internal/external accessInternal/external access•• Advance notice of changes in methodology, Advance notice of changes in methodology,

source data and statistical techniquessource data and statistical techniques•• Concepts, definitions, scope, classifications, basis Concepts, definitions, scope, classifications, basis

of recordingof recording•• Intermediate data and analysis of revisionsIntermediate data and analysis of revisions•• Data presentation, release schedules, availability Data presentation, release schedules, availability

of nonof non--confidential subconfidential sub--aggregatesaggregates•• Contact persons and catalogues Contact persons and catalogues

DESA/UNSD 11

How to get to QFIS?How to get to QFIS?

•• CCSA accepts DPIS, either as Principles or as CCSA accepts DPIS, either as Principles or as Principles & PracticesPrinciples & Practices

•• If only P, what does it mean?If only P, what does it mean?•• If only P, what is the next step?If only P, what is the next step?•• Statistical Commission endorses P or P&P Statistical Commission endorses P or P&P •• If only P, what is the next step?If only P, what is the next step?•• If P&P, organizations have to sign up If P&P, organizations have to sign up •• From DPIS to QFIS to IDDSFrom DPIS to QFIS to IDDS

DESA/UNSD 12

Conclusions and points for Conclusions and points for discussiondiscussion

•• DQAF and DPIS both based on FPOSDQAF and DPIS both based on FPOS•• DQAF is a good starting point for QFISDQAF is a good starting point for QFIS•• DQAF contains elements that DPIS at this stage DQAF contains elements that DPIS at this stage

does not includedoes not include•• Is a DPIS without practices useful?Is a DPIS without practices useful?•• How to apply QFIS?How to apply QFIS?•• Self assessment, peer review, assessment by Self assessment, peer review, assessment by

countries?countries?•• Towards IDDS; generic or data specific?Towards IDDS; generic or data specific?