Pilot Census in Poland Some Quality Aspects Geneva , 7-9 July 2010

Pilot Census in PolandSome Quality Aspects

Geneva, 7-9 July 2010

Janusz DygaszewiczCentral Statistical Office

POLAND

Registry 1Registry 1

Metadata serverMetadata server

Operational Microdata

Registry nRegistry nAnalitycalMicrodata

AnalitycalMicrodata

ETL ToolsETL

Portal

Data processing infrastructure

FilesStatistical

FilesGolden Record

Metadata MetadataMetadata

Questionaries

Key elements of census process in terms of census quality • Census planning - scope of census,• Data sources,• Data collecting,• Data storing,• Data processing,• Development of census results,• Dissemination of census results,• Census Metadata System.

Census Quality

CENSUS PLANNING

Census planning Quality aspects: relevance, accuracy, costs including the burden on respondents, information security

• Determining the data scope defined in Act including:• Compliance with needs of domestic and

EU users,• Quality of data source,• Coherence and comparability of results

from census 2011 and 2002,

Census Quality

DATA ACQUISITION

AnalitycalMicrodata

ETL ToolsETL

Portal

Data acquisition

FilesStatistical

FilesGolden Record

Questionaries

Files format:• Flat files,• XML files,• Local Databases XML files integration,

Data acquisition

Data acquisition - Portal

Datasources Quality aspects: accuracy, timeliness and punctuality, comparability and coherence, costs including the burden on respondents, information security• Assessment of data sources quality for census:

• analyses of methodological compliance of concepts definitions from registers with those adopted in statistics and the UNECE and EUROSTAT Recommendations for the 2010 Censuses on Population and Housing,• developing methodology for compliance

analyses,• constructing the IT system PiK for describing,

comparing and assessing coherence level,

Census Quality – data acquisition

Registers• developing methodology for assessing the

quality: dimensions, quality indicators,• evaluation and description of sources

quality,• MATRIX that represents the possibility of

obtaining the values for the census from registers:• census variable compliance indicators

(methodology compliance indicator), • register suitability indicators (population

coverage indicator for data from the register),

Data sets• developing methodology for assessing

the quality,• evaluation and description of data sets

quality,• developing methodology for improving

source data sets quality – rules for: standardization, normalization, de-duplication, editing, imputation, calibration

CENSUS FRAME PREPARATION

Citizens, buildings and dwelling list preparing,

Citizens, buildings and dwelling list and statistical data integration,

Census Frame preparing.

Census Frame preparation

Goal Frame Preparation,

Random Sample preparation,

Quality of Census Frame

Census frame pre-census revision - checking in field by enumerators

Census frame preparation – validation and updating in counties,

Enumerator tracking

Census Completeness Monitoring

TRANSFORMATION TO STATISTICAL REGISTER

AnalitycalMicrodata

ETL ToolsETL

Portal

Source data collection and preparation

FilesStatistical

FilesGolden Record

Questionaries

Registers loading into data laboratory envroiment,

Denormalization,

Standarization,

Deduplication,

Validation,

Data completion,

Vocabulary validation and automatic correction,

Statistical files (register) generation,

Source data collection and preparation

Collecting dataQuality aspects: accuracy, costs including the burden on respondents, information security

• Collecting data from information systems• Central registers,• Distributed registers,

• format / file structure (XSD schemas),• data transfer platform,• application for encrypted data transfer,• application for validation and data set control

Census Quality – collection and preparation

Data loading to Operational Microdatabase,

Validation

Manual and automatic correction (cleaning),

Deduplication,

Variables calculating,

Source data loading and correction

AnalitycalMicrodata

ETL ToolsETL

Portal

FilesStatistical

FilesGolden Record

Questionaries

•CAII - Computer Assisted Internet Interview,•CAPI - Computer Assisted Personal Interview,•CATI - Computer Assisted Telephone Interviewing.

• Collecting data from respondents: CAII, CAPI, CATI;• CAxI input validation:

• Numerical data validation (answers within boundaries)• Cross question arithmetical validation• Hints and automatic answer completion• Dictionaries and drop down menus

• CAxI logical validation: • Answers determined by questions• Cross question logical validation• Data collection logical paths

Census Quality – data collection by electronic questionare

Data storingQuality aspects: information security

• Data storing in Operational Microdata Base,• Notification of Operational Microdata Base

to registration by General Inspector for Protection of Personal Data,

Census Quality

GOLDEN RECORD,

AnalitycalMicrodata

ETL ToolsETL

Portal

Golden Record generation

FilesStatistical

FilesGolden Record

Questionaries

AnalitycalMicrodata

ETL ToolsETL

Portal

Export to Analitycal Microdata Base

FilesStatistical

FilesGolden Record

Questionaries

Integration with Census Frame and CAxI data,

Validation,

Correction,

Operational Imputation,

Transfer proper values to Golden Record,

Golden Record generation

Registers 1..n

Golden Record

OMB Layers

Transition Tables Preparing,

Golden Records anonymisation,

Transfer to Analitycal Microdatabase,

Export to Analitycal Microdata Base

Data processingQuality aspects: accuracy

• Developing quality indicators for data sets at each stage of data processing and the procedures for calculating their value,

• Developing procedures for bringing data from administrative sources to full compliance or minimum discrepancy with appropriate methodology adopted in statistics,

• Developing procedures for normalization, editing of data sets from the administrative systems, including the imputation of data (administrative data sets),

• Developing procedures for synchronization of data from administrative systems,• Developing rules for linking data from different administrative systems,• Developing rules for linking data from administrative systems with data from CAII, CAPI, CATI,• Developing rules for calculation of Golden Record census variables,• Developing rules for anonymisation of Golden Record census data.

Census Quality

ANALITYCAL MICRODATABASE

AnalitycalMicrodata

ETL ToolsETL

Portal

Analitycal Microdata Base

FilesStatistical

FilesGolden Record

Questionaries

Analitycal Microdata Base - process

Process

Load dat a and m et adat aI nt egrat e dat aCl assi f y and code dat aEdi t and val i dat e dat aI m put eD er i ve new var i abl esWageAggregat eCreat e fil es

Analyse

minate

Pilot Census in Poland Some Quality Aspects Geneva , 7-9 July 2010

Documents

Transcript of Pilot Census in Poland Some Quality Aspects Geneva , 7-9 July 2010

Geneva County, Alabama Owens/Powell Census …alabamahoming.com/powell/powell-census-geneva1920.pdfRalph L 12 Al Al Al Boyd 10 Al Al Al Charlie M 5 Al Al Al WWI draft card, Geneva

Census Unit Fernando Casimiro and Paula Paulino Geneva, 28 - 30 October 2009 Portugal – Changes in the residence of third level students «

OUR COUNTRY POLAND POLAND. POLAND our place in Europe.

City of Lake Geneva, 626 Geneva St, Lake Geneva, WI 53147 ... · June 8, 2020 City Council Agenda Page 1 of 2 City of Lake Geneva, 626 Geneva St, Lake Geneva, WI 53147- 262.248.3673-

Census 2011 in Portugal: Development of e-Census system Statistics Portugal - Census Unit and IT Department Geneva, 28 - 30 October 2009.

, Geneva , Pregny-Chambésy, Geneva - Penthes

JOINT UN-ECE/EUROSTAT MEETING ON POPULATION AND HOUSING CENSUSES GENEVA, 28-30 OCTOBER 2009 ADOPTING THE CES RECOMMENDATIONS IN THE 2011 UK CENSUS IAN.

2020 World Population and Housing Census Programme United Nations Statistics Division Group of Experts on Population and Housing Censuses Geneva, 30 September.

Pilot Census in Poland Some Quality Aspects Geneva, 7-9 July 2010 Janusz Dygaszewicz Central Statistical Office POLAND.

2011 Housing and Population Census in the Czech Republic UNECE – Eurostat Meeting on Population and Housing Censuses Geneva, May 2012.

1831 CENSUS The Census Road - statisticsguyana.gov.gy · the census road 1980 census 1946 census 751,223 2002 census 723,673 1991 census 759,567 1980 census 701,718 1970 census 560,330

Census 2011 in Portugal: Implementation of e-Census system Statistics Portugal - Census Unit and IT Department Geneva, 22 - 25 May 2012.

United Nations Economic Commission for Europe Geneva, Switzerland Stephen L. Buckner, Center for New Media & Promotions U.S. Census Bureau Dealing With.

· D. Markulak M. Mašlak G. de Matteis E Mazzolani Hungary Belgium Greece Poland Poland Germany Germany Slovakia Poland Singapore France Poland China Poland Poland Poland Croatia

27 th Voorburg Group Meeting Warsaw, Poland Future Agenda presented by Mark E. Wallace Chief, Service Sector Statistics Division U.S. Census Bureau mark.e.wallace@census.gov.

U.S. Census Overview SOC 101. Outline of Presentation Census History Census Questionnaire Census Geography Census Data American FactFinder.

2011 UK Population Census 2011 UK Population Census · PDF file2011 UK Population Census ... same sex civil partnerships: highest in England and Wales. ... - Poland: 2,270 – similar

MODERN CENSUS in POLAND Janusz Dygaszewicz Central Statistical Office in Poland Group of Experts on Population and Housing Census Geneva, 28-30 October.

PEPC 2003, Geneva, 24-25.04.2003, PROGRESS Computing Portal Poznań Supercomputing and Networking Center (PSNC) Poland Poland Cezary Mazurek.

Puławy is a town in eastern Poland, in Lublin Province (northern Lesser Poland), on the Wisła river. According to the 2006 census estimate, the town had.