© 2008 Lockheed Martin Corporation. All Rights Reserved. Capture Data Quality Session 9 – Data...

© 2008 Lockheed Martin Corporation. All Rights Reserved.

Capture Data QualityCapture Data Quality

Session 9 – Data Capture: Process Stages

UNSD-ESCWA Regional Workshop on Census Data Processing

in the ESCWA region

Doha, State of Qatar, 18-22 May 2008

Fred Highland

Census Practice Architect

Lockheed Martin Transportation & Security Solutions

© 2008 Lockheed Martin Corporation. All Rights Reserved. 2

Objective of a Population CensusObjective of a Population Census

“ “ … … count everyone,count everyone,

count them once only,count them once only,

and count them in the right place…and count them in the right place… ” ”

Preston Jay Waite (US Census Bureau)Preston Jay Waite (US Census Bureau)


• It’s not just about paper – multi-channel data collectionIt’s not just about paper – multi-channel data collection

TelephoneTelephone• Voice capture accuracy (Voice capture accuracy (Service Quality v Data Quality) Service Quality v Data Quality)

InternetInternet• Self capture – no capture accuracy or image quality issuesSelf capture – no capture accuracy or image quality issues• Inventory Control, Processing Integrity issuesInventory Control, Processing Integrity issues

Field Hand-held deviceField Hand-held device• Similar to internetSimilar to internet

• Admin Records (not addressed here)Admin Records (not addressed here) Similar to internetSimilar to internet Data validationData validation Many issues with linkage/coherenceMany issues with linkage/coherence

• A Comprehensive view A Comprehensive view mustmust embrace embrace allall aspects and aspects and allall channels channels

A Comprehensive ViewA Comprehensive View


A Comprehensive ViewA Comprehensive View

PaperPaper InternetInternet TelephoneTelephone Hand HeldHand Held

Inventory Inventory ControlControl √√ √√ √√ √√

Questionnaire Questionnaire IntegrityIntegrity √√ √√ √√ √√ImageImage

QualityQuality √√Processing Processing

IntegrityIntegrity √√ √√ √√ √√Capture Capture

AccuracyAccuracy √√ √√ √√


“ “Ensuring that questionnaires are accurately accounted for and Ensuring that questionnaires are accurately accounted for and managed”managed”

• Accurate capture of data is irrelevant if you lose the questionnaireAccurate capture of data is irrelevant if you lose the questionnaire

Inventory ControlInventory Control

DeliveryDelivery

System EntrySystem Entry

StorageStorage

DispositionDisposition

ProcessingProcessing


“ “Ensuring that the questionnaire and its component parts are kept Ensuring that the questionnaire and its component parts are kept together for the complete process”together for the complete process”

• Maintain the linkage of a questionnaire to its componentsMaintain the linkage of a questionnaire to its components Pages/sheets (paper)Pages/sheets (paper) HouseholdHousehold PersonsPersons Response itemsResponse items

• Prevent mixing of data between questionnairesPrevent mixing of data between questionnaires

Questionnaire IntegrityQuestionnaire Integrity

Questionnaire

PagesPagesPages Household

Person nPerson 2

Person 1

Item 1Item 2

Item nItem n

Item 1Item 2


Image QualityImage Quality

• What is image quality?What is image quality? Qualitative not QuantitativeQualitative not Quantitative

• Capture of faithful images that are “fit for purpose”Capture of faithful images that are “fit for purpose”

• This is subjectiveThis is subjective

• No agreed-to measure exists !No agreed-to measure exists ! Operational definitionOperational definition

• Images are of Images are of sufficientsufficient resolution for processing resolution for processing

• Images represent the Images represent the completecomplete original document original document

• Images are free of artefacts introduced by processingImages are free of artefacts introduced by processing

• Questionnaires must be represented as digital images for:Questionnaires must be represented as digital images for:• Automatic recognition (e.g. OCR, OMR)Automatic recognition (e.g. OCR, OMR)• KeyingKeying• Other image assisted functions (e.g. Coding)Other image assisted functions (e.g. Coding)• ArchiveArchive

• Capture of Capture of high qualityhigh quality images is critical ! images is critical !


Processing IntegrityProcessing Integrity

““Ensure all responses are processed in the proper sequence, Ensure all responses are processed in the proper sequence, priority and completely through all appropriate steps”priority and completely through all appropriate steps”

• Complicating factorsComplicating factors Multiple response modesMultiple response modes

• Paper, internet, telephone and hand-held devicePaper, internet, telephone and hand-held device

Quantity of questionnairesQuantity of questionnaires• US - 140,000,000US - 140,000,000• UK - 30,000,000UK - 30,000,000• Canada – 13,500,000Canada – 13,500,000

Processing deadlinesProcessing deadlines• Non-response follow-upNon-response follow-up• Census Coverage Survey (CCS)Census Coverage Survey (CCS)

Large number of processing steps….Large number of processing steps….


Data Capture Accuracy - PaperData Capture Accuracy - Paper

Questionnaire

Scan

Image

OCR

ASCII

20%

0.2%

80%

99.8%OMR

Keying ASCII

ASCII

w/codes

Edit Code

““Capture all of the data accurately, regardless of source and be able Capture all of the data accurately, regardless of source and be able to assess and manage the accuracy”to assess and manage the accuracy”


A comprehensive approach to quality must consider moreA comprehensive approach to quality must consider morethan just data capture issues….than just data capture issues….

Inventory ControlInventory Control Questionnaire IntegrityQuestionnaire Integrity Image Quality Image Quality Processing IntegrityProcessing Integrity Data Capture AccuracyData Capture Accuracy

… … while ensuring accuracy and value for moneywhile ensuring accuracy and value for money

SummarySummary

A comprehensive approach identifies issues early and A comprehensive approach identifies issues early and enables timely corrective actions. enables timely corrective actions.

It requires an operational focus on data quality.It requires an operational focus on data quality.

© 2008 Lockheed Martin Corporation. All Rights Reserved. Capture Data Quality Session 9 – Data...

Documents

Transcript of © 2008 Lockheed Martin Corporation. All Rights Reserved. Capture Data Quality Session 9 – Data...