Post on 27-Mar-2015
HES Data Management
Ari Haukijärvi
Planning of HES Data Management
• Purpose of the data management• The data will be available for analysis• The available data are
• Complete• Correct• Verifiable• Secure
Planning of HES Data Management
• Purpose of the data management• The data will be available for analysis• The available data are
• Complete• Correct• Verifiable• Secure
• From the beginning - part of the general survey planning
Planning of HES Data Management
• Including all phases of the survey:
• Sampling
Sampling
= Output/ Workflow
= Data transfer/ Data storage
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
= Function
= Data/ Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling
Sampling
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
= Function
= Data/ Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments
Sampling
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Schedulingappoinments
Contact / Re-contactRecruitment
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
= Function
= Data/ Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments
Sampling
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Schedulingappoinments
Contact / Re-contactRecruitment
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
Data onparticipation
Data onappointment
schedules
= Function
= Data/ Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments
Sampling
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Schedulingappoinments
Contact / Re-contactRecruitment
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
Data onparticipation
Data onappointment
schedules
= Function
= Data/ Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments• Survey data collection• Quality control data
Fieldwork
Questionnaire/Interview
Physicalmeasurements
Laboratorysampling
Sampling
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Schedulingappoinments
Contact / Re-contactRecruitment
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
Data onparticipation
Data onappointment
schedules
= Function
= Data/ Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments• Survey data collection• Quality control data
Fieldwork
Questionnaire/Interview
Physicalmeasurements
Laboratorysampling
Sampling
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Schedulingappoinments
Contact / Re-contactRecruitment
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
Data onparticipation
Data onappointment
schedules
Fieldwork Surveydata
= Function
= Data/ Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments• Survey data collection• Quality control data
Fieldwork
Questionnaire/Interview
Physicalmeasurements
Laboratorysampling
Sampling
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Schedulingappoinments
Contact / Re-contactRecruitment
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
Data onparticipation
Data onappointment
schedules
Fieldwork Surveydata
= Function
= Data/ Samples
Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments• Survey data collection• Quality control data
Fieldwork
Questionnaire/Interview
Physicalmeasurements
Laboratorysampling
Sampling
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Schedulingappoinments
Contact / Re-contactRecruitment
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
Data onparticipation
Data onappointment
schedules
Fieldwork Surveydata
= Function
= Data/ Samples
Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments• Survey data collection• Quality control data
Fieldwork
Questionnaire/Interview
Physicalmeasurements
Laboratorysampling
Sampling
Samplecontrol
Reception,Storage,Forward
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Schedulingappoinments
Contact / Re-contactRecruitment
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
Data onparticipation
Data onappointment
schedules
Fieldwork Surveydata
Samplecontrol
data
= Function
= Data/ Samples
Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments• Survey data collection• Quality control data
Fieldwork
Questionnaire/Interview
Physicalmeasurements
Laboratorysampling
Sampling
Samplecontrol
Reception,Storage,Forward
National HESdatabase
= Output/ Workflow
= Data transfer/ Data storage
Schedulingappoinments
Contact / Re-contactRecruitment
Laboratoryanalysis
Sampling data
PSUStratum
Sampling weightSubject ID
Address, etc.
Data onparticipation
Data onappointment
schedules
Fieldwork Surveydata
Laboratoryanalysis data
Samplecontrol
data
= Function
= Data/ Samples
Samples
HESwork and data flow
Buy SmartDraw!- purchased copies print this document without a watermark .
Visit www.smartdraw.com or call 1-800-768-3729.
Planning of HES Data Management
• Including all phases of the survey:
• Sampling• Recruitment and scheduling appointments• Survey data collection• Quality control data• Survey data analysis
Planning of HES Data Management
• What information to be recorded in each phase
• How the information will be recorded and stored
• By whom the information will be recorded and stored
Planning of HES Data Management
Example 1. Sampling information
• Sampling frame• PSU/SSU• Stratum• Demographic group• Sampling weight• Subject ID• Address (contact) information• Additional information (age, sex, etc.)
Planning of HES Data Management
Example 2. Recruitment and scheduling
information • Subject ID• Contact information (address, phone number, etc.)• Recruitment information
• Eligibility status• Number and type of contact attempts• Partitipation status• Reason for non-participation
• Appointment information (time, place, etc.)
Planning of HES Data Management
National HES database
• Created and maintained in each country• Central data storage for:
• Sampling data on each survey respondent• Individual level data on the questionnaires and HES
measurements• Information on the quality of the data
• Used for evaluating the survey• Used for analysing the survey results• Available (operational) in each survey phase
Planning of HES Data Management
Survey data collection
• Computer-assisted data collection• Interviewing data• Measurements data• Includes automatic built-in data checks• Planning and testing of data management for the
fieldwork (computers, software, network, etc. used)
Planning of HES Data Management
Survey data collection
• Computer-assisted data collection• Interviewing data• Measurements data• Includes automatic built-in data checks• Planning and testing of data management for the
fieldwork (computers, software, network, etc. used)
• Using paper forms• Keying the data into electronic format
Planning of HES Data Management
Data transfer/import into the HES database
• Data transfer techniques:• Internet• Disks• Other
Planning of HES Data Management
Data transfer/import into the HES database
• Data transfer techniques:• Internet• Disks• Other
• User interface to import the data:• Web application• PC client application• Other (e.g. direct import from data files)
Planning of HES Data Management
Planning of HES Data Management
Data transfer/import into the HES database
• Data security:• Confidentiality
• Access control and auditing• Data encryption
Planning of HES Data Management
Data transfer/import into the HES database
• Data security:• Confidentiality
• Access control and auditing• Data encryption
• Integrity• Data check (always before import into database)
Planning of HES Data Management
Data transfer/import into the HES database
• Data security:• Confidentiality
• Access control and auditing• Data encryption
• Integrity• Data check (always before import into database)
• Availability• Back-up of the data• System recovery
Planning of HES Data Management
Data transfer/import into the HES database
• Data security:• Confidentiality
• Access control and auditing• Data encryption
• Integrity• Data check (always before import into database)
• Availability• Back-up of the data• System recovery
• Transfer via a secure data transfer system
Planning of HES Data Management
Data transfer/import into the HES database
• Data security:• Confidentiality
• Access control and auditing• Data encryption
• Integrity• Data check (always before import into database)
• Availability• Back-up of the data• System recovery
• Transfer via a secure data transfer system• Logging the data transfers
Planning of HES Data Management
National HES data management and EHES RC
Planning of HES Data Management