Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) -...

13
Moving towards Web Data Collection in Household Surveys 2 – Quality Improvement Methods in Household Surveys Pertti Taskinen, Statistics Finland Laura Hulkko, Statistics Finland

Transcript of Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) -...

Page 1: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Moving towards Web Data Collection in

Household Surveys

2 – Quality Improvement Methods in Household Surveys

Pertti Taskinen, Statistics FinlandLaura Hulkko, Statistics Finland

Page 2: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Web is a strategic choice and a biginvestment

Statistics Finland has set a strategic goal:Web will be included as a data collection method in all household surveys in 2018.Considerable revisions of data collection processes,

strategies, questionnaires etc.New data collection management system is needed

Benefits: Better service for respondents, reduction of costs, new ways to fight the rising non-response rate

Page 3: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Fig. 1. Planned implementation schedule of mixed mode data collection in household surveys at Statistics Finland

5/2016ICT-S

1/2017AES

9/2017Leisure Survey

2018LFS

2018 or

2019SILC

2019CCS and Travel Survey

2020TUS

Page 4: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Fig. 2. Response rate of the Finnish LFS 1997-2015

0

10

20

30

40

50

60

70

80

90

100

1997 1999 2001 2003 2005 2007 2009 2011 2013 2015

Page 5: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Fig. 3. Share from net sample by reason of non-response, LFS 2015, all waves

0

2

4

6

8

10

12

14

16

18

Refused, nospecific reason

Refused, somespecific reason

Unttained Other reason

Page 6: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Fig. 4. Number of CATI interviews by length of interview, LFS 2015, 1st Wave

0

2000

4000

6000

8000

10000

12000

less than 5mins

5-9 mins 10-14 mins 15-19 mins 20 min ormore

Page 7: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Fig. 5. Unemployment rate estimate and its 95 % confidence interval, LFS Web Pilot and CATI, October 2013

0123456789

10

WEB CATI

Page 8: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Final pilot for the mixed mode LFS

- Three rounds 2016-2017 (CAWI + CATI)- WEB option will be offered first

- Pilot is possible to go through without direct contact with an interviewer

- Questionnaire technically suitable for all devices- Text message and e-mail remainders- Advance letter (paper)

Page 9: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Advance letter text (upper part)

Welcome to take part in the Labour Force SurveyThe Labour Force Survey applies to all people, such as wage and salary earners, entrepreneurs, home-makers, unemployed, students, pupils and pensioners.The Labour Force Survey provides statistical data, for example, on employment and unemployment in Finland. Questions are asked about working hours, job seeking, duration of unemployment, participation in training and work done last.

Two ways to respond to the Labour Force SurveyResponding by web questionnaireThe responding time is between xx. - xx.xx. For the information security log in to the form with your bank identifiers.Write on the browser line www.stat.fi/keruu/tyve/lomake

Responding by telephoneIf you cannot or do not want to reply online, our interviewer will contact you after the online responding time.

Page 10: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

LFS Leaflet

Page 11: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct
Page 12: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Challenges of mixing modes (LFS)

- Questionnaire (two “sides” – CAWI and CATI)- Cognitive and field tests needed

- Comparability issues (mode effect)- E.g. unemployment; willingness to take a job

- Technical platform- Data collection sequence problem

(concurrent/sequential design?)- Response rate- Dissemination

Page 13: Moving towards Web Data Collection in Household Surveys · - Three rounds 2016-2017 (CAWI + CATI) - WEB option will be offered first - Pilot is possible to go through without direct

Thank you!

[email protected]