Third Group Training Course in Application of Information and Third Group Training Course in Application of Information and

Communications Technology to Production and Communications Technology to Production and

Dissemination of Official Statistics Dissemination of Official Statistics

(06(06thth May’07 – 12 Jul’07) May’07 – 12 Jul’07)

Compare Various Types of Interviewing & Data Compare Various Types of Interviewing & Data Capturing MethodsCapturing Methods

ByBy

Group - IIGroup - II

Ms. Rashmi Sharma, IndiaMs. Rashmi Sharma, India

Mst. Maksuda Shilpi, BangladeshMst. Maksuda Shilpi, Bangladesh

Ms. Aminath Shirmeen, MaldivesMs. Aminath Shirmeen, Maldives

Mr. Amadou Tidiane Diallo, SenegalMr. Amadou Tidiane Diallo, Senegal

Presentation OverviewPresentation Overview

Introduction Introduction - Amadou- Amadou

Project Activity PlanProject Activity Plan - Shiru- Shiru

QuestionnaireQuestionnaire - Shiru- Shiru

Software Used Software Used - Rashmi- Rashmi

Software Development Software Development - Rashmi- Rashmi

Data Collection Data Collection - Shilpi- Shilpi

Tabulation Tabulation - Shilpi- Shilpi

Data Analysis & Conclusions Data Analysis & Conclusions - Amadou- Amadou

References References - Amadou- Amadou

Data Dissemination Including web Data Dissemination Including web – Rashmi– Rashmi

Action Plan Action Plan - Shiru, Rashmi, Shilpi, Amadou- Shiru, Rashmi, Shilpi, Amadou

Q & A on project and A/PQ & A on project and A/P - All- All

IntroductionIntroduction

Target group is TIC participantsTarget group is TIC participants

Sample concerned with 54 individualsSample concerned with 54 individuals

Sample distribution:21 males and 33 Sample distribution:21 males and 33 females, drawn from all 5 regionsfemales, drawn from all 5 regions

Response rate is 96 %Response rate is 96 %

Project Activity Plan and the Project Activity Plan and the QuestionnaireQuestionnaire

ShiruShiru

Activity PlanActivity Plan Activity planActivity plan

– MeetingsMeetings

– Choosing the TopicChoosing the Topic

– Design questionnaireDesign questionnaire

– Develop Data entry programmeDevelop Data entry programme

– Data Collection and Data Entry Data Collection and Data Entry

– Data cleaning and AnalysisData cleaning and Analysis

– Finalize tablesFinalize tables

– Dissemination in different formatDissemination in different format

MeetingsMeetings We had total 7 meetings.We had total 7 meetings.

We held our meetings in TIC lobby and one We held our meetings in TIC lobby and one meeting during normal project class at SIAP.meeting during normal project class at SIAP.

We changed our survey topic 3 times.We changed our survey topic 3 times.

55thth meeting – We finalized survey topic. meeting – We finalized survey topic.

Meetings Meetings

Data CollectionData Collection

We used 4 methods of data We used 4 methods of data collection:collection:

– PAPI PAPI – CAPICAPI– CATICATI– Electronic Electronic – method using email– method using email

Factors considered during Factors considered during questionnaire designquestionnaire design

Flow of questionsFlow of questions

Multiple answersMultiple answers

Skip questionsSkip questions

QuestionnaireQuestionnaire

Design Questionnaire in excel Design Questionnaire in excel format.format.

Total no. of QuestionsTotal no. of Questions = 15= 15 No. of Multiple questionsNo. of Multiple questions = 3= 3 No. of Skip questionsNo. of Skip questions = 2= 2 Questionnaire Questionnaire

– PAPI and CATI PAPI and CATI (questionnaire1)(questionnaire1)

– Electronic Electronic (questionnaire2)(questionnaire2)

RashmiRashmi

Software DevelopmentSoftware Development

Software UsedSoftware Used

CSProCSPro STATA & SPSSSTATA & SPSS Microsoft AccessMicrosoft Access Microsoft ExcelMicrosoft Excel Microsoft WordMicrosoft Word Microsoft FrontPageMicrosoft FrontPage XerverXerver

Data Entry ApplicationData Entry Application

Data entry app s/w developed in :Data entry app s/w developed in :

CSPro, Access, ExcelCSPro, Access, Excel

Data file specificationData file specification– Number of Variables = 37Number of Variables = 37

- Numeric variables =35 - Numeric variables =35 – Alphanumeric variables = 2Alphanumeric variables = 2– Number of record type = 1Number of record type = 1

Created Date Entry ApplicationCreated Date Entry Application Created DictionaryCreated Dictionary: All items in CSPro : All items in CSPro

dictionarydictionary Created Identification : Identification, Id, 2Created Identification : Identification, Id, 2 Identify Records and variable, sub items : Identify Records and variable, sub items :

(Person)(Person) Identify variable label: Exact Question TextIdentify variable label: Exact Question Text Identify variable name: Q<question number>Identify variable name: Q<question number> Size of variable (according to question)Size of variable (according to question) Type of variable (according to question)Type of variable (according to question) Identify Values (according to question)Identify Values (according to question) Fix number of occurrences (according default)Fix number of occurrences (according default)

Click hereClick here

Data Dictionary

Value Set

CSPro Data Capture Screen

Logic

pop-up response

s box

CAPI Question

MS ExcelMS Excel

MacroMacro Recording Recording Data save in ASCII formData save in ASCII form Align the data according to CSPro Align the data according to CSPro

Data Dictionary format Data Dictionary format

MS ACCESS

Data Integration Data Integration

Concatenation (CSPro)

Input Data

Output Data

ACCESSCAPI

CSPro CATI

EXCELEMAIL

CSPro CAPI

CSPro PAPI

CSPro DATA File

Data IntegrationData Integration

Integration of the different data files Integration of the different data files formatformat

The integrated file is handed over to The integrated file is handed over to all group membersall group members

Data Collection and TabulationData Collection and Tabulation

Mst. Maksuda ShilpiMst. Maksuda Shilpi

Methods and Name of CollectorMethods and Name of Collector

1.1. PAPI Methods by ShilpiPAPI Methods by Shilpi

2.2. CAPI Methods by RashmiCAPI Methods by Rashmi

3.3. CATI Methods by AmadouCATI Methods by Amadou

4.4. Electronic Methods by ShiruElectronic Methods by Shiru

Methods and Number of CasesMethods and Number of Cases

1.1. 10 Cases by PAPI Methods10 Cases by PAPI Methods

2.2. 8 Cases by Electronic Methods8 Cases by Electronic Methods

3.3. 19 Cases by CAPI Methods 19 Cases by CAPI Methods

4.4. 17 Cases by CATI Methods17 Cases by CATI Methods

5.5. 2 Non-responses in Electronic 2 Non-responses in Electronic Methods Methods

Data IntegrationData Integration

Using CSPro data entry application all Using CSPro data entry application all these files are concatenated.these files are concatenated.

TabulationTabulation

We made tabulation by CSPro We made tabulation by CSPro Tabulation Application.Tabulation Application.

No. of Table=9No. of Table=9 No. of Frequency Table=5No. of Frequency Table=5 No. of Cross Table=4 No. of Cross Table=4

Demonstration of tabulation applicationDemonstration of tabulation application

Table 1: Percentage Distribution of Method UsedTable 1: Percentage Distribution of Method Used

Method UsedMethod Used PercentPercent

PAPIPAPI 1818

CAPICAPI 3535

CATICATI 3232

ElectronicElectronic 1515

% Total% Total 100100

Table 2: Percentage Distribution of Time to fill Table 2: Percentage Distribution of Time to fill QuestionnaireQuestionnaire

Time to fill Time to fill questionnairequestionnaire

PercentPercent

0 min- 5 min0 min- 5 min 5959

6 min- 11 min6 min- 11 min 3737

12 min- 17 min12 min- 17 min 22

18 min- 23 min18 min- 23 min --

>23 min>23 min 22

% Total% Total 100100

AmadouAmadou

Data Analysis & ConclusionsData Analysis & Conclusions

Analysis is done under STATA, SPSS Analysis is done under STATA, SPSS & Excel& Excel

Interpretation of ResultsInterpretation of Results

Survey findingsSurvey findings

Tables converted from CSPro into Tables converted from CSPro into SPSS and Stata SPSS and Stata

Converted data copied and pasted Converted data copied and pasted into Excel and data plotedinto Excel and data ploted

53.13 % of respondents completed the questionnaires 53.13 % of respondents completed the questionnaires through CAPI within 5 minutes through CAPI within 5 minutes

21.88 % completed the questionnaire by PAPI within the 21.88 % completed the questionnaire by PAPI within the same time interval. same time interval.

Figure 1: Distribution of time used to fill in the questionnaire per method used

21.88 15

53.13

10

9.38

65100

15.63 10

100

0

20

40

60

80

100

120

0 min - 5min 5 min - 11 min 11 min - 17 min > 23 min

Intervals of time

Pro

po

rtio

n o

f re

spo

nd

ents

(%

)

ELECTRONIC

CATI

CAPI

PAPI

15.63 % (third of CATI proportion) filled in 15.63 % (third of CATI proportion) filled in the questionnaires within the first time the questionnaires within the first time intervalinterval

The proportion goes further down with The proportion goes further down with

CATI (9.38 %).CATI (9.38 %).

15.63 % (third of CATI proportion) filled in 15.63 % (third of CATI proportion) filled in the questionnaire by Electronic within the the questionnaire by Electronic within the first time intervalfirst time interval

The proportion goes further down with The proportion goes further down with

CATI (9.38 %).CATI (9.38 %).

15.63 % (third of CATI proportion) filled in 15.63 % (third of CATI proportion) filled in the questionnaire by Electronic within the the questionnaire by Electronic within the first time intervalfirst time interval

The proportion goes further down with The proportion goes further down with

CATI (9.38 %).CATI (9.38 %).

Figure 2: Distribution of time used to fill in the questionnaire per first language

12.5

20

87.5

80

100

100

0 20 40 60 80 100 120

0 min - 5 min

5 min - 11 min

11 min - 17 min

> 23 min

Tim

e in

terv

al

Respondents (%)

English is not my firstlanguage

English is my firstlanguage

8 respondents in 10, whose first language is not English, 8 respondents in 10, whose first language is not English, completed the questionnaire between 5 and 11 minutescompleted the questionnaire between 5 and 11 minutes

2 in 10, whose first language is English, completed the 2 in 10, whose first language is English, completed the questionnaire within the same intervalquestionnaire within the same interval

Figure 4: Distribution of time used to fill in the questionnaire per sex

52.4

42.9

04.8

63.6

33.3

30

59.3

37

1.9 1.9

0

10

20

30

40

50

60

70

0 min - 5 min 5 min - 11 min 11 min - 17 min > 23 min

Time interval

Pro

po

rtio

n o

f re

sp

on

den

ts (

%)

Male

Female

Both Sexes

63.6 % of female respondents completed the questionnaire 63.6 % of female respondents completed the questionnaire within 5 minutes within 5 minutes

52.4 % of male respondents completed the questionnaire within 52.4 % of male respondents completed the questionnaire within the same time interval the same time interval

Descriptive statistics under StataDescriptive statistics under Statavariablevariable ObsObs MeanMean Std. Dev.Std. Dev. Min Min MaxMax

Method usedMethod used 5454 2.422.42 0.960.96 11 44

Region Region 5454 2.702.70 1.101.10 11 55

SexSex 5454 1.611.61 0.490.49 11 22

Age groupAge group 5454 1.891.89 0.690.69 11 44

EducationEducation 5454 2.672.67 0.800.80 11 55

First languageFirst language 5454 1.851.85 0.350.35 11 22

Fill a Fill a questionnaire questionnaire beforebefore

5454 1.171.17 0.380.38 11 22

Time usedTime used 5454 1.481.48 0.720.72 11 55

• Method used:Method used:Mean = 2.42; Standard deviation:0.96; Minimum value=1 and Mean = 2.42; Standard deviation:0.96; Minimum value=1 and Maximum value=4Maximum value=4

Regression analysis under STATARegression analysis under STATA

Source SS df MS Number of obs 54

        F( 7, 46) 1.66

Model 5.53425486 7 0.79060784 Prob > F 0.1436

Residual 21.9472266 46 0.47711362 R-squared 0.2014

        Adj R-squared 0.0799

Total 27.4814815 53 0.51851852 Root MSE 0.69073

About 20 % of the variation of Time used is explained by the modelAbout 20 % of the variation of Time used is explained by the model

Survey FindingsSurvey Findings

CAPI is more effective than PAPI, CATI or E-mail in CAPI is more effective than PAPI, CATI or E-mail in terms of timeterms of time

Women did better than men in filling in the Women did better than men in filling in the questionnairequestionnaire

Non-English speaking respondents did better than Non-English speaking respondents did better than English-speaking respondentsEnglish-speaking respondents

Familiarity with IT Tools is higher among Asian Familiarity with IT Tools is higher among Asian respondents than those from other regionsrespondents than those from other regions

Time to fill in the questionnaire is longer with Time to fill in the questionnaire is longer with non-English speaking respondents through CATInon-English speaking respondents through CATI

ReferencesReferences 1. Demographic and Health Surveys-Phase II 1. Demographic and Health Surveys-Phase II

(1990), Institute for Resource Development.(1990), Institute for Resource Development.

2. Designing Surveys, A Guide to Decisions and 2. Designing Surveys, A Guide to Decisions and Procedures (1995), Ronald Czaja and Johny Blair.Procedures (1995), Ronald Czaja and Johny Blair.

3. U.S. Bureau of the Census. (1992) 1990 Census 3. U.S. Bureau of the Census. (1992) 1990 Census of Population: General Population Characteristics—of Population: General Population Characteristics—North Carolina. Washington, DC: U.S. Government North Carolina. Washington, DC: U.S. Government Printing Office. (1990 CP-1-35).Printing Office. (1990 CP-1-35).

4. SIAP HANDOUTS, 20074. SIAP HANDOUTS, 2007

5. JICA-TIC Survey 2007 conducted by participants 5. JICA-TIC Survey 2007 conducted by participants of the Fifth Group Training Course in Modules on of the Fifth Group Training Course in Modules on Core Official StatisticsCore Official Statistics

Data DisseminationData Dissemination

CDCD

WebWeb

Hard CopyHard Copy