Writing a Good Survey

1Module 2, Unit 4, Session 7

It is only after you know who you are going to

interview and the preliminary objectives for your survey that you should begin to write survey questions.

2Module 2, Unit 4, Session 7

Survey Design Guidelines…. See Reader

• Length• Types of questions/variables• Bias• Closed vs. open-ended questions • Use existing questions• Use language that is appropriate • Order of questions• Use transitions between sections • If you need to translate, make sure that the

translations are accurate. • Pre-test

3Module 2, Unit 4, Session 7

1 TOP TIPS

“Complete each interview in about 30 minutes or less”.

4Module 2, Unit 4, Session 7

BiasBias means to give a prejudiced view, or to influence unfairly.

5Module 2, Unit 4, Session 7

“Do you think that a law should be passed to protect the nearly extinct DikDik?”

“Do you agree that campus parking is a problem and that the administration should be working diligently on a solution?”

Exercise in Survey Pro

Find the bias!

Open surveyExport questions into wordCorrect for bias using track changesMake corrections in Survey Pro file

6Module 2, Unit 4, Session 7

Module 2, Unit 4, Sub-Unit 1.1 7

…I am working with the Marine Wildlife Protection Society

…survey of people in this area about the natural environment

What is the best way to position yourself and the interview?

Module 2, Unit 4, Sub-Unit 1.1 8

(1) Which of the following statements best describes you

- You are a fisher that fished at least 1 time in the past month in the Lola Marine Sanctuary using dynamite and other illegal gear

- You are a fisher that fished at least 1 time in the past month in the Lola Marine Sanctuary,

Module 2, Unit 4, Sub-Unit 1.1 9

(10)People hear information about the environment from many different sources. I am going to read you a list of sources from which you might hear information about the environment, and I would like you to tell me whether you think this is a trustworthy source of information.

…I would like you to tell me whether you would find that source "Most trustworthy, Very trustworthy, Somewhat trustworthy, or Not trustworthy.

Module 2, Unit 4, Sub-Unit 1.1 10

(17)I am going to read you a list of 6 statement about breaking the regulations of the Lola Marine Sanctuary. I would like you to listen to all 6 statements, then tell me which one statement best represents you:

I am going to read you a list of 6 statement about following regulations of the Lola Marine Sanctuary.

Module 2, Unit 4, Sub-Unit 1.1 11

(19) Please state below whether you believe each regulation is either true or false as a Lola Marine Sanctuary Rules/Policies:  (A) You agree that only members of the Lola Marine Sanctuary Management Committee can harvest fish inside the Lola Marine Sanctuary[ ] True [ ] False [ ] Unsure

(A) Only members of the Lola Marine Sanctuary Management Committee can harvest fish inside the Lola Marine Sanctuary[ ] True [ ] False [ ] Unsure

 

Module 2, Unit 4, Sub-Unit 1.1 12

(24) Is the size of the Lola Marine Sanctuary too small?[ ] Too Big [ ] Too Small [ ] Just the right size [ ] Unsure [ ] N/A

(24) What do you think of the size of the Lola Marine Sanctuary?[ ] Too Big [ ] Too Small [ ] Just the right size [ ] Unsure [ ] N/A

Module 2, Unit 4, Sub-Unit 1.1 13

(33) Have you ever talked to anyone about "the consequences of breaking the Lola Marine Sanctuary rules & regulations"? If you have, please tell me all of the people with whom you have talked to about this.

(33) In the past 6 months, have you talked to anyone about "the consequences of breaking the Lola Marine Sanctuary rules & regulations"? If you have, please tell me all of the people with whom you have talked to about this.

Module 2, Unit 4, Sub-Unit 1.1 14

(36) Have you done any fishing in the Lola Marine Sanctuary at any time in the past 6 months?[ ] Yes [ ] No

(36) Have you seen anyone fishing in the Lola Marine Sanctuary at any time in the past 6 months?[ ] Yes [ ] No

Module 2, Unit 4, Sub-Unit 1.1 15

(40)In the past 12 months, have you attended the reef assessment of the Lola Marine Sanctuary and also have you attended the village fiesta in honor of the MPA? If so, about how many times in those 12 months did you attend?

In the past 12 months, have you attended the reef assessment of the Lola Marine Sanctuary? If so, about how many times in those 12 months did you attend?

Module 2, Unit 4, Sub-Unit 1.1 16

(48)I am going to ask you about a number of ways in which you may or may not have seen or heard about our conservation movement.

I am going to ask you about a number of ways in which you may or may not have seen or heard about the Lola Marine Sanctuary.

3

2 TOP TIPS

“The categories should also be “exhaustive;” that is, there is no other possible response that a respondent wants to give but cannot”.

17Module 2, Unit 4, Session 7

“Be sure that your questions directly relate to what it is you are studying, especially for those questions intended to measure SMART objectives”.

5

4 TOP TIPS

“Be very aware of the fact that people in your target communities may not have the same vocabulary as you”.

18Module 2, Unit 4, Session 7

“If you want to force people to choose from a short list of possible responses, use the closed-ended format”.

6 TOP TIPS

“If there are some questions that you feel might be sensitive you should put these at the end of the survey so that respondents don’t get upset at the beginning”.

19

7

TOP TIPS

Have one person do the first translation from the language the survey was drafted in into the second language. Then, have a different person translate the survey back into the original language (back translation).

20Module 2, Unit 4, Session 7

“Administer the survey to a small number of respondents (five is usually enough) similar to your target population to make sure that categories are clear and complete”.

Session 5Introduction to Survey Pro 3.0

Session Objectives

By the end of this session, campaign managers should be able to:

Module 2, Unit 5, Session 5

•Install SurveyPro and create a new file for their campaign questionnaire

•Apply basic skills in SurveyPro to create and export a survey

•Create 4 different types of questions in SurveyPro

Exercise in Survey Pro

4 different types of questions :1. Multiple options, single answer2. Multiple options, multiple answer3. Open ended question, one typed

answer4. Grid of questions and answers

24Module 2, Unit 4, Session 7

Session 5Introduction to SurveyPro 3.0

Module 2, Unit 4, Sub-Unit 1.1 26

(1) Which of the following statements best describes you [CHOOSE ONE ONLY]: - You are a fisher that fished at least 1 time in the past month near the Lola Marine Sanctuary, - You are a fisher that fished at least 1 time in the past month in the Lola Marine Sanctuary, - You are a gleaner that gleaned at least 1 time in the past month near the Lola Marine Sanctuary, - You are a gleaner that gleaner at least 1 time in the past month in the Lola Marine Sanctuary,  [ ] Fisher near Lola Marine Sanctuary [ ] Fisher in Lola Marine Sanctuary [ ] Gleaner near Lola Marine Sanctuary [ ] Gleaner in Lola Marine Sanctuary[ ] None of the Above

Multiple options - single answer

Module 2, Unit 4, Sub-Unit 1.1 27

(A) Which TV stations do you watch most of the time? Please tell me up to 3 TV stations that you like to watch. [ ] ABS-CBN [ ] Channel 5 [ ] Channel 9 [ ] VIVA

[ ] Channel 2 [ ] No favorite[ ] Don't know[ ] Don't watch [ ] Other

________________

Multiple options - multiple answer

Module 2, Unit 4, Sub-Unit 1.1 28

(N)What other types of media programs do you like to watch, listen to, or read about?

________________

Open ended question, one typed answer

Module 2, Unit 4, Sub-Unit 1.1 29

(21) Please state below whether you agree or disagree with the following statements on the possible impacts on the local community if the Lola Marine Sanctuary Rules/Policies are not strictly observed by fishers:  (A) Fish will be scared out of the sanctuary and into the fishing nets[ ] Strongly Agree [ ] Agree [ ] Disagree [ ] Strongly Disagree (B) Fish species will continue to decline in number or disappear[ ] Strongly Agree [ ] Agree [ ] Disagree [ ] Strongly Disagree (C) Illegal fishers from outside will be encouraged to come in and blast fish within the Lola Marine Sanctuary[ ] Strongly Agree [ ] Agree [ ] Disagree [ ] Strongly Disagree 

Grid of questions

Module 2, Unit 4, Sub-Unit 1.1 30

How to load responses into Survey Pro

Working with a Survey Template …. See Lola

Survey Modules

• Introduction• Module 1: Information filled in prior to

interview• Module 2: Socioeconomic and demographic

questions• Module 3: Trusted sources of Information and

Media Access/Exposure• Module 4: Assign respondents to the

appropriate Stage of Change for each of your behavioral objectives

31Module 2, Unit 4, Session 7

Module 2, Unit 4, Sub-Unit 1.1 32

• Module 5: Knowledge questions to measure your K objectives

• Module 6: Attitude questions to measure your attitude objectives

• Module 7: Interpersonal Communication questions to measure your IC objective

• Module 8: Behavior questions to measure your behavior change objectives

• Module 9: Understanding barriers to and benefits of behavior change

• Module 10: Exposure to Campaign Activities and Messages