Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be...

15
2/25/2013 1 Writing Good Survey Questions UCSD Student Affairs Assessment February 2013 My Nightmare Do you want access to Campus Labs Baseline and/or Compliance Assist? UCSD Student Research and Information

Transcript of Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be...

Page 1: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

1

Writing Good Survey Questions

UCSD Student Affairs Assessment

February 2013

My Nightmare

Do you want access to Campus Labs

Baseline and/or Compliance Assist?

UCSD Student Research and Information

Page 2: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

2

Intended Outcomes

As a result of this workshop, you will

Know the steps to writing good survey questions

Be able to identify characteristics of good

survey questions

Be able to recognize characteristics of good

response options

4 Steps to Good Survey Questions

1. Establish goals

2. Develop questions & responses

3. Pilot test questions

4. Re-evaluate each question

UCSD Student Research and Information

Page 3: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

3

1. Establish Goals

“If you don’t know where you are going, you might

end up somewhere else.”

~ Yogi Berra

2. Develop Questions: Wording Questions

Clear Objective Specific

UCSD Student Research and Information

Page 4: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

4

To what extent did your facilitator address your

workshop concerns and questions?

2. Develop Questions: Wording Questions

Be Clear – Avoid double barred questions

To what extent did your facilitator address your

workshop concerns?

To what extent did your facilitator address your

workshop questions?

The in-class activities facilitated active learning.

2. Develop Questions: Wording Questions

Be Clear – Avoid abstract terms or jargon

The in-class activities (e.g., concept mapping,

eye-witness testimony activity) helped keep me

engaged in class.

UCSD Student Research and Information

Page 5: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

5

Tutoring services has been shown to improve

college GPA. Do you plan to use the new XYZ

tutoring program this quarter?

2. Develop Questions: Wording Questions

Be Objective - Avoid leading questions

Do you plan to use the new XYZ tutoring program

this quarter?

Did you vote in the last election?

2. Develop Questions: Wording Questions

Be Specific

Did you vote in the November 2012

presidential election?

UCSD Student Research and Information

Page 6: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

6

In an average week, how many times do you

go to the Main Gym?

• 1-2

• 2-3

• 4-5

• 6 or more times a week

2. Develop Questions: Wording Responses

Exhaustive and Mutually Exclusive

In an average week, how many times do you

go to the Main Gym?

• 0

• 1-2

• 3-4

• 5-6

• 7 or more times a week

2. Develop Questions: Wording Responses

Exhaustive and Mutually Exclusive

UCSD Student Research and Information

Page 7: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

7

Why did you choose to study at Fox Paw U?

(Choose all that apply.)

• Close to home

• Geographic location

• Academic reputation

• Program/major of interest

• Academic ranking

• Close to family & friends

2. Develop Questions: Wording Responses

Exhaustive and Mutually Exclusive

Why did you choose to study at Fox Paw U?

(Choose all that apply.)

• Geographic location

• Academic reputation

• Program/major of interest

• Other ____________

2. Develop Questions: Wording Responses

Exhaustive and Mutually Exclusive

UCSD Student Research and Information

Page 8: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

8

Overall, how satisfied were you with the

consulting service you received from the

Assessment Office?

• Very Satisfied

• Satisfied

• Somewhat Satisfied

• Dissatisfied

2. Develop Questions: Wording Responses

Balanced Scales

Overall, how satisfied or dissatisfied were

you with the consulting service you received

from the Assessment Office?

• Very Satisfied

• Satisfied

• Neither Satisfied or Dissatisfied

• Dissatisfied

• Very Dissatisfied

2. Develop Questions: Wording Responses

Balanced Scales

UCSD Student Research and Information

Page 9: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

9

I am confident in my ability to function on a

multi-disciplinary team.

• Strongly Agree

• Agree

• Unsure

• Disagree

• Strongly Disagree

2. Develop Questions: Wording Responses

“No Opinion” or “Unsure” answer choices

I am confident in my ability to function on a

multi-disciplinary team.

• Strongly Agree

• Agree

• Disagree

• Strongly Disagree

• Unsure

2. Develop Questions: Wording Responses

“No Opinion” or “Unsure”

UCSD Student Research and Information

Page 10: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

10

I would recommend this seminar to others.

• Outstanding

• Above Average

• Average

• Below Average

2. Develop Questions

Match the question and response

I would recommend this seminar to others.

• Strongly Agree

• Agree

• Disagree

• Strongly Disagree

2. Develop Questions

Match the question and response

UCSD Student Research and Information

Page 11: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

11

Rate today’s seminar.

• Above Average

• Average

• Below Average

2. Develop Questions

Match the question and response

2. Develop Questions

Open-ended questions allow the respondents to

write their own answers

What was the most important thing you learned in

the internship?

UCSD Student Research and Information

Page 12: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

12

Your Turn

How can the survey questions be improved?

Read and evaluate the survey questions

With a partner, revise the survey questions

Be prepared to share

3. Pilot test

Read aloud

Think aloud

Watch & get feedback

UCSD Student Research and Information

Page 13: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

13

Your Turn

Find some partners

Use one of the three pilot testing technique to pilot

test your survey questions.

4. Re-evaluate Each Question

How does it address your goals?

How will the response help answer your question?

Can I get this information somewhere else?

UCSD Student Research and Information

Page 14: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

14

My Epiphany

Do you want access to Campus Labs Baseline

and/or Compliance Assist?

1) Do you want access to Campus Labs Baseline

(our surveying tool)? Y/N

2) Do you want access to Compliance Assist (our assessment reporting tool)? Y/N

Parting Thoughts

Decide what you want to learn

Use today’s handouts to construct questions and

responses

Pilot test, revise, and repeat

If in doubt, cut it out

UCSD Student Research and Information

Page 15: Writing Good Survey Questions · 2/21/2013  · Know the steps to writing good survey questions Be able to identify characteristics of good survey questions Be able to recognize characteristics

2/25/2013

15

Questions?

Marlene P. Lowe

534-4872

[email protected]

UCSD Student Research and Information