Surveying macrh 16 - UC Berkeley School of...
Transcript of Surveying macrh 16 - UC Berkeley School of...
![Page 1: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/1.jpg)
Surveys and Usability
I214 March 11, 2010
![Page 2: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/2.jpg)
What Info Can Be Collected via Surveys?Facts
Characteristics of respondentsDemographics, experience, employment...
Self-reported behaviorThis instanceGenerally/usuallyPastAnticipated (who will you vote for?)
Opinions and attitudes:Preferences, opinions, satisfaction, concerns, perceptionsTheir expectations of their future behavior
KnowledgeWhat do they they know about x, y, z
![Page 3: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/3.jpg)
Some sources of error
Sample, respondents
Question choice
Question wording
Question order
Method of administrationSurveyor, if administered person to person
Inferences from the data
Users’ interests in influencing results“vote and view the results”
![Page 4: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/4.jpg)
Response Rates
% of sample who actually participatelow rates may indicate bias in responses
Whom did you miss? Why?Who chose to cooperate? Why?
How much is enough? For statistically valid sample
Babbie: 50% is adequate; 70% is very good
Web surveys tend to be 3%, 5%....
![Page 5: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/5.jpg)
Increasing response rates
Good designShortEasy to answer immediatelyNOT an extra step Harder to say ‘no’ to a personExplanation/request
Explain purpose of studyDon’t underestimate altruism
Why you need themIncentives
Reporting back to respondents as a way of getting responseMoney; entry in a sweepstakes
Follow up on non-respondents (if you can)
![Page 6: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/6.jpg)
Ways of Administering Surveys (roughly in order of expected response rate)
In person
Phone
Paper, in person
Email (usually with a link)
Web
Mail.
![Page 7: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/7.jpg)
Active vs passiveActive: solicit respondents
Send out email (with questions, or link), letters, phoneUse sampling frame to develop a sample, I.e. list
Ideal:Keep track of who respondsFollow up on non-respondents if possible
Compare respondents/non-respondents looking for biasesPassive – “poll”
Popup box: “would you take a few minutes to help us…”Link on a site
![Page 8: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/8.jpg)
Passive: problems may include
Response rate probably unmeasurableMay be difficult to compare respondents to population as a wholeLikely to be biased (systematic error)
Frequent users probably over-representedBusy people probably under-representedDisgruntled and/or happy users probably over-represented
![Page 9: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/9.jpg)
What to look for in web survey software/site
# of questions you can ask
# of respondents
How long the survey will be available
Variety of question designs/formats, or at least the designs you need
Kind of data analysis they support
Reports they produce for you
Whether you can download data into Excel etc
How long the data will be available to you
Most have free/lowcost versions and premium
![Page 10: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/10.jpg)
Web survey problems
Loss of context – what exactly are you asking about, what are they responding to?
Are you reaching them at the appropriate point in their interaction with site etc?
Incomplete responses Multiple submissions
NOW (PBS) using cookies to prevent repeated votingResponse rate problems
Low rateHard to calculate
Is your sampling unit the user or the interaction?
![Page 11: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/11.jpg)
Questionnaire construction
ContentGoals of study: What do you need to know?
What can respondents tell you?
Conceptualization
Operationalization – e.g., how exactly do you define “household with access to internet”?
Question design
Question ordering
Short, short, short!
![Page 12: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/12.jpg)
Respondent characteristics include:Demographics:
age, sex, race…IncomeFamily/living circumstances
Living conditionsWhereUrban/suburban/ruralHouse, apartment…etc etc.
Experience, expertiseOccupation
Know how you’ll use the data. If you don’t need to know, don’t ask
![Page 13: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/13.jpg)
Respondent characteristics
Pew Burning Man Survey
What is your gender? M, F
What is your current gender?
![Page 14: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/14.jpg)
Use standard categories OR Match the user’s wording
Pew Burning Man
What is your race? White
Black or African-American
Asian or Pacific Islander
Mixed race
Native American/American Indian
Other (SPECIFY)
Don't know/Refused
Do you consider yourself to be a person of color?
Do you consider yourself to be white?
![Page 15: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/15.jpg)
Income: PewLast year, that is in 2009, what was your total family
income from all sources, before taxes. 1 Less than $10,0002 $10,000 to under $20,0003 $20,000 to under $30,0004 $30,000 to under $40,0005 $40,000 to under $50,0006 $50,000 to under $75,0007 $75,000 to under $100,0008 $100,000 or more9 Don't know/Refused
![Page 16: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/16.jpg)
![Page 17: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/17.jpg)
Respondent characteristics: specific
![Page 18: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/18.jpg)
![Page 19: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/19.jpg)
![Page 20: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/20.jpg)
![Page 21: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/21.jpg)
Internet experience 2
![Page 22: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/22.jpg)
Behavior, Activity
In general
Specific to this topic
Specific to this product
![Page 23: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/23.jpg)
BehaviorTasks (e.g., what did you do today?)
Site usage, activityFrequency; common functions – hard to answer accurately
Self-reports vs observations
Time:This event
Today
The last time you...
The last week
The last month
Generally...
![Page 24: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/24.jpg)
![Page 25: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/25.jpg)
![Page 26: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/26.jpg)
![Page 27: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/27.jpg)
![Page 28: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/28.jpg)
![Page 29: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/29.jpg)
![Page 30: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/30.jpg)
Pew: Activity (open-ended)
We'd be interested in hearing about the most amazing thing that has ever happened while you were online.
It could be a story about how something on the Web changed your life, something interesting you discovered on the Web, or something really important or even really amusing that happened during an exchange of email.
![Page 31: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/31.jpg)
Opinions, Evaluation
![Page 32: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/32.jpg)
Opinions, preferences, concerns about this product
About the site: Content, organization, architecture, interface
Ease of use
Perceived needs
Preferences
ConcernsE.g., security
Success, satisfactionSubdivided by part of site, task, purpose…
Other requirements
Suggestions
![Page 33: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/33.jpg)
PEW: Opinions1. Some people say they feel overloaded with information these days, considering all the TV news shows, magazines, newspapers, and computer information services. Others say they like having so much information to choose from.
How about you... do you feel overloaded, or do you like having so much information available?
Feel overloaded
Like having so much information available
2. Overall, do you think that computers and technology give...
people MORE control over their lives, LESS control over their lives, or don't you think it makes any difference?
More
Less
No difference
![Page 34: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/34.jpg)
![Page 35: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/35.jpg)
![Page 36: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/36.jpg)
Summary Evaluation – and asking for follow-up
![Page 37: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/37.jpg)
![Page 38: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/38.jpg)
![Page 39: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/39.jpg)
![Page 40: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/40.jpg)
Writing Questions: Guidelines
![Page 41: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/41.jpg)
Writing questions involves:Deciding on topics to be addressed
Ordering the topics
Writing a specific SET of questions
Deciding on the type of question, the format
Writing the ANSWERSExhaustive list
Unambiguous
Mutually exclusive (unless you ask “check all that apply”)
![Page 42: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/42.jpg)
Picky (but important) decisions
Only one answer per question?Force them to answer to be able to continue? (NO!)Allow neutral answer? (YES)Include “other” – open-ended (USUALLY)Do you need:
“don’t know”“not applicable”“no experience” or something like that
![Page 43: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/43.jpg)
Remember!
People skimPeople answer quickly
![Page 44: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/44.jpg)
Types of questions
http://www.surveymonkey.com/
![Page 45: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/45.jpg)
Bad survey questionsBarreling:
Bad: Is this site clear and useful?Good: Do you find the information on this site clearly presented? Is it useful to you?
Loose Bundling vs. Anchoring:Questions are too general and not grounded in specific behaviors.
Bad: How often do you use the internet?Good: For the following internet uses, please indicate how often…LIST: email, online shopping, online banking, reading blogs…etc etc
AssumptionsBad: How has blogging changed your life?Good: Do you blog? If yes, how well does this statement describe you? “Blogging has changed my life.”
![Page 46: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/46.jpg)
Writing questions – some guidelines
Unambiguous questions
Caution re “what would you do”
![Page 47: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/47.jpg)
Not too many items for ranking
![Page 48: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/48.jpg)
Not too many ratings (with neutral!)
No more than 7; preferably 5 or fewer
![Page 49: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/49.jpg)
Writing: Parallel questions
Is easy to use?
Provides information at the right level?
![Page 50: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/50.jpg)
White space: attractive, easier to read
![Page 51: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/51.jpg)
Design: attractive; white space
![Page 52: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/52.jpg)
Avoid convoluted instructions, questions, answers
People SKIM
How interesting would each of the following displays be to you?
* Historic displays with old-fashioned and famous police artifacts from the beginning of America, through the Wild West, to the mobster era and more recent times
* Modern displays where visitors go behind the badge and experience what it's like to walk in an officers shoes today, featuring the latest crime-fighting equipment and tactics
![Page 53: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/53.jpg)
(Another ex) Avoid convoluted instructions, questions, answers
![Page 54: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/54.jpg)
(Another ex) Avoid convoluted instructions, questions, answers
![Page 55: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/55.jpg)
Questions should be broadly applicable (or use a skip pattern)
![Page 56: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/56.jpg)
Recognition rather than recall
P
Please evaluate the topics covered in this workshop:
Topic 1: ____________How useful was this topic?How would you rate the presenter?What did we NOT cover that you were hoping to learn about?
Topic 2: _______________
![Page 57: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/57.jpg)
More guidelines
Edit! Use good English syntax.
Focused questions people can answer briefly.
![Page 58: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/58.jpg)
Reporting Survey Data
![Page 59: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/59.jpg)
Some principlesReader must know how many total respondents are represented, andmust be able to calculate from data provided any numbers they may be interested in
Reader must know which responses/respondents are included and which not
Reader needs exact wording, answer choices offered, since these affect precise answers
Don’t know/refused: with large #s, there are always some. Are they included in %ages?
Any table or graphic should still make sense separated from the report.
Readers don’t always read text; some just look at the “pictures”Tables and graphics get copied and re-used
![Page 60: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/60.jpg)
Questionnaire with the data filled in
% % % %
![Page 61: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/61.jpg)
Pew – networked workers
![Page 62: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/62.jpg)
Pew – networked workers
% % % %% %
![Page 63: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/63.jpg)
Types of Variables and Measures of Central Tendency
Type Examples Measures of Central Tendency
Nominal gender, race, college major
mode
Ordinal preferences, satisfaction, opinion; age or income in intervals
mode, median
Interval (arbitrary zero point )
Year (calendar date)temperature Celsius or Fahrenheit
mode, median, or mean
Ratio age, income, time mode, median, arithmetic mean
![Page 64: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/64.jpg)
Ratio or Nominal?
![Page 65: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/65.jpg)
Ratio or Nominal?
1 2 3 4
![Page 66: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/66.jpg)
Pew – Nominal variable
![Page 67: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/67.jpg)
Burning Man - nominal
![Page 68: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/68.jpg)
Ordinal Variable
![Page 69: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/69.jpg)
Ratio
![Page 70: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/70.jpg)
Tables
![Page 71: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/71.jpg)
![Page 72: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/72.jpg)
Questionnaire with the data filled in
![Page 73: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/73.jpg)
Tables
![Page 74: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/74.jpg)
Pew – cross tabs
Independent variableDependent variable
![Page 75: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/75.jpg)
Table Summarizing Key Findings
![Page 76: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/76.jpg)
Respondent characteristics
Pew Typology Quiz Burning Man Survey
What is your gender? M, F
What is your age? Fill in
Where do you live? Drop down
What is your educational background?
drop down – from currently in middle school to grad degree
![Page 77: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/77.jpg)
Burning Man: Race
![Page 78: Surveying macrh 16 - UC Berkeley School of Informationcourses.ischool.berkeley.edu/i214/s10/slides/Surveying macrh 16.pdf · What to look for in web survey software/site `# of questions](https://reader034.fdocuments.us/reader034/viewer/2022050418/5f8e0cd99e51a817a17dab4f/html5/thumbnails/78.jpg)