Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to...
-
Upload
annie-pettit-chief-research-officer -
Category
Data & Analytics
-
view
387 -
download
0
Transcript of Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to...
![Page 1: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/1.jpg)
Please tweet! @ESRAsurvey @LoveStats
Please tweet! @LoveStats #ESRAsurvey
Call Me Maybe: Effects of asking for telephone numbers on survey honesty
Presented by Annie PettitChief Research Officer at Peanut Labs
![Page 2: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/2.jpg)
Please tweet! @ESRAsurvey @LoveStats
Research Questions
Should you ask at the beginning or the end of the survey?
When To Ask
Will people endorse more socially desirable, charitable behaviours?
Will people endorse fewer illegal, unethical, and embarrassing behaviours?
Social Desirability Illegal BehavioursCBA
![Page 3: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/3.jpg)
Please tweet! @ESRAsurvey @LoveStats
MethodGroup 1•Beginning•Phone number request was first question•N=500
Group 2•End•Phone number request was last question•N=500
Non-probability, incentivized research panelSampled and weighted to US census targets
![Page 4: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/4.jpg)
Please tweet! @ESRAsurvey @LoveStats
Question Categories
Compliment employee
Bought someone
coffee
Kind Charitable
Pee in shower
Embarrassing
Called in sick
Unethical
Listen to music
Neutral
Impaired driving
Illegal
![Page 5: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/5.jpg)
Please tweet! @ESRAsurvey @LoveStats
RESULTSBEGINNING VS END
![Page 6: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/6.jpg)
Please tweet! @ESRAsurvey @LoveStats
Neutral% of People Endorsing Neutral Behaviours
![Page 7: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/7.jpg)
Please tweet! @ESRAsurvey @LoveStats
NeutralIt doesn’t matter if you were asked at the beginning or the end, endorsement rates for neutral behaviours were the same.
Average Endorsement
Standard Deviation
![Page 8: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/8.jpg)
Please tweet! @ESRAsurvey @LoveStats
CharitableEndorsement of charitable behaviours didn’t change if you were asked at the beginning or the end.
![Page 9: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/9.jpg)
Please tweet! @ESRAsurvey @LoveStats
Embarrassing Endorsement of embarrassing behaviours didn’t change if you were asked at the beginning or the end.
![Page 10: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/10.jpg)
Please tweet! @ESRAsurvey @LoveStats
IllegalThough there was more variability, endorsement of illegal behaviours didn’t change if you were asked at the beginning or the end.
![Page 11: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/11.jpg)
Please tweet! @ESRAsurvey @LoveStats
ormakes no Beginning
differenceend
CONC
LUSI
ON
![Page 12: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/12.jpg)
Please tweet! @ESRAsurvey @LoveStats
RESULTSAGREE VS DECLINE
![Page 13: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/13.jpg)
Please tweet! @ESRAsurvey @LoveStats
Method
Group 1•Yes, here’s my phone number•555-5555
Group 2•No! You can’t have my phone number•BUG-OFFF
![Page 14: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/14.jpg)
Please tweet! @ESRAsurvey @LoveStats
IllegalPeople who agree endorse more illegal behaviours
![Page 15: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/15.jpg)
Please tweet! @ESRAsurvey @LoveStats
EmbarrassingPeople who agree endorse more embarrassing behaviours
![Page 16: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/16.jpg)
Please tweet! @ESRAsurvey @LoveStats
CharitablePeople who agree endorse more charitable behaviours
![Page 17: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/17.jpg)
Please tweet! @ESRAsurvey @LoveStats
NeutralPeople who agree endorse more neutral behaviours
![Page 18: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/18.jpg)
Please tweet! @ESRAsurvey @LoveStats
ormakes aAgreeing
differencedisagreeing
CONC
LUSI
ON
![Page 19: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/19.jpg)
Please tweet! @ESRAsurvey @LoveStats
RESULTSINTERACTIONS
![Page 20: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/20.jpg)
Please tweet! @ESRAsurvey @LoveStats
MethodGroup 1
BeginningDecline
Group 2EndDecline
Group 3Beginning
Agree
Group 4End Agree
![Page 21: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/21.jpg)
Please tweet! @ESRAsurvey @LoveStats
Neutral QuestionsEndorsement Rates Not Affected
![Page 22: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/22.jpg)
Please tweet! @ESRAsurvey @LoveStats
Agreers Are Confessors
Illegal Unethical Embarrass Kind Charitable Neutral Average
![Page 23: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/23.jpg)
Please tweet! @ESRAsurvey @LoveStats
theandlisten
If
agreersbeginning
youwanthonestyaskattoCO
NCLU
SION
![Page 24: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/24.jpg)
Please tweet! @ESRAsurvey @LoveStats
Many new questions• Type of PII: What if we asked for email or physical address instead?
• Position of Ask: What if we ask half-way through? After an embarrassing question?
• Survey Style: What if the entire survey is embarrassing?
• Screen Outs: What if everyone was told there would be no screen-outs?
![Page 25: Creating Honesty: The effect of requesting telephone numbers and reporting on self or others to identify honest responders](https://reader031.fdocuments.us/reader031/viewer/2022020410/58ee65341a28abcf578b458b/html5/thumbnails/25.jpg)
Please tweet! @ESRAsurvey @LoveStats
Thank you!Annie Pettit
Chief Research [email protected]
ca.linkedin.com/in/AnniePettit/facebook.com/AnniePettit
twitter.com/LoveStats
Jonathan CheriffDirector of Sales & [email protected]
Find PeanutLabs on LinkedIn Facebook Twitter YouTube
DIY SURVEY PROGRAMMING DIY POLLINGDIY SAMPLE