An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data...
Transcript of An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data...
![Page 1: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/1.jpg)
1
An Empirical Analysis of
Data Deletion and Opt-Out Choices
on 150 Websites
Hana Habib, Yixin Zou, Aditi Jannu, Chelse Swoopes,
Alessandro Acquisti, Lorrie Cranor, Norman Sadeh,
Florian Schaub
![Page 2: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/2.jpg)
2
Privacy Choices Are Mandated
European
Union
The United
States
![Page 3: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/3.jpg)
3
Examples of Privacy Choices
![Page 4: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/4.jpg)
4
User Attitudes and Behaviors
said it’s “very important” to them to control
what information is collected about them. 65%
86% had taken steps to remove or mask their
digital footprints.
Pew Research Center. 2016. The State of Privacy in Post-Snowden America.
![Page 5: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/5.jpg)
5
Usability Issues of Privacy Choices
Large-scale
measurement studies
Small-scale
user studies
• Cranor et al., TWEB ’16
• Libert, WWW ’18
• Degeling et al., NDSS ’19
• Zimmeck et al., PETS ’19
• Komanduri et al., ISJLP ’11
• Leon et al., CHI ’12
• Ur et al., SOUPS ’12
Our Study
![Page 6: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/6.jpg)
6
Our Study…
A manual, in-depth content analysis of
privacy choices on 150 websites.
Opt-outs for email
communications
Opt-outs for
targeted ads
Choices for
data deletion
![Page 7: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/7.jpg)
7
What choices related to email
communications, targeted advertising,
and data deletion do websites offer?
How are websites presenting these privacy
choices to their visitors, and what are the
potential usability issues?
1.
2.
Research Questions
![Page 8: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/8.jpg)
8
Analysis Procedure
1. Visit home page 2. Create a user account
![Page 9: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/9.jpg)
9
Analysis Procedure
3. Visit privacy policy 4. Visit account settings
![Page 10: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/10.jpg)
10
Analysis Template
LocationPrivacy Policy? Account Settings? Other places?
Level of detailSpecific types of communications that can be opted out?
Link availabilityOne or multiple links? Broken or not?
Interaction pathClicks? Form fields? Other user actions required?
![Page 11: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/11.jpg)
11
Sampling Strategy
150 English-language websites sampled from Alexa’s
global top 10,000 sites (Mar. 2018).
Category Ranks
Top traffic (50) 1-200
Middle traffic (50) 201-5,000
Bottom traffic (50) >5,000
Amazon Alexa Top Sites: https://www.alexa.com/topsites
All sites were analyzed between Apr. and Oct. 2018
(κ = 0.82).
![Page 12: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/12.jpg)
12
Website LocationsUnknown
, 10%
Africa, 3%
Asia, 7%
Europe, 17%
Central America, 1%
US, 62%
Analysis only shows
the status quo for
US-based users.
![Page 13: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/13.jpg)
13
What did we find for
website privacy
choices?
![Page 14: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/14.jpg)
14
Findings of Website Privacy Choices
Presence
Description
Usability
![Page 15: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/15.jpg)
15
Findings of Website Privacy Choices
PresencePrivacy choices commonly
offered on all websites
across different traffic tiers.
![Page 16: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/16.jpg)
16
Privacy Choices Are Common
Other opt-outs:
• Web analytic
services (21)
• Third-party
sharing (17)
• Do-Not-Track (8)
• Cookies (5)
10085
111
1210
39
Emailcommunications
Targetedadvertising
Data deletion
Provide a choice DO NOT provide a choice
![Page 17: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/17.jpg)
17
Location of Privacy Choices
![Page 18: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/18.jpg)
18
Location of Privacy Choices
![Page 19: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/19.jpg)
19
Location of Privacy Choices
![Page 20: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/20.jpg)
20
Findings of Website Privacy Choices
Privacy choices text has
poor readability.Description
![Page 21: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/21.jpg)
21
Poor Readability in Text Description
Categories Mean
Email Communications 13.89
Targeted Advertising 13.72
Data Deletion 14.28
Privacy Policies Overall 10.20
Text requires university-
level reading abilities!
Flesch-Kincaid Grade Level (FGL) scores
![Page 22: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/22.jpg)
22
Findings of Website Privacy Choices
No dominant wording for
section headings.Description
![Page 23: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/23.jpg)
23
No Dominant Wording for Headings
N-Gram Email
Communications
Targeted
Advertising
Data Deletion
your choic* 11 9 10
opt out 13 7 2
third part* 0 14 2
your right* 9 2 20
“*” is a place holder for one or more letters that follow the beginning pattern.
![Page 24: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/24.jpg)
24
No Dominant Wording for Headings
N-Gram Email
Communications
Targeted
Advertising
Data Deletion
your choic* 11 9 10
opt out 13 7 2
third part* 0 14 2
your right* 9 2 20
“*” is a place holder for one or more letters that follow the beginning pattern.
![Page 25: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/25.jpg)
25
No Dominant Wording for Headings
N-Gram Email
Communications
Targeted
Advertising
Data Deletion
your choic* 11 9 10
opt out 13 7 2
third part* 0 14 2
your right* 9 2 20
“*” is a place holder for one or more letters that follow the beginning pattern.
![Page 26: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/26.jpg)
26
No Dominant Wording for Headings
N-Gram Email
Communications
Targeted
Advertising
Data Deletion
your choic* 11 9 10
opt out 13 7 2
third part* 0 14 2
your right* 9 2 20
“*” is a place holder for one or more letters that follow the beginning pattern.
![Page 27: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/27.jpg)
27
No Dominant Wording for Headings
N-Gram Email
Communications
Targeted
Advertising
Data Deletion
your choic* 11 9 10
opt out 13 7 2
third part* 0 14 2
your right* 9 2 20
No single n-gram occurred in >20 analyzed policies.
“*” is a place holder for one or more letters that follow the beginning pattern.
![Page 28: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/28.jpg)
28
Various Headings for Data Deletion
![Page 29: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/29.jpg)
29
Findings of Website Privacy Choices
DescriptionAmbiguity in what happens
after exercising the choice.
![Page 30: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/30.jpg)
30
Ambiguity in Targeted Ads Opt-outs
Among 80 sites that offered targeted ads opt-outs:
50%did not specify if it
works across multiple
browsers or devices.
did not specify if it also
applies to tracking.
90%
![Page 31: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/31.jpg)
31
Ambiguity in Data Deletion Choices
Among 108 sites that offered data deletion:
did not describe when the account
would be permanently deleted.83%
![Page 32: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/32.jpg)
32
Findings of Website Privacy Choices
UsabilityExercising privacy choices
requires many actions.
![Page 33: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/33.jpg)
33
Average Number of Actions
Actions we counted:
• Clicks
• Hovers
• Checkboxes
• Form fields
Average number for the
shortest path:
5.3for email opt-outs
and data deletion
choices.
3.2 for targeted ads
opt-outs.
![Page 34: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/34.jpg)
34
![Page 35: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/35.jpg)
35
Findings of Website Privacy Choices
UsabilityMultiple links leading to
different opt-out tools.
![Page 36: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/36.jpg)
36
1. Twitter implemented
2. DAA
3. NAI
4. Google
Links to Multiple Opt-outs
1. Twitter implemented
Account Settings “About Ads” page
Privacy Policy
1. Twitter implemented
2. DAA
![Page 37: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/37.jpg)
37
Findings of Website Privacy Choices
Usability Poor design choices.
![Page 38: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/38.jpg)
38
![Page 39: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/39.jpg)
39
How do we improve
website privacy
choices?
![Page 40: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/40.jpg)
40
Improving Website Privacy Choices
Planning
Translation
Physical action
Assessment
Determining what to do
Determining how to do it
Doing it
Determining outcomes
via feedback
Andre et al. The user action framework: A reliable foundation for usability engineering support tools. International
Journal of Human-Computer Studies, 54(1):107–136, 2001.
![Page 41: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/41.jpg)
41
Improving Website Privacy Choices
Planning
Translation
Physical action
Assessment
Standardize section
headings in privacy policies.
![Page 42: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/42.jpg)
42
Standardize Policy Section Headings
![Page 43: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/43.jpg)
43
Improving Website Privacy Choices
Planning
Translation
Physical action
Assessment
Simplify the process of
learning opt-outs.
![Page 44: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/44.jpg)
44
1. Twitter implemented
2. DAA
3. NAI
4. Google
1. Twitter implemented
1. Twitter implemented
2. DAA
Unify multiple choice mechanisms into a single interface.
Help users distinguish different opt-out tools.
![Page 45: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/45.jpg)
45
Improving Website Privacy Choices
Planning
Translation
Physical action
Assessment
Reduce number of actions
to exercise choices.
![Page 46: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/46.jpg)
46
Reduce Number of User ActionsAdd the option “delete
my account from all
NYT services.”
Convert this to a list of
checkboxes.
![Page 47: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/47.jpg)
47
Reduce Number of User Actions
![Page 48: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/48.jpg)
48
Regulation Needs to Combat Dark
Patterns
For alleged failure to…
• Provide notice in an accessible form.
• Obtain valid user consent to data processing for ad
personalization.
![Page 49: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/49.jpg)
49
Improving Website Privacy Choices
Planning
Translation
Physical action
Assessment Describe what privacy
choices achieve clearly.
![Page 50: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/50.jpg)
50
Describe What Privacy Choices Do
![Page 51: An Empirical Analysis of Data Deletion and Opt-Out Choices ... · 1 An Empirical Analysis of Data Deletion and Opt-Out Choices on 150 Websites Hana Habib, Yixin Zou, Aditi Jannu,](https://reader035.fdocuments.us/reader035/viewer/2022062604/5f7ce2a1478a422a1d4e4ed6/html5/thumbnails/51.jpg)
51
SummaryPrivacy choices are prevalent on websites.
Severe issues exist regarding their description
and usability.
Companies and regulators must ensure usability
of privacy choices.
Yixin [email protected] / @yixinzou1124
yixinzou.github.io