Ballot design best practices
Dana Chisnell
@danachis @ChadButterfly
Democracy is a design problem
HAVA did not cure this problem
Poor ballot design
• frustrates voters
• undermines confidence
• contributes to Election Day problems
Classic problems
splitting contests into different columns
placing different contests on the same screen
placing response options on both sides of names
using arrows rather than bubbles on paper ballots
leaving in disqualified candidates
Better Ballots: Re-designed Ballot, Kewaunee County
Keep contests in same column
Better Ballots: Sarasota County, FL (2006)
Better Ballots: Sarasota County, FL (2006)
Better Ballots: Sarasota County, FL (2006)
Classic problems
inconsistency in format and style
not using shading, bold text
not writing short, simple instructions
placing instructions too far away
not telling voters how to correct paper ballots
Multiple modesStraight party
Vote for 1
Vote for n
RCV
Retention questions
Measures
Top 10 design principles
Use lowercase letters
Avoid centered text
Pick one sans-serif font
Use big enough type
Support process and navigation
Use clear, simple language
Use accurate instructional illustrations
Use informational icons (only)
Use contrast and color functionally
Decide what’s most important
Cedar County: May 2006 for ES&S optical scanners
Cedar County: November 2006 for
ES&S optical scanners
King County: November 2004 for Premier optical scanners
King County: November 2008 for Premier optical scanners
Shawnee County: November 2004 for Premier optical scanners
Shawnee County: November 2008 for Premier optical scanners
No testing = lost votesKing Co. 2009 undervotes were disproportionate to other counties
resulted in legislation about ballot design
Ensuring franchiseMinnesota SoS tests vote-by-mail after 2008 senate recounts
Before
Ensuring franchiseMinnesota SoS tests vote-by-mail after 2008 senate recounts
After
DEMONSTRATION BALLOTSAMPLE BALLOT FOR THE GENERAL ELECTION - City of New York - County of Kings - November 2, 2010
1. BEFORE VOTING THIS BALLOT, PLEASE READ THE INSTRUCTIONS ON THE OTHER SIDE OF THIS BALLOT.
1. ANTES DE EMITIR SU VOTO CON ESTA PAPELETA, SÍRVASE LEER LAS INSTRUCCIONES EN EL DORSO DE ESTA PAPELETA.
2. BALLOT PROPOSALS ARE LOCATED ON THE OTHE SIDE OF THIS BALLOT.
2. LAS PROPUESTAS DE PAPELETA APARECEN EN EL DORO DE ESTA PAPELETA.
MARKING
INSTRUCTIONS:
INSTRUCCIONES
DE MARCADO:
Correct Mark:
Marca Correcta:
[Insert Chinese Translation]
[Insert Korean Translation]
Electors for
Governor and
Lieutenant
Governor
[Spanish]
[Chinese]
[Korean]
Vote Once
Vote una vez
[Chinese]
[Korean]
Comptroller
[Spanish]
[Chinese]
[Korean]Vote Once
Vote una vez
[Chinese]
[Korean]
Attorney General
[Spanish]
[Chinese]
[Korean]Vote Once
Vote una vez
[Chinese]
[Korean]
United States
Senator
[Spanish]
[Chinese]
[Korean]Vote Once
Vote una vez
[Chinese]
[Korean]
United States
Senator
[Spanish]
[Chinese]
[Korean]Vote Once
Vote una vez
[Chinese]
[Korean]
Supreme Court
Justice
[Spanish]
[Chinese]
[Korean]Vote for any FIVE
[Spanish]
[Chinese]
[Korean]
Representative in
Congress
[Spanish]
[Chinese]
[Korean]Vote Once
Vote una vez
[Chinese]
[Korean]
State
Senator
[Spanish]
[Chinese]
[Korean]Vote Once
Vote una vez
[Chinese]
[Korean]
Member of
Assembly
[Spanish]
[Chinese]
[Korean]Vote Once
Vote una vez
[Chinese]
[Korean]
1
2
3
4
5
6
7
8
9
10
11
12
13
1A 1B 1C 1D 1E 1F 1G 1H
1K 1J 1I
2A 2B 2C 2D 2E 2F 2G
3G3F3E3D3C3B3A
4I4K 4J
4G4F4E4D4C4B4A
5A 5B 5C 5D 5E 5F 5G
6E6D6C6B6A
7A 7B 7C 7D 7E
8E8D8C8B8A
9E9D9C9B9A
10D10C10B10A
13D13C13B13A
12C12B12A
11C11B11A
4H
WRITE-IN
CANDIDATO POR
ESCRITO
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
WRITE-IN
A B C D E F G H
K J I
A B C D E F G
A B C D E F G
A B C D E F G H
K J I
A B C D E F G
EDCBA
A B C
CBA
DCBA
Democratic[Chinese]
[Korean]
Democratic[Chinese]
[Korean]
Democratic[Chinese]
[Korean]
Democratic[Chinese]
[Korean]
Democratic[Chinese]
[Korean]
Democratic[Chinese]
[Korean]
Democratic[Chinese]
[Korean]
Democratic[Chinese]
[Korean]
Democratic[Chinese]
[Korean]
Republican[Chinese]
[Korean]
Independence[Chinese]
[Korean]
Conservative[Chinese]
[Korean]
Working Families[Chinese]
[Korean]
Green[Chinese]
[Korean]
Rent is 2 DamnHigh
[Chinese]
[Korean]
Libertarian[Chinese]
[Korean]
Taxpayers[Chinese]
[Korean]
Freedom[Chinese]
[Korean]
Anti-Prohibition[Chinese]
[Korean]
Republican[Chinese]
[Korean]
Independence[Chinese]
[Korean]
Conservative[Chinese]
[Korean]
Working Families[Chinese]
[Korean]
Green[Chinese]
[Korean]
Libertarian[Chinese]
[Korean]
Republican[Chinese]
[Korean]
Independence[Chinese]
[Korean]
Conservative[Chinese]
[Korean]
Working Families[Chinese]
[Korean]
Libertarian[Chinese]
[Korean]
Freedom[Chinese]
[Korean]
Republican[Chinese]
[Korean]
Independence[Chinese]
[Korean]
Conservative[Chinese]
[Korean]
Working Families[Chinese]
[Korean]
Green[Chinese]
[Korean]
Rent is 2 DamnHigh
[Chinese]
[Korean]
Libertarian[Chinese]
[Korean]
Tax Revolt[Chinese]
[Korean]
Taxpayers[Chinese]
[Korean]
Anti-Prohibition[Chinese]
[Korean]
Republican[Chinese]
[Korean]
Independence[Chinese]
[Korean]
Conservative[Chinese]
[Korean]
Working Families[Chinese]
[Korean]
Green[Chinese]
[Korean]
Libertarian[Chinese]
[Korean]
Republican[Chinese]
[Korean]
Independence[Chinese]
[Korean]
Conservative[Chinese]
[Korean]
Working Families[Chinese]
[Korean]
Conservative[Chinese]
[Korean]
Working Families[Chinese]
[Korean]
Republican[Chinese]
[Korean]
Working Families[Chinese]
[Korean]
Republican[Chinese]
[Korean]
Conservative[Chinese]
[Korean]
Working Families[Chinese]
[Korean]
HAnti-Prohibition
[Chinese]
[Korean]
5H
HarryWilson[Chinese]
[Chinese]
[Korean]
[Korean]
Andrew M.Cuomo[Chinese]
[Chinese]
[Korean]
[Korean]
Carl P.Paladino
[Chinese]
[Chinese]
[Korean]
[Korean]
Andrew M.Cuomo[Chinese]
[Chinese]
[Korean]
[Korean]
Carl P.Paladino
[Chinese]
[Chinese]
[Korean]
[Korean]
Andrew M.Cuomo[Chinese]
[Chinese]
[Korean]
[Korean]
HowieHawkins
[Chinese]
[Chinese]
[Korean]
[Korean]
JimmyMcMillan
[Chinese]
[Chinese]
[Korean]
[Korean]
WarrenRedlich[Chinese]
[Chinese]
[Korean]
[Korean]
Carl P.Paladino
[Chinese]
[Chinese]
[Korean]
[Korean]
CharlesBarron[Chinese]
[Chinese]
[Korean]
[Korean]
Kristin M.Davis
[Chinese]
[Chinese]
[Korean]
[Korean]
Thomas P.DiNapoli
[Chinese]
[Chinese]
[Korean]
[Korean]
HarryWilson[Chinese]
[Chinese]
[Korean]
[Korean]
HarryWilson[Chinese]
[Chinese]
[Korean]
[Korean]
Thomas P.DiNapoli
[Chinese]
[Chinese]
[Korean]
[Korean]
Julia A.Willebrand
[Chinese]
[Chinese]
[Korean]
[Korean]
JohnGaetani[Chinese]
[Chinese]
[Korean]
[Korean]
Eric T.Schneiderman
[Chinese]
[Chinese]
[Korean]
[Korean]
BruceBlakeman
[Chinese]
[Chinese]
[Korean]
[Korean]
Eric T.Schneiderman
[Chinese]
[Chinese]
[Korean]
[Korean]
DanDonovan
[Chinese]
[Chinese]
[Korean]
[Korean]
Eric T.Schneiderman
[Chinese]
[Chinese]
[Korean]
[Korean]
Carl E.Person[Chinese]
[Chinese]
[Korean]
[Korean]
Ramon J.Jimenez
[Chinese]
[Chinese]
[Korean]
[Korean]
Kristen E.Gillibrand
[Chinese]
[Chinese]
[Korean]
[Korean]
Joseph J.DioGuardi
[Chinese]
[Chinese]
[Korean]
[Korean]
Kristen E.Gillibrand
[Chinese]
[Chinese]
[Korean]
[Korean]
Joseph J.DioGuardi
[Chinese]
[Chinese]
[Korean]
[Korean]
Kristen E.Gillibrand
[Chinese]
[Chinese]
[Korean]
[Korean]
Cecile A.Lawrence
[Chinese]
[Chinese]
[Korean]
[Korean]
JosephHuff
[Chinese]
[Chinese]
[Korean]
[Korean]
JohnClifton[Chinese]
[Chinese]
[Korean]
[Korean]
DanDonovan
[Chinese]
[Chinese]
[Korean]
[Korean]
Joseph J.DioGuardi
[Chinese]
[Chinese]
[Korean]
[Korean]
VivaMorgan[Chinese]
[Chinese]
[Korean]
[Korean]
Charles E.Schumer
[Chinese]
[Chinese]
[Korean]
[Korean]
Eugene M.Fahey
[Chinese]
[Chinese]
[Korean]
[Korean]
Charles E.Schumer
[Chinese]
[Chinese]
[Korean]
[Korean]
JayTownsend
[Chinese]
[Chinese]
[Korean]
[Korean]
Charles E.Schumer
[Chinese]
[Chinese]
[Korean]
[Korean]
ColiaClark
[Chinese]
[Chinese]
[Korean]
[Korean]
Randy A.Credico[Chinese]
[Chinese]
[Korean]
[Korean]
Randy A.Credico[Chinese]
[Chinese]
[Korean]
[Korean]
Kevin M.Dillon
[Chinese]
[Chinese]
[Korean]
[Korean]
Cheryl A.Green
[Chinese]
[Chinese]
[Korean]
[Korean]
Kevin M.Dillon
[Chinese]
[Chinese]
[Korean]
[Korean]
Kevin M.Dillon
[Chinese]
[Chinese]
[Korean]
[Korean]
Kevin M.Dillon
[Chinese]
[Chinese]
[Korean]
[Korean]
Eugene M.Fahey
[Chinese]
[Chinese]
[Korean]
[Korean]
Mark C.Rodgers
[Chinese]
[Chinese]
[Korean]
[Korean]
Eugene M.Fahey
[Chinese]
[Chinese]
[Korean]
[Korean]
JayTownsend
[Chinese]
[Chinese]
[Korean]
[Korean]
Eugene M.Fahey
[Chinese]
[Chinese]
[Korean]
[Korean]
Mark A.Montour
[Chinese]
[Chinese]
[Korean]
[Korean]
Deborah A.Chimes[Chinese]
[Chinese]
[Korean]
[Korean]
Mark A.Montour
[Chinese]
[Chinese]
[Korean]
[Korean]
Deborah A.Chimes[Chinese]
[Chinese]
[Korean]
[Korean]
Cathrine NugentPanepinto
[Chinese]
[Chinese]
[Korean]
[Korean]
Nydia M.Velazquez
[Chinese]
[Chinese]
[Korean]
[Korean]
Nydia M.Velazquez
[Chinese]
[Chinese]
[Korean]
[Korean]
Henry J.Nowak[Chinese]
[Chinese]
[Korean]
[Korean]
AliceGaffney[Chinese]
[Chinese]
[Korean]
[Korean]
Paul B.Wojtaszek
[Chinese]
[Chinese]
[Korean]
[Korean]
Henry J.Nowak[Chinese]
[Chinese]
[Korean]
[Korean]
Paul B.Wojtaszek
[Chinese]
[Chinese]
[Korean]
[Korean]
Cathrine NugentPanepinto
[Chinese]
[Chinese]
[Korean]
[Korean]
Jeffrey F.Voelkl
[Chinese]
[Chinese]
[Korean]
[Korean]
Cathrine NugentPanepinto
[Chinese]
[Chinese]
[Korean]
[Korean]
Cathrine NugentPanepinto
[Chinese]
[Chinese]
[Korean]
[Korean]
Henry J.Nowak[Chinese]
[Chinese]
[Korean]
[Korean]
Daniel L.Squadron
[Chinese]
[Chinese]
[Korean]
[Korean]
Joseph A.Nardiello
[Chinese]
[Chinese]
[Korean]
[Korean]
Daniel L.Squadron
[Chinese]
[Chinese]
[Korean]
[Korean]
John L.Millman[Chinese]
[Chinese]
[Korean]
[Korean]
John A.Jasilli, Jr.
[Chinese]
[Chinese]
[Korean]
[Korean]
John A.Jasilli, Jr.
[Chinese]
[Chinese]
[Korean]
[Korean]
John L.Millman[Chinese]
[Chinese]
[Korean]
[Korean]
Robert J.Duffy
[Chinese]
[Chinese]
[Korean]
[Korean]
Gregory J.Edwards
[Chinese]
[Chinese]
[Korean]
[Korean]
Robert J.Duffy
[Chinese]
[Chinese]
[Korean]
[Korean]
Gregory J.Edwards
[Chinese]
[Chinese]
[Korean]
[Korean]
Robert J.Duffy
[Chinese]
[Chinese]
[Korean]
[Korean]
GloriaMattera[Chinese]
[Chinese]
[Korean]
[Korean]
AldenLink
[Chinese]
[Chinese]
[Korean]
[Korean]
Gregory J.Edwards
[Chinese]
[Chinese]
[Korean]
[Korean]
Eva M.Doyle
[Chinese]
[Chinese]
[Korean]
[Korean]
TanyaGendelman
[Chinese]
[Chinese]
[Korean]
[Korean]
RDH
RDH
�
�
✺
✺
a
a
a
:;New York sued for usability problems
4097
Trim Trim
PERF
PERF
Trim
PERF
PERF
Trim
Score 1
Score 2
Score 3
Score
Score
Score
Santa CruzRunDate:03/29/2016 10:37:42 a
Last Printed:3/29/1610:39
cC
opyr
ight
201
2 D
OM
INIO
N V
OT
ING
Vers
ion:
80O
ptec
h 3P
E4c
CA44-1-001D
VOTE BOTH SIDES (2A) CA44-1-001D
DEM 1
DEM 1
DEM 1
OFFICIAL BALLOT
PRESIDENTIAL PRIMARY ELECTION COUNTY OF SANTA CRUZ, TUESDAY, JUNE 7, 2016
This ballot stub shall be removed and retained by the voter
OFFICIAL BALLOT PRESIDENTIAL PRIMARY ELECTION
DEMOCRATIC PARTY COUNTY OF SANTA CRUZ, TUESDAY, JUNE 7, 2016
Instructions to Voters: x Use only a blue or black ballpoint pen to mark your choices.
x You must connect the head and tail of the arrow for your vote to count. You only need to draw one line.
x To vote for a qualified write-in candidate, write the person’s name on the blank line provided and connect the head and tail of the arrow.
x If you make a mistake, ask a poll worker for another ballot. If you are voting by mail, follow the instructions you received with your ballot.
Party-Nominated Offices Only voters who disclosed a preference upon registering to vote for the same party as the candidate seeking the nomination of any party for the Presidency or election to a party committee may vote for that candidate at the primary election, unless the party has adopted a rule to permit non-party voters to vote in its primary elections.
Voter-Nominated and Nonpartisan OfficesAll voters, regardless of the party preference they disclosed upon registration, or refusal to disclose a party preference, may vote for any candidate for a voter-nominated or nonpartisan office. The party preference, if any, designated by a candidate for a voter-nominated office is selected by the candidate and is shown for the information of the voters only. It does not imply that the candidate is nominated or endorsed by the party or that the party approves of the candidate. The party preference, if any, of a candidate for a nonpartisan office does not appear on the ballot.
United States Senator continued on next column
United States Senator contest has 35 candidates. Only vote for One
Vote for OnePresidential Preference
President of the UnitedStates
Party-Nominated Offices
KEITH JUDD
MICHAEL STEINBERG
BERNIE SANDERS
WILLIE WILSON
ROQUE DE LA FUENTE
HILLARY CLINTON
HENRY HEWES
Vote for One
United States SenatorVoter-Nominated Offices
GEORGE C. YANG
AccountantParty Preference: Republican
JERRY J. LAWSParty Preference: Republican
GAIL K. LIGHTFOOTParty Preference: Libertarian
MIKE BEITIKSParty Preference: None
PAMELA ELIZONDOParty Preference: Green
SCOTT A. VINEBERGParty Preference: None
STEVE STOKESParty Preference: Democratic
DUF SUNDHEIMParty Preference: Republican
LING LING SHIParty Preference: None
LORETTA L. SANCHEZParty Preference: Democratic
PHIL WYMANParty Preference: Republican
JARRELL WILLIAMSONParty Preference: Republican
THOMAS G. DEL BECCAROParty Preference: Republican
RON UNZParty Preference: Republican
GREG CONIONParty Preference: Republican
JASON KRAUSParty Preference: None
TIM GILDERSLEEVEParty Preference: None
CLIVE GREYParty Preference: None
DON J. GRUNDMANNParty Preference: None
PRESIDENT CRISTINA GRAPPOParty Preference: Democratic
HERBERT G. PETERSParty Preference: Democratic
TOM PALZERParty Preference: Republican
KAREN ROSEBERRYParty Preference: Republican
EMORY PERETZ RODGERSParty Preference: Democratic
DON KRAMPEParty Preference: Republican
MARK MATTHEW HERDParty Preference: Libertarian
VON HOUGOParty Preference: Republican
JASON HANANIAParty Preference: None
KAMALA D HARRISParty Preference: Democratic
GAR MYERSParty Preference: None
PAUL MERRITTParty Preference: None
MASSIE MUNROEParty Preference: Democratic
AKINYEMI OLABODE AGBEDEParty Preference: Democratic
ELEANOR GARCIAParty Preference: None
Vote for One20th District
United StatesRepresentative
CASEY LUCIUS
National Security ProfessorParty Preference: Republican
JOE WILLIAMS
Hospital Laboratory TechnicianParty Preference: Peace and Freedom
JACK DIGBY
Ironworker/Homemaker/ArtistParty Preference: None
BARBARA HONEGGER
Investigative Journalist/AuthorParty Preference: None
JIMMY PANETTA
ProsecutorParty Preference: Democratic
California primary,
June 2016
4097
Trim Trim
PERF
PERF
Trim
PERF
PERF
Trim
Score 1
Score 2
Score 3
Score
Score
Score
Santa CruzRunDate:03/29/2016 10:37:42 a
Last Printed:3/29/1610:39
cC
opyr
ight
201
2 D
OM
INIO
N V
OT
ING
Vers
ion:
80O
ptec
h 3P
E4c
CA44-1-001DVOTE BOTH SIDES (2A) CA44-1-001D
DEM 1
DEM 1
DEM 1
OFFICIAL BALLOT
PRESIDENTIAL PRIMARY ELECTION COUNTY OF SANTA CRUZ, TUESDAY, JUNE 7, 2016
This ballot stub shall be removed and retained by the voter
OFFICIAL BALLOT PRESIDENTIAL PRIMARY ELECTION
DEMOCRATIC PARTY COUNTY OF SANTA CRUZ, TUESDAY, JUNE 7, 2016
Instructions to Voters: x Use only a blue or black ballpoint pen to mark your choices.
x You must connect the head and tail of the arrow for your vote to count. You only need to draw one line.
x To vote for a qualified write-in candidate, write the person’s name on the blank line provided and connect the head and tail of the arrow.
x If you make a mistake, ask a poll worker for another ballot. If you are voting by mail, follow the instructions you received with your ballot.
Party-Nominated Offices Only voters who disclosed a preference upon registering to vote for the same party as the candidate seeking the nomination of any party for the Presidency or election to a party committee may vote for that candidate at the primary election, unless the party has adopted a rule to permit non-party voters to vote in its primary elections.
Voter-Nominated and Nonpartisan OfficesAll voters, regardless of the party preference they disclosed upon registration, or refusal to disclose a party preference, may vote for any candidate for a voter-nominated or nonpartisan office. The party preference, if any, designated by a candidate for a voter-nominated office is selected by the candidate and is shown for the information of the voters only. It does not imply that the candidate is nominated or endorsed by the party or that the party approves of the candidate. The party preference, if any, of a candidate for a nonpartisan office does not appear on the ballot.
United States Senator continued on next column
United States Senator contest has 35 candidates. Only vote for One
Vote for OnePresidential Preference
President of the UnitedStates
Party-Nominated Offices
KEITH JUDD
MICHAEL STEINBERG
BERNIE SANDERS
WILLIE WILSON
ROQUE DE LA FUENTE
HILLARY CLINTON
HENRY HEWES
Vote for One
United States SenatorVoter-Nominated Offices
GEORGE C. YANG
AccountantParty Preference: Republican
JERRY J. LAWSParty Preference: Republican
GAIL K. LIGHTFOOTParty Preference: Libertarian
MIKE BEITIKSParty Preference: None
PAMELA ELIZONDOParty Preference: Green
SCOTT A. VINEBERGParty Preference: None
STEVE STOKESParty Preference: Democratic
DUF SUNDHEIMParty Preference: Republican
LING LING SHIParty Preference: None
LORETTA L. SANCHEZParty Preference: Democratic
PHIL WYMANParty Preference: Republican
JARRELL WILLIAMSONParty Preference: Republican
THOMAS G. DEL BECCAROParty Preference: Republican
RON UNZParty Preference: Republican
GREG CONIONParty Preference: Republican
JASON KRAUSParty Preference: None
TIM GILDERSLEEVEParty Preference: None
CLIVE GREYParty Preference: None
DON J. GRUNDMANNParty Preference: None
PRESIDENT CRISTINA GRAPPOParty Preference: Democratic
HERBERT G. PETERSParty Preference: Democratic
TOM PALZERParty Preference: Republican
KAREN ROSEBERRYParty Preference: Republican
EMORY PERETZ RODGERSParty Preference: Democratic
DON KRAMPEParty Preference: Republican
MARK MATTHEW HERDParty Preference: Libertarian
VON HOUGOParty Preference: Republican
JASON HANANIAParty Preference: None
KAMALA D HARRISParty Preference: Democratic
GAR MYERSParty Preference: None
PAUL MERRITTParty Preference: None
MASSIE MUNROEParty Preference: Democratic
AKINYEMI OLABODE AGBEDEParty Preference: Democratic
ELEANOR GARCIAParty Preference: None
Vote for One20th District
United StatesRepresentative
CASEY LUCIUS
National Security ProfessorParty Preference: Republican
JOE WILLIAMS
Hospital Laboratory TechnicianParty Preference: Peace and Freedom
JACK DIGBY
Ironworker/Homemaker/ArtistParty Preference: None
BARBARA HONEGGER
Investigative Journalist/AuthorParty Preference: None
JIMMY PANETTA
ProsecutorParty Preference: Democratic
?!
Thank you.
Dana Chisnell
civicdesign.org
@danachis@ChadButterfly
Top Related