Not Dead Yet: Designing Great Experiences with Bad Data
-
Upload
sonia-koesterer -
Category
Design
-
view
283 -
download
0
Transcript of Not Dead Yet: Designing Great Experiences with Bad Data
1 0 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
1 1 0 1 1 1 0 0 1 1 0 1 1 0 1 0 1
0 1 1 0 1 0 0 1 0 1 1 0 0 1 1 1 0
1 1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
0 1 0 1 1 0
0 1 1 1 0 0
1 0 1 0 0 1
0 1 0 0 1 1
0 0 1 0 1 0
1 0 0 1 0 1
1 1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
0 1 0 0 1 1
0 0 1 0 1 0
1 0 0 1 0 1
1
0
1
1
1
0
1
1
0
1
0
1
1
1
0
1
1
0
NOT DEAD YET…Designing Great Experiences with Bad Data@ SONIA KOESTERER
HAPPY PATH (NOUN)
A default positive scenario, which demonstrates the sequence of activities executed if everything goes as expected.
1 0 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
1 1 0 1 1 1 0 0 1 1 0 1 1 0 1 0 1
0 1 1 0 1 0 0 1 0 1 1 0 0 1 1 1 0
1 1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
1 0 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
1 1 0 1 1 1 0 0 1 1 0 1 0 1
0 1 1 0 1 0 0 0 1 1 1 0
1 1 0 1 0 1 1 0 0 1
0 1 0 0 1 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
1 0 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
1 1 0 1 1 1 0 0 1 1 0 1 1 0 1 0 1
0 1 1 0 1 0 0 1 0 1 1 0 0 1 1 1 0
1 1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
1 0 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
1 1 0 1 1 1 1 0 1 1 0 1 0 1
0 1 1 0 1 0 1 0 0 1 1 1 0
1 1 0 1 0 0 1 1 1 0 0 1
0 1 0 0 1 0 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
1 0 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
1 1 0 1 1 1 0 0 1 1 0 1 1 0 1 0 1
0 1 1 0 1 0 0 1 0 1 1 0 0 1 1 1 0
1 1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
1 0 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
0 1 1 0 1 0 0 1 0 1 1 0 0 1 1 1 0
0 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1 1
We need a process for understanding & fixing failures in design.
Solution
Problem Space
FAIL
FAILFAIL
FAIL
Why not borrow concepts from Manufacturing, Software Engineering, Systems Engineering & Safety Engineering?
Solution
Problem Space
FAIL
FAIL FAIL
FAIL
Imagine FBI agents turn up at your home and forcefully declare it to be the site of illicit activities…
FRAUDFRAUD
Imagine FBI agents turn up at your home and forcefully declare it to be the site of illicit activities…
FRAUDFRAUDA quiet Kansas home wound up with 600-million IP addresses and a world of trouble. KASHMIR HILL, FUSION.NET
1 0 0
1
01
1 0 1 0 11
0 1 100
1 1
0
1 1 1
0
0 1 1 0 1 1 0 1 0 1
0 1 1 0
1
00
1 0
1
1 00
1 1 1
01
1
0 1 0
01
10 1 01 1 1 0 0 1
01 0
01 0 1 0 1 1 1 0
01 0 1 1
0
0 1 0 0 1 0
1
0 0 1 0 1
0
1 1 0
0 1
0
1 1 0
0 1 1 10
0
1 0 1
0 0 1
0
10 0
1 1
0 0
1
0 1 0
1 0
0
1 0 1
11
0 1 0 0 1 1 0 1 0 11
1 0 0 1
0 1
0
0 1 0 1 0
1
1 100
1 0 1 1
0 0 1 0 0 10
1 0 0 1 01 0 1 1 0
0 1 0 0 1 1
0 0 1 0 1 0
1 0 0 1 0 1
1
0
1
11
0
1
1 01
0 11
1
0
1
1
0
1 0 0
1
01
1 0 1 0 11
0 1 100
1 1
0
1 1 1
0
0 1 1 0 1 1 0 1 0 1
0 1 1 0
1
00
1 0
1
1 00
1 1 1
01
1
0 1 0
01
10 1 01 1 1 0 0 1
01 0
01 0 1 0 1 1 1 0
01 0 1 1
0
0 1 0 0 1 0
1
0 0 1 0 1
0
1 1 0
0 1
0
1 1 0
0 1 1 10
0
1 0 1
0 0 1
0
10 0
1 1
0 0
1
0 1 0
1 0
0
1 0 1
11
0 1 0 0 1 1 0 1 0 11
1 0 0 1
0 1
0
0 1 0 1 0
1
1 100
1 0 1 1
0 0 1 0 0 10
1 0 0 1 01 0 1 1 0
0 1 0 0 1 1
0 0 1 0 1 0
1 0 0 1 0 1
1
0
1
11
0
1
1 01
0 11
1
0
1
1
0
PROBLEM ONE
Data is messy. Sloppy data, uneven data, varying levels of precision
Hospitals and medical practices mix up 8% of patient identities. JOHN MCQUAID, STATNEWS.COM
1 1 0 1 1 0 1 0 0 1 1 0 0
1 1 0 1 1 0 0 1 1 0 1 1 0 1 0 1
0 1 1 0 1 0 0 1 1 1 0 0 1 1 1 0
1 1 0 0 1 1 0 1 0 1 1 1 1
0 1 0 0 1 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 1 1 0
0 1 0 1 1 0
1 0 0
1 0 1 0 0 1
0 1 0 0 1
0 0 1 0 1 0
1 0 0 1 1
1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 0 0 1 1 1 0 0 1 0 1
0 0 1 0 1 0 1 0 0 1 0 1 0 1 1 0
0 1 0 0 1 1
0 0 1 0 1 0
1 0 0
0
1
1
1
0
1
1
1
0
1
1
0
1
1
1 1 0 1 1 0 1 0 0 1 1 0 0
1 1 0 1 1 0 0 1 1 0 1 1 0 1 0 1
0 1 1 0 1 0 0 1 1 1 0 0 1 1 1 0
1 1 0 0 1 1 0 1 0 1 1 1 1
0 1 0 0 1 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 1 1 0
0 1 0 1 1 0
1 0 0
1 0 1 0 0 1
0 1 0 0 1
0 0 1 0 1 0
1 0 0 1 1
1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 0 0 1 1 1 0 0 1 0 1
0 0 1 0 1 0 1 0 0 1 0 1 0 1 1 0
0 1 0 0 1 1
0 0 1 0 1 0
1 0 0
0
1
1
1
0
1
1
1
0
1
1
0
1
1
PROBLEM TWO
Data is incomplete. Blank fields, disappearing feeds, and uncollected information
Man’s home mistakenly set as a Pokémon GO gym. MARCUS LESHOCK, WGNTV
BOON SHERIDAN @BOONERANG
1 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
1 1 0 1 1 1 1 1 0 1 1 0 1 0 1
0 1 1 1 0 0 1 0 1 1 0 0 1 1 1 0
1 1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 0 0 1 0 1 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
0 1 0 1 1 0
0 1 1 1 0
1 0 1 0 0 1
0 1 0 0 1 1
0 0 1 0 1 0
1 0 1 0 1
1 1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 0 0 1 0 1 0 1 1 1 0 1 0 1 1
0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
1 0 0 1 1
0 0 1 0 1 0
1 0 0 1 0 1
1
0
1
1
1
0
1
1
0
0 0
0
0
0
0
0
0
0
0
1
0
1
1
1
0
1
1
0
0
1
1 1
0
1
1
1
1
1
1
1
0 1 0 1 0 1 1 0 1 1 0 0
1 1 0 1 1 0 1 1 0 1 0 1
0 1 1 0 0 1 0 1 1 0 0 1 1 1 0
1 1 0 1 0 0 1 1 0 1 1 1 0 0 1
0 1 0 0 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
0 1 0 1 1
0 1 1 1
1 0 1 0 0 1
0 1 0 0 1 1
0 0 1 0
1 0 1
1 1 0 1 0 0 1 1 0 1 0 1 0 0
0 0 1 0 1 0 1 1 1 1 0 1 1
1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
1 0 0 1 1
0 0 1 0 1 0
1 0 0 1 0
0
1
1
1
0
1
0
0 0
0
0
0
0
0
0
0
0
1
0
1
1
1
0
1
0
0
1
1 1
0
1
1
1
1
1
1
1
0
0
0
0
0
0
0
0
0
0
1
1
0
1
1
1
1
1
1
1
0
0 0
0
0
0
0
0
0 0
1
1 1
0
1
1
1
1
1 1
0
0
0
0
0
0
0
0
0
0
1
1
0
1
1
1
1
1
1
1
PROBLEM THREE
Data is fickle. Temporary data, old data, information no longer valid
Imagine going to the doctor for a cough, and being told they can’t help you because you’re dead…
deceased
deceasedOver 12,000
Americans are erroneously declared dead each year. MARISSA FESSENDEN, SMITHSONIAN.COM
1 0 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
1 1 0 5 1 1 0 0 1 1 0 1 1 0 C A T
0 1 1 0 1 0 0 1 0 1 1 0 0 1 1 1 0
1 1 0 1 0 0 1 1 0 1 0 2 1 1 0 0 1
0 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
0 1 0 1 1 2
0 1 1 1 0 0
1 0 1 0 0 1
0 1 0 0 9 1
0 0 1 0 1 0
1 0 0 1 0 1
1 1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 8 0 1 0 1 0 1 1 1 0 2 1 0 1 1
0 0 1 0 0 W T F 0 0 1 0 1 0 1 1 0
C A T 0 1 1
0 0 1 0 1 2
1 0 0 1 0 1
3
0
1
1
1
0
1
1
0
4
0
1
1
1
0
1
1
8
1 0 0 1 0 1 1 0 1 0 1 1 0 1 1 0 0
1 1 0 5 1 1 0 0 1 1 0 1 1 0 C A T
0 1 1 0 1 0 0 1 0 1 1 0 0 1 1 1 0
1 1 0 1 0 0 1 1 0 1 0 2 1 1 0 0 1
0 1 0 0 1 0 1 0 1 1 1 0 0 1 0 1 1
0 0 1 0 0 1 0 1 0 0 1 0 1 0 1 1 0
0 1 0 1 1 2
0 1 1 1 0 0
1 0 1 0 0 1
0 1 0 0 9 1
0 0 1 0 1 0
1 0 0 1 0 1
1 1 0 1 0 0 1 1 0 1 0 1 1 1 0 0 1
0 1 8 0 1 0 1 0 1 1 1 0 2 1 0 1 1
0 0 1 0 0 W T F 0 0 1 0 1 0 1 1 0
C A T 0 1 1
0 0 1 0 1 2
1 0 0 1 0 1
3
0
1
1
1
0
1
1
0
4
0
1
1
1
0
1
1
8
PROBLEM FOUR
Data is imperfect. Typos, duplications, bad formatting, oh my!
1. First be fat.Pilot new offerings at a small scale to learn where the weak points are and gracefully recover.
2. Know your anti-use case. Define what you don’t want your service to enable, and create forcing functions to prevent disastrous mistakes.
3. Get ahead of changes. Future-proof your service by continuously gathering updated data from multiple sources.
4. Do the right thing.Verify the validity of key transitions where major status, account, or behavior changes occur for your users.
INTERESTING THOUGHTS FROM SMART PEOPLE
1. Fat Thinking and Economies of VarietyVenkatesh Rao
2. Go Home, Data, You’re DrunkDanielle Malik
3. Goodhart’s Law and Why Measurement is HardDavid Manheim