Remixing Mobile User Experience

234
REMUX Remixing Mobile User eXperience Mobile UX London 2015 @jasonmesut

Transcript of Remixing Mobile User Experience

Page 1: Remixing Mobile User Experience

REMUXRemixing Mobile User eXperience Mobile UX London 2015

@jasonmesut

Page 2: Remixing Mobile User Experience

A meeting of monthly meet ups

Page 3: Remixing Mobile User Experience

The worst synopsis ever

Page 4: Remixing Mobile User Experience

The worst keynote synopsis ever

Potential Opportunities and Associated Challenges for Designing Valuable Futures based around Mobile Experiences

A lot of focus around mobile UX seems to be around designing responsively, adapting to different platform paradigms, or designing for gestures, with little focus on the powers we now wield by having a super computer in our pockets. With the apparent advent of the Internet of Things and never-ending hype, what are the potential future trajectories of solutions for people on the move? What are the form factors, new service approaches and challenges associated with these?

Page 5: Remixing Mobile User Experience

The worst keynote synopsis ever

Potential Opportunities and Associated Challenges for Designing Valuable Futures based around Mobile Experiences

A lot of focus around mobile UX seems to be around designing responsively, adapting to different platform paradigms, or designing for gestures, with little focus on the powers we now wield by having a super computer in our pockets. With the apparent advent of the Internet of Things and never-ending hype, what are the potential future trajectories of solutions for people on the move? What are the form factors, new service approaches and challenges associated with these?

Page 6: Remixing Mobile User Experience

Naveed

We want it to be case study led

Page 7: Remixing Mobile User Experience

I’m no expert in mobile. Who is? Really?

What do I know about mobile UX?

Page 8: Remixing Mobile User Experience

Which is highly relevant

I can’t show my recent work

Page 9: Remixing Mobile User Experience

Zipdisks, CDs, and my hard drive

So I raided my old media

Page 10: Remixing Mobile User Experience

Looking back 20+ years mobile design

Page 11: Remixing Mobile User Experience

GCSE Craft, Design and Technology

Portable music studio

1995~

Page 12: Remixing Mobile User Experience

Portable music studio — 1995

A future mobile music studio concept designed at school

– Nintendo SNES inspired

peripheral inputs

– Minidisc inspired central brain I couldn’t find the original sketches, but it was sort of like this but minidisc sized

Page 13: Remixing Mobile User Experience

Early web design

Yell.com

1999–2000

Page 14: Remixing Mobile User Experience

Early web design — 1998–2000

Extended placement creating websites for SME businesses

– 1 Website a day

– Scanning, copywriting, visual design, HTML, browser testing(2-3h design, 6-7h testing and tweaking)

– IE, Netscape, Mac, PC

– 640x480 – 1280x1024

– <30k for a web page

– <13k for a gif/flash banner

Page 15: Remixing Mobile User Experience

Key learnings

– You have to test with different platforms and screen sizes

– File size really matters

Page 16: Remixing Mobile User Experience

The Don makes some prescient predictions

The invisible computer

Page 17: Remixing Mobile User Experience

The Don

Page 18: Remixing Mobile User Experience

Don Norman

Page 19: Remixing Mobile User Experience

Device convergence

Page 20: Remixing Mobile User Experience

App divergence

Divergent, single serving apps

Page 21: Remixing Mobile User Experience

Key learnings

– Divergent appliances restrict modal errors

– We will still desire objects

– Key technologies will be distributed: screens, internet access, sensors

– Predictions rarely turn out as you expect them

Page 22: Remixing Mobile User Experience

A future of reading

Amazon Via

2001

Page 23: Remixing Mobile User Experience

University

Brunel Design Directory 2001

Page 24: Remixing Mobile User Experience

Amazon Via — 2001

Come up with a new product concept for Amazon for 2005

Page 25: Remixing Mobile User Experience

Reading context and behaviours

Page 26: Remixing Mobile User Experience

I explored different form factors* *I was an Industrial Design after all

Page 27: Remixing Mobile User Experience

Clamshell

Page 28: Remixing Mobile User Experience

Ergonomic controller

Page 29: Remixing Mobile User Experience

Necklace projector

Page 30: Remixing Mobile User Experience

Thumb controllers

Page 31: Remixing Mobile User Experience

eInk and LCD (with a stylus)

AccountMessages

Message

SearchCommunityCommunityBookshelf CommunityCommunity

Profile NetworkMembers

MarkFriend

Currently reading favourites

Land rover legend 4.5 engineering weekly 5

the rise and fall of 4

Mcdonalds

WarrenFriend colleague

Currently reading favourites

Angella’s ashes 4 cre@te online 4

design of everyday 4.5 chi journal 4

things

JuliePartner

Currently reading favourites

Harry potter 4 silence of the lambs 5

hannibal 4 wallpaper 4

wallpaper 3.5

Tony Colleague

Currently reading favourites

The art of innovation 5 design week 4

hannibal 4 sony design 4

vision of the future 3.5

Leisure Business Interest

Page 32: Remixing Mobile User Experience
Page 33: Remixing Mobile User Experience
Page 34: Remixing Mobile User Experience

Amazon Via — 2001

A future concept for digital books, making Amazon a provider of e-books for niche material within communities

– E-Ink display

– Digital Books

– Basic page turning

– Annotations

– Thumb controls

– Necklace projector

AccountMessages

Message

SearchCommunityCommunityBookshelf CommunityCommunity

Profile NetworkMembers

MarkFriend

Currently reading favourites

Land rover legend 4.5 engineering weekly 5

the rise and fall of 4

Mcdonalds

WarrenFriend colleague

Currently reading favourites

Angella’s ashes 4 cre@te online 4

design of everyday 4.5 chi journal 4

things

JuliePartner

Currently reading favourites

Harry potter 4 silence of the lambs 5

hannibal 4 wallpaper 4

wallpaper 3.5

Tony Colleague

Currently reading favourites

The art of innovation 5 design week 4

hannibal 4 sony design 4

vision of the future 3.5

Leisure Business Interest

Page 35: Remixing Mobile User Experience

Amazon Kindle — 2007

– E-Ink display

– Digital Books

– Basic page turning

– Annotations

X No thumb controls

X No necklace projector

Page 36: Remixing Mobile User Experience

Mycestro — 2014

– Thumb controller

– Finger buttons

X No necklace projector

Page 37: Remixing Mobile User Experience

Airplay and chromecasting — 2010–15

– Other ways to transmit

information to different displays

– Finger buttons

X No necklace projector

Page 38: Remixing Mobile User Experience

Key learnings

– Understanding context inspires radical ideas that could work

– Ideas are easy — delivery is hard

– Prototyping with wire and blue tack makes you look like an idiot

– One day we’ll have necklace projectors (or maybe not)

Page 39: Remixing Mobile User Experience

Clinical application for Kenya and NHS

Mobile Map of Medicine

2006

Page 40: Remixing Mobile User Experience

Map of Medicine — 2006

Page 41: Remixing Mobile User Experience

A need in Kijabe, Kenya

Small medical centres with generalists serving large communities

Page 42: Remixing Mobile User Experience

Limited shared computers

– 2 installs of Map of Medicine

– 2 big folders of printouts

Page 43: Remixing Mobile User Experience

Limited network access

Page 44: Remixing Mobile User Experience

Large geography, terrible transport

– Take over a day to get to some patients

– Longer for patients to get to clinics

Page 45: Remixing Mobile User Experience

– Cheap PDAs

– Cisco wanted to hep developing world

– Opportunity to install WIMAX networks

Opportunity for a mobile device + Cisco

Page 46: Remixing Mobile User Experience

Rapid prototyping (paper and Java)

Page 47: Remixing Mobile User Experience

Menu UI

Page 48: Remixing Mobile User Experience

Mobile form factors

Page 49: Remixing Mobile User Experience

Designed a blended research approach

Interview

Surveys

Week 3 Week 5Week 2 Week 4

Introduce plans to end users

Week 1

Initial demo

Day 1- Present plan to users

Day 1-Demo Map & device

Testing

Day (1-30)- Diary studies. Week 1-6 (day 5)- Attitude surveys

Day 1&2-Intro. interviews

Day 5- Market survey

Day 4 & 5- User testing

1st week in October – 3rd week in November

Week 6

Day 5- Market survey

Day 4&5- de-briefing

Week 7

Day 1- Present plan to users

Day 1-Demo Map & device

Day 2-Intro. interviews

Day 5- de-briefing

Day (1-30)- Diary studies. Week 1-6 (day 5)- Attitude surveys

Day 5- Market survey

Day 5- Market survey

Day 4- User testing

Day 1&2- User interviews

Day 1- User interviews

Page 50: Remixing Mobile User Experience

Observed usage in NHS

Page 51: Remixing Mobile User Experience

Suited downtime refreshers

Page 52: Remixing Mobile User Experience

Activity map

Page 53: Remixing Mobile User Experience

Plenty of ‘wearable’ devices

Page 54: Remixing Mobile User Experience

Key learnings

– Mobile technology could empower developing communities

– Mobile technology can opens up new infrastructure

– It’s hard to fit into established workflows

– Healthcare professionals have a lot of wearable technology already

Page 55: Remixing Mobile User Experience

Improving safety and efficiency of wind turbine maintenance

Visual Eyes mobile

2011

Page 56: Remixing Mobile User Experience

Visual Eyes desktop application

Page 57: Remixing Mobile User Experience

Mapping activities across roles

Page 58: Remixing Mobile User Experience

Targeting a maintenance agent

2 33

5

5

4 6

6

8

8

7 9

6 Response to alert

As Bob has almost finished his final task he agrees

with the Operations Controller that if he can

complete the job in 15 minutes he will, otherwise

he will have to leave the site and come back another time.

7 Completes task

Bob completes the final task in the job list and taps to add

more details (photo/notes).

He takes a photograph of something that he has

spotted that will need to be monitored and adds a note

with the date and his comments, before getting in his

van ready to move on to the next job.

5 Alerts

While he is still on-site working, Bob receives an alert notifying him that there are electrical storms forecast in the area he is working.

Bob dismisses the alert by calling Operations Control to

check in and get advice on what he should do.

1 Planning for the day ahead

Over breakfast Bob uses his phone to look at the jobs he has scheduled for the day. He

taps to view details of each job (location, weather forecast, time

allocation etc) so he can plan his day.

2 On the way to Turbine

Bob gets into his van and drives to the location of the first job on

his list. If he needs to he can view the location on a map and link through to his iPhone's GPS enabled maps application to get directions.

3 At the Turbine

When he arrives at the wind farm/turbine, Bob taps the

start button in the job detail screen. He is asked to verify

his ID by entering a password/code. When this

code is successfully verified he receives a code via SMS which will

give him access to the turbine.

4 Completing Tasks

As he completes each of the tasks for the job, Bob taps to mark it completed. (this logs his progress and updates the display at Operations Control).

Visual Eyes Mobile App User Journey

Page 59: Remixing Mobile User Experience

Met Office Mobile

Page 60: Remixing Mobile User Experience

Key learnings

– Mobile solutions don’t need to reflect desktop counterparts

– Mobile technology can create new use cases

– Use older insights to inform new solutions

Page 61: Remixing Mobile User Experience

Making timesheet more enjoyable

Fingerpainting

2012

Page 62: Remixing Mobile User Experience

Timesheet applications fail

– Boring

– People forget

– Entering time against different job codes is hard

– Designed for resource and account managers, not ‘talent’

Page 63: Remixing Mobile User Experience

Parallel inspiration

Page 64: Remixing Mobile User Experience

Touch and swipe interactions

Page 65: Remixing Mobile User Experience

Prototyping

Page 66: Remixing Mobile User Experience

Key learnings

– Sound can provide tactile feedback

– Sound can engage others

– Bad sound can annoy

– You don’t have to follow a platform paradigm

– But a strong metaphor can always help

Page 67: Remixing Mobile User Experience

Interaction R&D for A&E applications

Healthier mobile entry

2012

Page 68: Remixing Mobile User Experience

Clinical system for an A+E

– Leapfrog competition

– Triage patients better and more efficiently

– Reduce waiting times

– Minimise data workflow errors

Page 69: Remixing Mobile User Experience
Page 70: Remixing Mobile User Experience

Typical clinical form

Page 71: Remixing Mobile User Experience

Multiple pulldowns

Page 72: Remixing Mobile User Experience

Spider triage

Page 73: Remixing Mobile User Experience

Spider triage

Page 74: Remixing Mobile User Experience

Physical triage cards

Page 75: Remixing Mobile User Experience

Old stool hypercard UI

Page 76: Remixing Mobile User Experience

Touch triage

Page 77: Remixing Mobile User Experience

Touch triage

Page 78: Remixing Mobile User Experience

Key learnings

– Different users and usage contexts demand different UI

– GUIs haven’t moved on that much from hypercard

– Truly touch interfaces are rare but allow for eye contact

– Touch interfaces suit more coarse interactions

– Quickly prototyping and animating engages stakeholders

Page 79: Remixing Mobile User Experience

Focusing on what matters to the market

Future smartphone

2013

Page 80: Remixing Mobile User Experience

Plan

2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011

Mobile phonesInfluential milestones for designers

3310 9210 6310 5510

Siemens SL45iSiemens ME45

7650 5210

Vertu Signature

89107210

Siemens A55

6610

Handspring Treo 270

3650 68005100 N-Gage

SiemensSL55 Siemens XeliriO2 XDA BlackBerry 6230

1100 2300 76006230 7200

Siemens Xelibri KDDI Talby (Marc Newson)

7610

VertuAscent

6630 2650

Siemens SL65

6170 7260 7280 7710

Siemens SK65 Toshiba Nudio V602T

8800

Siemens CL75 KDDI Penck(Makoto Saitou)

N91 N70 7380 7360

KDDI Neon(Naoto Fukasawa)

N93

LG Chocolate

N95 8800 7373 6300

BlackBerry Pearl 8100Vertu Boucheron

2630

LG ShineKDDI MediaSkin(Tokujin Yoshioka)

LG Prada

8600 5310

Apple iPhoneO2 Cocoon KDDI Infobar2 (Naoto Fukasawa)

Porsche P9521

N82 8800 8800 Sapphire Arte

7900

Palm Centro

5220 Xpress music

E71 E66 8800 Carbon Arte

5800 Xpress music

N97 5330Xpress Music

6700 6790 Surge

5530Xpress Music

N900 X66600(C) 1661

HTC Touch Diamond BlackBerry Storm Google G1 Vertu Signature S Palm Pre LG BL40 HTC HeroHTC Magic Apple iPhone 3GS Iida Ply Iida LottaBlackBerry Bold 9000

V8088 V60 V70 E365V600 A835 A920 E1000 RAZR V3 PEBL L7 SLVR RAZR V3 PEBL Colours W220 L7 (RED) MotoFone KRZR K1 RAZR V9 PEBL U9RAZR2 Luxury edition

Aura Motocubo A45

Droid HD2 Nexus One Desire

M100 A110 A200 A300 A400 R210 T100 A500 V200 P400 A800 E720 D500 Z500D600 E530 Serene P300 E870 E900 X820 X830D900 F300 i600 U300 U600 J600 P520 Serenata G800 U900 F110 F400 M7600 Beat DJM32000 Beat Blue Earth S8300UltraTouch

S3650Corby/Genio

S5150Diva

C3530 Nexus S Galaxy Ace Galaxy S2 Galaxy NoteWave 525ChampChat 355 GalaxyMonte

Sony CMD Z5 Sony CMD J5 Ericsson R520 Ericsson T39 Sony Z7 Sony J70 T68 T300T200 T610 Z200 P900 K700 P910 K750i W800i W950 K800 Z610 W850 W880 K810i P1 T650 K770i W380 Xperia X1 Z555 W980W350C902 C510 W508 W508 C901 Jalou Xperia X10 Pureness Vivaz X8Cedar Xperia RayX10 Mini Xperia Arc

E5N8 C5 N9 Lumia 710x5X2 X3-02

HTC, Legend

Apple, iPhone 4 BlackBerry Torch 9800 BlackBerry P9981LG Cookie LG310 Dell Streak Æsir, AE&Y, (Yves Behar) Motorola, EX212

Rhyme Sensation XLRadarSalsaChaCha

BlackBerry 9930Huawei, Folded Leaf

HD7

What’s next?

2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011

Mobile phonesInfluential milestones for designers

3310 9210 6310 5510

Siemens SL45iSiemens ME45

7650 5210

Vertu Signature

89107210

Siemens A55

6610

Handspring Treo 270

3650 68005100 N-Gage

SiemensSL55 Siemens XeliriO2 XDA BlackBerry 6230

1100 2300 76006230 7200

Siemens Xelibri KDDI Talby (Marc Newson)

7610

VertuAscent

6630 2650

Siemens SL65

6170 7260 7280 7710

Siemens SK65 Toshiba Nudio V602T

8800

Siemens CL75 KDDI Penck(Makoto Saitou)

N91 N70 7380 7360

KDDI Neon(Naoto Fukasawa)

N93

LG Chocolate

N95 8800 7373 6300

BlackBerry Pearl 8100Vertu Boucheron

2630

LG ShineKDDI MediaSkin(Tokujin Yoshioka)

LG Prada

8600 5310

Apple iPhoneO2 Cocoon KDDI Infobar2 (Naoto Fukasawa)

Porsche P9521

N82 8800 8800 Sapphire Arte

7900

Palm Centro

5220 Xpress music

E71 E66 8800 Carbon Arte

5800 Xpress music

N97 5330Xpress Music

6700 6790 Surge

5530Xpress Music

N900 X66600(C) 1661

HTC Touch Diamond BlackBerry Storm Google G1 Vertu Signature S Palm Pre LG BL40 HTC HeroHTC Magic Apple iPhone 3GS Iida Ply Iida LottaBlackBerry Bold 9000

V8088 V60 V70 E365V600 A835 A920 E1000 RAZR V3 PEBL L7 SLVR RAZR V3 PEBL Colours W220 L7 (RED) MotoFone KRZR K1 RAZR V9 PEBL U9RAZR2 Luxury edition

Aura Motocubo A45

Droid HD2 Nexus One Desire

M100 A110 A200 A300 A400 R210 T100 A500 V200 P400 A800 E720 D500 Z500D600 E530 Serene P300 E870 E900 X820 X830D900 F300 i600 U300 U600 J600 P520 Serenata G800 U900 F110 F400 M7600 Beat DJM32000 Beat Blue Earth S8300UltraTouch

S3650Corby/Genio

S5150Diva

C3530 Nexus S Galaxy Ace Galaxy S2 Galaxy NoteWave 525ChampChat 355 GalaxyMonte

Sony CMD Z5 Sony CMD J5 Ericsson R520 Ericsson T39 Sony Z7 Sony J70 T68 T300T200 T610 Z200 P900 K700 P910 K750i W800i W950 K800 Z610 W850 W880 K810i P1 T650 K770i W380 Xperia X1 Z555 W980W350C902 C510 W508 W508 C901 Jalou Xperia X10 Pureness Vivaz X8Cedar Xperia RayX10 Mini Xperia Arc

E5N8 C5 N9 Lumia 710x5X2 X3-02

HTC, Legend

Apple, iPhone 4 BlackBerry Torch 9800 BlackBerry P9981LG Cookie LG310 Dell Streak Æsir, AE&Y, (Yves Behar) Motorola, EX212

Rhyme Sensation XLRadarSalsaChaCha

BlackBerry 9930Huawei, Folded Leaf

HD7

A mobile timeline from Plan Strategic — www.plan.london

Page 81: Remixing Mobile User Experience

Future smartphone

Meaningful value

Usability

?

Battery life

Camera?

?

? ?

Screen

Connectivity

?

Page 82: Remixing Mobile User Experience

Key learnings

– Gimmicks do attract attention

– Advanced technology is not enough

– Design can empower through providing usable and meaningful solutions

– Connect to the wider system

Page 83: Remixing Mobile User Experience

Helping people unlock London

Future transportation service

2014–ongoing

Page 84: Remixing Mobile User Experience

A service design challenge

Icons created by Vicons Design from the Noun Project

?– Helps people unlock London – Mobile apps and wider digital services – Spaces, places, people, vehicles, interactions

Page 85: Remixing Mobile User Experience

Mobile diary and movement tracking

Digital diaryMovement tracking Battery pack

+ Needs

Page 86: Remixing Mobile User Experience

– Client – Call centre services company – Brand agency – Marketing and advertising company – App development company – Systems integrator – Product strategy consultancy – Political negotiations – PR groups – Maintenance company – Hardware companies – Payment provider

Key project partners

Page 87: Remixing Mobile User Experience

– Algorithm experts – Product owners – Product designers – Developers – Researchers – 2D Designers – 3D Designers – Design strategists – Product strategists – Content strategists – Strategist strategists

Key project roles

Page 88: Remixing Mobile User Experience

– Proposition – Service ideas – Marketing ideas – Design details – Language

A lot of opinions about everything

A lot of overlaps in what we contribute to

Page 89: Remixing Mobile User Experience

We have heated debates on UI

Product designers Me

– Engage people – Less words, more imagery – Less steps – Smaller narrow font – Subtlety – Reference cool app UI

– Be clear to people – More words – Clear steps – Readable font – Contrast – Reference UI research

Visual simplicity Conceptual simplicity

Page 90: Remixing Mobile User Experience

Copywriting is often the saviour

– Selling ideas – Explaining functions – Working within tight spaces – Expressing the brand

So much of what we do in User Experience ends

up being about the words we use

Page 91: Remixing Mobile User Experience

Key learnings

– Mobile diary studies help to catch people in the moment

– Mobile phone batteries don’t last

– People love battery packs

– Visual designers getting more influence

– Old stool usability and accessibility is being left behind

– Service and UX sensitive copywriting is a rare skill

Page 92: Remixing Mobile User Experience

– Think beyond the device

– Find ways to engage people

– Consider how your solution co-exists in a wider system

– Visual designers are getting more influence

– Usability and accessibility is getting forgotten about

– We’re copying bad examples

– Optimisation is as important in 2015 as it was in 2000

Key lessons from 20+ years

Page 93: Remixing Mobile User Experience

Looking forward Potential trajectories

Page 94: Remixing Mobile User Experience

What’s next in our most popular UI paradigm?

Better graphical user interfaces

Page 95: Remixing Mobile User Experience

Graphical

User Interface

Allows users to

interact with

electronic systems

Page 96: Remixing Mobile User Experience

Visual Language

Motion Graphics

Information Design

Information Architecture

Interaction Design

Page 97: Remixing Mobile User Experience

Visual Language

Motion Graphics

Information Design

Information Architecture

Interaction Design

Page 98: Remixing Mobile User Experience

Visual language

Motion graphics

Information Design

Information Architecture

Interaction Design

Still relevant

Page 99: Remixing Mobile User Experience

Original iPhone

2007 — Direct manipulation — Dynamic display — Rich graphics

Page 100: Remixing Mobile User Experience
Page 101: Remixing Mobile User Experience
Page 102: Remixing Mobile User Experience

???

Steve lied We do need hard keys

Page 103: Remixing Mobile User Experience

???

Steve lied We do need a pointer

Page 104: Remixing Mobile User Experience

Skeuomorphism ??

2007 — ??

Page 105: Remixing Mobile User Experience
Page 106: Remixing Mobile User Experience
Page 107: Remixing Mobile User Experience

In defence of skeuomorphism

2007 — ??

Page 108: Remixing Mobile User Experience

Skeuomorphism has always been in design

Page 109: Remixing Mobile User Experience

Windows 8 Radical failure

Page 110: Remixing Mobile User Experience

What’s next after flat?

Page 111: Remixing Mobile User Experience

Does Material design get it right?

Page 112: Remixing Mobile User Experience

Screens will continue to improve

New screen technology

Page 113: Remixing Mobile User Experience

Round screens

Page 114: Remixing Mobile User Experience

Any shape screens

Page 115: Remixing Mobile User Experience

Curved screens

Page 116: Remixing Mobile User Experience

Better interfaces designed for touch

Truly touch interfaces

Page 117: Remixing Mobile User Experience

iMaschine2

Portable music making app

with 3D touch

Page 118: Remixing Mobile User Experience

iMaschine2

Portable music making app

with 3D touch

Page 119: Remixing Mobile User Experience

Summary conclusion

Page 120: Remixing Mobile User Experience

Connectivity inside more focused products

Connected devices

Page 121: Remixing Mobile User Experience

Bleep Bleeps

Page 122: Remixing Mobile User Experience

Bleep Bleeps

Page 123: Remixing Mobile User Experience

Hackaball

Page 124: Remixing Mobile User Experience

SAM

A prototyping toolkit for

the Internet of Things

Page 125: Remixing Mobile User Experience

SAM

Sensors

Actuators

Computer brain

Page 126: Remixing Mobile User Experience

Great battery life, restricted functionality

Focused phones

Page 127: Remixing Mobile User Experience

Respect human values

Calmer technology

Polite technology

Page 128: Remixing Mobile User Experience

Different devices and services working together

Co-operative systems

Page 129: Remixing Mobile User Experience

Ableton link Multi-device synchronisation

Page 130: Remixing Mobile User Experience

Ableton link Multi-device synchronisation

Page 131: Remixing Mobile User Experience

Physical peripherals working with a central brain

Accessories and modularity

Page 132: Remixing Mobile User Experience

Physical peripherals with digital interfaces

Page 133: Remixing Mobile User Experience

Modular smartphones

Page 134: Remixing Mobile User Experience

Distributed knobs

Page 135: Remixing Mobile User Experience

What will the interfaces and objects be like in the future?

Future form factors

Page 136: Remixing Mobile User Experience

What’s next? Mobile computing form factors

?

Page 137: Remixing Mobile User Experience

What does your home look like?

Page 138: Remixing Mobile User Experience

Original iPhone ??

2007 — Direct manipulation — Dynamic display — Rich graphics

Page 139: Remixing Mobile User Experience

Knob handles ??

Page 140: Remixing Mobile User Experience

Knob handles ??

Page 141: Remixing Mobile User Experience

Knob handles ??

Page 142: Remixing Mobile User Experience

Knob handles ??

Page 143: Remixing Mobile User Experience

Knob handles ??

Page 144: Remixing Mobile User Experience

Knob handles ??

Page 145: Remixing Mobile User Experience

Knob handles ??

Page 146: Remixing Mobile User Experience

Original iPhone ??

2007 — Direct manipulation — Dynamic display — Rich graphics

Page 147: Remixing Mobile User Experience

Knob handles ??

Page 148: Remixing Mobile User Experience

Knob handles ??

Page 149: Remixing Mobile User Experience

Knob handles ??

Page 150: Remixing Mobile User Experience

Knob handles ??

Page 151: Remixing Mobile User Experience

Knob handles ??

Page 152: Remixing Mobile User Experience

Knob handles ??

Page 153: Remixing Mobile User Experience

Knob handles ??

Page 154: Remixing Mobile User Experience

Knob handles ??

Page 155: Remixing Mobile User Experience

Knob handles ??

Page 156: Remixing Mobile User Experience

Knob handles ??

Page 157: Remixing Mobile User Experience

Knob handles ??

Page 158: Remixing Mobile User Experience

Knob handles ??

Page 159: Remixing Mobile User Experience

Knobs

Buttons

Switches

Levers and handles

Page 160: Remixing Mobile User Experience

Knobs

Buttons

Switches

Levers and handles

Page 161: Remixing Mobile User Experience

Looking forward Challenges

Page 162: Remixing Mobile User Experience

Visual and conceptual simplicity are often confused

Simplicity is complex

Page 163: Remixing Mobile User Experience

2 types of simplicity*

Visual – Less words – Less clutter – More attractive – Cleaner – Clearer visually – Hidden controls and options

Conceptual – More words – More to arrange – Less engaging – Can be too much to parse – Options are clearer – Exposed options

*An oversimplification in itself

Page 164: Remixing Mobile User Experience

Displaced complexity

System rules

Mental models

Page 165: Remixing Mobile User Experience

Attracted by magic

and visual slickness

We’re like magpies

Page 166: Remixing Mobile User Experience

Wearable excitement

Something other than a smartphone to design

Page 167: Remixing Mobile User Experience

Even if they make us look ridiculous

Page 168: Remixing Mobile User Experience

Gestures

Page 169: Remixing Mobile User Experience

Theremin

Page 170: Remixing Mobile User Experience

Gesture issues

Tiring

Coarse control

Confusion with natural gestures

Hard to learn and remember

Page 171: Remixing Mobile User Experience

We’re too expensive, we can’t do enough, we can’t be the bottleneck — we need to disseminate

Not enough UX skills

Page 172: Remixing Mobile User Experience

Not enough UX

Too expensive

Tangible ROI is unclear

Lack of supply to meet demand

Supply isn’t of great quality

Page 173: Remixing Mobile User Experience

UX Spectrum

Strategy

ResearchInterface

Info

rmat

ion

PSProduct Strategy

CXCustomer

Experience

VDVisual Design

IxDInteraction

Design

QlRQualitative

Research

qNRQuantitative Research

IAInformation Architecture

CSContent Strategy

Work in progress with Vitamin T…

UX Spectrum of skills

Page 174: Remixing Mobile User Experience

UX Spectrum

Strategy

ResearchInterface

Info

rmat

ion

PSProduct Strategy

CXCustomer

Experience

VDVisual Design

IxDInteraction

Design

QlRQualitative

Research

qNRQuantitative Research

IAInformation Architecture

CSContent Strategy

Work in progress with Vitamin T…

Product Designer

Strategy

ResearchInterface

Info

rmat

ion

Product Strategy Customer Experience Visual Design

In

teraction D

esign Qualitative Research Quantitative Research§

Info

rmat

ion

Arc

hit

ectu

re

Co

nte

nt S

trat

egy

Service Designer

Strategy

Research

Interface

Info

rmat

ion

Product Strategy Customer Experience Visual Design

In

teraction D

esign Qualitative Research Quantitative Research§

Info

rmat

ion

Arc

hit

ectu

re

Co

nte

nt S

trat

egy

UI / UX Designer

Strategy

Research

Interface

Info

rmat

ion

Product Strategy Customer Experience Visual Design

In

teraction D

esign Qualitative Research Quantitative Research§

Info

rmat

ion

Arc

hit

ectu

re

Co

nte

nt S

trat

egy

UX Strategist

Strategy

Research

Interface

Info

rmat

ion

Product Strategy Customer Experience Visual Design

In

teraction D

esign Qualitative Research Quantitative Research§

Info

rmat

ion

Arc

hit

ectu

re

Co

nte

nt S

trat

egy

Page 175: Remixing Mobile User Experience

So many organisations, skills and roles to navigate

Many different people to work with

Page 176: Remixing Mobile User Experience

Hard to observe context of use on the move

Understanding mobile experiences is hard

Page 177: Remixing Mobile User Experience

Physical web, native vs. web, agile vs. waterfall

Dogmatic differences

Page 178: Remixing Mobile User Experience

We use a lot of jargon and deceptive language

Bad language

Page 179: Remixing Mobile User Experience

Battle the bullshit

Ban deception

– Intuitive

– Seamless

– Frictionless

– No UI

– Natural UI

Clarify our jargon

– Lean

– MVP

– Responsive / adaptive

– Mobile first

Page 180: Remixing Mobile User Experience

Looking forward Opportunities

Page 181: Remixing Mobile User Experience

Applying design across all levels of the mobile experience

Design across all levels

Page 182: Remixing Mobile User Experience

Design better UI components– Buttons – Signifiers – Scrollbars

Tap me please

Page 183: Remixing Mobile User Experience

Use the right interactions– See – Tap – Swipe – Stroke – Speak

Page 184: Remixing Mobile User Experience

On clearer screens– Layouts – Grids – Cards – Zones – Drawers

Tap me please

Page 185: Remixing Mobile User Experience

Within better flows– Drill down – Traverse – Fade – Pogo stick

Tap me please

Page 186: Remixing Mobile User Experience

Within quality apps– Proposition – App icon

Tap me please

Page 187: Remixing Mobile User Experience

Better device app organisation– App icon – Within groups – On different screens – In widgets

Tap me please

Page 188: Remixing Mobile User Experience

Better app store organisation – App icon – Within groups

Page 189: Remixing Mobile User Experience

To put on their devices– Smartphones – Smart watches – Tablets

Page 190: Remixing Mobile User Experience

To use in different environments

Icons created by Jonathan Li, DonBLC and parkjisun from the Noun Project

– Car – Home – Office – Street

Page 191: Remixing Mobile User Experience

In different geographies– Connectivity – Data plans

Created by Yamini Ahluwaliafrom the Noun Project

Page 192: Remixing Mobile User Experience

Design skills are important across all of them

Elements + interactions

Screens + flows

Apps OS App stores Devices Environments + geographies

Tap me please

Different levels of abstraction that we can design around

Page 193: Remixing Mobile User Experience

User research

Sound design

Motion graphics

Visual language

Information design

Information architecture

Interaction design

Experience strategy

Elements + interactions

Screens + flows

Apps OS App stores Devices Environments + geographies

Tap me please

Page 194: Remixing Mobile User Experience

Uniting the worlds of physical products with digital services

Cohere the Physical and Digital

Page 195: Remixing Mobile User Experience

A recipe for integrated products?

+ +Physical Product

Digital Interface

Digital Service

Integrated product

=

Page 196: Remixing Mobile User Experience

+ +Physical Product

Digital Interface

Digital Services

Aesthetic Visceral. Visual, sonic, feel.

Interactive Behavioural. Distribution of inputs and controls.

Experiential Reflective. Fit with person’s context and ecosystems.

Key levels of harmony

Components of integrated experience

Page 197: Remixing Mobile User Experience

iPod The original integrated product?

Appropriate interactions — Hardware and software

interface working together — iTunes store — Aesthetic mismatch

Page 198: Remixing Mobile User Experience

Unite product and graphic language

Nokia and Microsoft Windows mobileSeparated at birth

Page 199: Remixing Mobile User Experience

Nest Rare harmony?

Coherent product-service — Elegant hardware — Slick UI — Intelligent services

Page 200: Remixing Mobile User Experience

Norman, Verplank, Tog, Neilsen and more

Revisit (and respect) our elders

Page 201: Remixing Mobile User Experience

I want harmony

Page 202: Remixing Mobile User Experience

Think of the motor

Page 203: Remixing Mobile User Experience

Diverge again

Focused devices

Peripherals and accessories

Page 204: Remixing Mobile User Experience
Page 205: Remixing Mobile User Experience
Page 206: Remixing Mobile User Experience

Even if they do have some senior moments

Page 207: Remixing Mobile User Experience

Ideally the ones that have research evidence and design solutions

But follow practitioners

Page 208: Remixing Mobile User Experience
Page 209: Remixing Mobile User Experience
Page 210: Remixing Mobile User Experience

Connect, calibrate and create with different skillets

Craft collaboration

Page 211: Remixing Mobile User Experience

How can we better collaborate with an increasing number of stakeholders of different backgrounds? ?

Page 212: Remixing Mobile User Experience

Create Ca

libra

te

Connect

Strategies

Page 213: Remixing Mobile User Experience

C

reate

C

alib

rate

Connect

Be

human

Hold up

a mirror

Establish

frames

Foster

friendly

friction

Practice,

practice,

practice

Flex

yourselfPrinciples

Page 214: Remixing Mobile User Experience

C

reate

C

alib

rate

Connect

Be

human

Hold up

a mirror

Establish

frames

Foster

friendly

friction

Practice,

practice,

practice

Flex

yourself

Crafting Collaboration

Talking

Capturing

Listening

Learning other

perspectives

Planning and

preparing

Sharing at

right time

Skills

Page 215: Remixing Mobile User Experience

As well as the product/service and its interface

Consider experience + engagement

Page 216: Remixing Mobile User Experience

You can start with an idea, a need, some technology– A service – A product – A feature

Page 217: Remixing Mobile User Experience

Which you can empower through good designEmpower

– Desirable – Accessible – Usable – Powerful

Page 218: Remixing Mobile User Experience

To engage the audienceEmpower EngageEmpower Engage

– Reach out – Connect – Sell – Remind

Page 219: Remixing Mobile User Experience

And embrace the wider systemEmpower EmbraceEngage

– Integrate with other services – Fit into people’s lives – Cohere with conventions

Page 220: Remixing Mobile User Experience

Just remember there are 1000s like your product or service

Page 221: Remixing Mobile User Experience

3 strategies

Get (and stay) on the radar

Unlock the potential

Connect to the wider system

1 2 3

Engage Empower Embrace

Jean-Philippe CabarocCreated by Pantelis GkavosCreated by Joel Bryant

Page 222: Remixing Mobile User Experience

Go to where people are, and listen with your eyes

Understand behaviours in context

Page 223: Remixing Mobile User Experience

Observe real people doing real things in their real environments

Page 224: Remixing Mobile User Experience

The world The products and services that people will use and the context of that usage

The user How they see the world and how they need to manipulate it

Page 225: Remixing Mobile User Experience

The world The products and services that people will use and the context of that usage

The user How they see the

world and how they need to manipulate it

Environment User

Situation Task

System

FamiliarityEcosystem

Intent

Page 226: Remixing Mobile User Experience

Environment User

Situation Task

System

FamiliarityEcosystem

Intent

The world The products and services that people will use and the context of that usage

The user How they see the

world and how they need to manipulate it

Page 227: Remixing Mobile User Experience

Environment User

Situation Task

System

FamiliarityEcosystem

Intent

Usability

Product

Experience

Brand

The world The user

Page 228: Remixing Mobile User Experience

Cennydd Bowles: http://www.cennydd.com/blog/designing-with-context

evices nvironment ime ctivity ndividual ocation ocial

D E T A I L S

Page 229: Remixing Mobile User Experience

— IBM, 1980

customers didn’t like the solution, not because of flaws in the recognition but because of a host of hitherto-unseen environmental challenges

IBM voice UI

Page 230: Remixing Mobile User Experience

Speaking taxed the subject’s throat

There was concern for privacy

Awkward in a communal setting

Page 231: Remixing Mobile User Experience

Polite interactions

Contextual

Respectful

Discrete

Page 232: Remixing Mobile User Experience

Wrapping up Conclusions

Page 233: Remixing Mobile User Experience

We have all the parts already We just need to remix them in our own style

Goals

– Think beyond interfaces + devices

– Empower technology

– Engage people

– Embrace wider systems

– Understand the real context

Key tactics

– Connect, calibrate + create with others

– Keep learning from each other

– Think beyond one person’s answers

REMIXING User Experience

Page 234: Remixing Mobile User Experience

Thank you

@jasonmesut