Human testing iOS apps

27
© Mobtest 2013 Human Testing iOS apps Dirk de Kok [email protected] twitter.com/dirkdk Renaissance conference Jan 23rd 2013

description

This is the presentation Mobtest's CTO and founder Dirk de Kok gave at the Renaissance iOS app makers' conference. He talked about user testing iOS apps, including concept testing, usability testing, beta testing, QA testing. See also https://github.com/mobtest/renaissance.io/

Transcript of Human testing iOS apps

Page 1: Human testing iOS apps

© Mobtest 2013

Human Testing iOS apps

Dirk de [email protected]/dirkdk

Renaissance conferenceJan 23rd 2013

Page 2: Human testing iOS apps

‣ works technically as intended

App quality

‣ offers considerable value

‣ intuitive and easy to use

Page 3: Human testing iOS apps

Human testing

Manual QA testing

Concept testing

Usability testing

Beta testing

Live testing

{User testing

Page 4: Human testing iOS apps

Test to create better apps

not just bug free apps

Page 5: Human testing iOS apps

‣ if high quality, app might get featured

‣ initial ratings drive subsequent downloads

‣ reaching a top 25 normally happens

around launch

‣ critical updates take still 1-2 weeks

because of Apple review process

Test early, before launch

Page 6: Human testing iOS apps

Concept testing

Goal

validate app idea with target market

How

‣ find respondents

‣ do interview with factual questions

‣ show mockup or prototype

Page 7: Human testing iOS apps
Page 8: Human testing iOS apps
Page 9: Human testing iOS apps

Usability testing

Goal

test how easy it is to use your app

How

‣ in person

‣ remote

Page 10: Human testing iOS apps

‣ meet testers in office or coffee shop

‣ give tasks with only end result

‣ let user think out loud

‣ observe usage, facial expression, posture

In person usability testing

Page 11: Human testing iOS apps
Page 12: Human testing iOS apps

‣ easier to remember

‣ easier to share with your team

can’t do it on iOS device itself

Record usability test

Page 13: Human testing iOS apps
Page 14: Human testing iOS apps

Via Skype DIY camera

Page 15: Human testing iOS apps

‣ recruit larger group of users

‣ distribute ad hoc build

‣ give tasks with only end result

‣ track task completion in app and

ask questions afterwards by survey

Remote usability testing

Page 16: Human testing iOS apps

‣ does it work as user expects?

‣ discoverability

‣ areas of confusion

‣ positive experience

What to look for

Page 17: Human testing iOS apps

Goals

‣ final feedback from users

‣ integration test with real data

‣ get early adopters enthusiastic about

app (reviews and ratings!)

Beta testing

Page 18: Human testing iOS apps

How

‣ Recruit testers via own network or service

‣ Get their UDID, create ad hoc build and

distribute

‣ Reward feedback

Beta testing

Page 19: Human testing iOS apps

QA testing

Page 20: Human testing iOS apps
Page 21: Human testing iOS apps

Goals

‣ make sure app works technically fine

QA testing

How

‣ get a good test engineer

‣ write a detailed plan

‣ execute plan

Page 22: Human testing iOS apps

QA methods

‣ structured testing with predefined test

scripts with expected outcomes

‣ “go break it” exploratory testing

Page 23: Human testing iOS apps

What to look for

‣ Hardware models x iOS versions

‣ Connectivity (wifi, cell, intermittent)

‣ Gestures, moves, tilting and multitouch

‣ Location/geofencing

Page 24: Human testing iOS apps

Live testing

‣ A/B testing

‣ Monitoring usage patterns

‣ Crash log analysis

‣ Feedback options for user

Page 25: Human testing iOS apps
Page 26: Human testing iOS apps