Build Measure Learn is Broken

72
Build Measure Learn Is Not Enough @MandaLaceyS

Transcript of Build Measure Learn is Broken

Page 1: Build Measure Learn is Broken

Build Measure Learn Is Not Enough

@MandaLaceyS

Page 2: Build Measure Learn is Broken

Build Measure Learn Is Broken

@MandaLaceyS

Page 3: Build Measure Learn is Broken

3

Image from http://theleanstartup.com/principles

Page 4: Build Measure Learn is Broken

What is The Lean Startup, again?

Page 5: Build Measure Learn is Broken

Lean Startup

A method to develop new businesses and products that addresses uncertainty and risk

through cycles of rapid experimentation.

Page 6: Build Measure Learn is Broken
Page 7: Build Measure Learn is Broken
Page 8: Build Measure Learn is Broken
Page 9: Build Measure Learn is Broken
Page 10: Build Measure Learn is Broken
Page 11: Build Measure Learn is Broken

Lean Startup Concepts

Entrepreneurship is everywhere. Eliminate waste.

Innovation Accounting. Validated Learning.

Build. Measure. Learn. Minimum Viable Products.

Page 12: Build Measure Learn is Broken

12

Page 13: Build Measure Learn is Broken

Observe

Question

Hypothesize

Experiment

Conclusion

Page 14: Build Measure Learn is Broken

Build. Measure.

Learn.

Page 15: Build Measure Learn is Broken

Build - MVPs Measure - Meaningful data

Learn - To pivot or persevere

Page 16: Build Measure Learn is Broken

Build

Page 17: Build Measure Learn is Broken

Minimum

Viable

Product (required to learn)

Page 18: Build Measure Learn is Broken

DA REAL MVP

NOT half baked

NOT a bad experience

NOT necessarily code

Page 19: Build Measure Learn is Broken

GOOD MVP

Page 20: Build Measure Learn is Broken

GOOD ITERATION

Page 21: Build Measure Learn is Broken

GOOD ITERATION

Page 22: Build Measure Learn is Broken

NOT MINIMUM

Page 23: Build Measure Learn is Broken

NOT VIABLE

Page 24: Build Measure Learn is Broken

NOT HALF-Baked

NOT VIABLE

Page 25: Build Measure Learn is Broken

Measure

Page 26: Build Measure Learn is Broken

Validated Learning

Page 27: Build Measure Learn is Broken

answer

Actionable MetricsVanity Metrics*

Anything that looks good but doesn’t help you make a decision

Examples: • Facebook likes • Pageviews • Event attendees

Tied to specific, repeatable tasks and help you decide whether you’re succeeding or not

Examples: • Revenue/customer • Retention rate • Customer source

Page 28: Build Measure Learn is Broken

*Metric Caveat

Page 29: Build Measure Learn is Broken

Learn

Page 30: Build Measure Learn is Broken

30

Pivot! Pivot! PIVOT!

Page 31: Build Measure Learn is Broken

31

Page 32: Build Measure Learn is Broken

*Analysis Caveat

Page 33: Build Measure Learn is Broken

Observe

Question

Hypothesize

Experiment

Conclusion

Page 34: Build Measure Learn is Broken

Observe

Question

Hypothesize

Experiment

Conclusion LearnMeasure

Build

Page 35: Build Measure Learn is Broken

Observe

Question

Hypothesize

Experiment

Conclusion LearnMeasure

Build

??

??

??

Page 36: Build Measure Learn is Broken

So what to do?

Page 37: Build Measure Learn is Broken

1. Start with observation

Page 38: Build Measure Learn is Broken

38

Interview

Page 39: Build Measure Learn is Broken

39

Diary Study or Experience Sampling

Page 40: Build Measure Learn is Broken

40

Interviews, diary studies, experience mapping, etc.

Experience Map

Page 41: Build Measure Learn is Broken

2. Make an assumption about a problem

Page 42: Build Measure Learn is Broken

42

Page 43: Build Measure Learn is Broken

43

The cat is looking for a comfy place to nap.

Page 44: Build Measure Learn is Broken

44

NOT: The cat is too big for the box.

Page 45: Build Measure Learn is Broken

45

NOT: We should build a cat bed.

Page 46: Build Measure Learn is Broken

3. Generate solutions

Page 47: Build Measure Learn is Broken

47

Page 48: Build Measure Learn is Broken

48

Page 49: Build Measure Learn is Broken

49

Page 50: Build Measure Learn is Broken

50

Page 51: Build Measure Learn is Broken

Participatory Design

Page 52: Build Measure Learn is Broken

6 up, 1 ups

Idea

IdeaIdeaIdea

IdeaIdea6 Ideas

Page 53: Build Measure Learn is Broken

6 up, 1 ups

IdeaBest Idea Notes

Page 54: Build Measure Learn is Broken

6 up, 1 ups

IdeaBest Idea Notes

Page 55: Build Measure Learn is Broken

4. Hypothesize solution impact

Page 56: Build Measure Learn is Broken

56

If we build a cat bed, Sammy will spend 20% less time sleeping on my keyboard so I can work.

Page 57: Build Measure Learn is Broken

Usability Test

Usability Tests

Page 58: Build Measure Learn is Broken

A/B Tests

Page 59: Build Measure Learn is Broken

Wizard of Oz

Page 60: Build Measure Learn is Broken

Start with Think, not Build

Page 61: Build Measure Learn is Broken

61

Image from http://theleanstartup.com/principles

Page 62: Build Measure Learn is Broken
Page 63: Build Measure Learn is Broken

Start here!!

Page 64: Build Measure Learn is Broken

Reduce cycle time. Not build time.

5.

Page 65: Build Measure Learn is Broken
Page 66: Build Measure Learn is Broken

6. Don’t forget the big picture.

Page 67: Build Measure Learn is Broken

67

Page 68: Build Measure Learn is Broken

Story Time.

Page 69: Build Measure Learn is Broken
Page 70: Build Measure Learn is Broken

70

Page 71: Build Measure Learn is Broken

71

Page 72: Build Measure Learn is Broken

THANK YOU

@MandaLaceyS [email protected]