Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa...

34
Teresa Torres www.ProductTalk.org { @ttorres Shifting to an Experimental Mindset: The Dos and Don’ts of Hypothesis Testing

Transcript of Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa...

Page 1: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

Teresa Torres www.ProductTalk.org !!

{@ttorres !!

Shifting to an Experimental Mindset: The Dos and Don’ts of Hypothesis Testing

Page 2: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

It all starts with a good idea.

Page 3: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Confidence is not connected to reality.

Page 4: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Confidence is a symptom of coherence.

Page 5: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Coherence doesn’t necessitate truth.

Page 6: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Research in Motion was confident in their secure network.

Page 7: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Yahoo was confident in their start page.

Page 8: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

What assumptions are you making?

Page 9: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Wisdom = knowledge + doubt

Page 10: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Work toward your vision with conviction.

Page 11: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

And be prepared to be wrong.

Page 12: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

We need to be wise about our product decisions.

Page 13: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

We can’t predict the future.

Page 14: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

We will be wrong.

Page 15: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

We don’t know what’s best for our

customers.

Page 16: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

We don’t know

what to build next.

Page 17: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

And we don’t know

when we can deliver it.

Page 18: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

We need to update our methods to acknowledge these truths.

Page 19: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Instead of writing 50-page PRDs …

Page 20: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

… we need to build iteratively.

Page 21: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Instead of telling our customers what’s on our roadmaps …

Page 22: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

… we need to test our hypotheses in

customer interviews.

Page 23: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Instead of building 10 features to find out only three worked …

Page 24: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

… we need to run 10 experiments and only build the 3 that worked.

Page 25: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

What would happen if your competitors started working this way?

Page 26: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

How do you shift to

an experimental mindset?

Page 27: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Be prepared to be wrong.

Page 28: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Test your assumptions.

Page 29: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Experiment before you build.

Page 30: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Know what you need to learn.

Page 31: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Page 32: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

Start with good hypotheses.

Page 33: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

@ttorres

The 5 components of a good hypothesis.

Page 34: Shifting to an Experimental Mindsetsvpma.org/.../2011/04/SVPMA-Talk-Teresa-Torres.pdf · Teresa Torres !! {@ttorres!! Shifting to an Experimental Mindset: The Dos and Don’ts of

Teresa Torres Product Consultant & Coach !!

{

ProductTalk.org@ttorres

Let’s keep the conversation going.