Experimentation At Skyscanner By Colin McFarland

33
Colin McFarland @MCFRL Experimentation

Transcript of Experimentation At Skyscanner By Colin McFarland

Page 1: Experimentation At Skyscanner By Colin McFarland

Colin McFarland @MCFRL

Experimentation

Page 2: Experimentation At Skyscanner By Colin McFarland

Education & Tooling

Page 3: Experimentation At Skyscanner By Colin McFarland

Associations (x,y)

Page 4: Experimentation At Skyscanner By Colin McFarland

PromotionHere

Page 5: Experimentation At Skyscanner By Colin McFarland
Page 6: Experimentation At Skyscanner By Colin McFarland

Causality (x -> y)

Page 7: Experimentation At Skyscanner By Colin McFarland
Page 8: Experimentation At Skyscanner By Colin McFarland
Page 9: Experimentation At Skyscanner By Colin McFarland
Page 10: Experimentation At Skyscanner By Colin McFarland
Page 11: Experimentation At Skyscanner By Colin McFarland

HARKing

Page 12: Experimentation At Skyscanner By Colin McFarland
Page 13: Experimentation At Skyscanner By Colin McFarland

p-hacking

Page 14: Experimentation At Skyscanner By Colin McFarland
Page 15: Experimentation At Skyscanner By Colin McFarland

We tend to digest data in ways that confirm what we already think

Page 16: Experimentation At Skyscanner By Colin McFarland
Page 17: Experimentation At Skyscanner By Colin McFarland
Page 18: Experimentation At Skyscanner By Colin McFarland
Page 19: Experimentation At Skyscanner By Colin McFarland

Miami

Edinburgh & Glasgow

Singapore

BeijingBarcelona

Shenzhen

BudapestSofia

London

Tokyo

Page 20: Experimentation At Skyscanner By Colin McFarland

Peer review

Page 21: Experimentation At Skyscanner By Colin McFarland
Page 22: Experimentation At Skyscanner By Colin McFarland

Discovery

Page 23: Experimentation At Skyscanner By Colin McFarland
Page 24: Experimentation At Skyscanner By Colin McFarland

Ground Truth Problem

Page 25: Experimentation At Skyscanner By Colin McFarland
Page 26: Experimentation At Skyscanner By Colin McFarland

Parallelism

Page 27: Experimentation At Skyscanner By Colin McFarland
Page 28: Experimentation At Skyscanner By Colin McFarland
Page 29: Experimentation At Skyscanner By Colin McFarland

Configuration

Page 30: Experimentation At Skyscanner By Colin McFarland
Page 31: Experimentation At Skyscanner By Colin McFarland
Page 32: Experimentation At Skyscanner By Colin McFarland

Build tools that make doing the right thing easy

(and the wrong thing hard)

Page 33: Experimentation At Skyscanner By Colin McFarland

@MCFRL