Engineering Change

Engineering Change: Enable rapid experimentation

Kellan Elliott-McCrea@kellanCTO, Etsy

Thursday, May 17, 12

* A marketplace for handmade and vintage goods.

In April 2012

* 875,000 artisans and creative independents* $63.6 million USD in sales* 1.32 billion page views


Engineering Change:

* Continuous Deployment* Metrics driven development


Engineering Change:

* Make mistakes quickly* Learn from mistakes


Engineering Change:

* Continuous Deployment* Metrics driven development


Continuous Deployment:

a technique for rapid iteration



make failure cheap



small changes, pushed frequently



small changes, pushed frequently.

To production.



10,068 releases to production in 2011

@ Etsy



How?



No branching.

“All existing revision control systems werebuilt by people who build installedsoftware”- Paul Hammond,Always Ship Trunk, Velocity 2010Thursday, March 17, 2011


if ($cfg[‘awesome_new_search’]) {# new hotness$rsp = do_solr();

} else {# boring old stuff$rsp = do_grep();

}


feature flags



Ramp - ups (on top of feature flags)

1. Launch to staff only2. Launch to 1% of all users3. Launch to members of a beta group



any engineer can launch a feature to

1% of users



~200 experiments live right now


Metrics driven development:

optimize for learning



measure everything



getting started:make it easy



measure everything:logs, monitoring, A/B, graphs, StatsD



StatsD @Instagram, Pinterest, Github, Mozilla, LAN.com, Zynga, Kickstarter, LivingSocial and 70+ other companies



StatsD“We love statsd at Instagram. Written by Etsy, it’s a network daemon that aggregates and rolls-up data into Graphite. At its core, it has two types of statistics: counter and timers. We use the counters to track everything from number of signups per second to number of likes, and we use timers to time generation of feeds, how long it takes to follow users, and any other major action.” - Mike Krieger, Founder and CTO, Instagram.


http://github.com/etsy/statsd/

http://github.com/etsy/statsd/

http://github.com/etsy/

http://github.com/etsy/


StatsD Open source, a daemon for timing and counting things, graphs rates, averages and 95th percentile, 20-30 minute install, easy to use


Metrics driven development

StatsD::timing("page.render", $msec);



getting started:your 5 core metrics



5 core metrics @ Etsy:sign ups, logins, checkout, new listings, posts in the bugs forums



378,000 metrics, collected roughly once a second



the confidence to change


Adapt, find market fit.

Engineering change:Rapid experimentation


Adapt, find market fit,addictive to engineers.

Engineering change:Rapid experimentation


Thank you!

Lean more: http://codeascraft.etsy.com


http://codeascraft.etsy.com

http://codeascraft.etsy.com

Engineering Change

Technology

Transcript of Engineering Change