TMF2014 Testing Disruption-K Ross
-
Upload
k-j-ross-associates -
Category
Technology
-
view
68 -
download
1
description
Transcript of TMF2014 Testing Disruption-K Ross
![Page 1: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/1.jpg)
9/05/14
1
1
Disruptive Forces In Testing
Dr Kelvin Ross Australian Test Managers Forum, Sydney 8 May 2014
2
Disruptive Technology
![Page 2: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/2.jpg)
9/05/14
2
3
Disruptive Technology
4
Disruptive Technology
![Page 3: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/3.jpg)
9/05/14
3
5
Disruptive Technology
Biggest Disruptors The Last 5 Years? Agile
Offshoring Virtualisation
![Page 4: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/4.jpg)
9/05/14
4
7
Disruptive Forces
Customer Testing
Dev Ops
“You can't just ask customers what they want and then try to give that to them. By the time you get it built, they'll want something new.”
Steve Jobs
![Page 5: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/5.jpg)
9/05/14
5
9
FAIL FAST
10
Customer Testing
![Page 6: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/6.jpg)
9/05/14
6
Secured $80m in VC funding
Applause!Testing In The Wild
![Page 7: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/7.jpg)
9/05/14
7
Verification “Are we building the product right?”
Validation “Are we building the right product?”
Barry Boehm, 1979
Barry Boehm
Scientific Method for Customer Experiments
to Guide Software Development
![Page 8: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/8.jpg)
9/05/14
8
15
Customer Testing
A / B Tests
Source: Advanced Topics in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks E.g.“Google Analytics Content Experiments”
![Page 9: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/9.jpg)
9/05/14
9
Source: Principles and Practices in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks
Feature Toggles
![Page 10: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/10.jpg)
9/05/14
10
Source: Advanced Topics in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks
Feature Toggles
DEV OPS
![Page 11: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/11.jpg)
9/05/14
11
21
No Silos
22
CI CD CD
Continuous Integration
Continuous Deployment
Continuous Delivery
![Page 12: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/12.jpg)
9/05/14
12
Source: Principles and Practices in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks
Rapid Releases
![Page 13: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/13.jpg)
9/05/14
13
CD Platform
Source Control
Build System
Pipeline Management
& Visualization
Artifact/Package
Repository
Automated Configuration Management
(IaC)
Test infrastructure
Automated Deployment
System
Source: Continuous Delivery at Scale John Esser, Director Engineering Productivity, Ancestry.com ALM Forum Seattle, 2014
Git Flow
![Page 14: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/14.jpg)
9/05/14
14
Source: Principles and Practices in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks
Release Pipeline
Source: Steve Neely, [email protected] @stenvoon http://bit.ly/cdpaper ALM Forum Seattle, 2014
Release Pipeline
![Page 15: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/15.jpg)
9/05/14
15
Source: Advanced Topics in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks
Release Pipeline
Source: Principles and Practices in Continuous Deployment Mike Brittain,Engineering Director, Etsy @mikebrittain mikebrittain.com/talks
Release Pipeline
![Page 16: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/16.jpg)
9/05/14
16
![Page 17: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/17.jpg)
9/05/14
17
33
In 5 Years…
“Be a yardstick of quality. Some people aren't used to an environment where excellence is expected.”
Steve Jobs
![Page 18: TMF2014 Testing Disruption-K Ross](https://reader034.fdocuments.us/reader034/viewer/2022042714/54b6bece4a7959e71b8b456b/html5/thumbnails/18.jpg)
9/05/14
18
35
Q&A