Doing DevOps? Better base it on performance - DevNexus 2014
-
Upload
stephen-wilson -
Category
Technology
-
view
504 -
download
0
description
Transcript of Doing DevOps? Better base it on performance - DevNexus 2014
![Page 1: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/1.jpg)
1 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Stephen Wilson
• apmblog.compuware.com • @steve0wilson (0 as in zero)
• LinkedIn • [email protected]
![Page 2: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/2.jpg)
2 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
80
60
150
% of a Development Budget is spent on ID and fixing defects
![Page 3: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/3.jpg)
3 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 4: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/4.jpg)
4 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
80
60
150
% of a Development Budget is spent on ID and fixing defects
B dollars is the cost of defects that reach production
![Page 5: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/5.jpg)
5 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 6: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/6.jpg)
6 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
80
60
150
% of a Development Budget is spent on ID and fixing defects
B dollars is the cost of defects that reach production
X the cost to fix a problem in production vs. in development
![Page 7: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/7.jpg)
7 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 8: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/8.jpg)
8 8
DOING DEVOPS? WHY YOU NEED TO FOCUS ON PERFORMANCE Andreas Grabner, Technology Strategist @ Compuware/dynaTrace
![Page 9: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/9.jpg)
9 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 10: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/10.jpg)
10 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 11: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/11.jpg)
11 11
![Page 12: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/12.jpg)
12 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 13: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/13.jpg)
13 13
![Page 14: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/14.jpg)
14 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Development
TesZng
ProducZon Release
The Waterfall Process
![Page 15: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/15.jpg)
15 15
Then came Agile…
![Page 16: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/16.jpg)
16 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Rapid Acceleration…
![Page 17: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/17.jpg)
17 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Production Problems
![Page 18: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/18.jpg)
18 18
Produc>on (local, remote, outsourced)
• Cloud load tesZng • Monitoring
![Page 19: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/19.jpg)
19 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 20: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/20.jpg)
20 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
buzzword? process?
agile ops? a way of life?
![Page 21: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/21.jpg)
21 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Seeking Knowledge vs. Applying Knowledge
![Page 22: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/22.jpg)
22 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
BUSINESS ALIGNMENT
TRADITIONS
ORGANIZATIONAL TRUST
CHALLENGES NATURAL FRICTION
LEGACY ATTITUDES
![Page 23: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/23.jpg)
23 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
ReacZve ProacZve PredicZve
![Page 24: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/24.jpg)
24 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 25: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/25.jpg)
25 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 26: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/26.jpg)
26 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 27: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/27.jpg)
27 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 28: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/28.jpg)
28 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Development (local, remote, outsourced)
Test/QA Produc>on
• Ops tools • Network Tools • Log scraping • App Monitoring
• Load TesZng • App Monitoring
• Jprobe • Eclipse • Debuggers
![Page 29: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/29.jpg)
29 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Problem: Unclear Ops Problem Descrip>ons
![Page 30: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/30.jpg)
30 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 31: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/31.jpg)
31 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Unclear End User Problem Descrip>ons …
![Page 32: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/32.jpg)
32 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
… when you really want to have this …
![Page 33: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/33.jpg)
33 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
… and this
Top Contributor is related to String handling
99% of that Zme comes from RegEx Pabern Matching
Page Rendering is the main component
![Page 34: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/34.jpg)
34 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 35: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/35.jpg)
35 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
STOP THE BLEEDING
COMMUNICATE THE WINS
IDENTIFY KEY PLAYERS
![Page 36: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/36.jpg)
36 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 37: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/37.jpg)
37 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 38: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/38.jpg)
38 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 39: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/39.jpg)
39 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 40: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/40.jpg)
40 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 41: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/41.jpg)
41 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Performance Focus in Test Automa>on
Embed your Architectural Results in Jenkins
![Page 42: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/42.jpg)
42 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Performance Focus in Test Automa>on
Build-‐level Performance Metrics
![Page 43: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/43.jpg)
43 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
STANDARDIZE THE PROCESS
DEFINE PERFORMANCE DRIVERS
CREATE A CONSTITUTION
![Page 44: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/44.jpg)
44 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 45: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/45.jpg)
45 45
How? Performance Focus in Test AutomaZon
12 0 120ms
3 1 68ms
Build 20 testPurchase OK
testSearch OK
Build 17 testPurchase OK
testSearch OK
Build 18 testPurchase FAILED
testSearch OK
Build 19 testPurchase OK
testSearch OK
Build # Test Case Status # SQL # Excep CPU
12 0 120ms
3 1 68ms
12 5 60ms
3 1 68ms
75 0 230ms
3 1 68ms
Test Framework Results Architectural Data
We identified a regresesion
Problem solved
Lets look behind the scenes
Exceptions probably reason for failed tests
Problem fixed but now we have an architectural regression
Problem fixed but now we have an architectural regression
Now we have the functional and architectural confidence
![Page 46: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/46.jpg)
46 46
How? Performance Focus in Test AutomaZon
Analyzing All Unit / Performance Tests
Analyze Perf Metrics
IdenZfy Regressions
![Page 47: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/47.jpg)
47 47
How? Performance Focus in Test AutomaZon
Cross Impact of KPIs
![Page 48: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/48.jpg)
48 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
![Page 49: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/49.jpg)
49 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
DRIVE FEEDBACK
AUTOMATE THE PROCESS
PERFORMANCE BASED DECISIONS
![Page 50: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/50.jpg)
50 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
ROME WAS NOT BUILT IN A DAY
SPONSORSHIP
DON’T BE AFRAID TO FAIL
TALENT KNOWLEDGE
![Page 51: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/51.jpg)
51 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE
Stephen Wilson
• apmblog.compuware.com • @steve0wilson (0 as in zero)
• LinkedIn • [email protected]
![Page 52: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/52.jpg)
52 © 2011 Compuware Corporation — All Rights Reserved © 2011 Compuware Corporation — All Rights Reserved
52
ParZcipate in Compuware APM Discussion Forums apmcommunity.compuware.com
Like us on Facebook facebook.com/CompuwareAPM
Join our LinkedIn group Compuware APM User Group
Follow us on TwiTer twiber.com/CompuwareAPM
Read our Blog About:Performance
Watch our Videos & product Demos youtube.com/Compuware
www.compuware.com/APM
Thank You
![Page 53: Doing DevOps? Better base it on performance - DevNexus 2014](https://reader033.fdocuments.us/reader033/viewer/2022052522/554f5670b4c905b9508b50fa/html5/thumbnails/53.jpg)
53 © 2011 Compuware Corporation — All Rights Reserved © 2011 Compuware Corporation — All Rights Reserved
53 COMPANY CONFIDENTIAL – DO NOT DISTRIBUTE