Microservices 101: From DevOps to Docker and beyond
-
Upload
donnie-berkholz -
Category
Software
-
view
1.414 -
download
1
Transcript of Microservices 101: From DevOps to Docker and beyond
![Page 1: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/1.jpg)
Microservices 101: From DevOps to Docker and beyond
Donnie Berkholz, Ph.D.Research Director — Development, DevOps, & IT Ops
MSP Computer Measurement Group, Feb 2016
![Page 2: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/2.jpg)
2
microservices
![Page 3: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/3.jpg)
3
Source: 451 Research custom surveys
Minimizing risk, maximizing agility
![Page 4: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/4.jpg)
The need for speed
4
Source: 451 DevOps study, Q3 2014; n=237
63% want more
![Page 5: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/5.jpg)
Technology adoption
is increasingly bottom-up
5
Wikipedia: G.dallorto
![Page 6: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/6.jpg)
6
Source: 451/Microsoft Hosting + Cloud Study 2015
![Page 7: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/7.jpg)
The new stack?
7
An infinite array of possible stacks.
![Page 8: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/8.jpg)
DevOps:Putting IT into high gear
8
![Page 9: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/9.jpg)
9
Agile, truly tip to tail
Business to customer
![Page 10: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/10.jpg)
3 pillars of DevOps
10
Culture
Automation
Measurement
![Page 11: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/11.jpg)
11
Culture: Tear down all the silos
Flickr: kalandrakas
![Page 12: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/12.jpg)
12
Flickr: respres Flickr: hartvig, snapeverything, roymaloon
Automation: Pets vs Cattle
![Page 13: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/13.jpg)
Automation: Infrastructure as code
13
Wikipedia: Magnus Manske
![Page 14: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/14.jpg)
Knight Capital and the $460 million bug
14
Wikipedia: Jericho
![Page 15: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/15.jpg)
Continuous delivery
15
Source: continuousautomation.com
![Page 16: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/16.jpg)
16
Source: Don Reinertsen, The Principles of Product Development Flow
![Page 17: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/17.jpg)
Where are we today?
17
10.0%
54.7%
27.9%
6.8%
0.7%
Highly Manual
Manual with Limited Automation Tools
Automated with Manual Exception Handling
Policy Based Automation and Orchestration
Other
n = 843 Source: 451 VotE Cloud, Q3 2015
![Page 18: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/18.jpg)
Measurement: #monitoringsucks/monitoringlove
18
![Page 19: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/19.jpg)
Who is doing DevOps?
Google, Amazon, Netflix, Etsy, Spotify, Twitter, Facebook … CSC, IBM, CA, SAP, HP, Microsoft, Red Hat … GE Capital, Nationwide, BNP Paribas, BNY Mellon, World Bank, Paychex, Intuit … The Gap, Nordstrom, Macy’s, Williams-Sonoma, Target … General Motors, Northrop Grumman, LEGO, Bosche … UK Government, US Department of Homeland Security … Kansas State University…
Who else? Source: Gene Kim
19
![Page 20: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/20.jpg)
Source: Puppet Labs 2014 State Of DevOps
Can Large Orgs Be High Performers?
Yes.
But orgs with 10,000+ employees 40% less likely to be high performing vs.
500 employee orgs…
20
![Page 21: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/21.jpg)
Enter containers: The future of virtualization
![Page 22: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/22.jpg)
Automation, agility, empathy
22
![Page 23: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/23.jpg)
Container-native OSs
23 Snappy Ubuntu
![Page 24: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/24.jpg)
Developers love Docker
24
![Page 25: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/25.jpg)
Docker is not just a toy
25
Prod in Q3 2015:
22.5% } Source: 451 VotE Cloud, 2015; Q1 n=991; Q3 n=960
31.5%
10.2%
8.4%
9.4%
4.7%
35.8%
56.1%
10.7%
3.9%
4.2%
2.1%
22.9%
Discovery and Evaluation
Running Trials/Pilot Projects
In Test and Development Environment
Initial Implementation of Production Applications
Broad Implementation of Production Applications
No Plans
Q3 2015 Q1 2015
of cloud-using orgs
![Page 26: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/26.jpg)
Today, early adopters. Tomorrow, the majority.
26
12.0%
41.4%
37.1%
9.5%
We are early adopters on the leading edge
We are pragmatic about new technology, but will act sooner rather than later
We are conservative about new technology and take a wait and see approach
We are skeptical and are usually late to the game
Source: 451 VotE Cloud, Q3 2015; n=935
![Page 27: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/27.jpg)
Fragmentation drives microservices —enabled by containers
27
![Page 28: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/28.jpg)
28
Loosely coupled services
“ The only communication allowed [at Amazon] is via service interface calls over the network.” – Steve Yegge, Google, Oct 2011,
paraphrasing Jeff Bezos memo
https://plus.google.com/+RipRowan/posts/eVeouesvaVX
![Page 29: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/29.jpg)
Loosely coupled teams
“ One of the biggest changes is that we no longer have an official ‘architecture’ team. Instead, we have made ‘architecture’ an ‘ingredient’ on each of our teams.”
29 http://tech.gilt.com/post/102628539834/making-architecture-work-in-microservice
– Lauri Apple, Gilt Groupe, 14 Nov 2014
![Page 30: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/30.jpg)
The foundation of microservices
30
![Page 31: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/31.jpg)
Monitoring remains a challenge
• Scale • Complexity & flow • Transience • Bottlenecks / queue depth • How to respond to self-healing issues?
31
![Page 32: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/32.jpg)
Open-source tools emerging (proprietary too)
32
spigo / simianviz Zipkin
![Page 33: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/33.jpg)
Real-world examples
33
![Page 34: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/34.jpg)
Real-world example #1
34 http://www.slideshare.net/nathariel/scaling-microservices-architecture-on-aws
![Page 35: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/35.jpg)
Hailo architecture
35
![Page 36: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/36.jpg)
Hailo architecture
36
![Page 37: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/37.jpg)
Hailo architecture
37
![Page 38: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/38.jpg)
38
“ Our infrastructure is decomposed into a large number of very simple pieces of software – each of which is independently deployed and monitored, and can be easily reasoned about.” – Matt Heath, Hailo, 9 Mar 2015
https://sudo.hailoapp.com/services/2015/03/09/journey-into-a-microservice-world-part-3/
![Page 39: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/39.jpg)
Complexity is the new normal
39
![Page 40: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/40.jpg)
Real-world example #2: REA (realestate.com.au)
40
http://techblog.realestate.com.au/a-microservices-implementation-retrospective/
![Page 41: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/41.jpg)
REA microservices timeline
41
0
20
40
60
0 6 12 18 24
Mic
rose
rvic
es
Months
http://yowconference.com.au/slides/yow2014/SkurrieBottcherEvans-MonolithsToMicroservices.pdf
“ Microservices is a long term strategy.” – Evan Bottcher,
ThoughtWorks/REA, 9 Dec 2014
![Page 42: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/42.jpg)
42
“ We relied on [our open-source library] Pacts, some manual tests, and then made sure there was very good monitoring in production.” – Beth Skurrie, REA consultant, 10 Nov 2014
http://techblog.realestate.com.au/a-microservices-implementation-retrospective/
![Page 43: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/43.jpg)
Real-world example #3: Ctrip (Chinese travel site)
43
http://www.slideshare.net/yang75108/micro-service-architecture-c-trip-v11
![Page 44: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/44.jpg)
Real-world example #3: Ctrip (Chinese travel site)
44
http://www.slideshare.net/yang75108/micro-service-architecture-c-trip-v11
![Page 45: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/45.jpg)
Real-world example #3: Ctrip (Chinese travel site)
45
http://www.slideshare.net/yang75108/micro-service-architecture-c-trip-v11
![Page 46: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/46.jpg)
Real-world example #3: Ctrip (Chinese travel site)
46
http://www.slideshare.net/yang75108/micro-service-architecture-c-trip-v11
![Page 47: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/47.jpg)
Minimizing risk, maximizing agility
Architecture: Microservices, composable monitoring Code: Continuous integration, feature flags Servers: Continuous delivery, infrastructure as code Services: Rolling updates, resilience engineering Product: Continuous deployment, restricted audience
47
![Page 48: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/48.jpg)
How? DevOps (Culture, Automation, Measurement)
What? Microservices Why? Survival
48
![Page 50: Microservices 101: From DevOps to Docker and beyond](https://reader034.fdocuments.us/reader034/viewer/2022050614/5881056c1a28ab22368b4f5b/html5/thumbnails/50.jpg)
Some content from this presentation is Creative-Commons licensed. https://creativecommons.org/licenses/by-sa/https://creativecommons.org/licenses/by/
50