StackEngine Problem Space Demo
-
Upload
boyd-hemphill -
Category
Technology
-
view
319 -
download
7
description
Transcript of StackEngine Problem Space Demo
![Page 1: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/1.jpg)
Managing Docker Applications in Production
Boyd E. Hemphill @behemphi @stackengine
![Page 2: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/2.jpg)
History - BoydOracle Developer, MySQL DBA, PHP Developer, System Architect, DevOps Director (yea, really)
Started Austin DevOps In 2012
Co-Organizer of DevOps Days Austin
Became involved in Docker Austin in August.
Working with Docker for the first Docker Days Austin
Keep an eye on @stackengine to see if we can make it happen!
![Page 3: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/3.jpg)
History -StackEngine
CopperEgg
Started in May 2014 to address problems arising due to Docker adoptions
Funding announcement October
Currently in private beta
![Page 4: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/4.jpg)
Common Ground
![Page 5: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/5.jpg)
What is The Goal of Your
Company?
![Page 6: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/6.jpg)
What is The Goal of Your
Company?Make Money!
![Page 7: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/7.jpg)
So … What is DevOps?
![Page 8: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/8.jpg)
Is DevOps a Process?
![Page 9: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/9.jpg)
Is it an intersection of overlapping concerns?
![Page 10: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/10.jpg)
Is DevOps a Culture?
![Page 11: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/11.jpg)
DevOps:
DevOps is the way in which a technology organization embeds itself in a business to the benefit of that business.
![Page 12: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/12.jpg)
The Ideal Docker Application
![Page 13: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/13.jpg)
Netflix (unicorn)Service Oriented Architecture
![Page 14: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/14.jpg)
BenefitsIncrease developer velocity using containers to model application topology
Decrease build and test times using containers as build/test agents rather than VMs
Density - Reduce Costs
Separation of Concerns - “Code to an interface” moves to the infrastructure level
Taken together a company that can get to the end state has a significant and lasting competitive advantage
![Page 15: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/15.jpg)
Today’s Docker Reality
![Page 16: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/16.jpg)
ConcernsThis is still very early days for Docker
Tools to support Dockerized applications immature or do not exist
Service oriented architecture is hard
Increasing developer is only a local optima, thus a false economy
Its the first major DevOps initiative not driven by Ops.
![Page 17: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/17.jpg)
SDLC
Developers are moving forward
QA sees production modeling and large test grids
Build engineers see easier build grids
Operations panics - no tools or instrumentation
![Page 18: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/18.jpg)
The Final Mile
![Page 19: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/19.jpg)
The Final Mile
Developer uses containers
System is built and images are produced
Images stored in a private repo
Now we need to deploy to a QA environment
Umm ….
![Page 20: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/20.jpg)
Docker DeploymentCompleting the final mile
![Page 21: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/21.jpg)
![Page 22: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/22.jpg)
DeploymentContinuous Deployment was published in 2010
In general we still talk about build and integration, not deployment
This is true for all applications, not just those that are Dockerized
Docker promises A/B deployment
StackEngine is working on making A/B deployment a policy based activity
![Page 23: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/23.jpg)
Container Sprawl
![Page 24: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/24.jpg)
Container Sprawl
First there was VMware and suddenly a large corps departments could easily spin up environments
Then there was the cloud and developers could complete circumvent Ops
Now there is Docker and Developers are creating numerous abstractions that are not managed like traditional VMs
Containers on VMs on phyical hardware located in availability zones in data centers in geographic regions.
![Page 25: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/25.jpg)
My Head HurtsContainer Sprawl
![Page 26: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/26.jpg)
Inventory Management
![Page 27: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/27.jpg)
Where’s My StuffHosts
![Page 28: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/28.jpg)
Where’s My StuffImages
![Page 29: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/29.jpg)
Where’s My StuffContainers
![Page 30: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/30.jpg)
Telemetry
![Page 31: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/31.jpg)
Telemetry
What does monitoring a docker app look like?
What does log aggregation look like?
![Page 32: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/32.jpg)
Telemetry
Container size matters - blog
Log aggregation solution - blog
![Page 33: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/33.jpg)
What’s my stuff (not) doing
Containers
![Page 34: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/34.jpg)
What’s my stuff (not) doing
Containers
![Page 35: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/35.jpg)
What’s my stuff (not) doing
Containers
![Page 36: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/36.jpg)
Components
![Page 37: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/37.jpg)
Components
Components are infrastructure abstractions (cloud provider, data center, docker registry, docker image)
Components can be arranged in logic ways to represent physical infrastructure.
![Page 38: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/38.jpg)
Composing and AppComponents
![Page 39: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/39.jpg)
Composing and AppComponents
![Page 40: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/40.jpg)
Composing and AppComponents
![Page 41: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/41.jpg)
Service Discovery
![Page 42: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/42.jpg)
Service Discovery - Consistency Models
Zookeeper
Etcd / Consul
Chef Server / Heira
![Page 43: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/43.jpg)
Service DiscoveryDue out in December
Allows multiple deployments of the same service on the same host.
Containers register themselves upon startup and are found by tags rather than URI’s, fixed ports, etc.
A step towards cattle containers instead of pet containers
![Page 44: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/44.jpg)
Roadmap
![Page 45: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/45.jpg)
Roadmap
Service Discovery
User Management
Addition of new Components
Better telemetry
Scheduling
A/B Deployment support
![Page 46: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/46.jpg)
Live Product DemoAl Gore and his gremlins willing
![Page 47: StackEngine Problem Space Demo](https://reader033.fdocuments.us/reader033/viewer/2022060121/559446be1a28abfc728b465a/html5/thumbnails/47.jpg)
Boyd Hemphill @behemphi
@stackengine
Thank You for Your Time and Comments.