Adapting Deployment Pipelines for Complex Applications
-
Upload
ibm-urbancode-products -
Category
Technology
-
view
1.662 -
download
0
description
Transcript of Adapting Deployment Pipelines for Complex Applications
![Page 1: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/1.jpg)
© 2013 IBM Corporation
Adapting Deployment Pipelines for Complex Applications
Eric Minick,
IBM UrbanCode Technical [email protected]
@ericminick
© 2013 IBM Corporation
![Page 2: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/2.jpg)
© 2013 IBM Corporation
Acknowledgements and Disclaimers:
© Copyright IBM Corporation 2013. All rights reserved.
U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
IBM, the IBM logo, ibm.com,WebSphere, Rational, and IBM Mobile Enterrise are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at www.ibm.com/legal/copytrade.shtml
Other company, product, or service names may be trademarks or service marks of others.
Availability. References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates.
The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are
provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software.
All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results.
![Page 3: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/3.jpg)
Presenting Today
Eric is a DevOps Evangelist where he helps customers get the most out of their build, deploy and release processes.
Today he works with customers and industry leaders to figure out this DevOps thing. Eric Minick
[email protected]@EricMinick
![Page 4: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/4.jpg)
Agenda
Introduction to Continuous Delivery
Continuous Delivery & Complex Apps
Adapting apps to CD
Adapting CD to complex apps
Q&A
![Page 5: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/5.jpg)
What is Continuous Delivery?
An automated flow from build to “ready to deploy to production”
Push-button deployment to production
The execution of many types of tests
Cultural emphasis on constant shipability
![Page 6: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/6.jpg)
Why?
![Page 7: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/7.jpg)
“Normal” CD
builddev
test
system
testUAT sign-off staging prod
![Page 8: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/8.jpg)
The Build Pipeline
Perform a build
–and execute unit tests
Promote build to a test environment & test
–Repeat N times
Release
builddev
test
system
testUAT sign-off staging prod
![Page 9: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/9.jpg)
Continuous Delivery is a DevOps Strategy
Successful implementation requires assistance from developers, operations, and others
Cooperation and coordination between developers and operations must improve
![Page 10: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/10.jpg)
Agenda
Introduction to Continuous Delivery
Continuous Delivery & Complex Apps
Adapting apps to CD
Adapting CD to complex apps
Q&A
![Page 11: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/11.jpg)
The Hard Part is Coordination
Image from wisc.edu
![Page 12: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/12.jpg)
Complex apps have related builds
Builds of one part of the app depend on another
A change in one “pipeline” could impact another pipeline
Tests cross-cut builds pipelines
![Page 13: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/13.jpg)
Multiple tier apps
Different tiers, different teams, different builds
How do we align the changes?
![Page 14: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/14.jpg)
Modern architectures make it worse
Image from ischool.tv
![Page 15: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/15.jpg)
Prod deployments aren’t of one build*
*Except these
![Page 16: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/16.jpg)
Build pipelines in coupled systems
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
![Page 17: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/17.jpg)
Some pieces aren’t built
Databases
Infrastructure
Content
Reports / ETL
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
builddev
test
system
testUAT sign-off staging prod
![Page 18: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/18.jpg)
The Build Pipeline fails to:
Account for deployment time dependencies
Model things that aren’t built
Deal with incremental updates
X
X
X
![Page 19: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/19.jpg)
Now what?
Work hard to salvage build pipelines
Or
Use a different model
![Page 20: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/20.jpg)
Agenda
Introduction to Continuous Delivery
Continuous Delivery & Complex Apps
Adapting apps to CD
Adapting CD to complex apps
Q&A
![Page 21: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/21.jpg)
Adapting apps to CD: Principals
1. Everything is a “build”
2. Builds are promoted independent of other builds
![Page 22: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/22.jpg)
So we need great architecture
photo credit: http://www.flickr.com/photos/ishmaelo/256431712/
![Page 23: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/23.jpg)
Build of Build Pattern
Mega Build
system
test
UAT
sign-off
staging
prod
dev
test
Comp.
Build
dev
test
Comp.
Build
dev
test
Comp.
Build
Challenges: My “mega build” is big, and is always fully deployed. My components don’t know if they went to Prod
![Page 24: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/24.jpg)
A Build of Builds
.Mega Build
system
test
UAT
sign-off
staging
prod
dev
test
Comp.
Build
dev
test
Comp.
Build
dev
test
Comp.
Build
![Page 25: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/25.jpg)
Enforce Backwards Compatibility
Build and immediately deploy to integration testing
If integration tests fail, the build is rejected and the old build of that component is redeployed to integration testing
![Page 26: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/26.jpg)
Enforce Backwards Compatibility
Build and immediately deploy to integration testing
If integration tests fail, the build is rejected and the old build of that component is redeployed to integration testing
Challenges: Good integration tests, extra engineering to support new and old versions, etc.
![Page 27: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/27.jpg)
Database Expand / Contract
Goal: Backwards compatible, zero downtime database deployments.
Never remove objects old / active users of the database need. Only add new objects. Once all clients are using the new objects, remove the old.
See: http://exortech.com/blog/2009/02/01/weekly-release-blog-11-zero-downtime-database-deployment/
![Page 28: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/28.jpg)
Database Expand / Contract
Goal: Backwards compatible, zero downtime database deployments.
Never remove objects old / active users of the database need. Only add new objects. Once all clients are using the new objects, remove the old.
Challenges: a significant and not always easy change to how organizations develop DB updates.
See: http://exortech.com/blog/2009/02/01/weekly-release-blog-11-zero-downtime-database-deployment/
![Page 29: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/29.jpg)
Agenda
Introduction to Continuous Delivery
Continuous Delivery & Complex Apps
Adapting apps to CD
Adapting CD to complex apps
Q&A
![Page 30: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/30.jpg)
Adapting CD to our Apps
Account for deployment time dependencies
Model things that aren’t built
Deal with incremental updates
![Page 31: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/31.jpg)
Use the “Build of Builds” model as a start
Mega Build
system
test
UAT
sign-off
staging
prod
dev
test
Comp.
Build
dev
test
Comp.
Build
dev
test
Comp.
Build
![Page 32: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/32.jpg)
Shift to “Release Sets” or “Snapshots”
We don’t need a new build
– we need a name for a collection of builds.
Delay the creation of these until integration tests pass, and create based on the successful integration tests
build
devtest
systemtest
build
devtest
systemtest
build
devtest
systemtest
UATSign-
offStagin
g Prod
Snapshots at “Application” or “System” level.
![Page 33: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/33.jpg)
Don’t require “build”
Extracts from existing systems, artifact repos, or source control are OK to get deployable version.
Build
devtest
system
test
Config Extrac
t
devtest
system
testFetch from SCM
devtest
system
test
UATSign-
offStagin
g Prod
Snapshots at “Application” or “System” level.
![Page 34: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/34.jpg)
Support multiple incremental moves
Incremental requires:
–Multiple versions of a component in snapshots
–Awareness when tracking what is where
–Order awareness when performing rollbacks.
![Page 35: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/35.jpg)
Pipeline with Snapshots
Fetch from SCM
devtest
system
test
Config Extrac
t
devtest
system
testFetch from SCM
devtest
system
test
UATSign-
offStage Prod
Build
devtest
system
test
Web
Mid. Code
Mid. Config
DB
![Page 36: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/36.jpg)
In story form
A change to a component, creates a new version (often by doing a build).
![Page 37: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/37.jpg)
In story form
A change to a component, creates a new version (often by doing a build).
The new version is vetted, and then tested in an integration environment.
![Page 38: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/38.jpg)
In story form
A change to a component, creates a new version (often by doing a build).
The new version is vetted, and then tested in an integration environment.
When the integrated system passes tests, a snapshot of all the component versions in the system is created.
![Page 39: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/39.jpg)
In story form
A change to a component, creates a new version (often by doing a build).
The new version is vetted, and then tested in an integration environment.
When the integrated system passes tests, a snapshot of all the component versions in the system is created.
Snapshot deployments don’t redeploy unchanged components
![Page 40: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/40.jpg)
In story form
A change to a component, creates a new version (often by doing a build).
The new version is vetted, and then tested in an integration environment.
When the integrated system passes tests, a snapshot of all the component versions in the system is created.
Snapshot deployments don’t redeploy unchanged components
The snapshot is promoted & released
![Page 41: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/41.jpg)
In Summary
Today, continuous delivery on complex systems is hard to coordinate.
Two options
1. Strict development standards to force our systems into the build promotion model
2. A shift towards snapshot deployments that accommodate projects “as they are”
![Page 42: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/42.jpg)
References
http://urbancode.com/resources
http://ibm.com/devops/
Enterprise CD Maturity Model
Death to Manual Deployments!
Build & Deployment Automation for the Lean Economy
ITIL Release Management and Automation
Urbancode.com/blogs/
Twitter.com/UrbanCode
Facbebook.com/UrbanCodeSoft
Slideshare.net/Urbancode
![Page 43: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/43.jpg)
Yes, we sell products for this
IBM UrbanCode Deploy
–Application Deployment Automation
IBM UrbanCode Release
–Coordination across many applications
![Page 45: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/45.jpg)
© 2013 IBM Corporation
© Copyright IBM Corporation 2012. All rights reserved. The information contained in these materials is provided for informational purposes only, and is provided AS IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, these materials. Nothing contained in these materials is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. References in these materials to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. Product release dates and/or capabilities referenced in these materials may change at any time at IBM’s sole discretion based on market opportunities or other factors, and are not intended to be a commitment to future product or feature availability in any way. IBM, the IBM logo, Rational, the Rational logo, Telelogic, the Telelogic logo, and other IBM products and services are trademarks of the International Business Machines Corporation, in the United States, other countries or both. Other company, product, or service names may be trademarks or service marks of others.
www.ibm.com/software/rational
![Page 46: Adapting Deployment Pipelines for Complex Applications](https://reader036.fdocuments.us/reader036/viewer/2022070315/554f4e7fb4c905423f8b5048/html5/thumbnails/46.jpg)
46