2013 IBM Corporation Learn Faster Deploy what you have,
Virtualize what you dont
2013 IBM Corporation Who are these guys? Eric is a DevOps
Evangelist with IBM where he helps customers get the most out of
their build, deploy and release processes. Today he works with
customers and industry leaders to find the best ways of adopting
continuous delivery and DevOps. @EricMinick Eric Minick Al is a
Testing Evangelist at IBM focused on quality management and
testing. Having performed many development roles over a number of
years and armed with real-world experience for the testing
challenges organizations face. Al has spent the last two years
raising awareness for Service Virtualization and how it is the
enabler to Continuous Testing! @Al_Wagner Al Wagner
2013 IBM Corporation Delayed learning is why waterfall fails
Idea Requirements Development Integrated Test Release Weeks /
months to validate code matches Reqs Months or years to learn if
ideas / requirements match the market need
2013 IBM Corporation Time to customer feedback is governed by
risk Traditionally Organizations looked to find a balance between
speed, cost & risk. Development teams were not as agile as they
are today; testing never seemed to have enough time.
2013 IBM Corporation Time to customer feedback is governed by
risk Traditionally Organizations looked to find a balance between
speed, cost & risk. Development teams were not as agile as they
are today; testing never seemed to have enough time. *Survey of 250
Testers 90% of testers have some but not complete confidence in the
software thats released. 4 testers are seeing faster releases per 1
that sees slower 34% of those who expressed no change were
regularly releasing quarterly or better.
2013 IBM Corporation Shift Left: To win in the market, learn
faster Organizations are asking teams to release higher quality
software sooner. Development teams are becoming more and more
agile; testing still never seems to have enough time.
2013 IBM Corporation Todays Focus: Integration Testing Pretty
Great Castle, huh? Just need to do that little integration part at
the end.
2013 IBM Corporation Late integration testing: Design
verification occurs too late in the lifecycle 100% Project Schedule
DevelopmentProgress (%coded) Original Target Date Integration
Begins
2013 IBM Corporation Earlier validation leads to a smoother
curve 100% Project Schedule DevelopmentProgress (%coded)
2013 IBM Corporation Basic strategy 1. Deploy all the stuff
into a test environment 2. Setup test scenarios 3. Run regression
tests 4. Create known good version of the system 5. Repeat when
there are changes Pet Shop Content J2EE App MySQL DB SIT WEB MID DB
PROD WEB MID DB Tomcat Deploy Process Rollback Process Restart
Process
So why arent we all doing this?
2013 IBM Corporation Composite applications have lots of pieces
Image from ischool.tv
2013 IBM Corporation Deploying composite applications
Challenges 1. Deploy all the stuff into a test environment 2. Setup
test scenarios 3. Run regression tests 4. Create known good version
of the system 5. Repeat when there are changes Need to coordinate
change Link to provisioning Track / collect versions under
test
2013 IBM Corporation Deploying composite applications
Challenges 1. Deploy all the stuff into a test environment 2. Setup
test scenarios 3. Run regression tests 4. Create known good version
of the system 5. Repeat when there are changes Coordinate Change
Model full applications and design orchestrated release processes
JPetStore Application Apache Tomcat JPetStore DB SIT WEB MID DB
PROD WEB MID DB JPetStore Content JPetStore WAR
2013 IBM Corporation Deploying composite applications
Challenges 1. Deploy all the stuff into a test environment 2. Setup
test scenarios 3. Run regression tests 4. Create known good version
of the system 5. Repeat when there are changes Link Provisioning
& Deploy Deploy into environments that dont yet exist.
2013 IBM Corporation Deploying composite applications
Challenges 1. Deploy all the stuff into a test environment 2. Setup
test scenarios 3. Run regression tests 4. Create known good version
of the system 5. Repeat when there are changes Track / collect
versions Create a logical version of what was tested together, for
deployment to later environments.
2013 IBM Corporation Testing is often plagued with bottlenecks
& delays Todays testing challenges 1. Difficult to automate
tests when the dependent services have yet to be developed 2. Lack
of complete production like test labs 3. Software and/or systems
dont exist yet as priorities may differ across development teams 4.
Testing with 3rd party services may incur access fees driving up
the cost of testing 5. Blocking defects may interrupt end-to-end
testing 6. There just isnt enough time due to all the
interruptions! There must be a way which allows Testers to test
What they want, When they want, How they want!
2013 IBM Corporation Where do Testers want to spend their time?
Creating Automated Tests Performing Exploratory Tests Executing
Automated Tests Designing Tests Planning Tests Reviewing Test
Results Running Pre-defined Tests Maintaining Automated Tests I
want to spend MORE time I want to spend LESS time Creating Reports
Maintaining Automated Test Tools Configuring Test Tools Creating
Test Data Re-running tests Investigating, Documenting and
Submitting Defects Setting Up Test Labs
2013 IBM Corporation Continuous Testing means Validating todays
composite applications earlier and at a lower cost Continuous
Testing DevOps Foundation Test Automation Run unattended Validate
business flows across channels Durable, maintainable, resilient to
change Automated Deployment Into Test Environments Reliable
Repeatable Traceable Test Environments Realistic & complete -
(production like) Available on demand Inexpensive to setup
2013 IBM Corporation Continuous Testing means Making
production-like test environments a reality Traditional test
environments are both underutilized and insufficient Environments
are expensive: hardware, software, and labor Tester and developer
time wasted waiting for appropriate environment Agile test
environments require four enabling capabilities Dynamic
Infrastructure Deployment Automation Test Environments DevOps
Foundation Service Virtualization Test Data Management
2013 IBM Corporation Time Spent on Test Data Management
2013 IBM Corporation Organization Process Technology an agile
test organization and testers need continuous access to test data
with agile development you have continuous integration and delivery
and have to test often test data management software needs to
support agile method by streamlining access to test data and having
insight into test data Test Data Management with IBM InfoSphere
Optim Agile testing needs continuous access to test data
2013 IBM Corporation Dealing With Unavailable Software &
Services
2013 IBM Corporation Continuous Testing improves software
quality Actual Service/App Virtual Service/App Service
Virtualization can simulate the behavior of a service or
application for the purposes of testing Service Virtualization is
an enabler for continuous testing Services, applications, systems
are introduced into the continuous integration cycle in a
prioritized, controlled fashion. Controlled integration helps
isolate defects for faster resolution. Service virtualization
enables continuous integration testing Using Service Virtualization
Enables testers to test continuously with control
2013 IBM Corporation Continuous Testing means Creating easy to
maintain automated tests for continuous execution Continuous
Testing DevOps Foundation Test Automation Run unattended Validate
business flows across channels Durable, maintainable, resilient to
change Automated Deployment Into Test Environments Reliable
Repeatable Traceable Test Environments Realistic & complete -
(production like) Available on demand Inexpensive to setup
2013 IBM Corporation Unattended test execution Automate testing
with Rational Test Workbench integration, functional, &
performance Continuous Testing
2013 IBM Corporation Continuous Testing means. Automating the
creation of realistic test labs Continuous Testing DevOps
Foundation Test Automation Run unattended Validate business flows
across channels Durable, maintainable, resilient to change
Automated Deployment Into Test Environments Reliable Repeatable
Traceable Test Environments Realistic & complete - (production
like) Available on demand Inexpensive to setup
2013 IBM Corporation IBM UrbanCode Deploy orchestrates and
automates the deployment of applications, middleware configuration,
and database changes into development, test and production
environments. Databases Internal Messages Third-party Services
virtual components Simultaneously test across multiple test stages
Dev QA IBM Rational Test Virtualization Server Combining continuous
testing withOrchestration from build to production A REAL reliable,
repeatable, & traceable deployment automation solution IBM
UrbanCode Deploy IBM Rational Test Workbench integrated with Test
Environments Dynamic Infrastructure Deploy what is ready,
virtualize the rest Continuously test in production-like env.
Deploy private, secure right sized test data IBM InfoSphere Optim
Test Data Mgmt UC Deploy Plugins IBM Rational Quality Manager
Manage quality across the delivery lifecycle
2013 IBM Corporation Summary Get to market faster requires
faster testing Testers need automated tests, environments to run
them in, and the latest code in those environments. Complex
environments can be simplified with service virtualization Complex
deployments can be managed with Application Release Automation
Continuous testing coupled with continuous deployment, check the
software/validate the deployment process Together, you get faster
feedback and make more money
2013 IBM Corporation Resources Continue your learning journey
as you shift left ibm.co/ARDfordummies
ibm.co/ServiceVirtualizationForDummies ibm.co/agilefordummies
ibm.co/devopsfordummies
2013 IBM Corporation Learning opportunities on YouTube IBM
UrbanCode Applications IBM Continuous Testing videos
http://www.youtube.com/playlist?list=PLZGO0qYNSD4VZEYSvNbpXqFnAqmsSj2gQ
http://www.youtube.com/user/IBMRationalUE/playlists?sort=dd&view=50&shelf_id=9