Large-scale, Enterprise-wide Agile Delivery Transformation

Continuous Delivery at Cisco IT

Pete Rim

prim@cisco.com

Agenda

Continuous Delivery Transformation Focus of Continuous Delivery at Cisco

Our approach and implementation

What results did we see

We need help in these areas

‘Stickies’ for a successful CD transformation

Continuous Delivery Transformation Accelerating the speed of business with Fast IT

Improve

Software Quality

Optimize

Cost-of-Delivery

Testing Automation

Embed SMEs

Fail Fast / Recover

Dedicated Teams

Adaptive Infrastructure

Self-Service Tools

Small & Mighty Teams

Active Stakeholders

Iterative Approach

Culture Mindset Perception Change the of IT

Accelerate

Time-to-Capability

Small & Mighty

Teams

Automation Tools

Embedded SMEs

Automation Tools

Centralized Test

Data Management

Automation Tools

Centralized

Release

Management

Active Stakeholders

Fast Results

Operational Priority

High Availability

Changing the Way We Work: Continuous Delivery

Mindset

Automated Testing Built by Developers

Embedded QC

Adapt & Scale Policy Enforced

Workload Mobility

Deploy & Release Control Gates

Regulatory

Compliance

Develop and Build Continuous

Integration

Innovation Circles

Architectural

Framework

Active Stakeholders

Plan Iterative Planning

Continuous Delivery Core Team

• Business Value Case

• Communication

• Change Management

• Program Governance

• Metrics

PMO

Process

Tools

Adoption

Sustainability • Operations

• Automation

• Evolution Plan

• Org Change

• End State Model

• Tool Chain

• Automation

• Optimization

• Release Environment

• Technical Support

Program

Director

Chief

Architect

• End to End Process

• Biz Engagement

• Best Practices

• Training

• Release Strategy

• Adoption Plan

• Client Engagement

• Best Practices

• Checkpoints

• Certification

CD Core Team

Adoption/Subscriber “Waves” (80+ Services & 600+ Applications grouped into 3 waves)

Pioneer

Business Critical

All Others

- Willing partner

- Get a “win”

- Create your ambassador network

- Prove it’s scalable

- Take a risk

- Show business value

- Finish the job

- Everyone gets to go

- Make it “concrete”

Wave 1

Wave 2

Wave 3

E2E Tools Landscape

ER

P

Non-E

RP

Portfolio & Business Outcome

AppDB

A tool developed Internally in Cisco IT

for Oracle Code Deployment

Conceptual: Release & Environment Model

Dev

Sta

ge

Pro

d

QA

QA Medium Frequency Lane

Large Scope

Every Six Months

High Frequency Lane

Medium Scope: Every Month

Small Scope: Every Week/Day

Emergency Lane

Bug Fixes & Patches

On Demand

3 Lanes together provide unlimited go live opportunities

1

2

3

DevInt Dev

DevInt Dev

All lanes merge in Stage

before deployment to Prod

How did we measure?

TC / # Enhancements or # Stories Delivered

# of Enhancements or # Stories Delivered

Incidents & Downtime

How fast?

At what price?

With what quality?

Business Value Got measurable value?

Process & Platform Adoption How transformational?

Speed

Cost

Quality

Adoption

Biz Value

Continuous Delivery Scorecard

Methodology adoption (Waterfall vs Agile)

62%

55% 56%

49%

38%

27%

38%

45% 44%

50%

63%

73%

0%

10%

20%

30%

40%

50%

60%

70%

80%

FY14-Q4 FY15-Q1 FY15-Q2 FY15-Q3 FY15-Q4 FY16-Q1

Waterfall Agile

Plan

6.00%

Develop & Build

11.25%

Regression

Test

7.50%

Progression

Test

4.75%

Deploy

2.50%

Total Savings

32.00%

Application Delivery Productivity Savings Opportunity

We need help in these areas

ERP/Oracle Environment refresh in 2 days (we have reduced it from 10 days to 6 days)

Coexistence of multiple active versions of code (FE/BE) in the same environment

Team 1 for Release A

Team 2 for Release B (overlaps with Rel A)

Copy/Clone

‘Stickies’ for a successful Continuous Delivery Transformation

Tools

Tools for ERP and non-ERP

Integrated CD Tool set

Connected Collab tools Training

Scrum Master Training

Product Owner Training

SAFe Training

Applied Agile Training

Hands-on Workshops

Process End to End Process

Best Practices (CoE)

Release Process

Business Engagement

Requirement Process

Dev Processes

Test Process

Deployment Process

Production Support Process

Env Support Process

Compliance Process

Test

Test Automation

Risk Based Testing

Test Data Management

Performance Test

Platform Virtualization

Expedited full-stack provisioning

Elastic infrastructure

Faster Env refreshes

Simplified Infra Engagement

Compliance Security

SOX

ISO

Support P1 support for Platform & Tool

Click-to-chat

Self-service Portal

Client Experience

Generic Transactional vs Content Based

X-functional vs standalone

MVP vs WBS/Components

Distributed vs Collocated

Definition & Measure of Speed

Deployment Frequency

Agile Team Workspaces

Vendor Readiness & SOWs

Release Go Live windows

Simplified Process

Release Types

Release & Env Model

Freeze process

Early engagement

E2E Automation

Development PLC (Agile/Hybrid)

Estimation

Code Merge

Embedded QA

Built-in Compliance

Program PMO

Process

Tools

Adoption

Metrics

Ambassadors

CRC update to consistent look and feel

Increased # of Agile Project Releases

Total Releases: Waterfall vs Agile Trending: Waterfall vs Agile Projects

65 70 64

86

52 38

36 32 52

72

106 142

0

20

40

60

80

100

120

140

160

180

200

Q1FY15 Q2FY15 Q3FY15 Q4FY15 Q1FY16 Q2FY16

Agile

Waterfall

101 102

116

158 158

180

CD as a Program CD as a Service CD as a Program

CD as a Service

64% 64%

56%

41% 41%

36% 36%

36%

44%

59% 59%

64%

0%

10%

20%

30%

40%

50%

60%

70%

Q1FY15 Q2FY15 Q3FY15 Q4FY15 Q1FY16 Q2FY16

% Waterfall

% Agile

“CD Speed to Production” - Improvements

65 70

64

86

52

38 48 46

50

34 34

35

0

10

20

30

40

50

60

70

80

90

100

Q1FY15 Q2FY15 Q3FY15 Q4FY15 Q1FY16 Q2FY16

Waterfall: Mean Time to Release

Total Projects

Average Days

36 32

52

72

106

142

49 40 38

32 28

32

0

20

40

60

80

100

120

140

160

Q1FY15 Q2FY15 Q3FY15 Q4FY15 Q1FY16 Q2FY16

CD Speed to Production

Total Projects

Average Days

CD as a Program CD as a Service

CD as a Program CD as a Service