Analyze This! CloudBees Jenkins Cluster Operations and Analytics

Analyze This!CloudBees Jenkins Cluster Operations and Analytics

Ryan CampbellCyrille Le Clerc

Today’s Presenters

Cyrille Le ClercDirector, Product Management

[email protected]@cyrilleleclerc

Ryan CampbellEngineer

[email protected]@recampbell

mailto:[email protected]




Using WebEx

Questions?Submit via the Q&A window at any time during the presentation.

We will cover Q&A at the end of the presentation.

Session is being recorded.

Q&A Window

Agenda

● Problem statement● Jenkins Reference Architecture● CloudBees Analytics● Cluster Operations● Conclusion● Q&As

Problem Statement

Problem Statement

How to onboard more and more teams on a Jenkins Continuous Delivery Platform

How to scale Jenkins in an organization

The top down “structured” and “lets grow vertically” approach

5 projects0 slaves

25 projects5 slaves

100 projects25 slaves



Vertical Scaling Issue

When is the next failure ?

One size fits all?Single point of failure

The “organic” agile growth – “let each group do what they want to” approach

Horizontally … Virally

Horizontal Issues: I Would Like to…

master-a

master-b master-c

Share slaves between masters


master-a

master-b master-c

Share security


master-a

master-b master-c

Manage the Jenkins masters “globally”

plugin

core

upgrade / restart

backup

script


master-a

master-b master-c

Monitor the Jenkins masters “globally”

Jenkins Operations Center by CloudBees

master-a

master-b master-c

Jenkins Operations Center

plugin

core

upgrade / restart

backup

script

Jenkins Reference Architecture

Reference Architecture

LB master-a

LB master-n

***

slaves

LB


shared slaves

Role Based Access Control

Update Center

SSO

LB master-test

Update Center Jenkins TestEnvironment

master-a

master-b master-c


JOC features

plugin

core

upgrade / restart

backup

CloudBees Analytics

Cluster Operations

CloudBees Analytics

CloudBees Analytics

master-a

master-b master-c


Drivers for Analytics

● Easily understand the performance and behavior of hundreds of Jenkins nodes

● Consistent interface allowing for easy comparisons over time and between nodes

● Key questions:○ What is the user experience?○ Why is Jenkins slow?○ How is Jenkins being used?○ How are resources being used? → capacity

CloudBees Analytics

masterJenkins Operations Center

Data Collection

Scalable compute and storage backend

Rich visualization interface

Embedded Architecture


Embedded Elasticsearch

Embedded Kibana

Horizontally Scaled Architecture


Embedded Kibana

Multiple Remote Elasticsearch Instances

Analytics Demo

JOC Dashboard

Analytics Demo

Build Analytics

Analytics Demo

Performance Analytics

Analytics Demo

Dashboard Creator

Cluster Operations

Cluster Operations

master-a

master-b master-c


plugin

core

upgrade / restart

backup

script

Cluster Operations Agenda

● Update all plugins on all masters and restart● Deploy new plugin on masters● Cluster Operations Ref Card

Update Plugins on All Masters and Safely Restart

Demo time!

Cluster Operations

Standard Jenkins Style: New Item “Clustered Operations”

Cluster Ops > Master Operation

Standard Jenkins Style: Add Operation “Masters”

Master Operation > Select Targets

Select the Client Masters on which you perform the operation

Master Operation > Define Operations

Define the sequence of operations to apply on the Client Masters

Deploy Plugin on Mastersvia a Custom Update Center

Deploy New PluginUpdate Center master-test

Upload Plugin

Refresh Update Center Metadata

Install Plugin

Demo time!

Deploy Plugin on Masters

Parameterized build: File Parameter


Target Update Center


Upload Plugin on Custom Update Center


Target Masters

Quick Cluster Operations

Demo time!

Quick Cluster Operations

Cluster Operations Ref Card

Master Operation > Ref Card

● Backup master● Disable plugin● Execute Groovy Script on Master● Install plugin● Prepare Master for shutdown● Refresh update center metadata

Master Operation > Ref Card

● Reindex for Analytics● Restart Now● Safe restart● Upgrade Jenkins● Upgrade all plugins

Update Center Operations > Ref Card

● Delete core● Delete plugin● Promote core● Pull Everything● Pull new versions● Refresh upstream sources

Update Center Operations > Ref Card

● Track latest core● Track latest plugin● Upload core● Upload plugin

Conclusion

master-a

master-b master-c



plugin

core

upgrade / restart

backup

CloudBees Analytics

Cluster Operations

CloudBees Analytics

master-a

master-b master-c


Cluster Operations

master-a

master-b master-c


plugin

core

upgrade / restart

backup

script

Resources

http://www.slideshare.net/cloudbees/analyze-this-jenkins-cluster-operations-and-analytics



Questions

Appendix

Webinar InvitationMore and more organizations are jumping on the Continuous Delivery bandwagon to remain competitive. As they do so, they use Jenkins to on-board teams and to orchestrate their continuous delivery pipelines.

Jenkins Operations Center by CloudBees is the tool that helps organizations run their CI infrastructure at scale.

In this webinar, you will learn about:

● Reference architecture to build resilient Jenkins that onboard teams quickly● Cluster Operations - helps to manage multiple Jenkins instances simultaneously. ● Want to install a new plugin on a 4 Jenkins masters ? We got that covered!● CloudBees Analytics - offers insight into build and performance analytics. ● Want to know the number of jobs failing across 4 masters - we've got that covered too!

Analyze This! CloudBees Jenkins Cluster Operations and Analytics

Technology

Transcript of Analyze This! CloudBees Jenkins Cluster Operations and Analytics