Transform. Innovate.

54
Transform. Innovate. How DevOps and Cloud are changing Engineering Melody Meckfessel Engineering Director [email protected]

Transcript of Transform. Innovate.

Page 1: Transform. Innovate.

Transform. Innovate. How DevOps and Cloud are changing Engineering

Melody Meckfessel Engineering Director [email protected]

Page 2: Transform. Innovate.

Cloud Computing

Innovation in Engineering

The Road Ahead

Agenda

Page 3: Transform. Innovate.

Cloud Computing

Page 4: Transform. Innovate.

Big Trends

enabling a new world via mobile

global connections at any minute

connections virtually everywhere

Any PlaceAny Device

minds of many need to collaborate

vitally important to stay ahead

consumer leads, business follows

AdoptionSpeedAny Team

Any Time

Page 5: Transform. Innovate.

75years

1957 2003 2013

500

25years

10years

(average age of a company joining the S&P 500)

Page 6: Transform. Innovate.

95%using cloud services

230k Yearssocial media per month

40%own a smartphone

Page 7: Transform. Innovate.

Google confidential | Do not distribute

Enterprise Cloud Platform market will exceed $22B globally by 2015.2013

Page 8: Transform. Innovate.

Google confidential | Do not distribute

“People tend to overestimate what can be done in one year and to underestimate what can be done in five or ten years.”Amara's Law

Page 9: Transform. Innovate.

IT Trends

The decreasing cost of storage enables virtually limitless storage in the cloud. $600 can buy enough storage for the world’s music.

(Source: McKinsey Global Institute May 2011)

Computing as a utility is now available for easy purchase, provided from massively efficient data centers.

(Source: Nicholas Carr, The Big Switch, 2008)

The internet allows for a model of real-time access to new innovation, information and applications from a wide range of devices.

AffordableCapacity

On-demandcomputing

Instantaccess

Page 10: Transform. Innovate.

IaaS PaaS SaaSInfrastructure-as-a-Service Platform-as-a-Service Software-as-a-Service

Google Cloud Platform

Cloud Computing

Page 11: Transform. Innovate.

IaaS PaaS SaaSInfrastructure-as-a-Service Platform-as-a-Service Software-as-a-Service

Google

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

PackagedSoftware

ApplicationsDataRuntimeMiddlewareO/SVirtualizationServersStorageNetworking

Cloud ComputingYou Manage Vendor Managed

Page 12: Transform. Innovate.

Save Scale Succeed

Concentrate on yourcore mission

Leverage massive, scalable computing power

Save on capitaland operational costs

Build Your Apps in the Cloud

Page 13: Transform. Innovate.

Storage App ServicesCompute

Cloud Storage

Cloud SQL

Cloud Datastore

Compute Engine

App Engine

BigQuery

Cloud Endpoints

Google Cloud Platform

Page 14: Transform. Innovate.

Innovation in Engineering

Page 15: Transform. Innovate.

Google confidential | Do not distribute

Page 16: Transform. Innovate.

Google confidential | Do not distribute

For the past 15 years, Google has been building out the world’s fastest, most powerful, highest quality cloud infrastructure on the planet.

Page 17: Transform. Innovate.

Google confidential | Do not distribute

Cloud Platform is built on the same infrastructure that powers Google.

Page 18: Transform. Innovate.

DevOps at Google

Page 19: Transform. Innovate.

800KBUILDS

2PB+BUILD OUTPUTS

30K+CHANGELISTS

100M+TEST CASES RUN

EACH DAY...

Page 20: Transform. Innovate.

Google confidential | Do not distribute

●●

Page 21: Transform. Innovate.

Google confidential | Do not distribute

Page 22: Transform. Innovate.

Google confidential | Do not distribute

Page 23: Transform. Innovate.

Google confidential | Do not distribute

Page 24: Transform. Innovate.

Google confidential | Do not distribute

Page 25: Transform. Innovate.

Google confidential | Do not distribute

Page 26: Transform. Innovate.

Google confidential | Do not distribute

Page 27: Transform. Innovate.

DevOps you deserve

Page 28: Transform. Innovate.

Continuous Delivery

Page 29: Transform. Innovate.

Deploying to App Engine

$ gcloud auth login$ gcloud init your-project-name$ git push origin master # Pushes your changes to production.

$ gcloud app --help

Usage: gcloud app [optional flags] <command> command may be cancel-deployment | delete | deploy | download | get- logs | get-resource-limits | list-versions | run | set- default | set-managed-by | setup-managed-vms | start | stop

Page 30: Transform. Innovate.

Push to Deploy

Page 31: Transform. Innovate.

amount of time most developers spend finding issues in production (source)

Time Spent Troubleshooting: The Old Way

50%● High stakes and time critical

● Data rich; information scarce

● Imperfect system understanding

Page 32: Transform. Innovate.

When Things Go Wrong in Production

Page 33: Transform. Innovate.

● Reduce the guess work

● Speed up iteration cycle

● Provide system transparency

Time Spent Troubleshooting: The Modern Way

Page 34: Transform. Innovate.

Eliminate Server Errors with Cloud Logs

Reduce Latency with Cloud Trace

Deep Understanding with Cloud Debugger

1

2

3

Debugging in the Cloud

Page 35: Transform. Innovate.

SSH to machine to look at logs

GuessPager Goes Off

Problem log found

PROBLEM

Debugging with Logs: the Old Way

Now what?

Page 36: Transform. Innovate.

Problem log found

Search aggregated

logs

Pager Goes Off

Seamlessly navigate to other tools

PROBLEM

Debugging with Logs: the Modern Way

Page 37: Transform. Innovate.

● Search ALL your logs● Navigate to & from

○ Monitoring○ Trace○ Source

● Infiniscroll & Live streaming!

Google Cloud Logs

Page 38: Transform. Innovate.

Logs Viewer

Page 39: Transform. Innovate.

● Visualize and understand the time spent

● Compare performance from release to release with a detailed report

● Low Overhead - Always On

Google Cloud Trace

Image source info

Page 40: Transform. Innovate.

Cycle of Debugging in the Cloud: the Old Way

PROBLEM

Search Logs Stare at Code

Add More LoggingRedeploy

Page 41: Transform. Innovate.

Cycle of Debugging in the Cloud: the Modern Way

● Attaches (listens) to all instances

● Negligible performance impact

● Access stack and locals

PROBLEM

Stare at Code WatchPoint

Local Variables

Page 42: Transform. Innovate.

● Enables modern production debugging

● Negligible performance impactEvaluations < 40usCaptures < 10ms

● Access to stack and locals

● No setup is required, on by default!

● Use today on Managed VMs for Java

Google Cloud Debugger: The Modern Debugger

Page 43: Transform. Innovate.

Runtime Insights

https://cloud.google.com/appengine/articles/logging

https://cloud.google.com/tools/cloud-trace

https://cloud.google.com/tools/cloud-debugger

Cloud Logs

Cloud Debugger

Cloud Trace

Page 44: Transform. Innovate.

The Road Ahead

Page 45: Transform. Innovate.

Don’t deal with unnecessary “stuff”

Cliffs are for climbers

Ops should be easy

Cloud Computing

Photo by Connie Zhou

Page 46: Transform. Innovate.

● The most important driver of long term TCO are early design decisions

● Factoring is critical● Help developers fall into the ‘pit of

operational success’

Operations, operations, operations

Page 47: Transform. Innovate.

Developer Velocity / Efficiency

● Focus on application code

● Shift operations to Cloud

● Integrated development environment

and toolchain

Page 48: Transform. Innovate.

Scale

● Built on single compute stack

● All performance innovation percolates

up

● Super low latency between all

application components

Page 49: Transform. Innovate.

OpenSolutions

● Users can customize or replace

runtimes

● Open Source Software is huge

● Integration with any third-party

software

● Involve the community in shaping the

APIs

Page 50: Transform. Innovate.

Google confidential | Do not distribute

Culture of launch and iterate is great…. but need right systems to support“In the cloud” means

Lower cost of Deployment and OperationsResilienceDevelopers choose

Page 51: Transform. Innovate.

DevOps using the Cloud is about helping you, the developer, do what you love.

Image source info

Page 52: Transform. Innovate.

Thank you!Melody Meckfessel Engineering Director [email protected]

Page 53: Transform. Innovate.

$500 in Cloud Platform credit to build your idea!

Go to g.co/CloudStarterPack

Enter promo code: qcon-sf

With Cloud Platform you can access application, compute, storage and big data services. You’re now building on the same infrastructure that powers Google.

Page 54: Transform. Innovate.

Questions?