Cluster management at Google with Borg · Cluster management at Google with Borg - coping with...
Transcript of Cluster management at Google with Borg · Cluster management at Google with Borg - coping with...
![Page 1: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/1.jpg)
![Page 2: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/2.jpg)
Cluster management at Google with Borg - coping with scale2016-11
john wilkes / [email protected] Software Engineer
Derived from EuroSys'15 paper (http://goo.gl/1C4nuo)
CC-BY-NC-ND Creative Commons license
![Page 3: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/3.jpg)
Cluster management
at Google with Borg -coping with scale2016-11
john wilkes / [email protected] Software Engineer
Derived from EuroSys'15 paper (http://goo.gl/1C4nuo)
CC-BY-NC-ND Creative Commons license
the system we internally call
![Page 4: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/4.jpg)
Borg contributorsCore: Abhishek Rai, Abhishek Verma, Andy Zheng, Ashwin Kumar, Ben Smith, Beng-Hong Lim, Bin Zhang, Bolu Szewczyk, Brad Strand, Brian Budge, Brian Grant, Brian Wickman, Chengdu Huang, Chris Colohan, Cliff Stein, Cynthia Wong, Daniel Smith, Dave Bort, David Oppenheimer, David Wall, Divyesh Shah, Dawn Chen, Eric Haugen, Eric Tune, Eric Wilcox, Ethan Solomita, Gaurav Dhiman, Geeta Chaudhry, Greg Roelofs, Grzegorz Czajkowski, James Eady, Jarek Kusmierek, Jaroslaw Przybylowicz, Jason Hickey, Javier Kohen, Jeff Dean, Jeremy Dion, Jeremy Lau, Jerzy Szczepkowski, Joe Hellerstein, John Wilkes, Jonathan Wilson, Joso Eterovic, Jutta Degener, Kai Backman, Kamil Yurtsever, Ken Ashcraft, Kenji Kaneda, Kevan Miller, Kurt Steinkraus, Leo Landa, Liza Fireman, Madhukar Korupolu, Maricia Scott, Mark Logan, Mark Vandevoorde, Markus Gutschke, Matt Sparks, Maya Haridasan, Michael Abd-El-Malek, Michael Kenniston, Ming-Yee Iu, Monika Henzinger, Mukesh Kumar, Nate Calvin, Onufry Wojtaszczyk, Olcan Sercinoglu, Paul Menage, Patrick Johnson, Pavanish Nirula, Pedro Valenzuela, Percy Liang, Piotr Witusowski, Praveen Kallakuri, Rafal Sokolowski, Rajmohan Rajaraman, Richard Gooch, Rishi Gosalia, Rob Radez, Robert Hagmann, Robert Jardine, Robert Kennedy, Rohit Jnagal, Roy Bryant, Rune Dahl, Scott Garriss, Scott Johnson, Sean Howarth, Sheena Madan, Smeeta Jalan, Stan Chesnutt, Temo Arobelidze, Tim Hockin, Todd Wang, Tomasz Blaszczyk, Tomasz Wozniak, Tomek Zielonka, Victor Marmol, Vish Kannan, Vrigo Gokhale, Walfredo Cirne, Walt Drummond, Weiran Liu, Xiaopan Zhang, Xiao Zhang, Ye Zhao, and Zohaib Maya.SRE: Adam Rogoyski, Alex Milivojevic, Anil Das, Cody Smith, Cooper Bethea, Folke Behrens, Matt Liggett, James Sanford, John Millikin, Matt Brown, Miki Habryn, Peter Dahl, Robert van Gent, Seppi Wilhelmi, Seth Hettich, Torsten Marek, and Viraj Alankar.BCL and borgcfg: Marcel van Lohuizen and Robert Griesemer.Reviewers: Christos Kozyrakis, Eric Brewer, Malte Schwarzkopf, and Tom Rodeheffer.
![Page 5: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/5.jpg)
http://www.google.com/about/datacenters/inside/locations/index.html
![Page 6: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/6.jpg)
http://googleasiapacific.blogspot.se/2015/06/growing-our-data-center-in-singapore.html
![Page 7: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/7.jpg)
Image by Connie Zhou
![Page 8: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/8.jpg)
job hello_world = {
runtime = { cell = 'ic' } // Cell (cluster) to run in
binary = '.../hello_world_webserver' // Program to run
args = { port = '%port%' } // Command line parameters
requirements = { // Resource requirements (optional)
ram = 100M
disk = 100M
cpu = 0.1
}
replicas = 5 // Number of tasks
}
10000
User view
![Page 9: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/9.jpg)
User view
![Page 10: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/10.jpg)
What justhappened?
web browsers
BorgMaster
link shard
UI shardBorgMaster
link shard
UI shardBorgMaster
link shard
UI shardBorgMaster
link shard
UI shard
Cell
Scheduler
borgcfg web browsers
scheduler
Borglet Borglet Borglet Borglet
BorgMaster
link shard
read/UI shard
Config file
persistent store (Paxos)
Binary
User view
![Page 11: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/11.jpg)
Hello world!
Hello world!
Hello world!
Hello world!Hello
world! Hello world! Hello
world!
Hello world!
Hello world!
Hello world!
Hello world!
Hello world!
Hello world!
Hello world!
Hello world!
Hello world!
Hello world!Hello world!
Hello world!
Hello world!
Hello world!
Hello world!
Hello world! Hello
world!
Hello world!
Hello world!
Hello world!
Image by Connie Zhou
User view
Hello world!
Hello world!
Hello world! Hello
world!
Hello world! Hello
world!
Hello world!
Hello world!
Hello world!
Hello world!
Hello world! Hello
world!
Hello world! Hello
world!
Hello world!
Hello world!
Hello world!
Hello world!
Hello world! Hello
world!
Hello world! Hello
world!
Hello world!
Hello world!
![Page 12: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/12.jpg)
User view
![Page 13: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/13.jpg)
task-eviction rates and causes
13
Failures
![Page 14: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/14.jpg)
Images by Connie Zhou
A 2000-machine service will have >10 task exits per dayThis is not a problem: it's normal
Failures
![Page 15: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/15.jpg)
![Page 16: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/16.jpg)
Advanced bin-packing algorithms
Experimental placement of production VM workload, July 2014
Efficiency
stranded resourcesavailable resourcesone
machine
![Page 17: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/17.jpg)
tasks per machine
Multiple applications per machineCPI^2 paper, EuroSys 2013
Efficiency
![Page 18: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/18.jpg)
18
Sharing clusters between prod/batch helps
Segregating them would need more machines
Efficiencyshared cell
(original)
shared cell(compacted)
non-prod load(compacted)
prod-only load(compacted)
# machines
![Page 19: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/19.jpg)
# machines
19
Sharing clusters between prod/batch helps
Segregating them would need more machines
Efficiencyshared cell
(original)
shared cell(compacted)
non-prod load(compacted)
prod-only load(compacted)
overhead
![Page 20: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/20.jpg)
WasteSharing clusters between prod/batch helps
Segregating them would need more machines
15 production cells from a larger pool, omitting small ones (<5000 machines)
20
Efficiency
![Page 21: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/21.jpg)
21
Efficiency
Smaller cells would need more machines
![Page 22: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/22.jpg)
Bucketing to next-largest power of 2 would need more machines
prod only, starting from 0.5 cores, 0.5GiB
⇒ GCE Custom machine types
22
Efficiency
![Page 23: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/23.jpg)
There are no “obvious” resource-bucket sizes
cf. cloud VMs
23
nice round numbers
gaming the system
Efficiency
![Page 24: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/24.jpg)
potentially reusable resources
Resource reclamation
24
Efficiency
time
limit: amount of resource requested
usage: actual resource consumption
reservation: estimate of future usage
![Page 25: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/25.jpg)
Resource reclamation could be more aggressive
Nov/Dec 2013
25
Efficiency
![Page 26: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/26.jpg)
Resource reclamation could be more aggressive
Nov/Dec 2013
26
Efficiency
![Page 27: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/27.jpg)
web browsers
BorgMaster
link shard
UI shardBorgMaster
link shard
UI shardBorgMaster
link shard
UI shardBorgMaster
link shard
UI shard
Cell
Scheduler
borgcfg web browsers
scheduler
Borglet Borglet Borglet Borglet
BorgMaster
link shard
read/UI shard
Config file
persistent store (Paxos)
A few other moving parts
![Page 28: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/28.jpg)
app
agent
masterjob config
A few other moving parts
![Page 29: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/29.jpg)
app
agent
master
system config
monitoring
security accounting/planning
binaries + data distribution
job config
storage
Diagram from an original by Cody Smith.
A few other moving parts
![Page 30: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/30.jpg)
app
agent
master
system config
monitoring
security accounting/billing
binaries + data distribution
job config
storage
A few other moving parts
Diagram from an original by Cody Smith.
![Page 31: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/31.jpg)
κυβερνήτης: pilot or helmsman of a ship
http://kubernetes.io
● Top 0.01% of all Github projects● 800+ unique contributors● 15000+ people signed up for k8s meetups
Kubernetes
![Page 32: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/32.jpg)
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
Kubernetes
Web server
Log roller
![Page 33: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/33.jpg)
Log roller
Web server
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
Kubernetesmaster/scheduler
Pods
![Page 34: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/34.jpg)
FE
FE
FE
FE
FEBE
BE
BE BEBE
BE
BEBE
BE
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
Kubernetes master/scheduler
Labels
![Page 35: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/35.jpg)
FE
FE
FE
FE
FEBE
BE
BE BEBE
BE
BEBE
BE
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
Kubernetes master/scheduler
Label selectors labels: role: frontend
![Page 36: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/36.jpg)
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
Kubernetes master/scheduler
FE
FE
FE
FE
FEBE
BE
BE BEBE
BE
BEBE
BE
Label selectors labels: role: frontend stage: production
![Page 37: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/37.jpg)
FE FE FE
replicas: 3template: ...labels: role: frontend
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
Kubernetes - Master/Scheduler
Replica controller
![Page 38: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/38.jpg)
FE FE FE FE
replicas: 4template: ...labels: role: frontend
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
Kubernetes - Master/Scheduler
Replica controller
![Page 39: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/39.jpg)
id: frontend-serviceport: 9000labels: role: frontend
frontend-service
FE FE FE FE
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
MachineHost
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
ContainerAgent
Kubernetes - Master/Scheduler
Service
![Page 40: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/40.jpg)
Kubernetes
Direct Borg analogues:
● containers● pods● Kubelet● persistent, declarative specs● reconciliation loops
![Page 41: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/41.jpg)
New / improved:
● labels● services● composable microservices
○ replication controller○ horizontal autoscaler
● IP per pod
Kubernetes
![Page 42: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/42.jpg)
Kubernetes & GCP
Kubernetes:● Open source container
orchestration● Supports multiple cloud and
bare-metal environments
Google Container Engine:● Kubernetes as a service
○ runs on GCE, part of GCP● Auto-upgrades, scaling,
healing, monitoring, backup, ...
![Page 43: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/43.jpg)
Kubernetes & GCP
App Engine● Platform as a
service
● Auto-everything
● Deploy from code
Container Engine● Containers as a
service
● Automation doesn’t limit control
● Run any app
Compute Engine● Infrastructure as a
service
● Roll-your-own automation
● Use VMs, disks, networks
![Page 44: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/44.jpg)
http://kubernetes.iohttp://goo.gl/1C4nuo (Borg paper)
Images by Connie Zhou
Observations:
1. Resiliency is achieved only by ruthless attention to detaila. ubiquitous software fault
toleranceb. persistent, declarative specs
2. We get efficiency by:a. sharing resourcesb. reclaiming unused allocations
3. Containers make users more productive
![Page 45: Cluster management at Google with Borg · Cluster management at Google with Borg - coping with scale 2016-11 john wilkes / johnwilkes@google.com Principal Software Engineer](https://reader031.fdocuments.us/reader031/viewer/2022040509/5e4e59b2f23d1b3d914e9ddd/html5/thumbnails/45.jpg)