Post on 29-May-2020
Confidential & Proprietary
Google Cloud Platform
Antonio Zurlo zurlo@google.com
$29 billion Over 1 billion 5,000 caching points
99.95% uptime
Over one billion users each.
Google Search
Android Chrome Google Maps
Google Play
YouTube Gmail Google Cloud
Google Cloud Platform Regions15 current regions. 4 new regions coming.
3
3
3
3
33
3
3
333
3
4
3
3
3
3
3
3
3
proprietary & confidential | not for distribution
2012 20132002 2004 2006 2008 2010
Google Research Publications referenced are available here: http://research.google.com/pubs/papers.htmlThe Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 2009 http://research.google.com/pubs/pub35290.html
GFS
MapReduce
BigTable
Google Research in Infrastructure Technologies
Colossus
Dremel Flume
Megastore
Spanner
Millwheel
PubSub
F1
Confidential & ProprietaryGoogle Cloud Platform 6
2012 20132002 2004 2006 2008 2010
Cloud Storage
DataProc
BigTable Cloud Storage
BigQuery DataFlow
DataStore
Spanner
DataFlow
PubSub
F1
Available as of Sep 2015 at cloud.google.com
Google Research Publications referenced are available here: http://research.google.com/pubs/papers.htmlThe Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines, 2009 http://research.google.com/pubs/pub35290.html
Google Products in Infrastructure Technologies
Tensorflow
8
Google Cloud PlatformBuilding Blocks
Network DataCompute
Confidential & Proprietary
Compute Engine
10
Google Compute
Highly Configurable Resources
●
●
●
●
Managed Compute Paradigms
●
●
●
●
Better EconomicsSUSTAINED USE DISCOUNTSThe more you use, the bigger the discount: automatically get up to 30%-off workloads that run for the duration of the billing month on Compute Engine 1
COMMITTED USE DISCOUNTSSavings of up to 57% without upfront fees and with instance-type flexibility 1
PER SECOND BILLINGYou pay per SECOND, with a one minute minimum.
CUSTOM MACHINE TYPESPick any configuration of CPU, memory, and attached devices. Our customers have saved an average of 19% — and as much as 50% — on top of our already market-leading prices.3
PREEMPTIBLE VM INSTANCESUp to 80%-off2 workloads that can be interrupted, like HTC, Batch and data processing.
1https://cloud.google.com/compute/pricing2https://cloud.google.com/preemptible-vms/3https://cloudplatform.googleblog.com/2016/02/Custom-Machine-Types-goes-GA-saving-you-up-to-50-percent-on-compute-costs.html
Managed Instance Groups
Intel Skylake CPUs
NVIDIA GPUs
Confidential & Proprietary
Networking
16
Network/Bandwidth
Google Networking
Network
Efficient SDN network
●
●●
Performance
●●●
●
Connectivity
●●●
17
Confidential & Proprietary
Storing data on GCP
Storage options on GCP
GOOGLE CLOUD STORAGE
PERSISTENT DISK
LOCAL STORAGE
ON-SITE SOLUTIONS
DataStorage
Block Storage Options
Local SSDFastest, Attached, Ephemeral
Persistent Disk: SSDFast, Persistent, Durable, Remote
Persistent Disk: HDDCheapest, Persistent, Durable, Remote
Targetscenarios
- High-performance scratch space. Frequently accessed data.
Features
- Max Throughput: 800 MB/s read, 400 MB/s write
- Max Throughput: 180 MB/s read, 120 MB/s write
Price / GB
GCS Object Storage
●●●●
●●●
22
Kx on GCP
StorageBigQuery
StorageCloud Storage
Pipeline ManagementCloud Composer
Data AnalysisCloud Datalab
ProcessingCloud Dataproc
MLCloud ML
Architecture: Kx > GCP
StreamingCloud Pub/Sub
On premises
Corporate SourcesStorage Compute
Cold StorageNearline Storage
Business Analysis
ETLCloud Dataflow
Transform Data
TensorFlow
External Feeds
embedPy
23
Thank You