BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through...
Transcript of BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through...
![Page 1: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/1.jpg)
DICK VAN STRAATEN
June 20, 2019
BREAK THROUGH DATA GRAVITY WITH CONTAINERS
![Page 2: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/2.jpg)
INTRODUCTION
Dick van StraatenMicrosoft Azure Consultant | Craft Expert Azure Development
![Page 3: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/3.jpg)
WHAT MAKES ME EXITED?
• CloudDemocratizes technology. Offers efficiency, security, scalability and mobility
• ServerlessThe abstraction infrastructure
• ContainersOffers the promise of portability and agility
![Page 4: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/4.jpg)
“Let the datasetchange yourmindset”
– David McCandless –
![Page 5: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/5.jpg)
0.162006
4.42013
1 ZETTABYTE = 1.000.000.000 TERABYTES
ZETTABYTES OF DATA
~502020
Historical and real-time data
![Page 6: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/6.jpg)
![Page 7: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/7.jpg)
LET’S TALK DATA GRAVITY
![Page 8: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/8.jpg)
LET’S TALK DATA GRAVITY
“Data gravity is an analogy of the nature of data and its ability to attract
additional applications and services.”
-Dave McCrory, 2010 -
![Page 9: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/9.jpg)
DATA ATTRACTSApplications and Application Interfaces
Solution
DataApp API
![Page 10: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/10.jpg)
“As love grows, they want to be close to each other.”
SERVICE GRAVITY
![Page 11: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/11.jpg)
WHEN MASS GROWSGravity will increase
Data
App API
![Page 12: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/12.jpg)
PERFORMANCE
Data
App API
Ensure high data
throughputAvoid
latency
![Page 13: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/13.jpg)
![Page 14: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/14.jpg)
![Page 15: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/15.jpg)
WHERE AND HOW DO I STORE MY DATA?
![Page 16: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/16.jpg)
DATA IN THE CLOUD OR ON-PREMISES?
• CostsPay-per-Use vs major investments and operational costs
• Privacy and SecurityValue added services vs possible limited security resources and expertise
• ScalabilityUnlimited real-time scalability
• RedundancyFault Tolerance, Disaster Recovery and Globally available
![Page 17: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/17.jpg)
![Page 18: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/18.jpg)
… WHEN DATA IS ON THE MOVEthen data gravity affects…
![Page 19: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/19.jpg)
HOW TO STORE DATA?Traditional data storage appliances
Compute
Vendor softwareCapacity
Storage
![Page 20: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/20.jpg)
HYPERCONVERGED?
Decloupled
Software
Vendor specific
Storage
![Page 21: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/21.jpg)
THE ALTERNATIVESoftware Defined Storage
Decloupled
Software
Hardware independent Storage
Storage
![Page 22: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/22.jpg)
SOFTWARE DEFINED BENEFITS
• Using commodity hardwareEasy to replace, less expensive
• Storage virtualizationMassive (unlimited) scalability, easy to move
• Object, File, Block BasedEnabling large storage clusters, efficient use of storage
• Fully managed
![Page 23: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/23.jpg)
SDS EXAMPLES
![Page 24: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/24.jpg)
![Page 25: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/25.jpg)
HOW ABOUT MICROSERVICES?
![Page 26: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/26.jpg)
HOW ABOUT CONTAINERS?HOW ABOUT CONTAINERS?
![Page 27: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/27.jpg)
BENEFITS
• PortabilityDeployed easily to multiple different platforms
• IndependentA container can be deployed independently
• ConsistentApplications in containers will run the same, regardless of where they are deployed
• EfficiencyLess resources, rapidly deployed, patched, or scaled
![Page 28: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/28.jpg)
BREAK THROUGH
Break-up your applications, create microservices,
decentralize data.
Run containers, go Serverless.
Use Software Defined Storage, extend storage features.
Use Cloud, create a hybrid environment.
Serve storage out of containers.
![Page 29: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/29.jpg)
MY ENVIRONMENTA Managed Cloud Service
Azure AKSGoogle GKE Amazon EKS
![Page 30: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/30.jpg)
ROOKA Storage Orchestrator for Kubernetes
![Page 31: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/31.jpg)
CEPHA software defined storage platform
![Page 32: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/32.jpg)
DEMO
![Page 33: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/33.jpg)
DRAWBACKS
• Empower - Learning CurveAzure, Docker, Kubernetes, Helm, Tiller, Rook, Ceph….
• Transform - Loosely coupled complexityProtocols, security, versioning, management….
• Optimize - Containers change ownershipYour build it, you run it…
![Page 34: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/34.jpg)
![Page 36: BREAK THROUGH DATA GRAVITY WITH CONTAINERSfiles.m1.mailplus.nl/user40544/1305/Slides Break Through Data Gravi… · dick van straaten june 20, 2019 break through data gravity with](https://reader033.fdocuments.us/reader033/viewer/2022053019/5f27aa69e99a991552626cb7/html5/thumbnails/36.jpg)
RESOURCES
• Centric Netherlandshttps://www.centric.eu/NL/Default
• Centric Craft Programhttps://www.centric.eu/NL/Default/Craft
• Google Kubernetes Enginehttps://cloud.google.com/kubernetes-engine/
• AWS Elastic Container Service for Kuberneteshttps://aws.amazon.com/eks/
• Azure Kubernetes Serviceshttps://azure.microsoft.com/en-in/services/kubernetes-service/
• Rookhttps://rook.io/
• Cephhttps://ceph.com/