Data Focused Docker Clustering. Docker Hamburg

19
Docker Hamburg The upcoming talk will be presented in English

description

Handling persistent data with Docker using Flocker

Transcript of Data Focused Docker Clustering. Docker Hamburg

Page 1: Data Focused Docker Clustering. Docker Hamburg

Docker HamburgThe upcoming talk will be presented in English

Page 2: Data Focused Docker Clustering. Docker Hamburg

Data focused DockerclusteringMarcus Hughes

Page 3: Data Focused Docker Clustering. Docker Hamburg

What was HybridCluster?

• Full stack LAMP platform

• FreeBSD Chroot containers

• ZFS

• Auto scaling

• Failover

• “AwesomeProxy”

Page 4: Data Focused Docker Clustering. Docker Hamburg

Docker

• Containers!

• Application level containerisation

• Data in “volumes”

• Lack of data portability

Page 5: Data Focused Docker Clustering. Docker Hamburg

Docker containers are portable

Page 6: Data Focused Docker Clustering. Docker Hamburg

Introduction to Flocker

• Open source volume manager

• Multi-node “cluster”

• 0.1 Released on 13th August (0.2 due on 2nd)

Page 7: Data Focused Docker Clustering. Docker Hamburg

Flocker

Page 8: Data Focused Docker Clustering. Docker Hamburg

Proxy layer

• Moving an application can be disruptive

• Application port responds on any node

• Routes reconfigured on migration

Page 9: Data Focused Docker Clustering. Docker Hamburg

ZFS

• Similarities to Docker containers

• ZFS on Linux

• Resilient

• Continuous replication

Page 10: Data Focused Docker Clustering. Docker Hamburg

Migration

• Container stops

• Volumes (ZFS dataset) is sent

• Routes altered

• Container re-started on new host

0.2

• Incremental send

Page 11: Data Focused Docker Clustering. Docker Hamburg
Page 12: Data Focused Docker Clustering. Docker Hamburg

Application configuration

"version": 1

"applications":

"mongodb-volume-example":

"image": "clusterhq/mongodb"

"ports":

- "internal": 27017

"external": 27017

"volume":

"mountpoint": "/data/db"

Page 13: Data Focused Docker Clustering. Docker Hamburg

Deployment configuration

"version": 1

"nodes":

"172.16.255.250": ["mongodb-volume-example"]

"172.16.255.251": []

Page 14: Data Focused Docker Clustering. Docker Hamburg

Deployment configuration

flocker-deploy deployment.yml application.yml

Page 15: Data Focused Docker Clustering. Docker Hamburg

DemoLets see what these configuration files do!

Page 16: Data Focused Docker Clustering. Docker Hamburg

Real world uses

• Moving applications to production

• Replacing servers

• Scalability

Future

• Clone datasets

Page 17: Data Focused Docker Clustering. Docker Hamburg

The FutureIdeas from our past and possible directions

Page 18: Data Focused Docker Clustering. Docker Hamburg

Contribute!

• GitHub https://github.com/ClusterHQ/flocker

• Email [email protected]

Page 19: Data Focused Docker Clustering. Docker Hamburg

Questions?


Smear, Shade| Hamburg Spast| · PDF fileSmear, Shade| Hamburg Spast| Hamburg Rams, Super| Hamburg Aris, Amit| Hamburg Flying Förtress, Most| Hamburg Sway, Nomad, Emir| Hamburg 012

Smear, Shade| Hamburg Spast| · PDF fileSmear, Shade| Hamburg Spast| Hamburg Rams, Super| Hamburg Aris, Amit| Hamburg Flying Förtress, Most| Hamburg Sway, Nomad, Emir| Hamburg 012

Docker und IBM Digital Experience in Docker Container€¦ · Docker und IBM Digital Experience in Docker Container 1. Watson Customer Engagement v What is docker ... • Docker swarm

Docker und IBM Digital Experience in Docker Container€¦ · Docker und IBM Digital Experience in Docker Container 1. Watson Customer Engagement v What is docker ... • Docker swarm

Docker Clustering with Hypriot Cluster Lab on ARM devices

Docker Clustering with Hypriot Cluster Lab on ARM devices

JAX-RS 3.0 The Next Generation - Java Forum Stuttgart · JAX-RS Container Java Runtime Docker Container Docker Container Docker Container Docker Container Docker Container Docker

JAX-RS 3.0 The Next Generation - Java Forum Stuttgart · JAX-RS Container Java Runtime Docker Container Docker Container Docker Container Docker Container Docker Container Docker

Xen Containers: Better way to run Docker Containers5 Docker Containers Running • docker run/create/stop Building • docker build Packaging • docker push/pull/commit Docker –a

Xen Containers: Better way to run Docker Containers5 Docker Containers Running • docker run/create/stop Building • docker build Packaging • docker push/pull/commit Docker –a

SECONDHAND- Hamburg LÄDEN IN HAMBURG · 1 SECONDHAND- Hamburg LÄDEN IN HAMBURG EIN WEGWEISER ZU EINKAUFSALTERNATIVEN

SECONDHAND- Hamburg LÄDEN IN HAMBURG · 1 SECONDHAND- Hamburg LÄDEN IN HAMBURG EIN WEGWEISER ZU EINKAUFSALTERNATIVEN

Docker Basics - docs.adfinis-sygroup.ch · Check your docker version docker version Check the available docker options docker Your first hello-world container docker run hello-world

Docker Basics - docs.adfinis-sygroup.ch · Check your docker version docker version Check the available docker options docker Your first hello-world container docker run hello-world

Clustering Docker with Docker Swarm on openSUSE

Clustering Docker with Docker Swarm on openSUSE

DOCKER 101 - DeveloperMarch€¦ · -Docker Machine -Docker Compose -Docker Stack -Docker Swarm -Docker Hub. INSTALLATION. INSTALLATION. WORKFLOW. client Dockerfile Image Registry

DOCKER 101 - DeveloperMarch€¦ · -Docker Machine -Docker Compose -Docker Stack -Docker Swarm -Docker Hub. INSTALLATION. INSTALLATION. WORKFLOW. client Dockerfile Image Registry

Agenda - azure.uhsky.noazure.uhsky.no/docs/samlinger/2018_mars_azure... · Docker Swarm is a clustering and scheduling tool for Docker containers. With Swarm, IT administrators and

Agenda - azure.uhsky.noazure.uhsky.no/docs/samlinger/2018_mars_azure... · Docker Swarm is a clustering and scheduling tool for Docker containers. With Swarm, IT administrators and

events.static.linuxfound.org · 2017-12-14 · OpenStack Cartridge Instance n create/destroy instances Cartridge Instance 2 os hardware Pocker Docker Docker Docker Docker Docker Docker

events.static.linuxfound.org · 2017-12-14 · OpenStack Cartridge Instance n create/destroy instances Cartridge Instance 2 os hardware Pocker Docker Docker Docker Docker Docker Docker

Clustering with Docker Swarm - 13/05/2016

Clustering with Docker Swarm - 13/05/2016

Revisited GeoServer Clustering · 2017-12-28 · onto Docker and Docker Swarm. How easy/difficult would it be to transition? • We will walk through a brief comparison of the two

Revisited GeoServer Clustering · 2017-12-28 · onto Docker and Docker Swarm. How easy/difficult would it be to transition? • We will walk through a brief comparison of the two

docker run docker service is the new · Getting Started with Docker Clustering Mike Goelzer / mgoelzer@docker.com / @mgoelzer Docker Inc. docker service is the new docker run docker

docker run docker service is the new · Getting Started with Docker Clustering Mike Goelzer / [email protected] / @mgoelzer Docker Inc. docker service is the new docker run docker

Intro to Docker and clustering with Rancher from scratch

Intro to Docker and clustering with Rancher from scratch

ASP.NET 5 + Docker + Azuregotocon.com/.../slides/StuartLeeks_ASPNET5DockerAzure.pdf · 2015. 10. 7. · Azure + Docker VM image: Ubuntu with docker Docker VM Extension Docker Compose

ASP.NET 5 + Docker + Azuregotocon.com/.../slides/StuartLeeks_ASPNET5DockerAzure.pdf · 2015. 10. 7. · Azure + Docker VM image: Ubuntu with docker Docker VM Extension Docker Compose

openQA - SUSE€¦ · Jenkins Gerrit Travis Selenium Docker Docker Docker Docker Docker Docker Docker Docker ... openQA runs tests on each Maintenance Update before being released

openQA - SUSE€¦ · Jenkins Gerrit Travis Selenium Docker Docker Docker Docker Docker Docker Docker Docker ... openQA runs tests on each Maintenance Update before being released

Docker Swarm using Cisco CloudCenterPlatform · Docker Swarm using Cisco CloudCenterPlatform What is Docker Swarm? Swarm is a native clustering tool for Docker. Swarm pools together

Docker Swarm using Cisco CloudCenterPlatform · Docker Swarm using Cisco CloudCenterPlatform What is Docker Swarm? Swarm is a native clustering tool for Docker. Swarm pools together

Docker on Hadoop - events.static.linuxfound.org Docker Docker must be ... Hadoop artfacts must exist in Docker containers

Docker on Hadoop - events.static.linuxfound.org Docker Docker must be ... Hadoop artfacts must exist in Docker containers

Docker Recipes for Java Developers - Red Hat · Docker Swarm • Native clustering for Docker • Provides a unified interface to a pool of Docker hosts • Fully integrated with

Docker Recipes for Java Developers - Red Hat · Docker Swarm • Native clustering for Docker • Provides a unified interface to a pool of Docker hosts • Fully integrated with