Cloud PostgreSQL Automation Management with Ansible

Kenny GormanChief Technologist; Data

Rackspace

@rackspace @kennygorman

My Background

● Database Engineer, Developer, DBA, Architect, Founder, Chief

Technologist

● Oracle, MySQL, PostgreSQL, MongoDB, Apache Spark

● Ran a very large PG implementation at Hi5

● Contributed to early pg_reorg tooling

● Co-Founded ObjectRocket; MongoDB as a Service

You have more data than yesterday

Simple systems automation/orchestration framework

Easy to learn and use

Little overhead and footprint

Parallel execution

Ansible is

● Written in python

● Agentless/Daemon-less

● OpenSSH

● Idempotent

Ansible attributes

● Human readable● Machine readable

Ansible is

● pip/yum/apt-get or repo

● SSH keys

● yaml files

Setup

● Config: /etc/ansible/ansible.cfg

● Inventory: /etc/ansible/hosts

● Command line interface

● Modules

● Playbooks

Components

● /etc/ansible/hosts

Inventory

● Easy command line interface

Command Line

● Core vs User● Ansible Galaxy

Modules

● TemplatePlaybooks

Ansible + PostgreSQL

● Do I need Ansible?

● Database Provisioning

● Database Management

● DBA Sanity

Idempotent

Provisioning PG

…

Core: ● postgresql_db● postgresql_user● postgresql_privs● ...

User:● Ansible Galaxy● ansible_roles_pipelinedb

PostgreSQL Modules

Ops: Too many servers? Too little time? Too many mistakes?

● Ansible Management Host (or two)

● virtualenv/python/ansible

● git/github + your management code

● Inventory

● ssh key on every DB host

Ansible Management Host

US-EastPrivate DC

LON

Database Management

● start/stop

● pg_hba.conf hax

● upgrades

● user management

● schema uniformity

DB Management one liners

Are my DB machines up?

Is PG responding?

Make sure production indexes exist

Rolling new code/push to site

Are my DB getting smoked?

Triage

Whats is the slow query?

kill it

Gettin’ jiggy with Ansible

● pg_shard

● backups, cloning

● replica creation

● performance tuning

DBA Sanity

● Use modules wherever you can, if there are none, make one. Standardize.

● Git and Github are powerful when combined with Ansible.

● Use the cloud. Setup Dynamic Inventory.

● Use ad-hoc and playbooks in unison selecting the right time to use each.

Contact

@kennygorman@rackspacekenny.gorman@rackspace.com

https://github.com/kgorman/ansible-roles_pipelinedb