“Collect Everything!”

GRAPHITE

Why collect data?- Problem Determination

- Root Cause Analysis

- Performance Optimization

- Cost optimization

- Reporting

- Forecasting

Why Graphite?- Powerful UI

- Highly scalable

- No central configuration

- Lots of Supporting tools- Collectd

- Statsd

- Dashboards

Powerful UI- Pulling data

- Correlating data

- Aggregating data

- Manipulating Data

Highly Scalable- Metrics are queued

- I/O nice

- 40,000+ metrics/minute on 1CPU 3G VM

How to scale?- Big $$$ storage

- Mount multiple independent RAID partitions

- Multiple Graphite instances

- Deduplication

No Central Configuration- Push metrics from anywhere

- Clients available for many programming languages

- Write data to socket in standard format

<Metric.name> <value> <timestamp>

Supporting toolsCollectd- Metric collection daemon

- Plugin based

- Support for…

- Apache

- JMX

- Load

- Memory

- Disk I/O and usage

- Etc.

Supporting toolsStatsd- Metrics are submitted to buckets

- Buckets flush on a regular interval

- Aggregated metrics are written to graphite

- Useful for application metrics

- Support for…

- Counters

- Timers

- Guages

- Sets

Supporting toolsDashboards- Graphite

- Descartes

- Cubism

- Tasseo

Glenn Poston

- Twitter: gposton

- Github: gposton

- Blog: www.glennposton.com