Nagios Conference 2014 - David Josephsen - Alert on What You Draw

73
hi.

description

David Josephsen's presentation on Alert on What You Draw. The presentation was given during the Nagios World Conference North America held Oct 13th - Oct 16th, 2014 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/conference

Transcript of Nagios Conference 2014 - David Josephsen - Alert on What You Draw

Page 1: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 2: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

[email protected]@davejosephsen

github: djosephsen

Graphing Nagios

Page 3: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

[email protected]@davejosephsen

github: djosephsen

Alert on What you Draw

Page 4: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Alert on What you Draw

Page 5: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 6: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 7: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 8: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 9: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 10: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 11: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 12: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 13: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

T

tim.mycorp.com bob.mycorp.com

Page 14: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.Developer cat

Wants to change things

Change control

Says no.

Page 15: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

You guys ok?

YUP YUP

Page 16: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.Process Oriented Model

Given a finite number of reliable systems, and full environmental control, run processes for as long

as possible

Page 17: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

The Cloud

VirtualVirtual

Massive Infrastructure

Maintenance Coersion

Page 18: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

The Cloud

Virtual

Massive Infrastructure

Maintenance Coersion

Page 19: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

The Cloud

Virtual

Multi-Tenant

Massive Infrastructure

Maintenance Coersion

Page 20: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

The Cloud

Virtual

Multi-Tenant

Massive Infrastructure

Compulsory Maintenance

Page 21: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

The Cloud

Virtual

Multi-Tenant

Massive Infrastructure

Compulsory Maintenance

Page 22: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

The Cloud

Page 23: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

The Cloud

Page 24: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

The Cloud

Page 25: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 26: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

US-EAST

AZ-1 AZ-2

Page 27: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

US-EAST

AZ-1 AZ-2

Page 28: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

US-EAST

AZ-1

AZ-2

AZ-3

Page 29: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

US-EAST

AZ-1

AZ-2

AZ-3

Page 30: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

US-EAST

AZ-1

AZ-2

AZ-3

Page 31: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

US-EAST

AZ-1

AZ-2

AZ-3

Page 32: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

US-EAST

AZ-1

AZ-2

AZ-3

XXXX

Page 33: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 34: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 35: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.Services Oriented Model

Design reliable services atop an infinite number of unreliable, and uncontrollable systems.

Page 36: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 37: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 38: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 39: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 40: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 41: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 42: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.here’s a log line wrapped in an http GET request

Page 43: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.HTTP 200 OK!

Page 44: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

hi.

Page 45: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

}<100ms

}<10

0ms

Page 46: Nagios Conference 2014 - David Josephsen - Alert on What You Draw
Page 47: Nagios Conference 2014 - David Josephsen - Alert on What You Draw
Page 48: Nagios Conference 2014 - David Josephsen - Alert on What You Draw
Page 49: Nagios Conference 2014 - David Josephsen - Alert on What You Draw
Page 50: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

tim.mycorp.com

Page 51: Nagios Conference 2014 - David Josephsen - Alert on What You Draw
Page 52: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

It Scales

I can change how it works

It’s resilient

Page 53: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

It ScalesIt’s resilient

I can change how it works

Page 54: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

It ScalesIt’s Resilient

I can change how it works

Page 55: Nagios Conference 2014 - David Josephsen - Alert on What You Draw
Page 56: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Latency, Queues, Workers

Summarized at the service level

Page 57: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Latency, Queues, Workers

Monitored from within..

Page 58: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Latency, Queues, Workers

Monitored from within..

…by Developers

Summarized at the service level

Page 59: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Latency, Queues, Workers

Monitored from within..

…by Developers

Summarized at the service level

Page 60: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it worksSummarized at the service level

Page 61: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Can be polled externallyState Data about hosts the order of minutes

Operations controls and configures hosts and services

Must be instrumented internally

Performance Data about services the order of seconds

Any engineer can create new ad-hoc metrics

Page 62: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

internally instrumented

metrics measured every few seconds

write-accessible by every engineer

Page 63: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Page 64: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Page 65: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Undermines Credibility

Page 66: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Undermines CredibilitySilo’s Knowledge

Multiplies Burden

Page 67: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

I can change how it works

Undermines CredibilitySilo’s KnowledgeMultiplies Burden

Page 68: Nagios Conference 2014 - David Josephsen - Alert on What You Draw
Page 69: Nagios Conference 2014 - David Josephsen - Alert on What You Draw
Page 70: Nagios Conference 2014 - David Josephsen - Alert on What You Draw
Page 71: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

Heka

Riemannhttp://riemann.io/

http://hekad.readthedocs.org/en/v0.7.2/

Page 72: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

LIVE Demo Ahead!

Page 73: Nagios Conference 2014 - David Josephsen - Alert on What You Draw

Questions?