OSDC 2014: Jordan Sissel - Find Happiness in your Logs

Post on 06-May-2015

396 views 0 download

Preview:

Click to see full reader

description

Got logs? With so much technology powering your business, you need tools to help you identify problems and analyze past behavior. Apache 2.0-licensed Elasticsearch ELK stack is here to help you process, store, and visualize any kind of logging data, in real time, from any source imaginable! Log management seems so boring. Log rotation, retention policy, grep, yuck! What are your servers are doing? Did last night's upgrade break anything? How your users are interacting with your products? Why did the site go down last weekend? Get ready to turn your log pains into awesome visual insights and more! BAM! Elasticsearch ELK! ELK stands for Elasticsearch, Logstash, and Kibana. Each of these three are lovely, open source projects that, together, give you and your business log management superpowers. This talk will primarily be done in three parts: open source and community, technology, and use cases. * The first part will introduce each project and its success as open source software, most notably through supportive and open communities. * The second part will discuss the each project and the problems solved. * The third (and most exciting!) part will highlight a variety of use cases and problem that real humans are using Elasticsearch ELK to solve. Live demos of some use cases will be provided. Attendees will leave the presentation totally full of excitement about this toolset and bursting with fresh ideas about how to tackle their sour logging problems.

Transcript of OSDC 2014: Jordan Sissel - Find Happiness in your Logs

Logstashfind happiness in your logs

with Elasticsearch ELK

Open Source

Apache 2.0 License

Open Source

Open and Friendly Community

Open Source

If a new user has a bad time, it’s a bug.

Open Source

Technology

Logstash

Processing & Transport

Logstash

FiltersInputs Outputs42 51 54

Processing & Transport

Logstash Processing & Transport

LAMP Example

ApacheMysqlPHP

Syslog

NagiosElasticsearch

Graphite

IRC

Parse: Latency, Bandwidth, and Errors

Load Balancer

Logstash Example Inputs

Files Graphite

SNMPEmail

Syslog

TwitterTCP

RabbitMQ

Logstash Example Filters

Grok Date

FingerprintGeoIPMultiline

User AgentKey-Value

Logstash Example Outputs

Elasticsearch Graphite

XMPPNagios

Email PagerdutyS3

Elasticsearch

Near Real-Time Search & Analysis

Elasticsearch

Scalable

Elasticsearch

REST + JSON API

Elasticsearch

Kibana

Visualization & Exploration

Kibana

Use Cases

Share Logs with Your Tech Support Team

Use Cases

Graph all things!

Use Cases

Exploration by Non-Technical Users

Use Cases

Troubleshooting Latency

?Late

ncy

Time

Movie Releases Demo

Use Cases

Apache Logs Demo

Use Cases

OSDC 2014: Jordan Sissel - Find Happiness in your Logs

Software

Transcript of OSDC 2014: Jordan Sissel - Find Happiness in your Logs

Osdc 2013 p

Osdc php preday odata 2011

Firefox Extension Development | By JIIT OSDC

OSDC 2015: Timo Derstappen | Microservice orchestration

Hadoop MapReduce - OSDC FR 2009

Experiences From Agile Projects Great & Small (OSDC 2009)

The VERCE Architecture for Data-Intensive Seismologyciara.fiu.edu/osdc-verce_Iraklis.pdf · The VERCE Architecture for Data-Intensive Seismology OSDC Workshop, Edinburgh, 19 June

OSDC 2014: Jordan Sissel & Lennart Koopmann - Intro to log management

Introduktion till workshop 4 Sissel Kondrup og Henrik Hersom

Silicon Beach Australia - Intro Presentation @ OSDC 2008

Sissel testing slideshare Macro

OSDC 2014 Test Driven Infrastructure

Hvilken effekt kan undervisningsmetoder ha på studenters ... · av sissel naustdal & katarzyna adamska sissel naustdal, september 2015 1 hva som bidrar til mestring og gode prestasjoner

OSDC 2014: Jonathan Clarke - Rudder

Kristin Alsos, Sissel C. Trygstad 11 Workplace Democracy ... · Kristin Alsos, Sissel C. Trygstad 11 Workplace Democracy: Representation and Participation Gaps in the Norwegian Labour

OSDC 2014: Tobias Schwab - Continuous Delivery with Docker

" -hlison hughes and holly hatam barbara taylor sissel safe keep

OSDC 2016 - Hybrid Cloud - A Cloud Migration Strategy

Group No. 16 OSDC Assignment Part-I

OSDC 2013 - Configuration Management and Linux Packages