Stream Processing Inside Librato [Monitorama PDX 2015]
-
Upload
librato-inc -
Category
Data & Analytics
-
view
764 -
download
1
Transcript of Stream Processing Inside Librato [Monitorama PDX 2015]
![Page 1: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/1.jpg)
hi.
![Page 4: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/4.jpg)
github: djosephsen
Who put Stream Processing in my Monitoring Conference?
![Page 5: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/5.jpg)
github: djosephsen
Graphing NagiosLet’s talk about signal processing
![Page 6: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/6.jpg)
github: djosephsen
Graphing NagiosLets talk about signal processing
RealTime Audio Processing
![Page 7: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/7.jpg)
github: djosephsen
Graphing NagiosLets talk about signal processing
![Page 8: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/8.jpg)
Graphing NagiosLets talk about signal processing
![Page 9: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/9.jpg)
github: djosephsen
Graphing NagiosLets talk about signal processing
![Page 10: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/10.jpg)
github: djosephsen
Graphing NagiosLets talk about signal processing
![Page 11: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/11.jpg)
github: djosephsen
Graphing NagiosLets talk about signal processing
![Page 12: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/12.jpg)
github: djosephsen
Graphing NagiosLets talk about signal processing
![Page 13: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/13.jpg)
github: djosephsen
Lets talk about signal processing
WhisperDB
WhisperDB
WhisperDB
WhisperDB
![Page 14: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/14.jpg)
github: djosephsen
Lets talk about signal processing
![Page 15: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/15.jpg)
github: djosephsen
Graphing NagiosLets talk about signal processing
![Page 16: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/16.jpg)
github: djosephsen
Graphing NagiosLets talk about signal processing
![Page 17: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/17.jpg)
github: djosephsen
![Page 18: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/18.jpg)
github: djosephsen
Nagios
Zabbix
Collectd
DAC (transform and normalize the signal)
(e.g., translate input to a standard json blob)
![Page 19: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/19.jpg)
github: djosephsen
Zabbix
Filters (de-duplication, noise reduction)
(e.g., compute percentiles to filter outliers)
![Page 20: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/20.jpg)
github: djosephsen
Multiplex (aggregation)
(e.g., aggregate http 200’s from multiple hosts)
![Page 21: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/21.jpg)
github: djosephsen
Effects (ad-hoc external signal processing)
??
![Page 22: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/22.jpg)
github: djosephsen
Effects (ad hoc external signal processing)
??
![Page 23: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/23.jpg)
![Page 24: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/24.jpg)
![Page 25: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/25.jpg)
![Page 26: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/26.jpg)
![Page 27: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/27.jpg)
![Page 28: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/28.jpg)
Say “Exponential Smoothing”
again
![Page 29: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/29.jpg)
Disk Latency
Queue Latency
Model A
Model B
![Page 30: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/30.jpg)
![Page 31: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/31.jpg)
ing
MultiVariate Data Science Menu
Specials Gaussian
Fuzzy
Discrete
Hybridized
SmoothingExponentialSmoothingHolt-Winters
Chicken Fried Exponential SmoothingNaieve Baysian
linear regression
Markov Chains
extreme studentized
Kung-Pow distance vector groupingstream decompisiton
Organic, free-range Ansecomb Quartet
really really smooth Exponential Smoothingxtra seasonality available on request
Downsampling
Statistical Convergence
Lacunary Sequence
Hashsum Distance
Lambda Convergence
Lambda ANYTHINGSeasonal Hybridized Whatever
HALF OFF!
Anything Named after a turn-of-the-century Member of the Russian Intelligencia
Spacial Forecasting
deviant TestQuantile isolation
Probablistic merging
Hybridized/Fuzzy Combo platter!
Collaborative n-gram cosine matching
Robust Sequential Map-Reduce
Micro-lot N-variate chi-square
Ask about our locally-sourced quantile robustness
Roasted Daily!
![Page 32: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/32.jpg)
Scientist gonna science
![Page 33: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/33.jpg)
Scientist gonna scienceEngineer gonna.. yeah.
![Page 34: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/34.jpg)
Scientist gonna scienceData Engineer gonna ??
![Page 35: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/35.jpg)
Making a model is just the beginning
![Page 36: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/36.jpg)
![Page 37: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/37.jpg)
![Page 38: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/38.jpg)
![Page 39: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/39.jpg)
![Page 40: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/40.jpg)
![Page 41: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/41.jpg)
![Page 42: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/42.jpg)
![Page 43: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/43.jpg)
Nagios
![Page 44: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/44.jpg)
GraphiosNagios
![Page 45: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/45.jpg)
Graphios StatsdNagios
![Page 46: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/46.jpg)
Graphios Statsd GraphiteNagios
![Page 47: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/47.jpg)
Graphios Statsd Graphite Grafana
![Page 48: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/48.jpg)
Graphios Statsd Graphite Grafana
Math thingy ???
![Page 49: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/49.jpg)
github: djosephsen
Effects (ad hoc external signal processing)
??
![Page 50: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/50.jpg)
Stuff Statsd Graphite Grafana
![Page 51: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/51.jpg)
Stuff Graphite GrafanaHeka
![Page 52: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/52.jpg)
Stuff Graphite GrafanaHeka
Model A
Model B
![Page 53: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/53.jpg)
Stuff Graphite GrafanaHeka
Model A
Model Bcarbon relay
carbon relay
carbon relay
carbon relay
carbon relay
carbon relay
carbon relay
carbon relay
![Page 54: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/54.jpg)
Stuff Graphite GrafanaHeka
Model A
Model Bcarbon relay
carbon relay
carbon relay
carbon relay
carbon relay
carbon relay
carbon relay
carbon relay
Elastisearch
Elastisearch
![Page 55: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/55.jpg)
![Page 56: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/56.jpg)
![Page 57: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/57.jpg)
![Page 58: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/58.jpg)
![Page 59: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/59.jpg)
Data in Truth out
![Page 60: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/60.jpg)
![Page 61: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/61.jpg)
![Page 62: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/62.jpg)
X
![Page 63: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/63.jpg)
XXX
![Page 64: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/64.jpg)
XXX X X
XX
![Page 65: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/65.jpg)
Kafka
![Page 66: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/66.jpg)
SSA
Kafka
![Page 67: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/67.jpg)
SSA
Kafka
![Page 68: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/68.jpg)
SSAr60
Kafka
![Page 69: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/69.jpg)
SSAr60
r900
Kafka
![Page 70: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/70.jpg)
SSA
![Page 71: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/71.jpg)
![Page 72: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/72.jpg)
SSA
r60
Raw Writer
![Page 73: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/73.jpg)
SSA
r60
Raw Writer
r900 r3600
![Page 74: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/74.jpg)
![Page 75: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/75.jpg)
![Page 76: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/76.jpg)
SSA
r60
Raw Writer
Alerts
![Page 77: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/77.jpg)
SSA
r60
Raw Writer
Alerts
![Page 78: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/78.jpg)
SSA
MySQL
![Page 79: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/79.jpg)
SSA
Alerts
MySQL
![Page 80: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/80.jpg)
SSA
Alerts
MySQL
![Page 81: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/81.jpg)
SSA
Alerts
MySQL
{ {
![Page 82: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/82.jpg)
SSA
Alerts
MySQL
![Page 83: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/83.jpg)
Storm is “pretty OK”
![Page 84: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/84.jpg)
Lacks visibility into flow, performance, and failures
![Page 85: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/85.jpg)
Netty? JVM Hops? Ser/Der?
![Page 86: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/86.jpg)
Samza? Spark?
NIH? ( kafka + zk + mezos + disruptor+? )
![Page 87: Stream Processing Inside Librato [Monitorama PDX 2015]](https://reader038.fdocuments.us/reader038/viewer/2022103119/55ce01e9bb61eb02588b46a1/html5/thumbnails/87.jpg)
Questions?