Treasure Data and Fluentd

Copyright ©2014 Treasure Data. All Rights Reserved.

Treasure Data and FluentdTreasure Data Tech Talk Satoshi Tagomori, Treasure Data March 11, 2015


@tagomoris

Satoshi Tagomori Treasure Data, Inc. ← new!

Backend team (& OSS)

2


Fluentd

4

• "an open source data collector for unified logging layer"

• Releases • v0.12.6 • v0.10.61 • td-agent 2.1.5

• Many 3rd party plugins


Plan for Fluentd v0.14

• New Plugin APIs • PluginSupport mixin (timer, thread, child_process, socket, ...) • Additional Buffer configuration params & APIs • Plugin storage • Compatibility layer for traditional plugins

• Sub-second Time • SocketManager & graceful restart

5

Copyright ©2014 Treasure Data. All Rights Reserved. 6

v0.12 vs 0.14 w/ PluginSupport (in_status)

59 lines (v0.12.6)

25 lines (v0.14 API)


Treasure Data &


Treasure Data OSS Team

• Masahiro Nakagawa (@repeatedly) • fluentd, td-agent

• Eduardo Silva • fluent-bit, fluentd-forwarder

• Satoshi Tagomori (@tagomoris), part-time • fluentd v0.14 APIs

• Many more to do!

8


We are hiring!

10/2/14

9

Treasure Data and Fluentd

Engineering

Transcript of Treasure Data and Fluentd