Fluentd
What is Fluentd?
“Fluentd is an open source data collector, which lets you unify the data collection and consumption for a better use and understanding of data.”
Configure a Client
To log to the central Fluentd server, you need td-agent. You will also need the fluent-plugin-secure-forward plugin installed in order to communicate over HTTPS.
Depending on what you’re looking to log, the configuration will vary. You will however need the following stanza in order to ship logs to your Fluentd server:
<source>
@type forward
</source>
<match secure.**>
@type secure_forward
shared_key YourSecret
self_hostname my-fancy-server.local
enable_strict_verification yes
secure true
<server>
host fluentd.yourdomain.com
port 24284
</server>
</match>
After you’ve configured your client and verified that there were no errors in td-agent’s logs, you can trigger a message to be sent by running:
echo '{"message":"Testing Provisioner"}' | fluent-cat --json secure.test
Alternatively, you can use the Fluentd endpoint directly with our docker helper container.
Technical Details
Fluentd holds no persistent data. All data is being relayed to the Elasticsearch container.