Fluentd
| Typically Used By | Organizations with diverse cloud infrastructure; Multi-cloud strategies |
| Description | An open-source data collector that unifies log collection and provides a flexible logging pipeline with extensive plugin ecosystem. |
| Official Vendor Documentation | https://docs.fluentd.org/ |
| Setup Difficulty | 5 (Advanced) |
| Useful for | DevOps , DevOps |
| Primary Use Case | Unified logging layer |
| Scenarios not Recommended | Simple logging needs; Resource-constrained environments |
| Data Volume Handling | High |
| Authentication Method | Token-based |
| Fault Tolerance | High |
| Additional Tools Required | None |
Fluentd is an open-source data collector that unifies log collection and consumption, enabling you to aggregate logs from multiple sources, transform them, and route them to various destinations including Falcon LogScale Collector. As a Cloud Native Computing Foundation (CNCF) graduated project, Fluentd provides a flexible plugin architecture with over 500 community-contributed plugins for inputs, outputs, filters, and parsers. Fluentd's unified logging layer approach decouples data sources from backend systems, making it ideal for complex, heterogeneous environments where logs need sophisticated processing, enrichment, and routing before reaching LogScale. Organizations already using Fluentd can easily add LogScale as an output destination without disrupting existing log pipelines.
Fluentd ingest flowThe following diagram shows how Fluentd log data flows through Log Collector's ingestion pipeline, highlighting specific parser types applied to the log data before data is compressed, stored in the repository, and indexed for searching: