Log Management

Centralized log management collects, parses, and analyzes log data from distributed systems in real time, replacing manual inspection across individual servers. Modern stacks typically combine a log collector (shipper) with an indexing backend and a query interface.

Grafana Loki (AGPL v3) is a horizontally scalable log aggregation system inspired by Prometheus. It indexes only metadata labels rather than the full log text, keeping storage costs low while enabling fast queries through LogQL. Loki integrates natively with Grafana for visualization and alerting.

OpenObserve (AGPL v3) is a petabyte-scale observability platform for logs, metrics, and traces. It requires no external dependencies like Elasticsearch or Kafka, runs as a single binary, and claims up to 140× lower storage costs compared to Elasticsearch-based stacks.

Fluentd (Apache 2.0) is a CNCF-graduated unified data collector that routes logs from hundreds of sources to any destination through a plugin architecture. Its lighter sibling Fluent Bit (Apache 2.0) is designed for resource-constrained environments like edge and IoT.

Vector (MPL 2.0) is a high-performance observability data pipeline written in Rust. It can collect, transform, and route logs and metrics with low resource overhead, serving as an alternative or complement to Fluentd.