![]() The following figure depicts the logging architecture we will setup and the role of fluent bit in it: Fluent bit has a pluggable architecture and supports a large collection of input sources, multiple ways to process the logs and a wide variety of output targets. It is written in C which makes it very lightweight in terms of its resource consumption as compared to both fluentd and logstash. Two of the most popular ones are fluentd and logstash. There are various options when it comes to selecting a log forwarding software. The application authors only need to ensure that their logs are being emitted to the standard output and error streams. Setting up log forwarding in a Kubernetes cluster allows all applications and system services that are deployed in the cluster to automatically get their logs processed and stored in a preconfigured central log storage. It and then forward them to a log storage system or another log forwarder. The job of the log forwarder is thus to read logs from one or multiple sources, perform any processing on Logs emitted by the application is in a format (JSON for example) understood by the log forwarder. This decoupling only works of course, if the Essentially, log forwarding decouples the application emitting logs and what needs to be done with those logs. As an application author, you don't want to be bothered with the responsibility of ensuring the application logs are being processed a certain way and then stored in a central log storage.Īs an operations personnel, you don't want to have to hack your way around different applications to process and ship logs. Log forwarding is an essential ingredient of a production logging pipeline in any organization.
0 Comments
Leave a Reply. |