fluent / fluent/fluent-bit

A separate metric for actual network-transmitted bytes?

Open
#10,184 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C
Stars
8.1k
Forks
2k
Avg merge
4d 20h
Merged PRs (30d)
71

Description

**Is your feature request related to a problem? Please describe.**

There is currently no way of telling how much data fluentbit transmits over the network to the log ingester without analyzing the ingester's http access logs or looking at the ingester's own metrics (if it has them at all).

Yes we have the `fluentbit_output_proc_bytes_total`, but it apparently counts the bytes before they are fed into the http client for transmission, and when the data is compressed before transmission (using gzip in my case), the actual amount transferred over the network becomes lower than that reported in `fluentbit_output_proc_bytes_total`.

**Describe the solution you'd like**

It would be nice to add a new metric to fluentbit such as `fluentbit_output_http_sent_bytes_total` that would measure actual bytes sent.

**Additional context**

Use case: traffic accounting for cost estimation and optimization in cloud-hosted environments.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.