GoogleCloudPlatform / GoogleCloudPlatform/opentelemetry-operations-python

Oversized logs are completely dropped

Open
#426 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
83
Forks
46
Avg merge
11h 40m
Merged PRs (30d)
2

Description

If you send a log that would exceed Cloud Logging's 256kb limit, the API will reject the log. This is pretty common with GenAI prompt/response capturing where the log can become huge. This is unfortunate because you lose everything, including labels. I'm not sure if this fails the whole batch of logs.

Some workaround ideas

1. do nothing and let them drop
3. unset the jsonPayload if it's too large
4. truncate the textPayload if it's too large
5. add a new log entry with just the labels and a payload indicating that the large body was dropped

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.