vllm-project / vllm-project/guidellm
Define effective hierarchy of debug logging
Open
@jaredoconnell is already working on this.
Since Aug 13, 2025.
internal
priority-low
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 234
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 46
Description
The INFO log level is way to verbose about the inner config of objects. We should push many of the messages to higher log levels and/or rewrite some messages to be less verbose.
Here is a proposal for what we could focus on in each log level:
ERROR: Anything that leads to complete failure of the testWARNING: Things might be going wrong, or not happening in the expected way- Requests erroring
- Concurrency saturated
INFO: Things that should be happening that help explain the state- Info about run configuration, dataset...
- What RPS settings are calculated in the sweep
- Infrequent status updates
- Info about output calculations / files that its dumped to
DEBUG: Stuff like prompts and resultsTRACE: token-level events from the requests
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.