nvtx markers for async llm engine
Open
Performance
- Dominant language
- Python
- Stars
- 2k
- Forks
- 561
- Avg merge
- 4d 5h
- Merged PRs (30d)
- 145
Description
currently only the sync vllm worker has nvtx markers. this issue tracks adding this to the async llm engine for parity
Contributor guide
Assessment
This issue has not been assessed yet.