mlcommons / mlcommons/endpoints
Add GitLab CI to stress test upper bound of the endpoint measurement
Open
@arekay-nv is already working on this.
Since Feb 26, 2026.
area: core-engine
priority: P0
type: chore
- Dominant language
- Python
- Stars
- 21
- Forks
- 28
- Avg merge
- 3d 17h
- Merged PRs (30d)
- 13
Description
Develop the proper e2e CI test to make sure:
- the inference endpoint measurement matches the server capality (the server is not bottlenecked by the client)
- Inference endpoint client is not bottlenecked by any of the components (the client is not bottlenecked by the components)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.