aws-samples / aws-samples/foundation-model-benchmarking-tool
Reports only show information per instance instead of per endpoint
- Dominant language
- Jupyter Notebook
- Stars
- 256
- Forks
- 44
- PR merge metrics
- No merged PRs in 30d
Description
In this configuration, I wanted to compare the performance of two different hosting images (LMI and TGI) on the same endpoint. (I added the g5 just to get past the statistics issue). So the config includes 2 inf2 endpoints and on g5 endpoint.
However, the graph only shows the metrics for the instance (presumably the best run) instead of a different circle for each endpoint.
We might also do the same thing if we were testing out different configurations, like batch sizes on inf2.
[Inf2-LMI-versions.yml.txt](https://github.com/user-attachments/files/15740052/Inf2-LMI-versions.yml.txt)
Contributor guide
Assessment
This issue has not been assessed yet.