aws-samples / aws-samples/foundation-model-benchmarking-tool
The business summary plot in the report needs to have a caption for disclaimer
Open
bug
- Dominant language
- Jupyter Notebook
- Stars
- 256
- Forks
- 44
- PR merge metrics
- No merged PRs in 30d
Description
Visualizations are powerful, so the message that it is the full serving stack that results in a particular performance benchmark can get lost unless explicitly called out. It is possible that someone could take the impression that a given instance type always performance better without considering that it is the instance type+inference container +parameters and so the results should not be taken out of context.
Contributor guide
Assessment
This issue has not been assessed yet.