aws-samples / aws-samples/foundation-model-benchmarking-tool
The README gives an impression that this tool is comparing instance types when it should be serving stacks
Open
documentation
- Dominant language
- Jupyter Notebook
- Stars
- 256
- Forks
- 44
- PR merge metrics
- No merged PRs in 30d
Description
Update the readme to clarify that it is the complete serving stack that we are comparing across different experiments. The serving stack includes everything from the instance type, the inference container and the backend configuration parameters.
Contributor guide
Assessment
This issue has not been assessed yet.