aws-samples / aws-samples/foundation-model-benchmarking-tool
miss warm up phase
Open
- Dominant language
- Jupyter Notebook
- Stars
- 256
- Forks
- 44
- PR merge metrics
- No merged PRs in 30d
Description
the benchmark of model latency highly depends on model warmup. There is no "warmup" phase in 3_run_inference.ipynb.
Contributor guide
Assessment
This issue has not been assessed yet.