aws-samples / aws-samples/foundation-model-benchmarking-tool
Model accuracy result file doesn't show correct candidate model name
Open
- Dominant language
- Jupyter Notebook
- Stars
- 256
- Forks
- 44
- PR merge metrics
- No merged PRs in 30d
Description
When comparing accuracy of models deployed to EC2, the candidate_model_accuracy.csv file's candidate_model column always shows 'http://127.0.0.1:8080/invocations', instead of the model_id.
Contributor guide
Assessment
This issue has not been assessed yet.