aws-samples / aws-samples/amazon-sagemaker-workshop-for-huggingface
how do i modify torchserve config in deployment?
Open
- Dominant language
- Jupyter Notebook
- Stars
- 3
- Forks
- 6
- PR merge metrics
- No merged PRs in 30d
Description
Hello.
I want to adjust the torchserve's dynamic batch, but I'm not sure how to access those settings.
Currently, the default batchsize seems to be 1, how can I adjust the ts-config that includes this value?
Contributor guide
Assessment
This issue has not been assessed yet.