huggingface / huggingface/optimum-nvidia
Triton Inference Server
Open
- Dominant language
- Python
- Stars
- 1k
- Forks
- 103
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
I would like to use this as a python backend within `triton-inference-server` in order to allow for bringing my production parameters in better alignment with training / validation.
Are there plans to make a supported triton server tag for optimum-nvidia? https://catalog.ngc.nvidia.com/orgs/nvidia/containers/tritonserver/tags
Contributor guide
Assessment
This issue has not been assessed yet.