dotnet / dotnet/machinelearning
ApplyOnnxModel with model as byte stream instead of local file
- Dominant language
- C#
- Stars
- 9.4k
- Forks
- 2k
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 11
Description
**Is your feature request related to a problem? Please describe.**
I wouldn't like to save files on my service's disk but providing a file name for an ONNX model is currently the only option when I need to load it. Instead, I would like to save the model in a remote source.
**Describe the solution you'd like**
I'd like to read the ONNX model from a remote source and pass it to `ApplyOnnxModel` as a byte stream/array instead of providing a local model file name. I see `InferenceSession` of `OnnxRuntime` is used for ONNX model loading and it provides a constructor which takes in a byte array as the model. Seems like this constructor could be used to achieve my need.
Contributor guide
Assessment
This issue has not been assessed yet.