dotnet / dotnet/machinelearning

ApplyOnnxModel with model as byte stream instead of local file

Open
#6,183 5 comments 0 reactions 0 assignees View on GitHub
area-ONNX enhancement
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

**Is your feature request related to a problem? Please describe.**
I wouldn't like to save files on my service's disk but providing a file name for an ONNX model is currently the only option when I need to load it. Instead, I would like to save the model in a remote source.

**Describe the solution you'd like**
I'd like to read the ONNX model from a remote source and pass it to `ApplyOnnxModel` as a byte stream/array instead of providing a local model file name. I see `InferenceSession` of `OnnxRuntime` is used for ONNX model loading and it provides a constructor which takes in a byte array as the model. Seems like this constructor could be used to achieve my need.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.