bytecodealliance / bytecodealliance/wasmtime
wasi-nn: handle any kind of tensor layout
- Dominant language
- Rust
- Stars
- 18.6k
- Forks
- 1.8k
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 126
Description
In #3956 we identified that OpenVINO's latest version has a new limitation on when the user must specify the layout of tensors. These layouts are somewhat image specific (e.g., `NHWC` = Number of images in a batch, Height in pixels, Width in pixels, number of Color channels) so their inclusion in the wasi-nn specification is dubious, since it should handle any kind of inference. OpenVINO expects some early configuration of this layout, though; currently the `NHWC` layout is forced as a sane default, but [other layouts are possible](https://docs.rs/openvino/latest/openvino/enum.Layout.html). To handle any kind of input layout, the OpenVINO backend could: 1) find another way of passing in the layout (i.e., upstream spec changes) or 2) avoid OpenVINO pre-processing that requires the layout (e.g., by using `ANY`).
Contributor guide
Assessment
This issue has not been assessed yet.