bytecodealliance / bytecodealliance/wasmtime

wasi-nn: handle any kind of tensor layout

Open
#3,961 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
18.6k
Forks
1.8k
Avg merge
1d 18h
Merged PRs (30d)
126

Description

In #3956 we identified that OpenVINO's latest version has a new limitation on when the user must specify the layout of tensors. These layouts are somewhat image specific (e.g., `NHWC` = Number of images in a batch, Height in pixels, Width in pixels, number of Color channels) so their inclusion in the wasi-nn specification is dubious, since it should handle any kind of inference. OpenVINO expects some early configuration of this layout, though; currently the `NHWC` layout is forced as a sane default, but [other layouts are possible](https://docs.rs/openvino/latest/openvino/enum.Layout.html). To handle any kind of input layout, the OpenVINO backend could: 1) find another way of passing in the layout (i.e., upstream spec changes) or 2) avoid OpenVINO pre-processing that requires the layout (e.g., by using `ANY`).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.