microsoft / microsoft/onnxruntime

Possible reversed functions in winml compute shaders

Open
#5,964 5 comments 0 reactions 2 assignees View on GitHub

@zhangxiang1993 is already working on this.

Since Feb 4, 2021.

platform:windows
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

**Describe the bug**
I was looking through the source of winml parts and noticed that in this shader [SurfaceToTensorFloat.hlsl](https://github.com/microsoft/onnxruntime/blob/master/winml/lib/Api.Image/shaders/SurfaceToTensorFloat.hlsl) the definitions of `SurfaceToTensorGRAY8 `and `SurfaceToTensorRGB8 `looks like they're reversed/swapped? GRAY8 version assigns 3 values per output and RGB8 assigns only one. Apologies in advance if I've missed something here and it's actually correct.

**Urgency**
None. I will not ultimately be using built-in tensorization.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.