microsoft / microsoft/onnxruntime
SplitToSequence cannot support float16 as input/output
Open
@justinchuby is already working on this.
Since May 14, 2024.
converter:dynamo
core runtime
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
Describe the issue
SplitToSequence operator cannot support float16 as input, although it was said 'yes' in ONNX doc.
It impact fp16 converter. Because the output is a sequence, so user have to convert the element in the output sequence to fp16 one by one, the performance is bad.
To reproduce
- prepare a [5,5] input array with dtype = np.float16
- call op.SplitToSequence(input, dim=0, num_outputs=2)
- the expected output is sequence([2,5], [3,5]).
It works on float32.
Urgency
No response
Platform
Windows
OS Version
11
ONNX Runtime Installation
Released Package
ONNX Runtime Version or Commit ID
1.14
ONNX Runtime API
Python
Architecture
X64
Execution Provider
Default CPU
Execution Provider Library Version
No response
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.