huggingface / huggingface/candle
Tile op for onnx support
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
Recently doing SNAC model to rust, the onnx can not be run due to Tile op.
```
Exploring on onnx model: snac_24hkz_sim.onnx
╭───────────────────────────── snac_24hkz_sim.onnx Summary ──────────────────────────────╮
│ IR Version: 7 │
│ Opset Version: 14, │
│ Doc: │
│ Producer Name: pytorch │
│ All Ops: │
│ Gather,Transpose,Conv,Unsqueeze,Tile,Shape,Slice,Concat,Reshape,Add,Mul,Sin,Pow,ConvTr │
│ anspose,ConstantOfShape,RandomNormalLike,Tanh │
╰────────────────────────────────────────────────────────────────────────────────────────╯
snac_24hkz_sim.onnx Detail
╭────────────────────┬────────────────────────┬─────────────────────────┬────────────────╮
│ Name │ Shape │ Input/Output │ Dtype │
├────────────────────┼────────────────────────┼─────────────────────────┼────────────────┤
│ c1 │ [-1, -1] │ input │ int64 │
│ c2 │ [-1, -1] │ input │ int64 │
│ c3 │ [-1, -1] │ input │ int64 │
│ audio_hat │ [-1, 1, -1] │ output │ float32 │
╰────────────────────┴────────────────────────┴─────────────────────────┴────────────────╯
```
any way to adding support for it?
Also, ConvTranspose, RandomNormalLike also useful.
SNAC decoder is now widely used in many TTS and Omni models with Audio speech ability.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating Candle's ONNX operator import and existing operator implementations, then inspect how the reported snac_24hkz_sim.onnx model reaches the unsupported Tile operation. Reproduce the failure with that model and determine the required coverage for Tile; ConvTranspose and RandomNormalLike are additional requested operators. Done means the model runs past these unsupported operations with appropriate tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100