huggingface / huggingface/candle

Tile op for onnx support

Open
#2,830 2 comments 3 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

Recently doing SNAC model to rust, the onnx can not be run due to Tile op.

```
Exploring on onnx model: snac_24hkz_sim.onnx
╭───────────────────────────── snac_24hkz_sim.onnx Summary ──────────────────────────────╮
│ IR Version: 7 │
│ Opset Version: 14, │
│ Doc: │
│ Producer Name: pytorch │
│ All Ops: │
│ Gather,Transpose,Conv,Unsqueeze,Tile,Shape,Slice,Concat,Reshape,Add,Mul,Sin,Pow,ConvTr │
│ anspose,ConstantOfShape,RandomNormalLike,Tanh │
╰────────────────────────────────────────────────────────────────────────────────────────╯
snac_24hkz_sim.onnx Detail
╭────────────────────┬────────────────────────┬─────────────────────────┬────────────────╮
│ Name │ Shape │ Input/Output │ Dtype │
├────────────────────┼────────────────────────┼─────────────────────────┼────────────────┤
│ c1 │ [-1, -1] │ input │ int64 │
│ c2 │ [-1, -1] │ input │ int64 │
│ c3 │ [-1, -1] │ input │ int64 │
│ audio_hat │ [-1, 1, -1] │ output │ float32 │
╰────────────────────┴────────────────────────┴─────────────────────────┴────────────────╯
```

any way to adding support for it?

Also, ConvTranspose, RandomNormalLike also useful.

SNAC decoder is now widely used in many TTS and Omni models with Audio speech ability.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating Candle's ONNX operator import and existing operator implementations, then inspect how the reported snac_24hkz_sim.onnx model reaches the unsupported Tile operation. Reproduce the failure with that model and determine the required coverage for Tile; ConvTranspose and RandomNormalLike are additional requested operators. Done means the model runs past these unsupported operations with appropriate tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.