huggingface / huggingface/candle

`candle-onnx` support for `DynamicQuantizeLinear`

Open
#3,290 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

Hi, I noticed that the [`DynamicQuantizeLinear`](https://onnx.ai/onnx/operators/onnx__DynamicQuantizeLinear.html) operator from ONNX isn't currently supported. Is this on the roadmap?

I've been studying quantization techniques and have a working implementation I'd be willing to contribute. Happy to open a PR if there's interest!

Contributor guide

No contributing guide indexed for this repository

Research direction

Read the linked ONNX DynamicQuantizeLinear specification first, then inspect candle-onnx's existing operator support and quantization-related behavior. Done means the operator is supported according to the specification and the project's relevant tests pass; the issue does not name specific files or tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.