tensorflow / tensorflow/model-optimization

How to use default n bit in QAT ?

Open
#885 3 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

feature request
Dominant language
Python
Stars
1.6k
Forks
349
Avg merge
3d 2h
Merged PRs (30d)
1

Description

System information

  • TensorFlow version (you are using):2.5
  • Are you willing to contribute it (Yes/No):Yes

Motivation

What is the use case and how does it broadly benefits users? Prioritization and whether a feature is added is based on how it
helps the community and the feature's maintenance costs.

As examples:

  1. Instead of, "Enable the technique for my model," "Enable this technique to work better with standard object detection models, including R-CNN (link) and SSD (link)" is stronger.

  2. Instead of, "Try something more customized with the technique," "Implement a variant of the algorithm described in equations X and Y of this paper" is clearer.

Describe the feature
sample code to QAT with 4 bit or n bit
Describe how the feature helps achieve the use case

Describe how existing APIs don't satisfy your use case (optional if obvious)

As examples:

  1. You tried using APIs X and Y and were able to do Z. However, that was not sufficient because of ...

  2. You achieved your use case with the code snippet W. However, this was more difficult than it should be because of ... (e.g. ran into issue X or had
    to do Y).

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No file, test, or entry point is identified; first clarify whether this requests documentation, an API change, or an implementation for 4-bit and arbitrary n-bit QAT in TensorFlow 2.5. Define the supported bit-width behavior and an example-based acceptance criterion before locating the relevant QAT entry points and tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.