tensorflow / tensorflow/model-optimization

Tensorflow Lite interpreter `invoke()` hangs upon attempting int8 quantization with convertor

Open
#788 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1.6k
Forks
349
Avg merge
3d 2h
Merged PRs (30d)
1

Description

1. System information
  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Linux Ubuntu 16.04
  • TensorFlow installation (pip package or built from source): pip package
  • TensorFlow library (version, if pip package or github SHA, if built from source): 2.5.1
2. Code

Collab based on the provided reference collab:

https://gist.github.com/lucapericlp/8773916d530c2e9ca4d2dcd2b6a023c0

3. Failure after conversion

If the conversion is successful, but the generated model is wrong, then state what is wrong:

Model hangs indefinitely after invoking a converted model using uint8 quantization.

4. Details

I've performed some experiments & discovered the following which might prove useful:

  • EfficientNetB3 & B4 convert & invoke successfully using only float16 quantization
  • EfficentNetB3 & B4 convert successfully but fail invocation when using int8 quantization
  • EfficientNetB0 converts & invokes successfully using float16 or uint8 quantization

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the linked reference Colab and reproduce the EfficientNetB3/B4 conversion and invocation behavior under float16, int8, and uint8 quantization. Compare the successful and hanging cases; done means the converted int8 or uint8 model invokes without hanging.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.