MegEngine / MegEngine/examples

how to dump a int4 model

Open
#9 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
31
Forks
5
PR merge metrics
No merged PRs in 30d

Description

hi我使用代码中提示的dump.py脚本,不加载模型文件,生成的mgb模型速度远低于resnet50.int4.mge的模型
另外参考int8的模型,https://github.com/MegEngine/Models/tree/master/official/quantization#quantization-aware-training-qat
dump成量化模型需要quantize。麻烦请教一下是否是我操作有误best
yours

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the dump.py script mentioned in the issue and compare its output with resnet50.int4.mge. Read the linked MegEngine quantization-aware training documentation to understand the expected quantization flow. Done means identifying whether the model dump procedure is incorrect and documenting the correct operation or reproducing a confirmed issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.