EIDOSLAB / EIDOSLAB/simplify

Big accuracy drop after simplify

Open
#12 8 comments 0 reactions 2 assignees Claimed by @AndreaBrg View on GitHub
bug
Dominant language
Python
Stars
36
Forks
3
PR merge metrics
No merged PRs in 30d

Description

Hi guys, congrats for the work, nice library.

I am trying to use Simplify with ResNet on CIFAR-100 dataset. I use prune.ln_structured method from Pytorch with amount value is 0.8 and then apply simplify and do fine-tune of the model. As a result I have got the inference time speed up by two times. But I have big accuracy drop: 75% accuracy before prune.ln_structured + simplify + fine-tune and 65% after prune.ln_structured + simplify + fine-tune. Is it expected result? Have you checked accuracy before and after simplify in your cases?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.