facebookresearch / facebookresearch/bit

Problem in reproduce multi-distillation approach

Open
#2 12 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
115
Forks
14
PR merge metrics
No merged PRs in 30d

Description

Hello, Thank you for providing code.

I can get the right results of W1A1 with `bash scripts/run_glue.sh MNLI` (around 77 accuracy on MNLI)

But when i reproduce the W1A1 with multi-distillation approach following (W32A32->W1A2->W1A1), I cannot reproduce the results of W1A2 in paper by simply change ` abits=1` to `abits=2` in `scripts/run_glue.sh` (The result of W1A2 i get is `80.96/81.36`).

Can you share the detail settings of multi-disitillation approach?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.