facebookresearch / facebookresearch/bit
Was Two Stage Knowledge Distillation used as in BinaryBERT?
Open
- Dominant language
- Python
- Stars
- 115
- Forks
- 14
- PR merge metrics
- No merged PRs in 30d
Description
Was Two Stage Knowledge Distillation used as in BinaryBERT in Table 7 (https://arxiv.org/pdf/2012.15701.pdf) to get these results?
Contributor guide
Assessment
This issue has not been assessed yet.