facebookresearch / facebookresearch/fairseq2

Downstream w2v-BERT improvements from SC

Open
#312 0 comments 0 reactions 1 assignee Claimed by @cbalioglu View on GitHub
enhancement modeling
Dominant language
Python
Stars
1.1k
Forks
144
Avg merge
4d 1h
Merged PRs (30d)
1

Description

Port the architectural changes we introduced to w2v-BERT in seamless_communication to fairseq2 for this year's representation learning tasks. Also make sure that we not only support eval, but pretraining as well.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.