allenai / allenai/bff

Backport improvements from the Dolma repo

Aperta
#7 1 commento 0 reazioni 1 assegnatario Rivendicata da @2015aroras Vedi su GitHub
Lingua principale
Rust
Stelle
39
Fork
9
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

@chris-ha458 has made some great improvements to BFF in the https://github.com/allenai/dolma repo. We should back-port those changes here, especially the ones that have to do with correctness (like the ones involving the choice of hash functions).

Chris' PRs are here:
* https://github.com/allenai/dolma/pull/23
* https://github.com/allenai/dolma/pull/24
* https://github.com/allenai/dolma/pull/31
* https://github.com/allenai/dolma/pull/35
* https://github.com/allenai/dolma/pull/39

They won't apply 1:1, because things have changed in the Dolma repo, but at least the important things should carry over.

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.