Backport improvements from the Dolma repo
未關閉
- 主要語言
- Rust
- 星號
- 39
- 分支
- 9
- PR 合併指標
- 30 天內沒有已合併 PR
描述
@chris-ha458 has made some great improvements to BFF in the https://github.com/allenai/dolma repo. We should back-port those changes here, especially the ones that have to do with correctness (like the ones involving the choice of hash functions).
Chris' PRs are here:
* https://github.com/allenai/dolma/pull/23
* https://github.com/allenai/dolma/pull/24
* https://github.com/allenai/dolma/pull/31
* https://github.com/allenai/dolma/pull/35
* https://github.com/allenai/dolma/pull/39
They won't apply 1:1, because things have changed in the Dolma repo, but at least the important things should carry over.
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。