huggingface/olm-training

Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.

Stars: 98
Forks: 11
Open beginner issues: 0
Indexed issues: 2

Dominant language: Python
License: Apache-2.0
Last GitHub push: Feb 9, 2023
Latest indexed: Sep 17, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Open All

2 open issues indexed

huggingface-hub error Open

huggingface/olm-training#3 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Generation config - "bos_token_id", "eos_token_id", "pad_token_id" Open

huggingface/olm-training#6 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026

A short digest of beginner-friendly GitHub issues.