google / google/seqio

Unimax sampler implementation?

Open
#565 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
596
Forks
60
Avg merge
19h 23m
Merged PRs (30d)
1

Description

I tried searching the code for seqio mixtures generated using the newly released unimax sampler.

I am trying to pretrain a custom umUL2 model. if i could perhaps know how to implement unimax it would be of great help. Thanks

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.