InternLM / InternLM/InternLM-XComposer
how to set differnt batch sizes for different datasets
Open
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 175
- PR merge metrics
- No merged PRs in 30d
Description
In the paper InternLM-XComposer2-4KHD, I find there is a description: "we adjust the data loader to enable different batch sizes for them and adjust their weight accordingly."
How to achieve this during trainining? Looking forward to your replay. Thanks!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.