InternLM / InternLM/InternLM-XComposer

how to set differnt batch sizes for different datasets

Open
#332 0 comments 0 reactions 1 assignee Claimed by @myownskyW7 View on GitHub
Dominant language
Python
Stars
2.9k
Forks
175
PR merge metrics
No merged PRs in 30d

Description

In the paper InternLM-XComposer2-4KHD, I find there is a description: "we adjust the data loader to enable different batch sizes for them and adjust their weight accordingly."

How to achieve this during trainining? Looking forward to your replay. Thanks!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.