InternLM / InternLM/InternLM-XComposer

关于训练Ixc2.5的数据读取问题

Open
#445 0 comments 0 reactions 1 assignee Claimed by @myownskyW7 View on GitHub
Dominant language
Python
Stars
2.9k
Forks
175
PR merge metrics
No merged PRs in 30d

Description

您好,我看到在data_mix.py中对于训练集中的样本的选取好像是随机的,也就是一个epoch可能并不会过完训练集中的所有数据,请问这种数据读取的方式有什么好处吗?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.