InternLM / InternLM/xtuner

LengthGroupedSampler 根据length排序是必要的吗?

Open
#756 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

如题 在LengthGroupedSampler中,会根据每个样本token length进行排序,这样的必要性是什么呢?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.