alibaba / alibaba/euler

关于数据分片

Open
#242 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.9k
Forks
553
PR merge metrics
No merged PRs in 30d

Description

请问分布式训练的时候对数据分片是只有dat文件需要分片么,train,test,val.id三个文件需要么。谢谢。

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue asks whether distributed training requires sharding only dat files or also train, test, and val.id files. Start by reading the project’s distributed-training and data-loading documentation or entry points; done would be a clear documented answer explaining which files require sharding and why.

Written by the indexing model from the issue text.

Assessment

Domain
distributed-systems
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.