evaluate question
Open
- Dominant language
- Python
- Stars
- 442
- Forks
- 93
- PR merge metrics
- No merged PRs in 30d
Description
您好,我在跑豆瓣的data.pkl数据集的时候,在save_step会卡住,我初步分析原因应该是验证集数量太大和for循环太多导致的。我观察了在跑data_small.pkl的时候,验证集的batch_num大概是31个,验证需要花费时间大概两分钟,而data.pkl的batch_num大概是1562个,验证的时候就会一直卡在那个地方。我想问一下您在实验的时候对这个部分有什么优化吗
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the save_step entry point and profiling its validation loop with data_small.pkl and data.pkl. Compare validation batch counts and time spent per batch, then verify that the full dataset completes validation without appearing to hang and that the runtime is meaningfully improved.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100