baidu / baidu/Dialogue

evaluate question

Open
#42 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
442
Forks
93
PR merge metrics
No merged PRs in 30d

Description

您好,我在跑豆瓣的data.pkl数据集的时候,在save_step会卡住,我初步分析原因应该是验证集数量太大和for循环太多导致的。我观察了在跑data_small.pkl的时候,验证集的batch_num大概是31个,验证需要花费时间大概两分钟,而data.pkl的batch_num大概是1562个,验证的时候就会一直卡在那个地方。我想问一下您在实验的时候对这个部分有什么优化吗

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the save_step entry point and profiling its validation loop with data_small.pkl and data.pkl. Compare validation batch counts and time spent per batch, then verify that the full dataset completes validation without appearing to hang and that the runtime is meaningfully improved.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.