Akegarasu / Akegarasu/lora-scripts

中断训练后恢复训练时epoch计数不对

Open
#644 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.1k
Forks
699
PR merge metrics
No merged PRs in 30d

Description

第二次中断训练后从save state继续第三次训练的时候,epoch计数会无视train_state.json里的记录数据并以第二次开始训练的数量作为第三次训练的起始计数, 并非从第一次开始算起的全局计数,不知道计数不对会不会对学习率的调度产生影响。

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.