modelscope / modelscope/ms-swift

Megatron Train Save CKPT

Open
#6,201 2 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

stale
Dominant language
Python
Stars
15.7k
Forks
1.7k
Avg merge
1d 16h
Merged PRs (30d)
136

Description

Image 使用 Megatron 训练模型时,可以通过 max_epoch 指定训练轮次,但是保存 ckpt 时只有 save_interval 参数控制按照 steps 存储,不支持 save_strategy == epoch 的形式,想咨询下这个会支持吗

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the Megatron training code that handles max_epoch, save_interval, and save_strategy. Check how checkpoint scheduling currently works and define the expected behavior for save_strategy == epoch, including when checkpoints should be written.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.