NVIDIA / NVIDIA/Megatron-LM

Automatic Checkpoint Converter to HybridModel

Open
#5,675 0 comments 0 reactions 1 assignee Claimed by @guihong-nv View on GitHub
enhancement
Dominant language
Python
Stars
17.9k
Forks
4.5k
Avg merge
4d 3h
Merged PRs (30d)
272

Description

As we are migrating from `GPTModel` to `HybridModel`, it would make the process easier for users if `GPTModel` checkpoints can be converted automatically before training begins.

We will introduce a `--use-legacy-model` flag:

- HybridModel ckpt -> HybridModel training
- GPTModel ckpt + `--use-legacy-model` -> GPTModel training
- GPTModel ckpt -> HybridModel training

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.