open-mmlab / open-mmlab/mmengine

[Feature Request] Support deepspeed integration

Open
#627 3 comments 2 reactions 1 assignee View on GitHub

Nobody has claimed this yet.

planned feature
Dominant language
Python
Stars
1.5k
Forks
464
PR merge metrics
No merged PRs in 30d

Description

Describe the feature

Motivation
Nowadays, deepspeed became a fundamental framework that facilitates training and inference for large-scale or foundation models.
We are developing a feature for deepspeed integration into mmengine with support for a deepspeed-specified runner and optim_wrapper.

Does MMEngine have a plan to support deepspeed?
Then we can contribute to MMEngine with our implementation :)

Please let me know any guide, plan or opinion about this. :)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.