[RFC] Add MindSpeed/Megatron Unit Test CI Pipeline
- Dominant language
- Python
- Stars
- 3.4k
- Forks
- 312
- Avg merge
- 1h 2m
- Merged PRs (30d)
- 2
Description
## Background
ROLL has added more MindSpeed/Megatron-related functionality, including `mcore_adapter`, `roll/third_party/megatron`, Megatron offload, model update, checkpoint handling,and Ascend NPU runtime patches.
These components depend on MindSpeed, Megatron-Core, torch-npu, and the Ascend runtime. They are difficult to validate reliably through local tests or the existing CPU-only unit test pipeline.
This RFC proposes adding a dedicated MindSpeed/Megatron unit test CI pipeline to detect regressions earlier in PRs and main branch updates.
## Goals
Add a dedicated CI workflow for MindSpeed/Megatron unit tests that can validate:
- MindSpeed and Megatron-Core installation
- Basic NPU runtime availability
- ROLL Megatron adapter behavior
- Megatron offload-related unit tests
- NPU/Megatron runtime patch compatibility
## Non-Goals
This RFC does not aim to:
- Add full end-to-end training jobs
- Add performance benchmark jobs
- Run heavy NPU tests for every unrelated PR
- Replace the existing CPU unit tests or NPU integration tests
## Proposal
Add a new GitHub Actions workflow:
```text
.github/workflows/ci-npu-mindspeed.yml
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the existing workflows and the proposed .github/workflows/ci-npu-mindspeed.yml entry point, then identify how MindSpeed, Megatron-Core, torch-npu, and the Ascend runtime are handled. The work is done when a dedicated pipeline covers installation, basic NPU availability, adapter behavior, offload tests, and runtime patch compatibility without replacing CPU or integration pipelines.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- github-actions, python
- Domain
- ci-cd, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100