NVIDIA-NeMo / NVIDIA-NeMo/RL

magi attention support

Open
#1,701 6 comments 1 reaction 0 assignees View on GitHub
community-request enhancement waiting-on-maintainers x-mini
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

[MagiAttention](https://github.com/SandAI-org/MagiAttention) has a good support for flexible attention masking designs, and support almost all modern features in long context training. Should we add it as another attention backend?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.