NVIDIA / NVIDIA/TransformerEngine
Restructure attention C API
@cyanguwa is already working on this.
Since May 5, 2026.
- Dominant language
- Python
- Stars
- 3.5k
- Forks
- 831
- Avg merge
- 3d 11h
- Merged PRs (30d)
- 65
Description
Is your feature request related to a problem? Please describe.
At the moment, we enumerate the parameters in C APIs like this:
As we add more features to attention, the list of non-tensor variables are also growing, which is a breaking change every time.
Describe the solution you'd like
To avoid the breaking change, we should seek other approaches such as packing most/all of the non-tensor variables into a struct and only modifying the content of the struct as we add features.
Describe alternatives you've considered
N/A
Additional context
N/A
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.