NVIDIA-NeMo / NVIDIA-NeMo/Automodel
workaround required for padding_mask
@zeel2104 is already working on this.
Since Mar 31, 2026.
- Dominant language
- Python
- Stars
- 963
- Forks
- 318
- Avg merge
- 3d 20h
- Merged PRs (30d)
- 143
Description
Describe the bug
In particular for https://github.com/NVIDIA-NeMo/Automodel/pull/1631, after fixing the tied weights issue, I run into another issue where the default collator was creating a "padding_mask" although the model is unable to consume it, thus crashing the run.
1631 included a filtering step to remove the padding_mask, but it would be better not to have to do any filtering, as it pollutes/complicates the code.
Steps/Code to reproduce bug
Run the yaml that I have attached to 1631
Expected behavior
Run without crashing / having to filter the batch.
Additional context
Add any other context about the problem here.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.