NVIDIA-NeMo / NVIDIA-NeMo/RL

[TRAIN-6] flash-linear-attention and causal-conv1d missing from container and docs for Qwen3.5

Open
#2,722 1 comment 0 reactions 2 assignees Claimed by @zpqiu View on GitHub
bug p0 Speed
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

## Problem

`flash-linear-attention` and `causal-conv1d` are required for full Qwen3.5 performance on the DTensor backend. Without these packages, DTensor silently falls back to the default PyTorch implementation and trains approximately 2x slower. Neither the NeMo-RL container nor the documentation mentions this requirement.

## Suggested fix

- Add `flash-linear-attention` and `causal-conv1d` to the NeMo-RL container.
- Document these packages as required dependencies for Qwen3.5 training on DTensor.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.