Master: Model Support & nvFP4 Quantization
@jjsjann123 is already working on this.
Since Oct 7, 2025.
Assessment
This issue has not been assessed yet.
Description
- nvFP4 Linear and and Grouped Linear support for Routed Experts
- Gating logic for routing plus data preparation for Grouped Linears. The gating logic is different for Llama 4, GPT-OSS, Deepseek R1, and Qwen3-Next
- GPT OSS uses sliding window attention. According to the "Sliding Window + Causal" section in https://pytorch.org/blog/flexattention/, there's going to be a big penalty if we implement this inefficiently. For example, F.scaled_dot_product_attention is going to be ~3x slower than flexattention.
Subtasks:
- Dominant language
- C++
- Stars
- 404
- Forks
- 84
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from NVIDIA/Fuser
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
Multi-GPU
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
Multi-GPU
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
Multi-GPU
Difficulty 4/5 3-5 days Newbie friendliness 38/100
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
-
Sensor initialization takes very long when `--initial-sim-time` is set to current UNIX timestamp Open
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
gazebosim/gz-sensors#662 · 1 comment ·
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
-
comp-datalake
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
ClickHouse/ClickHouse#121222 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
LadybirdBrowser/ladybird#12123 ·