pytorch / pytorch/pytorch

DISABLED test_main_loop_scaling_shape1_use_fast_accum_False_scaling_block_sizes2_cuda (__main__.TestFP8LoweringCUDA)

Open
#188,713 1 comment 0 reactions 0 assignees View on GitHub
bot-triaged module: cuda module: floatx (formerly float8) module: inductor module: linear algebra module: tests oncall: pt2 skipped triaged
Dominant language
Python
Stars
103k
Forks
29.6k
PR merge metrics
PR metrics pending

Description

This test fails consistently on CUDA (seen on `Limited CI on H100 / linux-jammy-cuda13.0-py3.10-gcc11-sm90 / test-osdc (smoke, 1, 1, mt-l-x86iamx-22-225-h100)`) with:

```
ValueError: scale_b must have shape N x ceil_div(K,128) Float elements, got [transposed]
```

Root cause: for `w = BlockWise1x128` recipes, the test builds `scale_b` (w's inverse scale) in `[K/128, N]` layout, but eager `torch._scaled_mm_v2` requires `[N, K/128]`. This is a pre-existing test/kernel scale-layout mismatch; CI only began exercising it on 2026-06-29.

Repro:
```
python test/inductor/test_fp8.py TestFP8LoweringCUDA.test_main_loop_scaling_shape1_use_fast_accum_False_scaling_block_sizes2_cuda
```

One of ~14 failing `test_main_loop_scaling` parametrizations (`w = BlockWise1x128` recipes). See also #188675, #188704.

cc @ptrblck @msaroufim @eqy @tinglvv @nWEIdia @mruberry @jianyuh @nikitaved @walterddr @Lezcano @chauhang @penguinwu @voznesenskym @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @kadeng @muchulee8 @amjames @aakhundov @coconutruben @jataylo

Contributor guide

Open the contributing guide

Research direction

Start with test/inductor/test_fp8.py and run the named TestFP8LoweringCUDA.test_main_loop_scaling_shape1_use_fast_accum_False_scaling_block_sizes2_cuda reproduction. Inspect the BlockWise1x128 recipes and the scale_b construction against the reported eager torch._scaled_mm_v2 shape requirement; done means this test and the related test_main_loop_scaling parametrizations no longer fail on CUDA.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
backend, testing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.