ROCm / ROCm/FlyDSL

[Issue]: MXFP6 support for A operand removed due to recent changes in #754

Open
#767 0 comments 0 reactions 1 assignee View on GitHub

@Phil-amd is already working on this.

Since Jul 30, 2026.

Dominant language
Python
Stars
282
Forks
120
Avg merge
1d 21h
Merged PRs (30d)
67

Description

Problem Description

Recent changes in https://github.com/ROCm/FlyDSL/commit/f5c50f45334cba1136c6c47598b336898d228678#diff-d76870d0abe4faede57451ca02ad6fdebc9db21d64b0dbb98f852d49906d3552L464 seems to have removed the MXFP6 support for A operand including the tests that checked for its correctness. One of the use cases for mxfp6 A operand can be seen in https://rocm.blogs.amd.com/artificial-intelligence/w4a6-quant-mm/README.html.

I can add my old changes back in kernels/mxfp4_preshuffle.py or we can have a separate kernel in kernels/mxfp6_preshuffle.py which will be very similar to the mxfp4 preshuffle kernel already present here. What do you think @coderfeli ?

CC @BowenBao

Operating System

Ubuntu 22.04

CPU

AMD Ryzen

GPU

AMD MI355X

ROCm Version

ROCm 7.2

ROCm Component

No response

Steps to Reproduce

No response

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support
rocminfo --support output
Paste output here
Additional Information

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.