[Feature]: Intra-kernel profiling

Assessment

This issue has not been assessed yet.

Description

Suggestion Description

Intra-kenrel profiling is really useful for communications kernels.
Also it is useful for compute-bound kernels too, to identify the XCD-imbanlance, and tail effect of some grids.

Some reference for other dsl.

1. cutedsl: https://docs.nvidia.com/cutlass/latest/media/docs/pythonDSL/cute_dsl_general/iket_profiling.html
2. tilelang: https://github.com/tile-ai/tilelang/pull/2515
3. triton: https://github.com/triton-lang/triton/blob/main/third_party/proton/tutorials/intra_kernel/example_dsl.py
4. flashinfer: https://github.com/flashinfer-ai/flashinfer/pull/913

Also here is a blog for how to use it to identify uneven work distribution in MI300x intra-node all2all implementations:
https://gau-nernst.github.io/amd-a2a/#intra-kernel-profiling

Operating System

No response

GPU

No response

ROCm Component

No response

Contributor guide

Open the contributing guide

First steps

1. Read the whole issue, then the project's contributing guide.
2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
3. Fork the repository and make your change on a branch.
4. Open a pull request that references the issue number.

More from ROCm/FlyDSL

• [Feature]: Megamoe for TP Open

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  ROCm/FlyDSL#1173 · Opened Sep 20, 2026

• [Documentation]: more docs about API details. Open

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  ROCm/FlyDSL#1172 · Opened Sep 20, 2026

• [Issue]: Tensor.fill fails for singleton layouts with multiple unit strides Open

  Difficulty 3/5 1-2 days Newbie friendliness 76/100

  ROCm/FlyDSL#1165 · 1 reaction · Opened Sep 18, 2026

• [Issue]: gfx950: a dropped `s_mov_b64` in an SGPR spill-staging chain puts an undefined register in a buffer descriptor base Open

  Difficulty 5/5 Over a week Newbie friendliness 42/100

  ROCm/FlyDSL#1087 · 4 comments · Opened Sep 2, 2026

• [Issue]: Every kernel is compiled twice Open

  ROCm/FlyDSL#1054 · 1 assignee · Opened Aug 21, 2026

All issues in ROCm/FlyDSL

Similar issues

• [Bug]: notebooks/06_visualization_quickstart.ipynb fails: SHAPVisualizer.plot_waterfall raises IndexError Open

  Difficulty 2/5 1-3 hours Newbie friendliness 74/100

  bancolombia/sentinel#23 · Opened Sep 20, 2026

• test md Open
  CI

  Difficulty 2/5 1-3 hours Newbie friendliness 74/100

  sympy/sympy#30547 · 1 comment · Opened Sep 20, 2026

• quickjs: support `timeout=None` (no per-call deadline) in `CodeInterpreterMiddleware` Open
  integration:quickjs org:external priority:backlog topic:code-interpreter topic:middleware type:feature

  Difficulty 2/5 1-3 hours Newbie friendliness 74/100

  langchain-ai/deepagents#6450 · Opened Sep 20, 2026

• OpenAISamplingHandler drops ToolResultContent when a user message's list content also carries text/image blocks Open
  bug client

  Difficulty 2/5 1-3 hours Newbie friendliness 88/100

  PrefectHQ/fastmcp#5182 · 1 comment · Opened Sep 20, 2026

• last-mile drop-off on this SKILL.md Open

  Difficulty 2/5 1-3 hours Newbie friendliness 74/100

  wshobson/agents#717 · Opened Sep 20, 2026

More Python issues