intel / intel/torch-xpu-ops

Register spill in XeFMHAFwdKernel on PVC (SIMD16, 256 GRF)

Open
#3,740 0 comments 0 reactions 1 assignee Claimed by @LuFinch View on GitHub
enhancement
Dominant language
Python
Stars
113
Forks
128
Avg merge
5d 9h
Merged PRs (30d)
112

Description

# Summary
Register spill warnings observed when compiling FMHA forward kernels on PVC. All three kernel variants use SIMD16 + 256 GRF configuration and spill 2–6 registers. While the spill count is small, it may cause measurable performance degradation in latency-sensitive attention kernels.

# Compiler Warnings
```
warning: kernel XeFMHAFwdKernel, FMHAFwdMainloop, causal=true, TiledMMA QK(64x32), PV(32x64), VTiles=2, EpilogueTile(128x64)>>
compiled SIMD16 allocated 256 regs and spilled around 6

warning: kernel XeFMHAFwdKernel, FMHAFwdMainloop, causal=false, TiledMMA QK(64x32), PV(32x64), VTiles=3, EpilogueTile(128x96)>>
compiled SIMD16 allocated 256 regs and spilled around 2

warning: kernel XeFMHAFwdKernel, FMHAFwdMainloop, causal=false, TiledMMA QK(32x32), PV(32x32), VTiles=4, EpilogueTile(128x128)>>
compiled SIMD16 allocated 256 regs and spilled around 2
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.