Support request: Bielik-11B-v3.0-Instruct-heretic-MPOA on Ryzen AI NPU
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 1.9k
- Forks
- 152
- Avg merge
- 4h 14m
- Merged PRs (30d)
- 11
Description
Hello FastFlowLM team,
I would like to request NPU support for the Polish Llama-based model Bielik-11B-v3.0-Instruct-heretic-MPOA.
Model sources:
- Base model: https://huggingface.co/speakleash/Bielik-11B-v3-Base-20250730
- Q6_K GGUF: https://huggingface.co/mradermacher/Bielik-PL-11B-v3.0-Instruct-heretic-GGUF
I converted the Q6_K GGUF to Q4NX_FLL successfully. The resulting model has 50 layers, hidden size 4096, intermediate size 14336, 32 attention heads, and 8 key/value heads.
System:
- Linux
- FastFlowLM 1.0.4
- AMD RyzenAI-npu6 / XDNA2
- XRT detects the NPU and
flm validate --jsonreports ready: true.
I tested the existing Llama-3.1-8B-NPU2 xclbins as a diagnostic only. The model loads and acquires the NPU, but generation fails with:
runlist failed execution (ERT_CMD_STATE_TIMEOUT)
Kernel Instance: MLIR_AIE
Could you please advise:
- Is there an existing compatible xclbin set for this Bielik/Llama architecture?
- If not, could support be added, including the required
attn.xclbin,dequant.xclbin,layer.xclbin, andmm.xclbin? - Is there a supported public workflow for compiling FLM-compatible xclbins for a custom Q4NX_FLL model?
I can provide the Q4NX tensor metadata, model configuration, and reproducible logs if helpful.
Thank you.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the flm validate --json result, the Q4NX_FLL tensor metadata and model configuration, and the timeout logs from the diagnostic Llama-3.1-8B-NPU2 xclbins. Done would be identifying a compatible xclbin set or establishing whether a supported workflow exists for compiling the requested attn.xclbin, dequant.xclbin, layer.xclbin, and mm.xclbin files.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- linux
- Domain
- ai-infra-agents, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100