[AOT Build] Cannot compile all modules ahead of time
@lalala-sh is already working on this.
Since Jul 26, 2025.
- Dominant language
- Python
- Stars
- 565
- Forks
- 585
- Avg merge
- 3d 4h
- Merged PRs (30d)
- 366
Description
Problem Description
I want to compile all modules ahead of time, so i use the following command to create a wheel package PREBUILD_KERNELS=1 python3 setup.py bdist_wheel
However, setup.py will exclude some modules as follows:
I tried to comment some modules above, such as module_moe_ck2stages, and the compile will fail. The reason why compiling module_moe_ck2stages here will fail is that no blob_gen_cmd is passed to the configs
I am not sure whether other modules will have the same problem
I hope aiter can support fully AOT build, or we can choose what modules we what via say like a config file
Operating System
Ubuntu 22.04
CPU
Null
GPU
MI308X
ROCm Version
ROCm 6.3.3
ROCm Component
No response
Steps to Reproduce
PREBUILD_KERNELS=1 python3 setup.py bdist_wheel
(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support
No response
Additional Information
No response
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.