AMD wheels for Windows built against ROCm 7.2, but Windows HIP SDK installer only goes to 7.1.1
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 4.7k
- Forks
- 536
- Avg merge
- 12h 12m
- Merged PRs (30d)
- 4
Description
I have a speech to text project built on faster-whisper/CT2. With the recent ROCm support release, I added AMD GPU support to my project.
My project has a pre-built windows exe via pyinstaller, so I made a new version that bundles the CTranslate2 ROCm Windows wheel. But the problem is that the wheel is built against ROCm 7.2 and the latest HIP SDK Installer for Windows only goes up to 7.1.1
I thought they might be compatible anyways, but it turns out that libhipblas.dll in 7.1.1 changed to hipblas.dll in 7.2, causing a crash when CT2 loads. I personally run a custom version of CT2 built to work with an older GPU, and for that ROCm version (6.2) the file is also named hipblas.dll
Would be great to have the window wheels be compatible with the latest HIP installer, since that allows my users to only use windows installers without dealing with python/pip/etc
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by checking the CTranslate2 ROCm Windows wheel build and packaging configuration, then compare its HIP BLAS DLL expectations with the HIP SDK 7.1.1 installer described in the issue. Done means the Windows ROCm wheel loads successfully with the latest supported HIP SDK and does not crash when used by the reported bundled executable.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, python
- Domain
- build-system, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100