RuntimeError: CUDA failed with error CUDA driver version is insufficient for CUDA runtime version
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 4.7k
- Forks
- 537
- Avg merge
- 12h 12m
- Merged PRs (30d)
- 4
Description
Issue Summary:
I'm attempting to run faster-whisper with GPU support on my device, which has CUDA 12.6 installed and cudnn 9.5. The following package versions are being used:
faster-whisper==1.0.3ctranslate2==4.4.0wyoming==1.5.3
The model runs successfully on the CPU; however, it does not utilize the GPU as expected. I am looking for a solution to enable GPU acceleration for faster-whisper using CUDA 12.6.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the faster-whisper GPU run with the stated faster-whisper, ctranslate2, CUDA 12.6, and cuDNN 9.5 versions, then compare the installed driver and runtime compatibility. Done means the same model uses GPU acceleration without the CUDA driver-version error; the issue mentions no repository file or test to target.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, python
- Domain
- backend, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100