AMD Radeon 9060 XT does not get detected
Open
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 132
- Forks
- 17
- PR merge metrics
- No merged PRs in 30d
Description
here's the the logs when I run the the binary
C:\Users\johnn\Downloads>localscore-0.9.3.exe -m Qwen2.5-14B-Instruct-Q4_K_M.gguf
import_cuda_impl: initializing gpu module...
extracting /zip/llama.cpp/ggml.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml.h
extracting /zip/llamafile/compcap.cu to /C/Users/johnn/.llamafile/v/0.9.3/compcap.cu
extracting /zip/llamafile/llamafile.h to /C/Users/johnn/.llamafile/v/0.9.3/llamafile.h
extracting /zip/llamafile/tinyblas.h to /C/Users/johnn/.llamafile/v/0.9.3/tinyblas.h
extracting /zip/llamafile/tinyblas.cu to /C/Users/johnn/.llamafile/v/0.9.3/tinyblas.cu
extracting /zip/llama.cpp/ggml-impl.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-impl.h
extracting /zip/llama.cpp/ggml-cuda.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.h
extracting /zip/llama.cpp/ggml-alloc.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-alloc.h
extracting /zip/llama.cpp/ggml-common.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-common.h
extracting /zip/llama.cpp/ggml-backend.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-backend.h
extracting /zip/llama.cpp/ggml-backend-impl.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-backend-impl.h
extracting /zip/llama.cpp/ggml-cuda.cu to /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.cu
get_rocm_bin_path: note: amdclang++.exe not found on $PATH
get_rocm_bin_path: note: $HIP_PATH/bin/amdclang++.exe does not exist
get_rocm_bin_path: note: /opt/rocm/bin/amdclang++.exe does not exist
get_rocm_bin_path: note: clang++.exe not found on $PATH
get_rocm_bin_path: note: $HIP_PATH/bin/clang++.exe does not exist
get_rocm_bin_path: note: /opt/rocm/bin/clang++.exe does not exist
extracting /zip/ggml-rocm.dll to /C/Users/johnn/.llamafile/v/0.9.3/ggml-rocm.dll
link_cuda_dso: note: dynamically linking /C/Users/johnn/.llamafile/v/0.9.3/ggml-rocm.dll
link_cuda_dso: warning: library not found: failed to load library
import_cuda_impl: won't compile AMD GPU support because $HIP_PATH/bin/clang++ is missing
extracting /zip/ggml-rocm.dll to /C/Users/johnn/.llamafile/v/0.9.3/ggml-rocm.dll
link_cuda_dso: note: dynamically linking /C/Users/johnn/.llamafile/v/0.9.3/ggml-rocm.dll
link_cuda_dso: warning: library not found: failed to load library
get_nvcc_path: note: nvcc.exe not found on $PATH
get_nvcc_path: note: $CUDA_PATH/bin/nvcc.exe does not exist
get_nvcc_path: note: /opt/cuda/bin/nvcc.exe does not exist
get_nvcc_path: note: /usr/local/cuda/bin/nvcc.exe does not exist
extracting /zip/ggml-cuda.dll to /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.dll
link_cuda_dso: note: dynamically linking /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.dll
link_cuda_dso: warning: library not found: failed to load library
extracting /zip/ggml-cuda.dll to /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.dll
link_cuda_dso: note: dynamically linking /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.dll
link_cuda_dso: warning: library not found: failed to load library
=================== LocalScore Runtime Information ===================
llamafile version: 0.9.3
llama.cpp commit: a30b324
======================================================================
========================= System Information =========================
Kernel Type: Windows
Kernel Release: 10.0
Version: Cosmopolitan 3.9.7 MODE=x86_64
System Architecture: x86_64
CPU: AMD Ryzen 7 9700X 8-Core Processor
RAM: 31.1 GiB
======================================================================
Loading model... Model loaded.
Warming up...... Warmup complete.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the report on Windows with localscore-0.9.3.exe and the Qwen2.5-14B-Instruct-Q4_K_M.gguf model, then inspect the import_cuda_impl and link_cuda_dso messages. Determine why the AMD Radeon 9060 XT is not detected when the log reports missing ROCm and clang++ components; done means the runtime detects and uses the GPU, with updated evidence in the logs.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 42/100