cjpais / cjpais/LocalScore

AMD Radeon 9060 XT does not get detected

Open
#36 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
TypeScript
Stars
132
Forks
17
PR merge metrics
No merged PRs in 30d

Description

here's the the logs when I run the the binary

C:\Users\johnn\Downloads>localscore-0.9.3.exe -m Qwen2.5-14B-Instruct-Q4_K_M.gguf
import_cuda_impl: initializing gpu module...
extracting /zip/llama.cpp/ggml.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml.h
extracting /zip/llamafile/compcap.cu to /C/Users/johnn/.llamafile/v/0.9.3/compcap.cu
extracting /zip/llamafile/llamafile.h to /C/Users/johnn/.llamafile/v/0.9.3/llamafile.h
extracting /zip/llamafile/tinyblas.h to /C/Users/johnn/.llamafile/v/0.9.3/tinyblas.h
extracting /zip/llamafile/tinyblas.cu to /C/Users/johnn/.llamafile/v/0.9.3/tinyblas.cu
extracting /zip/llama.cpp/ggml-impl.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-impl.h
extracting /zip/llama.cpp/ggml-cuda.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.h
extracting /zip/llama.cpp/ggml-alloc.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-alloc.h
extracting /zip/llama.cpp/ggml-common.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-common.h
extracting /zip/llama.cpp/ggml-backend.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-backend.h
extracting /zip/llama.cpp/ggml-backend-impl.h to /C/Users/johnn/.llamafile/v/0.9.3/ggml-backend-impl.h
extracting /zip/llama.cpp/ggml-cuda.cu to /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.cu
get_rocm_bin_path: note: amdclang++.exe not found on $PATH
get_rocm_bin_path: note: $HIP_PATH/bin/amdclang++.exe does not exist
get_rocm_bin_path: note: /opt/rocm/bin/amdclang++.exe does not exist
get_rocm_bin_path: note: clang++.exe not found on $PATH
get_rocm_bin_path: note: $HIP_PATH/bin/clang++.exe does not exist
get_rocm_bin_path: note: /opt/rocm/bin/clang++.exe does not exist
extracting /zip/ggml-rocm.dll to /C/Users/johnn/.llamafile/v/0.9.3/ggml-rocm.dll
link_cuda_dso: note: dynamically linking /C/Users/johnn/.llamafile/v/0.9.3/ggml-rocm.dll
link_cuda_dso: warning: library not found: failed to load library
import_cuda_impl: won't compile AMD GPU support because $HIP_PATH/bin/clang++ is missing
extracting /zip/ggml-rocm.dll to /C/Users/johnn/.llamafile/v/0.9.3/ggml-rocm.dll
link_cuda_dso: note: dynamically linking /C/Users/johnn/.llamafile/v/0.9.3/ggml-rocm.dll
link_cuda_dso: warning: library not found: failed to load library
get_nvcc_path: note: nvcc.exe not found on $PATH
get_nvcc_path: note: $CUDA_PATH/bin/nvcc.exe does not exist
get_nvcc_path: note: /opt/cuda/bin/nvcc.exe does not exist
get_nvcc_path: note: /usr/local/cuda/bin/nvcc.exe does not exist
extracting /zip/ggml-cuda.dll to /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.dll
link_cuda_dso: note: dynamically linking /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.dll
link_cuda_dso: warning: library not found: failed to load library
extracting /zip/ggml-cuda.dll to /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.dll
link_cuda_dso: note: dynamically linking /C/Users/johnn/.llamafile/v/0.9.3/ggml-cuda.dll
link_cuda_dso: warning: library not found: failed to load library

=================== LocalScore Runtime Information ===================

llamafile version:   0.9.3
llama.cpp commit:    a30b324

======================================================================

========================= System Information =========================

Kernel Type:         Windows
Kernel Release:      10.0
Version:             Cosmopolitan 3.9.7 MODE=x86_64
System Architecture: x86_64
CPU:                 AMD Ryzen 7 9700X 8-Core Processor
RAM:                 31.1 GiB

======================================================================

Loading model... Model loaded.
Warming up...... Warmup complete.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the report on Windows with localscore-0.9.3.exe and the Qwen2.5-14B-Instruct-Q4_K_M.gguf model, then inspect the import_cuda_impl and link_cuda_dso messages. Determine why the AMD Radeon 9060 XT is not detected when the log reports missing ROCm and clang++ components; done means the runtime detects and uses the GPU, with updated evidence in the logs.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.