abetlen / abetlen/llama-cpp-python

Unable to make CMake find gcc and use CUDA Windows 11 CUDA tool kit installed 4gb video ram

Offen
#1,485 2 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Vorherrschende Sprache
Python
Sterne
10.6k
Forks
1.4k
PR-Merge-Kennzahlen
PR-Kennzahlen ausstehend

Beschreibung

# Prerequisites

Please answer the following questions for yourself before submitting an issue.

- [yes] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [yes ] I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- [yes ] I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- [ yes] I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.

# Expected Behavior
It should easily install llama-cpp-python

Please provide a detailed written description of what you were trying to do, and what you expected `llama-cpp-python` to do.

# Current Behavior
I installed miniGW and installed both gcc and g++ compilers which I can clearly access through my terminal/cli. (They are in path!)
I installedd the CUDA Toolkit and made sure its also in path and is available.
Then I made a venv in python.
inside that I did this:
```sh
$env:CMAKE_ARGS = "-DLLAMA_CUDA=on"
setx CUDACXX="E:\coreCUDA\bin\nvcc"
pip install llama-cpp-python --no-cache-dir
```
Please provide a detailed written description of what `llama-cpp-python` did, instead.
I keep getting this error:
oading initial cache file C:\Users\mithr\AppData\Local\Temp\tmp_o0jceli\build\CMakeInit.txt
-- Building for: Visual Studio 17 2022
-- The C compiler identification is unknown
-- The CXX compiler identification is unknown
CMake Error at CMakeLists.txt:3 (project):
No CMAKE_C_COMPILER could be found.

CMake Error at CMakeLists.txt:3 (project):
No CMAKE_CXX_COMPILER could be found.

-- Configuring incomplete, errors occurred!

*** CMake configuration failed
----------------------------------------
ERROR: Failed building wheel for llama-cpp-python
Failed to build llama-cpp-python
ERROR: Could not build wheels for llama-cpp-python which use PEP 517 and cannot be installed directly
# Environment and Context

* Operating System, e.g. for Windows 11:
32GB RAM 4GB Graphics card nvidia rtx 4080

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.