abetlen / abetlen/llama-cpp-python

Pre-built CPU-only wheel for Windows (cp313) for version 0.3.16+ (Gemma 3 support)

Aperta
#2,130 1 commento 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
10.6k
Fork
1.4k
Metriche di merge delle PR
Metriche PR in attesa

Descrizione

Hi @abetlen and the contributors,

I am currently working in a strictly restricted corporate environment where I do not have access to C++ build tools (MSVC) or direct internet access to compile packages from source. Because of this, I heavily rely on the pre-built CPU `.whl` releases provided here.

I am trying to run a Gemma 3 based model (Trendyol Asure 12B), but I'm encountering the `unknown model architecture: 'gemma3'` error. I noticed that the latest available pre-built Windows CPU wheel for Python 3.13 (`cp313`) in the releases is version `0.3.2`, which does not yet support this architecture.

Would it be possible to trigger the build pipeline and upload a pre-built CPU-only wheel for Windows (`win_amd64`) for Python 3.13 (`cp313`) for version `0.3.16`?

This would be a lifesaver for users wanting to utilize the new Gemma 3 models and can't build.

Thank you for your time and hard work!

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.