abetlen / abetlen/llama-cpp-python

Pre-built CPU-only wheel for Windows (cp313) for version 0.3.16+ (Gemma 3 support)

Abierto
#2,130 1 comentario 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
10.6k
Forks
1.4k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

Hi @abetlen and the contributors,

I am currently working in a strictly restricted corporate environment where I do not have access to C++ build tools (MSVC) or direct internet access to compile packages from source. Because of this, I heavily rely on the pre-built CPU `.whl` releases provided here.

I am trying to run a Gemma 3 based model (Trendyol Asure 12B), but I'm encountering the `unknown model architecture: 'gemma3'` error. I noticed that the latest available pre-built Windows CPU wheel for Python 3.13 (`cp313`) in the releases is version `0.3.2`, which does not yet support this architecture.

Would it be possible to trigger the build pipeline and upload a pre-built CPU-only wheel for Windows (`win_amd64`) for Python 3.13 (`cp313`) for version `0.3.16`?

This would be a lifesaver for users wanting to utilize the new Gemma 3 models and can't build.

Thank you for your time and hard work!

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.