abetlen / abetlen/llama-cpp-python

Pre-built CPU-only wheel for Windows (cp313) for version 0.3.16+ (Gemma 3 support)

Aberta
#2,130 1 comentário 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
Python
Estrelas
10.6k
Forks
1.4k
Métricas de merge de PRs
Métricas de PR pendentes

Descrição

Hi @abetlen and the contributors,

I am currently working in a strictly restricted corporate environment where I do not have access to C++ build tools (MSVC) or direct internet access to compile packages from source. Because of this, I heavily rely on the pre-built CPU `.whl` releases provided here.

I am trying to run a Gemma 3 based model (Trendyol Asure 12B), but I'm encountering the `unknown model architecture: 'gemma3'` error. I noticed that the latest available pre-built Windows CPU wheel for Python 3.13 (`cp313`) in the releases is version `0.3.2`, which does not yet support this architecture.

Would it be possible to trigger the build pipeline and upload a pre-built CPU-only wheel for Windows (`win_amd64`) for Python 3.13 (`cp313`) for version `0.3.16`?

This would be a lifesaver for users wanting to utilize the new Gemma 3 models and can't build.

Thank you for your time and hard work!

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.