abetlen / abetlen/llama-cpp-python

Pre-built CPU-only wheel for Windows (cp313) for version 0.3.16+ (Gemma 3 support)

未关闭
#2,130 1 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
10.6k
派生
1.4k
PR 合并指标
PR 指标待抓取

描述

Hi @abetlen and the contributors,

I am currently working in a strictly restricted corporate environment where I do not have access to C++ build tools (MSVC) or direct internet access to compile packages from source. Because of this, I heavily rely on the pre-built CPU `.whl` releases provided here.

I am trying to run a Gemma 3 based model (Trendyol Asure 12B), but I'm encountering the `unknown model architecture: 'gemma3'` error. I noticed that the latest available pre-built Windows CPU wheel for Python 3.13 (`cp313`) in the releases is version `0.3.2`, which does not yet support this architecture.

Would it be possible to trigger the build pipeline and upload a pre-built CPU-only wheel for Windows (`win_amd64`) for Python 3.13 (`cp313`) for version `0.3.16`?

This would be a lifesaver for users wanting to utilize the new Gemma 3 models and can't build.

Thank you for your time and hard work!

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。