abetlen / abetlen/llama-cpp-python

Request for Gemma 3 4B & Gemma 4 Integration Support with llama-cpp-python

未关闭
#2,231 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
10.6k
派生
1.4k
PR 合并指标
PR 指标待抓取

描述

Hi team,

I would like to request official support and documentation for Gemma 3 4B and Gemma 4 integration within llama-cpp-python.

It would be helpful to have clarification regarding:

* Current compatibility status
* Required llama.cpp / llama-cpp-python versions
* Chat template handling requirements
* Recommended GGUF formats and quantizations
* Known limitations or issues
* Recommended inference parameters for stable usage

Any guidance, implementation notes, or examples would be greatly appreciated (without using ollama)

Kind regards,
Jonathan Park

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。