abetlen / abetlen/llama-cpp-python

Add support T5 (encode-decoder) models at API level and server

未关闭
#1,681 0 条评论 9 个 reaction 已指派 0 人 在 GitHub 查看
enhancement
主要语言
Python
星标
10.6k
派生
1.4k
PR 合并指标
PR 指标待抓取

描述

Ciao Andrei,
following the latest changes on llama.cpp repo
[https://github.com/ggerganov/llama.cpp/issues/5763](https://github.com/ggerganov/llama.cpp/issues/5763)

can you tell me if this is going to be art of your amazing repo?
In case it is not, can you provide some instructions to replicate at low Level API the same steps done by lama-cli?

we can start using amazing models like LaMini-Flan-T5-248M with llama-cpp-python.

thanks

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。