abetlen / abetlen/llama-cpp-python

Add additional function calling models

未关闭
#979 4 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement
主要语言
Python
星标
10.6k
派生
1.4k
PR 合并指标
PR 指标待抓取

描述

Hello,

This is in regards of the readme at: https://github.com/abetlen/llama-cpp-python#function-calling. I was reading up on your repo in order to get started/familiar with llam-cpp-python. I want to point out that there are other GGUF quantized LLMs other than functionary that do function calling. And that they are decently good at it from what I hear. Check out https://huggingface.co/TheBloke/Airoboros-M-7B-3.1.2-GGUF#agentfunction-calling for example. May be worth checking out and updating the readme if needed.
There are a few others, but I don't recall them off the top of my head. I may list them here if I do recall or find them.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。