abetlen / abetlen/llama-cpp-python

Direct image input via PIL instead of Base64

未关闭
#2,078 0 条评论 1 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
10.6k
派生
1.4k
PR 合并指标
PR 指标待抓取

描述

**Describe the solution you'd like**

Support for PIL library image input (path) instead of Base64 encoding.
For example, when using models with transformers library, I provide images this way `img = Image.open(path).convert("RGB")` which isn't an additional 33% increase of memory overhead like it is with Base64.

**Describe alternatives you've considered**

I am currently using llama.cpp CLI version to process images in batch using GGUF models but I'd rather prefer this functionality here as well.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。