abetlen / abetlen/llama-cpp-python

Direct image input via PIL instead of Base64

未關閉
#2,078 0 則留言 1 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Python
星號
10.6k
分支
1.4k
PR 合併指標
PR 指標待擷取

描述

**Describe the solution you'd like**

Support for PIL library image input (path) instead of Base64 encoding.
For example, when using models with transformers library, I provide images this way `img = Image.open(path).convert("RGB")` which isn't an additional 33% increase of memory overhead like it is with Base64.

**Describe alternatives you've considered**

I am currently using llama.cpp CLI version to process images in batch using GGUF models but I'd rather prefer this functionality here as well.

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。