abetlen / abetlen/llama-cpp-python

Direct image input via PIL instead of Base64

Open
#2,078 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

**Describe the solution you'd like**

Support for PIL library image input (path) instead of Base64 encoding.
For example, when using models with transformers library, I provide images this way `img = Image.open(path).convert("RGB")` which isn't an additional 33% increase of memory overhead like it is with Base64.

**Describe alternatives you've considered**

I am currently using llama.cpp CLI version to process images in batch using GGUF models but I'd rather prefer this functionality here as well.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.