abetlen / abetlen/llama-cpp-python

Direct image input via PIL instead of Base64

Ouverte
#2,078 0 commentaires 1 réaction 0 personnes assignées Voir sur GitHub
Langage dominant
Python
Étoiles
10.6k
Forks
1.4k
Métriques de merge des PR
Métriques de PR en attente

Description

**Describe the solution you'd like**

Support for PIL library image input (path) instead of Base64 encoding.
For example, when using models with transformers library, I provide images this way `img = Image.open(path).convert("RGB")` which isn't an additional 33% increase of memory overhead like it is with Base64.

**Describe alternatives you've considered**

I am currently using llama.cpp CLI version to process images in batch using GGUF models but I'd rather prefer this functionality here as well.

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.