abetlen / abetlen/llama-cpp-python

Support for MiniCPM-Llama3-V 2.5 / OCR Text Extraction

Open
#1,532 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

Hello, there are models available for MiniCPM-Llama3-V 2.5:
https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5-gguf/blob/main/mmproj-model-f16.gguf
https://huggingface.co/openbmb/MiniCPM-Llama3-V-2_5-gguf/blob/main/ggml-model-Q8_0.gguf

Has anyone tried running these models / are they supported?

The reason I ask is because the text extraction / OCR capabilities look very promising: https://huggingface.co/spaces/openbmb/MiniCPM-Llama3-V-2_5

Otherwise I would love to hear about your successes with OCR :-)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.