Owner

abetlen

4 indexed repositories · View on GitHub

ggml-python
Python bindings for ggml

Python · 152 stars
sqlite3-bfsvtab-ext
A virtual table extension for breadth-first search queries in Sqlite3

C · 39 stars
pikchr-js
The Pikchr markup language for diagrams, running in your browser

C · 8 stars
simdinfo
Small C library for SIMD feature detection at runtime

C · 6 stars

Open All

568 issues indexed so far

TypeError: 'add_special_tokens' is an invalid keyword argument for encode() Open

bug

abetlen/llama-cpp-python#1250 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 13, 2026
mpt-7b-storywrier-4bit-km-gguf-file -- not loading - missing one tensor Open

abetlen/llama-cpp-python#1251 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Does this lib support contrastive search decoding ? Open

enhancement

abetlen/llama-cpp-python#1253 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Failed to run on Intel GPUs Open

abetlen/llama-cpp-python#1268 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Installation error I couldn't solve it in any way Open

abetlen/llama-cpp-python#1270 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Qwen 72B GGUF needs manual rope frequency with llama-cpp-python, llama.cpp gets it right Open

bug

abetlen/llama-cpp-python#1271 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Unclear and differing computation of conditional tokens' log probabilities Open

abetlen/llama-cpp-python#1276 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Unable to build SYCL Open

abetlen/llama-cpp-python#1277 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Add command-r support like llamacpp has Open

enhancement

abetlen/llama-cpp-python#1279 · 5 comments · 11 reactions · 0 assignees · Indexed Sep 13, 2026
Failed to load shared library \venv\Lib\site-packages\llama_cpp\llama.dll Open

bug

abetlen/llama-cpp-python#1280 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
building a whl for android, issues with cmake Open

abetlen/llama-cpp-python#1284 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
(llama-cpp-python v0.2.57) RuntimeError: Failed to get embeddings from sequence pooling type is not set Open

bug

abetlen/llama-cpp-python#1288 · 15 comments · 11 reactions · 0 assignees · Indexed Sep 13, 2026
enabling cache slows generation Open

abetlen/llama-cpp-python#1293 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
ARM architecture cannot be installed Open

abetlen/llama-cpp-python#1300 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
ValueError: Failed to create llama_context Open

abetlen/llama-cpp-python#1304 · 10 comments · 5 reactions · 0 assignees · Indexed Sep 13, 2026
Fine tuned model does not work (GGUF, q4_k medium) Open

abetlen/llama-cpp-python#1309 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
llama-cpp-python bindings not working for multiple GPUs Open

question

abetlen/llama-cpp-python#1310 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
why is it so slower than origin llava1.5 model? Open

question

abetlen/llama-cpp-python#1313 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Even after installing CUDA + Pytorch + LLamaCPP Python I see BLAS = 0 always Open

abetlen/llama-cpp-python#1315 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
using `cmake .. -DBUILD_SHARED_LIBS=ON` failed Open

question

abetlen/llama-cpp-python#1321 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 13, 2026
Not selecting the tokens with the highest probabilities with temperature 0 Open

bug

abetlen/llama-cpp-python#1322 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Mistral 7b crashes permanently with GPU Open

bug

abetlen/llama-cpp-python#1326 · 10 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Enable / Add llama.cpp.python server --parallel | -np N | --n_parallel N Open

abetlen/llama-cpp-python#1329 · 3 comments · 8 reactions · 0 assignees · Indexed Sep 13, 2026
Models with multiple chat templates Open

enhancement

abetlen/llama-cpp-python#1336 · 7 comments · 1 reaction · 0 assignees · Indexed Sep 13, 2026
Allow any format for X-Request-Id Open

enhancement

abetlen/llama-cpp-python#1337 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
`function_call` and `tool_choice` didn't have "auto" feature implemented Open

abetlen/llama-cpp-python#1338 · 4 comments · 1 reaction · 0 assignees · Indexed Sep 13, 2026
Hermes 2 Pro Full Chat Format Support Open

enhancement

abetlen/llama-cpp-python#1339 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 13, 2026
Add hashes to GitHub Pages PEP503 index Open

abetlen/llama-cpp-python#1340 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Support for arm64 wheels and CPU Features Open

abetlen/llama-cpp-python#1342 · 11 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Enable Proxying Copilot Requests to External LLMs (Claude, etc.) Open

abetlen/llama-cpp-python#1343 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Attribute Error: /llama.cpp/libllama.so: undefined symbol: llama_numa_init Open

abetlen/llama-cpp-python#1346 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Mixtral 8x22b models not generating responses once loaded. Open

abetlen/llama-cpp-python#1348 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Cannot build with CUDA on Win11 Open

abetlen/llama-cpp-python#1352 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
llama cpp python server for llava slow token per second Open

abetlen/llama-cpp-python#1354 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Docker: Missing library transformers when HF_PRETRAINED_MODEL_NAME_OR_PATH is provided Open

abetlen/llama-cpp-python#1355 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 13, 2026
Add llama-cpp-python to Debian repositories Open

abetlen/llama-cpp-python#1358 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
llama-cpp-python[server] using the wrong port and not accepting port arguments. Open

abetlen/llama-cpp-python#1359 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Is loading of control vectors supported? Open

enhancement

abetlen/llama-cpp-python#1363 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 13, 2026
Cache misses previous generation Open

abetlen/llama-cpp-python#1369 · 7 comments · 2 reactions · 0 assignees · Indexed Sep 13, 2026
Difference between Model and Server Configs? Open

abetlen/llama-cpp-python#1379 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
llama-cpp-python trigger OpenCL failure, has difference with triggering original c++ code directly Open

abetlen/llama-cpp-python#1381 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Can't install GPU version for windows for many times. Open

abetlen/llama-cpp-python#1393 · 10 comments · 2 reactions · 0 assignees · Indexed Sep 13, 2026
How to import photos into LLM llava? Open

abetlen/llama-cpp-python#1395 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Implementation of LlamaDiskCache lacks capacity setting. Open

abetlen/llama-cpp-python#1402 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Multimodal Llama3 Support Open

abetlen/llama-cpp-python#1403 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
jinja2.exceptions.UndefinedError: 'dict object' has no attribute 'name' when running Functions.ipynb with Jupyter lab Open

abetlen/llama-cpp-python#1405 · 3 comments · 4 reactions · 0 assignees · Indexed Sep 13, 2026
Which Python + CUDA version do you recommend for LLaVA on Windows 10 Pro 64-bit? Open

abetlen/llama-cpp-python#1418 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
ValueError: could not broadcast input array from shape (371,) into shape (320,) Open

abetlen/llama-cpp-python#1421 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Docker image Open

abetlen/llama-cpp-python#1423 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Add Nous Hermes 2 Pro function calling ChatHandler. Open

enhancement

abetlen/llama-cpp-python#1429 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 13, 2026

abetlen

Get new issues in your inbox