Owner

abetlen

4 indexed repositories · View on GitHub

ggml-python
Python bindings for ggml

Python · 152 stars
sqlite3-bfsvtab-ext
A virtual table extension for breadth-first search queries in Sqlite3

C · 39 stars
pikchr-js
The Pikchr markup language for diagrams, running in your browser

C · 8 stars
simdinfo
Small C library for SIMD feature detection at runtime

C · 6 stars

Open All

568 issues indexed so far

Not sure if it's a bug or a configuration error... Open

abetlen/llama-cpp-python#1555 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
"llama.cpp error: 'error loading model architecture: unknown model architecture: 'deepseek2' Open

abetlen/llama-cpp-python#1556 · 12 comments · 4 reactions · 0 assignees · Indexed Sep 13, 2026
tool_call function "name" has incorrect format so function calling does not work for functionary Open

abetlen/llama-cpp-python#1560 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Switch to disable adding BOS token Open

abetlen/llama-cpp-python#1561 · 1 comment · 2 reactions · 0 assignees · Indexed Sep 13, 2026
Add MiniCPM-Llama3-V-2_5 to supported multi-modal models Open

abetlen/llama-cpp-python#1564 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Pyinstaller Cannot Find File After Compiling Open

abetlen/llama-cpp-python#1565 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
BUG: import error or execute error (NULL pointer access) for the latest prebuilt version `v0.2.81` Open

abetlen/llama-cpp-python#1571 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
build error for version 0.2.81 and 0.2.80 Open

abetlen/llama-cpp-python#1573 · 11 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
The new shared library causes conflicts if more than 1 variant of llama-cpp-python is imported Open

abetlen/llama-cpp-python#1575 · 10 comments · 5 reactions · 0 assignees · Indexed Sep 13, 2026
System role not supported Gemma 2 Open

abetlen/llama-cpp-python#1580 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Trying to load llm model using llama cpp python with GPU support fails with an OSError: exception: access violation reading 0x0000000000000000 Open

abetlen/llama-cpp-python#1581 · 21 comments · 5 reactions · 0 assignees · Indexed Sep 13, 2026
unsupported Microsoft Visual Studio version Open

abetlen/llama-cpp-python#1586 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Cannot run T5-based models Open

abetlen/llama-cpp-python#1587 · 18 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
GPU acceleration gives gibberish output and breaks string grammars Open

abetlen/llama-cpp-python#1593 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Windows - OpenBLAS (CPU) - Could NOT find BLAS (missing: BLAS_LIBRARIES) Open

bug

abetlen/llama-cpp-python#1595 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 13, 2026
Gemma 2 : flash_attn is not compatible with attn_soft_cap - forcing off Open

abetlen/llama-cpp-python#1598 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Load time in the log is much different from real load model time? Open

abetlen/llama-cpp-python#1601 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
streaming not working Open

abetlen/llama-cpp-python#1604 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Gemma-2 with Temperature=0 gives different output Open

abetlen/llama-cpp-python#1606 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Pull from Ollama repo functionality Open

enhancement

abetlen/llama-cpp-python#1607 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
destructor llama error: TypeError: 'NoneType' object is not callable Open

abetlen/llama-cpp-python#1610 · 11 comments · 3 reactions · 0 assignees · Indexed Sep 13, 2026
Add support for croos-encoders Open

enhancement

abetlen/llama-cpp-python#1611 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
ERROR: Failed building wheel for llama-cpp-python for SYCL installation on Windows Open

bug

abetlen/llama-cpp-python#1614 · 12 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Build fail for version from 0.2.80 to 0.2.83 Open

bug

abetlen/llama-cpp-python#1616 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
ERROR: Could not build wheels for llama-cpp-python Open

bug

abetlen/llama-cpp-python#1617 · 19 comments · 9 reactions · 0 assignees · Indexed Sep 13, 2026
Feat: Add support for Llama 3.1 function calling Open

enhancement

abetlen/llama-cpp-python#1618 · 3 comments · 21 reactions · 0 assignees · Indexed Sep 13, 2026
llama-cpp-python CMake,Failed building wheel for llama-cpp-python error on windows 11 pro Open

bug

abetlen/llama-cpp-python#1619 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
can not install llama-cpp-python Open

bug

abetlen/llama-cpp-python#1621 · 1 comment · 10 reactions · 0 assignees · Indexed Sep 13, 2026
Not able to Install with cuda support in Bento Open

bug

abetlen/llama-cpp-python#1622 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
CUDA error: unspecified launch failure on inference on Nvidia V100 GPUs Open

bug

abetlen/llama-cpp-python#1624 · 5 comments · 4 reactions · 0 assignees · Indexed Sep 13, 2026
All requests end with 'finish_reason': 'length' when the max_tokens=-1 parameter is set. Open

bug

abetlen/llama-cpp-python#1645 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
create_chat_completion is stuck in versions 0.2.84 and 0.2.85 for Mac Silicon Open

bug

abetlen/llama-cpp-python#1648 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Installing the pre-built v0.2.85 – v0.3.0 Metal wheels for Python 3.9 – 3.12 yields `Bad magic number for file header` Open

bug

abetlen/llama-cpp-python#1650 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
pip install llama-cpp-python on anaconda Open

bug

abetlen/llama-cpp-python#1654 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Error When Loading Model with llama_cpp: [WinError -1073741795] Windows Error 0xc000001d Open

bug

abetlen/llama-cpp-python#1660 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
High CPU Usage, very slow performance, with flash_attn=true on ROCM 6.1.2 Open

bug

abetlen/llama-cpp-python#1661 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Wheel build showing error of cmake suddenly - building version 0.2.76 on windows Open

abetlen/llama-cpp-python#1664 · 6 comments · 1 reaction · 0 assignees · Indexed Sep 13, 2026
error: no matching function for call to 'ggml_group_norm' Open

abetlen/llama-cpp-python#1665 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Model path does not exist: path/to/llama-2/llama-model.gguf Open

abetlen/llama-cpp-python#1672 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
How to improve GPU utilization Open

abetlen/llama-cpp-python#1674 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Add support T5 (encode-decoder) models at API level and server Open

enhancement

abetlen/llama-cpp-python#1681 · 0 comments · 9 reactions · 0 assignees · Indexed Sep 13, 2026
0.2.88 fails to build: error: invalid operands to binary expression, etc Open

abetlen/llama-cpp-python#1683 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Problem with v0.2.88 Open

bug

abetlen/llama-cpp-python#1684 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Failed to load shared library 'E:\anaconda\envs\xinference\lib\site-packages\llama_cpp\lib\llama.dll' Open

abetlen/llama-cpp-python#1685 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
CUDA not supported. `ValueError: Attempt to split tensors that exceed maximum supported devices. Current LLAMA_MAX_DEVICES=1` Open

abetlen/llama-cpp-python#1692 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 13, 2026
CUDA unsupported, installation bypasses CUDA at all Open

abetlen/llama-cpp-python#1693 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
D:\a\llama-cpp-python\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml.c:6399: GGML_ASSERT(c->ne[0] >= n_dims / 2) failed Open

abetlen/llama-cpp-python#1694 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
get hidden state Open

question

abetlen/llama-cpp-python#1695 · 0 comments · 2 reactions · 0 assignees · Indexed Sep 13, 2026
Empty output when running Q4_K_M quantization of Llama-3-8B-Instruct with llama-cpp-python Open

abetlen/llama-cpp-python#1696 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Feature request : NPU Support Open

abetlen/llama-cpp-python#1702 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026

abetlen

Get new issues in your inbox