abetlen / abetlen/llama-cpp-python

llama_get_kv_self debug symbols removed

オープン
#2,064 コメント 0 件 リアクション 1 件 担当者 0 名 GitHub で見る
主要言語
Python
スター
10.6k
フォーク
1.4k
PR マージ指標
PR 指標を取得中

説明

# Prerequisites

Please answer the following questions for yourself before submitting an issue.

- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [x] I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- [x] I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- [x] I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.

# Expected Behavior

Debugpy should not have issues debugging the application itself.

# Current Behavior

In actual development run *without* debugger, no issues with the latest binary.

This behaviour only occurs when DebugPy is being used to step through the processes.

# Environment and Context

* MacOS Sequoia
* Python 3.13
* Llama-cpp @ b6370
* Llama-cpp-python @ 3.16

# Failure Information

Image

An attribute error occurs as the debug symbol was removed 2 weeks back (mid aug 2025), see [libllama api changelog](https://github.com/ggml-org/llama.cpp/issues/9289).

# Reproduce

This is my .vscode/launch.json settings for DebugPy

```json
{
"version": "0.2.0",
"configurations": [
{
"_comment": "This only runs on current file instance.",
"type": "python",
"request": "launch",
"name": "Standalone File Debugger",
"program": "${file}",
"console": "integratedTerminal",
"justMyCode": false,
},
]
}

```

On MacOS, the libllama.dylib might need to be updated to reflect changes of the API.

Thanks for the developing this project, not a major issue unless the debugger is needed to step through the process.

Note: installing Llama.cpp binary @ commit: b6188 allows debugging as symbols still exists (did not test other commits).

コントリビューションガイド

コントリビューションガイドを開く

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。