abetlen / abetlen/llama-cpp-python

tensor read out of bounds

オープン
#1,241 コメント 0 件 リアクション 0 件 担当者 0 名 GitHub で見る
主要言語
Python
スター
10.6k
フォーク
1.4k
PR マージ指標
PR 指標を取得中

説明

# Prerequisites

Please answer the following questions for yourself before submitting an issue.

- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [x] I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- [x] I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- [x] I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.

# Expected Behavior

Stream responses correctly, or, if there is an error, throw an error but not crash the application

# Current Behavior

I'm using it in a Flask app and when multiple generations are running concurrently I get `tensor read out of bounds`

# Environment and Context

Latest version of macOS

# Failure Logs

```
GGML_ASSERT: /private/var/folders/n4/********/llama-cpp-python_**********/vendor/llama.cpp/ggml-backend.c:206: offset + size <= ggml_nbytes(tensor) && "tensor read out of bounds"
```

コントリビューションガイド

コントリビューションガイドを開く

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。