abetlen / abetlen/llama-cpp-python

"llama.cpp error: 'error loading model architecture: unknown model architecture: 'deepseek2'

オープン
#1,556 コメント 12 件 リアクション 4 件 担当者 0 名 GitHub で見る
主要言語
Python
スター
10.6k
フォーク
1.4k
PR マージ指標
PR 指標を取得中

説明

# Prerequisites

Please answer the following questions for yourself before submitting an issue.

- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [x] I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- [ ] I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- [x] I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.

{
"title": "Failed to load model",
"cause": "llama.cpp error: 'error loading model architecture: unknown model architecture: 'deepseek2''",
"errorData": {
"n_ctx": 8192,
"n_batch": 512,
"n_gpu_layers": 31
},
"data": {
"memory": {
"ram_capacity": "31.91 GB",
"ram_unused": "26.74 GB"
},
"gpu": {
"gpu_names": [
"NVIDIA GeForce GTX 1080 Ti"
],
"vram_recommended_capacity": "11.00 GB",
"vram_unused": "9.98 GB"
},
"os": {
"platform": "win32",
"version": "10.0.19045",
"supports_avx2": true
},
"app": {
"version": "0.2.24",
"downloadsDir": "C:\\Users\\ZeroCool22\\.cache\\lm-studio\\models"
},
"model": {}
}
}```

コントリビューションガイド

コントリビューションガイドを開く

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。