agentscope-ai / agentscope-ai/QwenPaw

[Question]: llama.cpp server fails to start in official Docker image due to GLIBC version mismatch

Offen
#3,211 3 Kommentare 2 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
question
Vorherrschende Sprache
Python
Sterne
34.9k
Forks
3.1k
Ø Merge
1 T. 15 Std.
Gemergte PRs (30 T.)
225

Beschreibung

## Question or topic

When using the official Docker image (agentscope/copaw:latest / agentscope-registry.ap-southeast-1.cr.aliyuncs.com/agentscope/copaw:latest), the llama.cpp local model provider fails to start with the error:
`llama.cpp server exited before becoming ready`
The Docker container is based on Debian 12 (GLIBC 2.36), but the llama.cpp binaries that CoPaw automatically downloads require GLIBC 2.38. This causes the llama-server binary to crash immediately on startup.

## Context

`ldd --version | head -1
ldd (Debian GLIBC 2.36-9+deb12u13) 2.36`

`/app/working/local_models/bin/llama-server --version 2>&1
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libm.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/llama-server)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.32' not found (required by /app/working/local_models/bin/llama-server)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libstdc++.so.6: version `CXXABI_1.3.15' not found (required by /app/working/local_models/bin/llama-server)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/llama-server)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/libmtmd.so.0)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/libllama.so.0)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/libggml-base.so.0)`

`# show copaw | grep Version
Version: 1.0.2`

## Tried so far

[Optional: what you already tried or read (docs, issues, etc.).]

---

**Note:** For general questions or ideas, [GitHub Discussions](https://github.com/agentscope-ai/CoPaw/discussions) may get more visibility. Use this template when the answer might lead to a bug report, feature request, or doc change.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.