agentscope-ai / agentscope-ai/QwenPaw
[Question]: llama.cpp server fails to start in official Docker image due to GLIBC version mismatch
- Vorherrschende Sprache
- Python
- Sterne
- 34.9k
- Forks
- 3.1k
- Ø Merge
- 1 T. 15 Std.
- Gemergte PRs (30 T.)
- 225
Beschreibung
## Question or topic
When using the official Docker image (agentscope/copaw:latest / agentscope-registry.ap-southeast-1.cr.aliyuncs.com/agentscope/copaw:latest), the llama.cpp local model provider fails to start with the error:
`llama.cpp server exited before becoming ready`
The Docker container is based on Debian 12 (GLIBC 2.36), but the llama.cpp binaries that CoPaw automatically downloads require GLIBC 2.38. This causes the llama-server binary to crash immediately on startup.
## Context
`ldd --version | head -1
ldd (Debian GLIBC 2.36-9+deb12u13) 2.36`
`/app/working/local_models/bin/llama-server --version 2>&1
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libm.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/llama-server)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.32' not found (required by /app/working/local_models/bin/llama-server)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libstdc++.so.6: version `CXXABI_1.3.15' not found (required by /app/working/local_models/bin/llama-server)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/llama-server)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/libmtmd.so.0)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/libllama.so.0)
/app/working/local_models/bin/llama-server: /lib/aarch64-linux-gnu/libc.so.6: version `GLIBC_2.38' not found (required by /app/working/local_models/bin/libggml-base.so.0)`
`# show copaw | grep Version
Version: 1.0.2`
## Tried so far
[Optional: what you already tried or read (docs, issues, etc.).]
---
**Note:** For general questions or ideas, [GitHub Discussions](https://github.com/agentscope-ai/CoPaw/discussions) may get more visibility. Use this template when the answer might lead to a bug report, feature request, or doc change.
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.