canonical/inference-snaps

View on GitHub

Local inference, optimized for your hardware

Stars: 50
Forks: 6
Open beginner issues: 0
Indexed issues: 45
Avg merge: 1d 20h
Merged PRs (30d): 7

Dominant language: No language data
License: No license data
Last GitHub push: Sep 10, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue

Open All

45 open issues indexed

Unable to detect Nvidia vRAM and Compute Capability on Ubuntu 20.04 Open

cli

canonical/inference-snaps#212 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Treat internal errors and mismatches differently Open

cli

canonical/inference-snaps#207 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
vram property is not uint64 Open

cli

canonical/inference-snaps#206 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
CPU info fails on Jammy Open

cli wontfix

canonical/inference-snaps#205 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Raw test data for additional properties Open

cli

canonical/inference-snaps#189 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Bad performance on Mac M2 machine Open

snap/deepseek-r1

canonical/inference-snaps#124 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Dependency Dashboard Open

canonical/inference-snaps#8 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Old `lspci` does not report all fields Open

cli

canonical/inference-snaps#188 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Print help on false usage Open

cli

canonical/inference-snaps#185 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support older Intel GPUs Open

snap/deepseek-r1

canonical/inference-snaps#116 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Decimal vram not supported Open

cli

canonical/inference-snaps#184 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Tab completion script generated by Cobra doesn't work from snaps Open

cli

canonical/inference-snaps#183 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Tab completion lists files when no arguments are available Open

cli

canonical/inference-snaps#177 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
intel-npu engine works only with an image in the prompt Open

snap/qwen-vl

canonical/inference-snaps#96 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
How to use an inference snap as a dependency of another snap Open

documentation

canonical/inference-snaps#46 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
`cuda` engine crashes due to insufficient vRAM Open

snap/deepseek-r1

canonical/inference-snaps#107 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
`intel-npu` engine fails with a large image Open

snap/qwen-vl

canonical/inference-snaps#91 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Help should show supported formats Open

cli

canonical/inference-snaps#158 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Requires two CPUs but doesn't mention that Open

snap/qwen-vl

canonical/inference-snaps#90 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Link to the exact VS-Code extension Open

documentation

canonical/inference-snaps#74 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
vRAM detection fails on Nvidia DGX Spark Open

cli

canonical/inference-snaps#143 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
cpu-xsmall should explicitly mention image support Open

documentation snap/gemma3

canonical/inference-snaps#223 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Switching from llamacpp engine to ovms engine fails Open

canonical/inference-snaps#225 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Move intel compute runtime to dedicated component Open

canonical/inference-snaps#232 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
gemma3 from edge fails to start up with intel engines Open

snap/gemma3

canonical/inference-snaps#253 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove terminal check for `use-engine` and `prune-cache` Open

good first issue

canonical/inference-snaps#265 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
gemma4 amd-gpu engine fails to start on FW16 with AMD GPU module Open

canonical/inference-snaps#275 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
`install` hook fails during `ubuntu-image --preseed` (hardware probe runs in a cgroup-constrained sandbox) Open

canonical/inference-snaps#276 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Setting http.port to a port already used by webui leaves server in broken state Open

bot snap/smollm2

canonical/inference-snaps#312 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PR workflows fail if PR is from fork Open

canonical/inference-snaps#316 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
`modelctl debug` exits 0 on non-existent subcommand Open

canonical/inference-snaps#321 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
dev: smoke tests fail if model does not support chat Open

canonical/inference-snaps#324 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Update deprecated Makefile in agentic AI snap creation tutorial Open

documentation

canonical/inference-snaps#326 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Engine switch fails if snap has "changes in progress" Open

canonical/inference-snaps#327 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
small typo in version needed for NVIDIA GPU drivers Open

documentation

canonical/inference-snaps#333 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Gemma4 restart loop on AMD gfx1103 Open

canonical/inference-snaps#337 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Use llama.cpp version numbers Open

canonical/inference-snaps#339 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Qwen3.5's Jetson Orin engine is pinned to 4k context size Open

snap/qwen3-5

canonical/inference-snaps#340 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Automate Intel compute-runtime updates Open

canonical/inference-snaps#341 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
glm-4-7-flash: llama-server aborts with GGML_ASSERT in fit-ctx because bundled model exceeds 16 GB RAM; no smaller model available Open

bot snap/glm-4-7-flash snap/qwen3-8

canonical/inference-snaps#343 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Embeddings fail with HTTP 500 for a single input longer than 512 tokens (fixed physical batch size, no config to raise it) Open

bot snap/nomic-embed-text-v1-5

canonical/inference-snaps#344 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
The snap should should support "snap set" configuration Open

canonical/inference-snaps#345 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
fix flaky tests: TestSnapInfo and TestGetComponents Open

cli

canonical/inference-snaps#352 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
using the environment variables set via "qwen3-coder set" does not seem to work as advertised Open

canonical/inference-snaps#353 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[qwen3-6] cpu engine server is killed by the OOM killer in an endless loop; inference never becomes available on 16GB machines Open

bot snap/qwen3-6

canonical/inference-snaps#354 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

canonical/inference-snaps

Get new issues in your inbox