containerd / containerd/runwasi

Problem when trying to use Runwasi + WasmEdge over Kind and Docker Image

Open
#647 14 comments 0 reactions 0 assignees View on GitHub
bug enhancement wasmedge
Dominant language
Rust
Stars
1.3k
Forks
131
PR merge metrics
No merged PRs in 30d

Description

Hi,

I've had a problem for several days trying to change the Kubernetes runtime to runwasi: WasmEdge.

I am trying to orchestrate the module **llama-simple.wasm** (https://github.com/second-state/llamaedge/releases/latest/download/llama-simple.wasm) for which I know that it is necessary to previously use the --nn-preload flag to indicate the LLM to execute.

The problem is that when I modify the runtime of containerd to run with wasmedge I always get the same error: **kubelet Back-off restarting failed container...**

![imagen](https://github.com/user-attachments/assets/098bca02-1be0-4a2d-a6ac-fa3537ad4821)

I have tried to use the runtime of this other runwasi repository (https://github.com/second-state/runwasi), without success, giving me a different error in this case:

![imagen](https://github.com/user-attachments/assets/874b3670-b3f1-44e0-888d-d4120902141a)

I don't know if anyone has tried to run a .wasm module that requires wasi-nn to work that can guide me to see what I'm doing wrong.

I test a simple HTTP server on RUST and it works perfect, so the problem is only with the modules that requires wasi-nn and the flag of --nn-preload to work:

![imagen](https://github.com/user-attachments/assets/45f340ef-5635-4148-9655-ca1c0fce9a34)

If anyone can help me I appreciate it!.

Regrats,
David.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.