Suggestion: WASI-NN CUDA
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 5.4k
- Forks
- 249
- PR merge metrics
- No merged PRs in 30d
Description
A feature request;
Implement the WASI-NN interface for CUDA so any WASM32-WASI [p1, p2 and future p3] runtime which wants a neural networking CUDA host can depend on a super efficient Rust implementation without needing to download a Docker image with gigabytes of other code.
Why?
At the moment running AI code requires a Docker image with Python and CUDA which easily goes between 5GB o 15GB which for a serverless or edge use case is ridiculous.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by scoping the WASI-NN interface for CUDA for WASM32-WASI runtimes, including p1, p2, and future p3 support; the work is done when runtimes can use a Rust CUDA host without requiring a large Python and CUDA Docker image.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust, wasm
- Domain
- ai, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100