RWKV.cpp backend
Open
Nobody has claimed this yet.
area/backends
enhancement
model/rwkv
new-backend
- Dominant language
- Go
- Stars
- 49.2k
- Forks
- 4.5k
- Avg merge
- 1d 3m
- Merged PRs (30d)
- 239
Description
I’m re-proposing @Pinucci0’s idea: it would be great to have an RWKV.cpp backend in LocalAI’s Gallery, with RWKV-6 and RWKV-7 models available for download.
RWKV-Runner is a nice idea (the concept of music generation from notes or MIDI rather than a text prompt is particularly fantastic), but it’s quite cumbersome to get working.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points. Start by locating LocalAI’s Gallery backend definitions and the existing model-download configuration, then determine how an RWKV.cpp backend would integrate with them. Done means the backend is available in the Gallery and RWKV-6 and RWKV-7 models can be downloaded.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- ai, backend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100