[Discussion] High-level API
Open
- Dominant language
- Python
- Stars
- 152
- Forks
- 16
- PR merge metrics
- No merged PRs in 30d
Description
Just some random ideas for the ggml-python high-level api.
- [x] Automatic memory / context management
- [x] Simplify backend offloading
- Immediate mode(?)
- File loaders
- On-the-fly Quantization
Contributor guide
Assessment
This issue has not been assessed yet.