Image kv caching?
Open
- Dominant language
- C
- Stars
- 22.3k
- Forks
- 2.1k
- Avg merge
- 1d 3h
- Merged PRs (30d)
- 4
Description
As title stated, I noticed that currently on every turn, the DwarfStar will reprocess the images within the context window.
Contributor guide
Assessment
This issue has not been assessed yet.