Support DeepSeek V4 Flash Vision
Open
- Dominant language
- C
- Stars
- 22.3k
- Forks
- 2.1k
- Avg merge
- 1d 3h
- Merged PRs (30d)
- 4
Description
Quickly, thank you so much for releasing this and working on this problem and enabling such advanced AI on consumer hardware.
Is there any reason to imagine ds4 cannot handle vision if the underlying DeepSeek model does too?
https://api-docs.deepseek.com/news/news260821/
What would the general steps be to prepare this model for use with ds4?
I'm using a Mac Studio M2 Ultra 192GB - is there any expected gain from omlx, gmlx, or basert given the architecture?
Contributor guide
Assessment
This issue has not been assessed yet.