ds4: --ssd-streaming is not compatible with --mtp yet" When trying to launch Dspark after the new commit
未关闭
- 主要语言
- C
- 星标
- 22.3k
- 派生
- 2.1k
- 平均合并
- 1 天 3 小时
- 30 天内合并 PR
- 4
描述
Hi, reading the new README section regarding Dspark it is stated "On Metal, the main model may be resident or use --ssd-streaming", does it mean that dspark (launched via the mtp flag) should work with ssd streaming ? Or maybe I misunderstood? I asked ds4 and it agrees with me :P
Here's what I launched :
````
dani@Host-002 ds4 % ./ds4-server \
--ssd-streaming \
--port 9000 \
--kv-disk-dir /Users/dani/ds4/kvcache \
--kv-disk-space-mb 32768 \
--kv-cache-continued-interval-tokens 10000 \
--mtp gguf/DeepSeek-V4-Flash-DSpark-support.gguf \
--dspark
ds4: --ssd-streaming is not compatible with --mtp yet
````
Should it work or not?
Thanks
贡献指南
评估
这个 Issue 还没有评估数据。