CommandCodeAI / CommandCodeAI/command-code
something seems not correct with ds v4 flash caching
Nessuno ha ancora preso questa issue.
- Lingua principale
- Nessun dato sulla lingua
- Stelle
- 4k
- Fork
- 350
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
Summary
Hi Command team,
Could you please help check whether there is an issue with DeepSeek V4 Flash caching or upstream routing on the Command servers?
My GOAT usage has increased unusually fast over the last couple of hours, and I hit the $35 weekly limit much faster than before, even though I have only been using deepseek/deepseek-v4-flash for past few hours and my workflow has not changed significantly.
One recent request from my usage dashboard shows:
- Input tokens: 357,723
- Output tokens: 120
- Charged: $0.0783
- Model:
deepseek/deepseek-v4-flash
At the current off-peak DeepSeek V4 Flash pricing, 357,723 fresh input tokens × $0.22/M is approximately $0.0787, which is almost exactly what I was charged.
This seems to suggest that nearly the entire input was billed as fresh/cache-miss input rather than cache-read input.
This is unusual for my workload. When I previously used the DeepSeek API directly for the same type of long-running agent workflow, my prompt cache hit rate was typically around 95–98%. For example, on one day I had about 758M cached input tokens versus only 13.4M uncached input tokens.
Could you please check whether there has recently been any issue with:
- DeepSeek V4 Flash prompt caching
- upstream provider/server routing or cache affinity
- cache keys being invalidated between consecutive agent requests
- any changes related to the recent DeepSeek V4 Flash / pricing update
I’ve attached screenshots of both my Command usage and my previous DeepSeek API usage for comparison.
If possible, could you also check the trace IDs from my recent requests and confirm whether those requests were actually receiving prompt-cache hits?
Thanks!
Expected Behavior
n.a.
Actual Behavior
n.a.
Steps to reproduce the issue
n.a.
Command Code Version
claude code
Operating System
macOS
Terminal/IDE
No response
Shell
No response
Session file (optional)
No response
Fix prompt (optional)
No response
Additional context
No response
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Direzione di ricerca
Inizia esaminando le prove allegate della dashboard di utilizzo e i request trace IDs recenti menzionati nel report. Confronta l’input addebitato con il comportamento cache-read previsto e verifica se le richieste DeepSeek V4 Flash ricevono prompt-cache hits; il lavoro è completato quando la causa di routing o caching viene confermata oppure esclusa con delle prove.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Valutazione
- Ambito
- ai, backend
- Tipo di issue
- Bug
- Difficoltà
- 4/5
- Tempo stimato
- 3-5 giorni
- Stato di attività
- Attiva
- Chiarezza
- Da chiarire
- Idoneità per principianti
- 28/100