How does KVCache Client works on 3FS?
Open
- Dominant language
- C++
- Stars
- 10.2k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
The top figure demonstrates the read throughput of all KVCache clients (1×400Gbps NIC/node), highlighting both peak and average values, with peak throughput reaching up to 40 GiB/s.
---- the amazing throughput of KVCache retrieval.
Dose the KVCache storage implemented on 3FS ?
KVCache client should be an kv storage interface, like redis client. Does KVCache Client access storage using 3FS client?
How about the latency KV Cache read ?
Thanks!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.