microsoft

G-KV, a KV cache eviction method that employs a global scoring mechanism, combining local and historical attention scores to more accurately assess token importance.

Stars

4

Forks

1

Open beginner issues

0

Indexed issues

1