Skip to content
#

eviction

Here are 30 public repositories matching this topic...

CUDA KV-cache eviction + INT8 quantized paged attention (vLLM-oriented). 26/26 pytest PASS on T1000. Eviction @16k blocks: host 1707.75µs → fused 562µs (~3×). INT8 attn p50 1.76–14.18ms; ~49.9% KV vs fp16. Apache-2.0 · PyTorch · NumPy.

  • Updated Jul 14, 2026
  • Python

Improve this page

Add a description, image, and links to the eviction topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the eviction topic, visit your repo's landing page and select "manage topics."

Learn more