KV cache shrinks with 2‑bit residuals
Tiny cache, big impact: ResidualQuant compresses the key‑value cache of looped Transformers to 2‑bit residuals plus a final‑loop reference, slashing memory use while keeping accuracy intact.
Why it mattersLess memory means larger models fit on the same hardware.




