InferScale is a GPU-native LLM memory system.
- GPU-native
InferScale replaces repeated prompt prefilling with reusable KV state, reducing time-to-first-token. It precomputes each memory fact's KV representation and stores it alongside a semantic embedding on the GPU.





