JustFit runs a 27‑billion‑parameter Qwen3.8 model on a 24 GiB MacBook, extending single‑request context to 212 k tokens (6.93× baseline) and achieving 19.11 tokens/s on a 32K‑input test.
- 24 GiB M4 Pro MacBook
- 212,992 context positions (6.93×)
- 19.11 tokens/s on 32K‑64 probe
JustFit integrates three mechanisms—KVExec for compressed key‑value storage, PhaseSwap for component residency, and StateTrans for state‑preserving transitions—independent of model quantization. In tests, three runs processed 196,608 input tokens and 16,384 output tokens. A two‑request scenario kept 229,376 positions in total. These techniques enable near‑full‑model execution on limited‑memory laptops.




