0 Releases 140 Tags

RSS Feed

• v0.19.0rc0 1dbbafd3f3

  Compare

  [Feat][v1] Simple yet General CPU KV Cache Offloading (#37160)

  biondizzle released this 2026-04-01 08:03:14 +00:00

  Signed-off-by: Yifan Qiao yifanqiao@berkeley.edu
  Signed-off-by: Yifan Qiao yifanqiao@inferact.ai
  (cherry picked from commit 91e4521f9f)

  Downloads

  • Source Code (ZIP)
  • Source Code (TAR.GZ)