[Feat][v1] Simple yet General CPU KV Cache Offloading (#37160)

Browse Source

Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
(cherry picked from commit 91e4521f9f)

...

This commit is contained in:

Yifan Qiao

2026-03-31 17:58:37 -07:00

committed by khluu

parent 0ee3b7fc3d

commit 1dbbafd3f3

15 changed files with 2964 additions and 3 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

0

tests/v1/simple_kv_offload/__init__.py Normal file