biondizzle/vllm-with-lmcache
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Compare commits

merge into: biondizzle:dream-build-glm
Branches Tags
biondizzle:master biondizzle:dream-build-glm biondizzle:dream-build biondizzle:rocm-mla-multi-group-kv-cache biondizzle:dream-build-glm-save-decode biondizzle:mla-multi-group-kv-cache biondizzle:glm51-cu130-nightly biondizzle:openai-rocm-nightly biondizzle:deepseekv4-cu130 biondizzle:custom-weights-cu130 biondizzle:glm51-cu130
...
pull from: biondizzle:dream-build-glm-save-decode
Branches Tags
biondizzle:dream-build-glm biondizzle:dream-build biondizzle:rocm-mla-multi-group-kv-cache biondizzle:dream-build-glm-save-decode biondizzle:mla-multi-group-kv-cache biondizzle:glm51-cu130-nightly biondizzle:openai-rocm-nightly biondizzle:deepseekv4-cu130 biondizzle:custom-weights-cu130 biondizzle:master biondizzle:glm51-cu130

1 Commits
dream-buil ... dream-buil

Author SHA1 Message Date
biondizzle
3c6f00e6d9 save decode 2026-05-06 16:07:39 +00:00
1 changed files with 1 additions and 1 deletions
Expand all files Collapse all files

2
lmcache-config-glm-51.yaml
View File

@@ -1,7 +1,7 @@
chunk_size: 256
local_cpu: true
max_local_cpu_size: 256.0
save_decode_cache: false
save_decode_cache: true
enable_lazy_memory_allocator: true
lazy_memory_initial_ratio: 1.0
use_gpu_connector_v3: true