0 Releases 140 Tags

RSS Feed

• v0.7.1 4f4d427ac2

  Compare

  Disable chunked prefill and/or prefix caching when MLA is enabled (#12642)

  biondizzle released this 2025-02-01 07:46:57 +00:00 | 11262 commits to main since this release

  From @mgoin in https://github.com/vllm-project/vllm/pull/12638

  I cannot push to that branch, therefore a new PR to unblock release.

  ---

  Signed-off-by: mgoin michael@neuralmagic.com
  Signed-off-by: simon-mo simon.mo@hey.com
  Co-authored-by: mgoin michael@neuralmagic.com

  Downloads

  • Source Code (ZIP)
  • Source Code (TAR.GZ)