biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
661a34fd4fdd700a29b2db758e23e4e243e7ff18
vllm/.buildkite/lm-eval-harness/configs/Qwen2-1.5B-Instruct-FP8W8.yaml
Robert Shaw 889da130e7 [ Misc ] fp8-marlin channelwise via compressed-tensors (#6524) 
Co-authored-by: mgoin <michael@neuralmagic.com>
2024-07-25 09:46:04 -07:00

357 B
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink