biondizzle/nvfp4-megamoe-kernel
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Remove VLLM_NVFP4_GEMM_BACKEND env var - CuTeDSL auto-selects on Blackwell

Browse Source
This commit is contained in:
biondizzle
2026-05-19 08:35:40 +00:00
parent 914d27fee7
commit 2672e98e4c
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docker-compose.yml
View File

@@ -11,7 +11,7 @@ services:
- PYTHONUNBUFFERED=1
- VLLM_RPC_TIMEOUT_MS=600000
- CLAWMINE_DEBUG=1
- VLLM_NVFP4_GEMM_BACKEND=cutedsl
# Don't set VLLM_NVFP4_GEMM_BACKEND - our CuTeDSL kernel auto-selects on Blackwell
command:
- /model
- --trust-remote-code