biondizzle 8f80991fdf CRITICAL FIX: Properly dequantize fp8 KV in decode using per-token inv_scale

2026-05-19 17:08:58 +00:00

..

kernels/linear/nvfp4

Fix OOM: add --max-model-len=876544 + revert CPU dummy weight

2026-05-19 07:35:43 +00:00

patches

CRITICAL FIX: Properly dequantize fp8 KV in decode using per-token inv_scale

2026-05-19 17:08:58 +00:00

cutedsl_quant_method.py

Fix OOM: add --max-model-len=876544 + revert CPU dummy weight

2026-05-19 07:35:43 +00:00

nvfp4_cutedsl.py

Replace autograd.Function with torch.library.custom_op for Dynamo compat

2026-05-19 01:54:48 +00:00