Logo
Explore Help
Register Sign In
biondizzle/deepseek-v4-quant
1
0
Fork 0
You've already forked deepseek-v4-quant
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
27dbf2850f459a57396d9002ba0b5e0aae15f3da
deepseek-v4-quant/patches
History
biondizzle 27dbf2850f fix: replace nested tl.where with sum-of-comparisons for E2M1 quantization
Triton can't compile deeply nested tl.where. Use arithmetic instead:
idx = sum(abs_s >= threshold_i) for 7 threshold values.
2026-05-11 22:23:05 +00:00
..
deepseek_v4.py
fix: replace nested tl.where with sum-of-comparisons for E2M1 quantization
2026-05-11 22:23:05 +00:00
deepseek_v4.py.bak
S11: Fixed substr mapping, stacking, suffix, and o_a_proj - loads weights but attention forward uses FP8 einsum incompatible with NVFP4
2026-05-10 17:45:53 +00:00
deepseek_v4.py.s11
S11: Fixed substr mapping, stacking, suffix, and o_a_proj - loads weights but attention forward uses FP8 einsum incompatible with NVFP4
2026-05-10 17:45:53 +00:00
patch_finegrained_fp8_blackwell.py
Add BF16 upcast script and Blackwell DeepGEMM patch
2026-05-07 14:25:30 +00:00
patch_vllm_weights.py
vLLM serving: patched deepseek_v4.py, disabled mega_moe, updated docs
2026-05-10 16:14:17 +00:00
quant_module_patched.py
Add ModelOpt NVFP4 pipeline: patch, run script, README
2026-05-07 07:22:54 +00:00
staging_kernel.py
fix: staging kernel outputs unpacked E2M1 (1 byte/element, not packed 2/byte)
2026-05-11 21:29:33 +00:00
Powered by Gitea Version: 1.25.2 Page: 50ms Template: 2ms
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API