biondizzle 4adee1207f FMHA: zero-init my_p_vals to fix N<128 padding NaN ...

When N<128, padded KV positions have my_p_vals[col] uninitialized
for col >= kv_len. The PV GEMM then computes garbage_P × zero_V,
which can produce NaN on tensor cores (0 × NaN = NaN).
Fix: zero-initialize my_p_vals so padded positions contribute 0.

2026-05-31 23:11:12 +00:00

..

cache

E1: Wire LayerCacheHandle gather methods + CUDA gather kernels

2026-05-30 21:09:21 +00:00

kernels

FMHA: zero-init my_p_vals to fix N<128 padding NaN

2026-05-31 23:11:12 +00:00

layers

Add --no-thinking mode to skip thinking tokens and use second-best

2026-05-31 19:24:21 +00:00

loader

Restructure: cutedsl/ -> dsv4/ with proper layering

2026-05-21 17:30:44 +00:00

model

Fix remaining mHC API references: layer_compare.py, layer.py comment

2026-05-31 18:38:34 +00:00

ops

Fix production rope.py: FP32 arithmetic for forward_rope_partial + inverse_rope_bf16

2026-05-31 09:17:36 +00:00

reference

Restructure: cutedsl/ -> dsv4/ with proper layering

2026-05-21 17:30:44 +00:00

__init__.py

Restructure: cutedsl/ -> dsv4/ with proper layering

2026-05-21 17:30:44 +00:00