8 Commits

Author	SHA1	Message	Date
biondizzle	5b2e690936	Milestone: Full FMHA HD=16 with PV SS MMA (SMEM-P) — cosine 0.9997	2026-05-28 14:50:43 +00:00
biondizzle	78026839b7	Fix V canonical layout: swap g_mn/g_k indices (d=MN, lr=K)	2026-05-28 14:49:17 +00:00
biondizzle	9a3b43c42b	Fix reference to also use uniform P	2026-05-28 14:47:10 +00:00
biondizzle	75bdcbf728	Debug: override P with uniform 1/128	2026-05-28 14:46:21 +00:00
biondizzle	af93c283c7	Enable all 8 PV K-tiles	2026-05-28 14:45:13 +00:00
biondizzle	6f5be8a4e4	Debug: print P values	2026-05-28 14:44:09 +00:00
biondizzle	3d15f5bb21	Debug: 1 PV K-tile	2026-05-28 14:43:01 +00:00
biondizzle	284a06ddf1	FMHA v5: clean rewrite with QK + softmax + PV SS per K-tile	2026-05-28 14:42:13 +00:00