biondizzle
5417f65b08
The kernel was using head strides for the T (query row) dimension, which happened to work for T=1 (qr=0 always) but was wrong for T>1. For (B,H,T,NOPE) layout: - Head stride = T*NOPE, but T stride = NOPE - Scale head stride = T, but T stride = 1 - RoPE head stride = T*ROPE, but T stride = ROPE Added q_nope_t_stride, q_scale_t_stride, q_rope_t_stride to params struct, C API, and Python wrapper.