CuTeDSL's cute.compile appears to corrupt GPU memory state, causing torch.arange to produce zero-filled tensors when allocated after the JIT compilation. Moving token_indices allocation before the weight stacking operations fixes the corruption.
CuTeDSL's cute.compile appears to corrupt GPU memory state, causing torch.arange to produce zero-filled tensors when allocated after the JIT compilation. Moving token_indices allocation before the weight stacking operations fixes the corruption.