CuTeDSL's cute.compile corrupts GPU memory during JIT compilation. Tensors allocated on GPU before/during compilation get zeroed. Fix: create token_indices on CPU, then .to(device) after JIT is done.
CuTeDSL's cute.compile corrupts GPU memory during JIT compilation. Tensors allocated on GPU before/during compilation get zeroed. Fix: create token_indices on CPU, then .to(device) after JIT is done.