biondizzle 2dc5b4ec19 Fix sampler kernel stack overflow: reduce MAX_K from 256 to 128 ...

128 * (sizeof(float) + sizeof(int)) = 1KB — within CUDA default stack limit.
256 * 8 = 2KB would overflow.

2026-06-01 20:42:53 +00:00

..

__init__.py

Restructure: cutedsl/ -> dsv4/ with proper layering

2026-05-21 17:30:44 +00:00

_hash_router.py

Router: full kernel stack — hash, topk, activation+topk, dense decode/prefill

2026-05-21 21:54:05 +00:00

activation_topk.cu

Router: full kernel stack — hash, topk, activation+topk, dense decode/prefill

2026-05-21 21:54:05 +00:00

amax_gsa.cu

Performance audit fixes: eliminate CPU-GPU syncs

2026-06-01 20:40:19 +00:00

append_swa.cu

KV Cache: schema, allocator, pools, manager, append_swa kernel

2026-05-22 00:08:38 +00:00

compressor_reduce.cu

fix: move compressor position_bias into CUDA kernel (was Python loop)

2026-06-01 05:54:44 +00:00

deinterleave_quantize.cu

Restructure: cutedsl/ -> dsv4/ with proper layering

2026-05-21 17:30:44 +00:00

flush_write.cu

Flush compressor: schema fix, prepare_forward, flush_write kernels, state rotation

2026-05-22 00:25:47 +00:00

gather_kv.cu

fix: extern declarations for gather_swa functions in gather_kv.cu

2026-05-30 21:14:15 +00:00

gather_swa.cu

fix: single PYBIND11_MODULE for combined gather .so

2026-05-30 21:13:24 +00:00

hash_router.cu

Router: full kernel stack — hash, topk, activation+topk, dense decode/prefill

2026-05-21 21:54:05 +00:00

indexer_score_topk.cu

Clean up E2M1 dequant: use LUT approach (consultant recommendation)

2026-05-28 16:17:47 +00:00

quantize_nvfp4.cu

fix quantize_nvfp4 kernel: use proven single-thread-per-CTA pattern from deinterleave_quantize.cu

2026-05-25 16:21:44 +00:00

sampler.cu

Fix sampler kernel stack overflow: reduce MAX_K from 256 to 128

2026-06-01 20:42:53 +00:00

sparse_topk_metadata.cu

Restructure: cutedsl/ -> dsv4/ with proper layering

2026-05-21 17:30:44 +00:00

topk_select.cu

Router: full kernel stack — hash, topk, activation+topk, dense decode/prefill

2026-05-21 21:54:05 +00:00