Xiaozhu Meng e42af78b18 [flashinfer] [kernel] support for fp8 kv cache for trtllm prefill attention (#24197) ...

Signed-off-by: Xiaozhu <mxz297@gmail.com>

2025-09-11 14:20:09 -07:00

..

__init__.py

Allow users to specify kv cache memory size (#21489)

2025-09-11 13:41:07 +00:00

deep_gemm.py

[Log] Use Debug Once for DeepGEMM E8M0 When not Enabled (#23858)

2025-08-28 22:18:10 +00:00

flashinfer.py

[flashinfer] [kernel] support for fp8 kv cache for trtllm prefill attention (#24197)

2025-09-11 14:20:09 -07:00

jsontree.py

Adds json_count_leaves utility function (#23899)

2025-08-29 05:28:13 -07:00

tensor_schema.py

[Bugfix] Fix MiniCPMV Image input inference failed (#22813)

2025-08-13 09:41:41 -07:00