Gregory Shtrasberg e97f802b2d [FP8][Kernel] Dynamic kv cache scaling factors computation (#11906) ...

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

2025-01-23 18:04:03 +00:00

..

attention_dtypes.h

…

attention_generic.cuh

…

attention_kernels.cuh

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

attention_utils.cuh

…

dtype_bfloat16.cuh

…

dtype_float16.cuh

…

dtype_float32.cuh

…

dtype_fp8.cuh

…

paged_attention_v1.cu

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00

paged_attention_v2.cu

[FP8][Kernel] Dynamic kv cache scaling factors computation (#11906)

2025-01-23 18:04:03 +00:00