Thomas Parnell 4ef95b0f06 [Bugfix] use float32 precision in samplers/test_logprobs.py for comparing with HF (#6409) ...

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

2024-07-15 13:14:49 -04:00

..

backends

[Bugfix][TPU] Fix megacore setting for v5e-litepod (#6397)

2024-07-12 15:59:47 -07:00

ops

[Bugfix] use float32 precision in samplers/test_logprobs.py for comparing with HF (#6409)

2024-07-15 13:14:49 -04:00

__init__.py

[Core][2/N] Model runner refactoring part 2. Combine prepare prefill / decode to a single API (#4681)

2024-05-15 14:00:10 +09:00

layer.py

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)

2024-07-08 17:12:15 +00:00

selector.py

[Misc] Remove flashinfer warning, add flashinfer tests to CI (#6351)

2024-07-12 01:32:06 +00:00