Isotr0py 04668ebe7a [Bugfix] Avoid import AttentionMetadata explicitly in Mllama (#10593) ...

Signed-off-by: Isotr0py <2037008807@qq.com>

2024-11-23 18:12:20 +00:00

..

backends

[Bugfix] Avoid import AttentionMetadata explicitly in Mllama (#10593)

2024-11-23 18:12:20 +00:00

ops

[Hardware][CPU] Support chunked-prefill and prefix-caching on CPU (#10355)

2024-11-20 10:57:39 +00:00

__init__.py

[Core] Add AttentionState abstraction (#7663)

2024-08-20 18:50:45 +00:00

layer.py

[Bugfix] Avoid import AttentionMetadata explicitly in Mllama (#10593)

2024-11-23 18:12:20 +00:00

selector.py

[Platform][Refactor] Extract func get_default_attn_backend to Platform (#10358)

2024-11-19 11:22:26 +08:00