Luka Govedič 5e4e0e51f4 [torch.compile] Compile CustomOp.forward_native for SiluAndMul and QuantFP8 to avoid raw torch ops inside opaque custom ops (#32806) ...

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

2026-01-22 19:52:26 -08:00

..

__init__.py

[Misc][BE] Type coverage for vllm/compilation [3/3] (#31748)

2026-01-12 19:24:38 +00:00

base.py

[Doc] Add developer guide for CustomOp (#30886)

2026-01-09 16:21:11 +00:00

common.py

[torch.compile] Compile CustomOp.forward_native for SiluAndMul and QuantFP8 to avoid raw torch ops inside opaque custom ops (#32806)

2026-01-22 19:52:26 -08:00

deepseek_scaling_rope.py

[Perf] enable flashinfer rotary_embedding custom ops in DeepSeek rotary (#30729)

2025-12-18 14:31:18 -05:00

dual_chunk_rope.py

[Doc] Add developer guide for CustomOp (#30886)

2026-01-09 16:21:11 +00:00

dynamic_ntk_alpha_rope.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

dynamic_ntk_scaling_rope.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

ernie45_vl_rope.py

[CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873)

2025-12-15 19:08:16 -08:00

linear_scaling_rope.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

llama3_rope.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

llama4_vision_rope.py

[Misc][LLaMa4] Compile LLaMa Vision Encoder (#30709)

2026-01-09 22:01:38 -05:00

mrope.py

[CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873)

2025-12-15 19:08:16 -08:00

ntk_scaling_rope.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

phi3_long_rope_scaled_rope.py

[Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431)

2025-10-28 12:00:56 +00:00

xdrope.py

[CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873)

2025-12-15 19:08:16 -08:00

yarn_scaling_rope.py

Add truncate arg to yarn to match openai implementation of gpt-oss (#28244)

2025-11-20 18:53:50 +08:00