This website requires JavaScript.
Explore
Help
Register
Sign In
biondizzle
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
2
Packages
Projects
Releases
Wiki
Activity
Files
52b48c1ead683ec2afe6b0396ece32d73884cd21
vllm
/
tests
/
compile
/
piecewise
/
piecewise_compilation_config.json
5 lines
110 B
JSON
Raw
Normal View
History
Unescape
Escape
[torch.compile] rework compile control with piecewise cudagraph (#9715) Signed-off-by: youkaichao <youkaichao@gmail.com>
2024-10-29 23:03:49 -07:00
{
"use_cudagraph"
:
true
,
[v1][torch.compile] support managing cudagraph buffer (#10203) Signed-off-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
2024-11-11 11:10:27 -08:00
"non_cudagraph_ops"
:
[
"silly.attention"
]
,
"cudagraph_copy_inputs"
:
true
[torch.compile] rework compile control with piecewise cudagraph (#9715) Signed-off-by: youkaichao <youkaichao@gmail.com>
2024-10-29 23:03:49 -07:00
}
Reference in New Issue
Copy Permalink