This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
2298e69b5f
vllm
/
tests
/
compile
/
piecewise
/
piecewise_compilation_config.json
5 lines
110 B
JSON
Raw
Normal View
History
Unescape
Escape
[torch.compile] rework compile control with piecewise cudagraph (#9715) Signed-off-by: youkaichao <youkaichao@gmail.com>
2024-10-30 14:03:49 +08:00
{
"use_cudagraph"
:
true
,
[v1][torch.compile] support managing cudagraph buffer (#10203) Signed-off-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
2024-11-12 03:10:27 +08:00
"non_cudagraph_ops"
:
[
"silly.attention"
]
,
"cudagraph_copy_inputs"
:
true
[torch.compile] rework compile control with piecewise cudagraph (#9715) Signed-off-by: youkaichao <youkaichao@gmail.com>
2024-10-30 14:03:49 +08:00
}
Reference in New Issue
Copy Permalink