vllm/tests/compile/piecewise/piecewise_compilation_config.json

{
    "use_cudagraph": true,
    "non_cudagraph_ops": ["silly.attention"],
    "cudagraph_copy_inputs": true
}
[torch.compile] rework compile control with piecewise cudagraph (#9715) Signed-off-by: youkaichao <youkaichao@gmail.com> 2024-10-30 14:03:49 +08:00			`{`
			`"use_cudagraph": true,`
[v1][torch.compile] support managing cudagraph buffer (#10203) Signed-off-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu> 2024-11-12 03:10:27 +08:00			`"non_cudagraph_ops": ["silly.attention"],`
			`"cudagraph_copy_inputs": true`
[torch.compile] rework compile control with piecewise cudagraph (#9715) Signed-off-by: youkaichao <youkaichao@gmail.com> 2024-10-30 14:03:49 +08:00			`}`