330e82d34a
Signed-off-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
5 lines
110 B
JSON
5 lines
110 B
JSON
{
|
|
"use_cudagraph": true,
|
|
"non_cudagraph_ops": ["silly.attention"],
|
|
"cudagraph_copy_inputs": true
|
|
} |