Woosuk Kwon
|
ee88a7e5f3
|
Add an option to use dummy model weights (#33)
|
2023-04-08 23:36:12 -07:00 |
|
Woosuk Kwon
|
c267b1a02c
|
Add query stride to multi_query_cached_kv_attention & Add kernel benchmark script (#27)
* Add query stride to multi_query_cached_kv_attention
* Add kernel benchmark script
|
2023-04-08 13:36:09 -07:00 |
|
Woosuk Kwon
|
0f40557af6
|
Implement block copy kernel to optimize beam search (#32)
|
2023-04-07 17:45:07 -07:00 |
|
Woosuk Kwon
|
12659a0bd7
|
Add CUDA graph-based all reduce launcher (#26)
|
2023-04-05 11:16:57 -07:00 |
|
Zhuohan Li
|
c45f3c3ab6
|
Optimize tensor parallel execution speed (#17)
|
2023-04-01 00:51:08 +08:00 |
|