4 Commits

Author	SHA1	Message	Date
Tri Dao	48bc6eacd6	[Gen] Add rotary base as an argument to FT attention kernel	2023-05-30 13:38:34 -07:00
Tri Dao	f1e01c27ba	[Gen] Pass qkv_stride to ft_attention kernel for batched generation	2023-01-15 15:20:01 -08:00
Tri Dao	7c2191542a	[Gen] Make generation work with Tensor Parallel	2023-01-15 11:34:27 -08:00
Tri Dao	a01d1213d7	[Gen] Add kernel from FasterTransformer for benchmarking	2023-01-03 17:37:43 -08:00