Tri Dao 88173a1aaf [FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP		2023-01-17 18:12:27 -08:00
..
flash_attn	[Compilation] Change BOOL_SWITCH to fix Windows compilation	2023-01-06 14:40:58 -08:00
ft_attention	[Gen] Pass qkv_stride to ft_attention kernel for batched generation	2023-01-15 15:20:01 -08:00
fused_dense_lib	[FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP	2023-01-17 18:12:27 -08:00
fused_softmax	Add Megatron attention implementation for benchmarking	2022-10-23 23:04:16 -07:00
layer_norm	[LayerNorm] Implement RMS Norm	2023-01-06 17:34:22 -08:00
rotary	Implement TensorParallel for MHA	2022-12-25 11:39:55 -08:00
xentropy	Add smoothing for CrossEntropyParallel, rename to CrossEntropyLoss	2022-12-23 14:51:08 -08:00