flash-attention/csrc
2023-08-16 23:41:36 -07:00
..
cutlass@6f47420213 Update to Cutlass 3.1 2023-08-13 13:53:17 -07:00
flash_attn [FusedDense] Run black on fused_dense.py 2023-08-16 23:41:36 -07:00
ft_attention [FT] Implement MQA/GQA 2023-07-22 23:47:01 -07:00
fused_dense_lib [FusedDense] Allocate lt_workspace on input device 2023-05-30 14:17:26 -07:00
fused_softmax Add Megatron attention implementation for benchmarking 2022-10-23 23:04:16 -07:00
layer_norm Fix random state for dropout_layer_norm (#315) 2023-07-23 15:05:13 -07:00
rotary Support H100 for other CUDA extensions 2023-03-15 16:59:27 -07:00
xentropy Support H100 for other CUDA extensions 2023-03-15 16:59:27 -07:00