Tri Dao c422fee377 Get rid of o_rows_are_valid since we don't have headdim=16 anymore		2022-10-24 17:29:36 -07:00
..
flash_attn	Get rid of o_rows_are_valid since we don't have headdim=16 anymore	2022-10-24 17:29:36 -07:00
fused_softmax	Add Megatron attention implementation for benchmarking	2022-10-23 23:04:16 -07:00