squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
ed553e9238
flash-attention/csrc
History
Tri Dao ed553e9238 Add Megatron attention implementation for benchmarking
2022-10-23 23:04:16 -07:00
..
flash_attn Attempt to use atomicCAS to replace atomicAdd(bfloat16) 2022-10-23 16:22:43 -07:00
fused_softmax Add Megatron attention implementation for benchmarking 2022-10-23 23:04:16 -07:00