squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6cc7342575
flash-attention/flash_attn
History
Tri Dao 6cc7342575 Support index_first_axis with more than 2 dimensions
2022-08-05 09:48:16 -07:00
..
__init__.py Add missing __init__.py 2022-07-03 02:04:55 -04:00
bert_padding.py Support index_first_axis with more than 2 dimensions 2022-08-05 09:48:16 -07:00
flash_attention.py Allow headdim 128 in FlashMHA interface 2022-08-05 09:47:22 -07:00
flash_attn_interface.py Do P * dP (pointwise) in the bwd in fp32 instead of fp16 2022-07-03 17:52:05 -07:00
flash_blocksparse_attention.py Rename src -> flash_attn 2022-06-01 18:50:26 -07:00
flash_blocksparse_attn_interface.py Rename src -> flash_attn 2022-06-01 18:50:26 -07:00
rotary.py Rename src -> flash_attn 2022-06-01 18:50:26 -07:00