squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
0842ec0da4
flash-attention/flash_attn/modules
History
Tri Dao c3b2196652 Add Alibi to MHA, test with Baichuan-13B
2023-12-21 22:49:55 -08:00
..
__init__.py Add __init__.py files to subdirectories for installation 2022-11-17 16:55:44 -08:00
block.py Run isort and black on python files 2023-08-18 14:22:11 -07:00
embedding.py Run isort and black on python files 2023-08-18 14:22:11 -07:00
mha.py Add Alibi to MHA, test with Baichuan-13B 2023-12-21 22:49:55 -08:00
mlp.py Add Alibi to MHA, test with Baichuan-13B 2023-12-21 22:49:55 -08:00