This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
flash-attention
Watch
1
Star
0
Fork
0
You've already forked flash-attention
Code
Issues
Pull Requests
Actions
Packages
Projects
Releases
Wiki
Activity
d0787acc16
flash-attention
/
flash_attn
/
modules
History
Markus Krimmel
6bbc532388
fix: cast the alibi slopes to torch.float32 (
#846
)
2024-03-15 00:49:40 -07:00
..
__init__.py
Add __init__.py files to subdirectories for installation
2022-11-17 16:55:44 -08:00
block.py
[LayerNorm] Switch from CUDA to Triton implementation
2024-01-05 00:31:17 -08:00
embedding.py
Run isort and black on python files
2023-08-18 14:22:11 -07:00
mha.py
fix: cast the alibi slopes to torch.float32 (
#846
)
2024-03-15 00:49:40 -07:00
mlp.py
Add Alibi to MHA, test with Baichuan-13B
2023-12-21 22:49:55 -08:00