This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
flash-attention
Watch
1
Star
0
Fork
0
You've already forked flash-attention
Code
Issues
Pull Requests
Actions
Packages
Projects
Releases
Wiki
Activity
1ec09ebd90
flash-attention
/
flash_attn
/
modules
History
Tri Dao
65b4064b2a
[FusedDense] Kick off input all_gather before weight dtype conversion
2022-12-31 22:47:34 -08:00
..
__init__.py
Add __init__.py files to subdirectories for installation
2022-11-17 16:55:44 -08:00
block.py
Implement Tensor Parallel for transformer Block
2022-12-25 14:08:21 -08:00
embedding.py
Implement Tensor Parallel for GPT2Embeddings
2022-12-25 14:29:53 -08:00
mha.py
[FusedDense] Kick off input all_gather before weight dtype conversion
2022-12-31 22:47:34 -08:00
mlp.py
Implement TensorParallel for FusedDense and FusedDenseGeluDense
2022-12-24 11:48:56 -08:00