squall/flash-attention
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6f6e9a9aaf
flash-attention/flash_attn/ops
History
Tri Dao 6f6e9a9aaf [FusedDense] Enable sqrelu activation in FusedMLP
2023-04-13 15:29:32 -07:00
..
triton [FusedDense] Enable sqrelu activation in FusedMLP 2023-04-13 15:29:32 -07:00
__init__.py Add __init__.py files to subdirectories for installation 2022-11-17 16:55:44 -08:00
activations.py [FusedDense] Enable sqrelu activation in FusedMLP 2023-04-13 15:29:32 -07:00
fused_dense.py [FusedDense] Enable sqrelu activation in FusedMLP 2023-04-13 15:29:32 -07:00
layer_norm.py [LayerNorm] Implement LN with parallel residual, support dim 8k 2023-03-31 14:23:45 -07:00
rms_norm.py [LayerNorm] Implement LN with parallel residual, support dim 8k 2023-03-31 14:23:45 -07:00