flash-attention/flash_attn/modules
2023-08-10 00:04:38 -07:00
..
__init__.py Add __init__.py files to subdirectories for installation 2022-11-17 16:55:44 -08:00
block.py [MLP] Add ParallelMLP 2023-07-22 23:45:51 -07:00
embedding.py Reorder LN in Block, support OPT 2023-01-15 22:14:31 -08:00
mha.py [MHA] Implement MQA/GQA 2023-07-23 00:06:58 -07:00
mlp.py [MLP] Change the check for out_features being None 2023-08-10 00:04:38 -07:00