flash-attention/flash_attn/modules
2023-09-19 22:20:22 -07:00
..
__init__.py Add __init__.py files to subdirectories for installation 2022-11-17 16:55:44 -08:00
block.py Run isort and black on python files 2023-08-18 14:22:11 -07:00
embedding.py Run isort and black on python files 2023-08-18 14:22:11 -07:00
mha.py [Gen] Rename max_sequence_len->max_seqlen, sequence_len_offset->seqlen_offset 2023-09-19 22:20:22 -07:00
mlp.py [MLP] Implement SwiGLU with torch jiterator 2023-09-04 15:43:53 -07:00