flash-attention/flash_attn/modules
2023-01-02 08:47:48 -08:00
..
__init__.py Add __init__.py files to subdirectories for installation 2022-11-17 16:55:44 -08:00
block.py Implement Tensor Parallel for transformer Block 2022-12-25 14:08:21 -08:00
embedding.py [TP] Put parallel embeddings in separate modules 2023-01-02 08:47:48 -08:00
mha.py [FusedDense] Kick off input all_gather before weight dtype conversion 2022-12-31 22:47:34 -08:00
mlp.py Implement TensorParallel for FusedDense and FusedDenseGeluDense 2022-12-24 11:48:56 -08:00