Alexander Ploshkin c7c66976cc fix slicing dimensions		2022-12-16 15:39:06 +04:00
..
layers	fix slicing dimensions	2022-12-16 15:39:06 +04:00
losses	Bump version to 0.2.1	2022-11-20 22:35:59 -08:00
models	[ViT] Use dropout_add_ln for the 1st layer norm	2022-11-23 12:48:56 -08:00
modules	[ViT] Use dropout_add_ln for the 1st layer norm	2022-11-23 12:48:56 -08:00
ops	[LayerNorm] Support taking subset of input or subset of output	2022-12-12 22:16:14 -08:00
utils	Add __init__.py files to subdirectories for installation	2022-11-17 16:55:44 -08:00
__init__.py	Add missing __init__.py	2022-07-03 02:04:55 -04:00
bert_padding.py	remove numpy dependency	2022-10-06 19:17:15 +02:00
flash_attention.py	Remove RotaryEmbedding from FlashAttention module	2022-11-10 11:54:36 -08:00
flash_attn_interface.py	Fix the case when dout is not contiguous	2022-12-13 13:58:17 -08:00
flash_attn_triton_og.py	Implement FlashAttention in Triton	2022-10-30 18:09:11 -07:00
flash_attn_triton.py	[Triton] Avoid einops repeat by using Tensor.expand	2022-12-14 14:48:41 -08:00
flash_blocksparse_attention.py	Rename src -> flash_attn	2022-06-01 18:50:26 -07:00
flash_blocksparse_attn_interface.py	Rename src -> flash_attn	2022-06-01 18:50:26 -07:00
fused_softmax.py	Add Megatron attention implementation for benchmarking	2022-10-23 23:04:16 -07:00