Tri Dao b630aef53f Implement GatedMlp		2023-04-18 03:37:14 -07:00
..
__init__.py	Add __init__.py files to subdirectories for installation	2022-11-17 16:55:44 -08:00
block.py	[LayerNorm] Implement LN with parallel residual, support dim 8k	2023-03-31 14:23:45 -07:00
embedding.py	Reorder LN in Block, support OPT	2023-01-15 22:14:31 -08:00
mha.py	Have a separate nn.Dropout module in SelfAttention module	2023-04-17 22:34:05 -07:00
mlp.py	Implement GatedMlp	2023-04-18 03:37:14 -07:00