5 Commits

Author	SHA1	Message	Date
Tri Dao	88173a1aaf	[FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP	2023-01-17 18:12:27 -08:00
Tri Dao	43798966cf	[Docs] Fix formatting	2022-12-30 00:01:55 -08:00
Tri Dao	3c7cbfc195	[Docs] Mention that dropout_layer_norm supports all dims up to 6k	2022-12-29 23:55:33 -08:00
Tri Dao	4a6eaa9f27	Update configs, add results	2022-11-29 04:46:43 -08:00
Tri Dao	0bf5e50038	Release training code	2022-11-28 17:34:40 -08:00