4 Commits

Author	SHA1	Message	Date
Tri Dao	942fcbf046	[Rotary] Implement rotary in Triton	2023-09-03 02:51:58 -07:00
Tri Dao	0e8c46ae08	Run isort and black on test files	2023-08-18 20:59:35 -07:00
Tri Dao	d4b320b31f	Add MLP, MHA, Block, Embedding modules	2022-11-13 22:06:44 -08:00
Tri Dao	ca81f32e04	Implement rotary embedding in CUDA	2022-11-04 22:42:01 -07:00