3 Commits

Author	SHA1	Message	Date
Tri Dao	e45a46a5b7	[Rotary] Implement GPT-J style (interleaved) rotary	2023-03-14 14:35:53 -07:00
Tri Dao	1e712ea8b0	Implement TensorParallel for MHA	2022-12-25 11:39:55 -08:00
Tri Dao	ca81f32e04	Implement rotary embedding in CUDA	2022-11-04 22:42:01 -07:00