5 Commits

Author	SHA1	Message	Date
Chirag Jain	50896ec574	Make nvcc threads configurable via environment variable (#885)	2024-03-13 20:46:57 -07:00
Tri Dao	dc08ea1c33	Support H100 for other CUDA extensions	2023-03-15 16:59:27 -07:00
Tri Dao	e45a46a5b7	[Rotary] Implement GPT-J style (interleaved) rotary	2023-03-14 14:35:53 -07:00
Tri Dao	1e712ea8b0	Implement TensorParallel for MHA	2022-12-25 11:39:55 -08:00
Tri Dao	ca81f32e04	Implement rotary embedding in CUDA	2022-11-04 22:42:01 -07:00