5 Commits

Author	SHA1	Message	Date
Tri Dao	0e8c46ae08	Run isort and black on test files	2023-08-18 20:59:35 -07:00
Tri Dao	88173a1aaf	[FusedDense] Support relu, rename FusedDenseGeluDense -> FusedMLP	2023-01-17 18:12:27 -08:00
Tri Dao	93383bd55b	[TP] Implement TensorParallel without sequence parallel	2023-01-07 13:45:22 -08:00
Tri Dao	ef1ba918c6	[GPT] Refactor function to shard state_dict for TensorParallel	2023-01-01 00:09:33 -08:00
Tri Dao	b4018a5028	Implement Tensor Parallel for GPT model	2022-12-26 16:22:43 -08:00