5 Commits

Author	SHA1	Message	Date
Tri Dao	78b7a1dc18	[OPT] Load fp16 weights on CPU before moving to GPU	2023-01-22 17:01:32 -08:00
Tri Dao	f68d41ec77	[Gen] Add OPT to generation test	2023-01-17 19:59:06 -08:00
Tri Dao	7c2191542a	[Gen] Make generation work with Tensor Parallel	2023-01-15 11:34:27 -08:00
Tri Dao	11be742aa3	[Gen] Test generation with rotary embedding	2023-01-07 14:37:54 -08:00
Tri Dao	c6ecd40a59	Tweak CrossEntropyLoss to take process_group in init	2022-12-27 10:47:43 -08:00