5 Commits

Author	SHA1	Message	Date
Tri Dao	a86442f0f3	[Gen] Use flash_attn_with_kvcache in generation	2023-09-07 08:24:43 -07:00
Tri Dao	9795159082	[Rotary] Set device before launching Triton kernel to avoid error	2023-09-05 21:29:03 -07:00
Tri Dao	913922cac5	[Gen] Refactor decoding function	2023-09-04 17:01:38 -07:00
Tri Dao	798858f9f1	Fix test_baichuan	2023-09-03 21:01:37 -07:00
GAOXinyu	a8c35b4f57	FEAT: add codes which supporting for baichuan-inc/Baichuan-7B (#425)	2023-08-21 11:05:06 -07:00