4 Commits

Author	SHA1	Message	Date
Tri Dao	3f7d5786ba	Pass alibi slopes to flash_attn_with_kvcache during generation	2023-12-24 20:31:59 -08:00
Tri Dao	2c7d7b7396	Implement norm head for Baichuan2	2023-12-22 16:55:40 -08:00
Tri Dao	c3b2196652	Add Alibi to MHA, test with Baichuan-13B	2023-12-21 22:49:55 -08:00
GAOXinyu	a8c35b4f57	FEAT: add codes which supporting for baichuan-inc/Baichuan-7B (#425)	2023-08-21 11:05:06 -07:00