4 Commits

Author	SHA1	Message	Date
Woosuk Kwon	d6e4a130b0	[Minor] Remove gather_cached_kv kernel (#3043)	2024-02-26 15:00:54 -08:00
zhaoyang-star	9090bf02e7	Support FP8-E5M2 KV Cache (#2279) ... Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn> Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>	2024-01-28 16:43:54 -08:00
Mingcan Xiang	614856da25	Avoid multiple redefinition (#1817)	2023-12-14 09:35:58 -08:00
Yanming W	e0c6f556e8	[Build] Avoid building too many extensions (#1624)	2023-11-23 16:31:19 -08:00