Commit Graph

2 Commits

Author SHA1 Message Date
zhaoyang-star
923797fea4
Fix compile error when using rocm (#2648) 2024-02-01 09:35:09 -08:00
zhaoyang-star
9090bf02e7
Support FP8-E5M2 KV Cache (#2279)
Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
2024-01-28 16:43:54 -08:00