zhaoyang-star 9090bf02e7 Support FP8-E5M2 KV Cache (#2279) ... Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn> Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>		2024-01-28 16:43:54 -08:00
..
awq	AWQ: Up to 2.66x higher throughput (#2566)	2024-01-26 23:53:17 -08:00
fp8_e5m2_kvcache	Support FP8-E5M2 KV Cache (#2279)	2024-01-28 16:43:54 -08:00
gptq	Enable CUDA graph for GPTQ & SqueezeLLM (#2318)	2024-01-03 09:52:29 -08:00
squeezellm	Enable CUDA graph for GPTQ & SqueezeLLM (#2318)	2024-01-03 09:52:29 -08:00