CHU Tianxiang 980dd4a2c4 Fix overflow in awq kernel (#1295) ... Co-authored-by: 楚天翔 <tianxiang.ctx@alibaba-inc.com>		2023-10-11 00:19:53 -07:00
..
attention	Fix boundary check in paged attention kernel (#1241)	2023-10-01 11:35:06 -07:00
quantization/awq	Fix overflow in awq kernel (#1295)	2023-10-11 00:19:53 -07:00
activation_kernels.cu	Avoid compiling kernels for double data type (#933)	2023-09-02 14:59:47 +09:00
activation.cpp	Implement approximate GELU kernels (#828)	2023-08-23 07:43:21 +09:00
attention.cpp	Optimize MQA Kernel (#452)	2023-07-14 20:06:40 -04:00
cache_kernels.cu	Avoid compiling kernels for double data type (#933)	2023-09-02 14:59:47 +09:00
cache.cpp	Memcpy kernel for flash attention (#29)	2023-04-10 18:22:49 -07:00
cuda_utils_kernels.cu	Allocate more shared memory to attention kernel (#1154)	2023-09-26 22:27:13 -07:00
cuda_utils.cpp	Allocate more shared memory to attention kernel (#1154)	2023-09-26 22:27:13 -07:00
dispatch_utils.h	Avoid compiling kernels for double data type (#933)	2023-09-02 14:59:47 +09:00
layernorm_kernels.cu	Avoid compiling kernels for double data type (#933)	2023-09-02 14:59:47 +09:00
layernorm.cpp	Add custom kernel for RMS normalization (#16)	2023-04-01 00:51:22 +08:00
pos_encoding_kernels.cu	[BugFix] Implement RoPE for GPT-J (#941)	2023-09-06 11:54:33 +09:00
pos_encoding.cpp	[BugFix] Implement RoPE for GPT-J (#941)	2023-09-06 11:54:33 +09:00
quantization.cpp	Implement AWQ quantization support for LLaMA (#1032)	2023-09-16 00:03:37 -07:00
reduction_utils.cuh	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00