Antoni Baum 9b945daaf1 [Experimental] Add multi-LoRA support (#1804) ... Co-authored-by: Chen Shen <scv119@gmail.com> Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com> Co-authored-by: Avnish Narayan <avnish@anyscale.com>		2024-01-23 15:26:37 -08:00
..
attention	[FIX] Support non-zero CUDA devices in custom kernels (#1959)	2024-01-02 19:09:59 -08:00
punica	[Experimental] Add multi-LoRA support (#1804)	2024-01-23 15:26:37 -08:00
quantization	Enable CUDA graph for GPTQ & SqueezeLLM (#2318)	2024-01-03 09:52:29 -08:00
activation_kernels.cu	[FIX] Support non-zero CUDA devices in custom kernels (#1959)	2024-01-02 19:09:59 -08:00
cache_kernels.cu	[FIX] Support non-zero CUDA devices in custom kernels (#1959)	2024-01-02 19:09:59 -08:00
cache.h	Avoid multiple redefinition (#1817)	2023-12-14 09:35:58 -08:00
cuda_compat.h	Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)	2023-12-07 23:16:52 -08:00
cuda_utils_kernels.cu	Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)	2023-12-07 23:16:52 -08:00
cuda_utils.h	Avoid multiple redefinition (#1817)	2023-12-14 09:35:58 -08:00
dispatch_utils.h	Avoid multiple redefinition (#1817)	2023-12-14 09:35:58 -08:00
layernorm_kernels.cu	[FIX] Support non-zero CUDA devices in custom kernels (#1959)	2024-01-02 19:09:59 -08:00
ops.h	Add GPTQ support (#916)	2023-12-15 03:04:22 -08:00
pos_encoding_kernels.cu	[FIX] Support non-zero CUDA devices in custom kernels (#1959)	2024-01-02 19:09:59 -08:00
pybind.cpp	Add GPTQ support (#916)	2023-12-15 03:04:22 -08:00
reduction_utils.cuh	Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)	2023-12-07 23:16:52 -08:00