vllm/csrc/punica/bgmv
Joe Runde ba4994443a
[Kernel] Add punica dimensions for Granite 3b and 8b (#5930)
Signed-off-by: Joe Runde <joe@joerun.de>
2024-06-29 10:48:25 +08:00
..
bgmv_bf16_bf16_bf16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_bf16_fp32_bf16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_config.h [Kernel] Add punica dimensions for Granite 3b and 8b (#5930) 2024-06-29 10:48:25 +08:00
bgmv_fp16_fp16_fp16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_fp16_fp32_fp16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_fp32_bf16_bf16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_fp32_fp16_fp16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_impl.cuh [ROCm] Add support for Punica kernels on AMD GPUs (#3140) 2024-05-09 09:19:50 -07:00
generator.py [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
vec_dtypes.cuh [ROCm] Add support for Punica kernels on AMD GPUs (#3140) 2024-05-09 09:19:50 -07:00