squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
260d119e86
vllm/csrc/punica/bgmv
History
raywanb 97b030005c
[Model] LoRA gptbigcode implementation (#3949)
2024-05-22 13:58:59 -07:00
..
bgmv_bf16_bf16_bf16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_bf16_fp32_bf16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_config.h [Model] LoRA gptbigcode implementation (#3949) 2024-05-22 13:58:59 -07:00
bgmv_fp16_fp16_fp16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_fp16_fp32_fp16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_fp32_bf16_bf16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_fp32_fp16_fp16.cu [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
bgmv_impl.cuh [ROCm] Add support for Punica kernels on AMD GPUs (#3140) 2024-05-09 09:19:50 -07:00
generator.py [Kernel] Full Tensor Parallelism for LoRA Layers (#3524) 2024-04-27 00:03:48 -07:00
vec_dtypes.cuh [ROCm] Add support for Punica kernels on AMD GPUs (#3140) 2024-05-09 09:19:50 -07:00