vllm/csrc/quantization
2024-07-31 07:55:21 -06:00
..
aqlm [Kernel] Squash a few more warnings (#6914) 2024-07-30 13:50:42 -04:00
awq [Kernel] Remove unused variables in awq/gemm_kernels.cu (#6908) 2024-07-29 18:01:17 -06:00
compressed_tensors [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) 2024-06-09 16:23:30 -04:00
cutlass_w8a8 [Kernel] Tuned int8 kernels for Ada Lovelace (#6848) 2024-07-29 20:24:58 -06:00
fp8 [Kernel] Squash a few more warnings (#6914) 2024-07-30 13:50:42 -04:00
gptq [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) 2024-06-09 16:23:30 -04:00
gptq_marlin [Kernel] Fix marlin divide-by-zero warnings (#6904) 2024-07-30 01:26:07 +00:00
marlin Support W4A8 quantization for vllm (#5218) 2024-07-31 07:55:21 -06:00
squeezellm [Kernel] Squash a few more warnings (#6914) 2024-07-30 13:50:42 -04:00