vllm/csrc/quantization
2024-05-20 14:55:34 +00:00
..
aqlm AQLM CUDA support (#3287) 2024-04-23 13:59:33 -04:00
awq Refactor 2 awq gemm kernels into m16nXk32 (#2723) 2024-02-12 11:02:17 -08:00
cutlass_w8a8 [Kernel] Add w8a8 CUTLASS kernels (#4749) 2024-05-16 18:32:50 -04:00
fp8 [Kernel] Refactor FP8 kv-cache with NVIDIA float8_e4m3 support (#4535) 2024-05-09 18:04:17 -06:00
gptq [Core] Set linear_weights directly on the layer (#3977) 2024-04-11 16:35:51 -04:00
gptq_marlin Remove marlin warning (#4918) 2024-05-20 14:55:34 +00:00
marlin Add GPTQ Marlin 2:4 sparse structured support (#4790) 2024-05-16 12:56:15 -04:00
squeezellm Enable CUDA graph for GPTQ & SqueezeLLM (#2318) 2024-01-03 09:52:29 -08:00