This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
a64e7b9407
vllm
/
csrc
/
quantization
History
Lucas Wilkinson
a64e7b9407
[Bugfix] Machete garbage results for some models (large K dim) (
#9212
)
2024-10-10 14:16:17 +08:00
..
aqlm
[Kernel] fix types used in aqlm and ggml kernels to support dynamo (
#7596
)
2024-08-16 14:00:11 -07:00
awq
[CI/Build] Suppress divide-by-zero and missing return statement warnings (
#7001
)
2024-08-05 16:00:01 -04:00
compressed_tensors
[Kernel] AQ AZP 3/4: Asymmetric quantization kernels (
#7270
)
2024-09-16 11:52:40 -07:00
cutlass_w8a8
[CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (
#8845
)
2024-10-03 22:55:25 -04:00
fp8
[CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (
#8845
)
2024-10-03 22:55:25 -04:00
gguf
[Bugfix][Kernel] Fix build for sm_60 in GGUF kernel (
#8506
)
2024-09-16 12:15:57 -06:00
gptq
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00
gptq_marlin
[Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (
#8973
)
2024-10-04 12:34:44 -06:00
machete
[Bugfix] Machete garbage results for some models (large K dim) (
#9212
)
2024-10-10 14:16:17 +08:00
marlin
[CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (
#8845
)
2024-10-03 22:55:25 -04:00