This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
15b86408a8
vllm
/
csrc
/
quantization
History
Antoni Baum
a10d3056da
[Core] Set
linear_weights
directly on the layer (
#3977
)
2024-04-11 16:35:51 -04:00
..
awq
Refactor 2 awq gemm kernels into m16nXk32 (
#2723
)
2024-02-12 11:02:17 -08:00
fp8
/amd_detail
Enable scaled FP8 (e4m3fn) KV cache on ROCm (AMD GPU) (
#3290
)
2024-04-03 14:15:55 -07:00
fp8_e5m2_kvcache
Fix compile error when using rocm (
#2648
)
2024-02-01 09:35:09 -08:00
gptq
[Core] Set
linear_weights
directly on the layer (
#3977
)
2024-04-11 16:35:51 -04:00
marlin
Integrate Marlin Kernels for Int4 GPTQ inference (
#2497
)
2024-03-01 12:47:51 -08:00
squeezellm
Enable CUDA graph for GPTQ & SqueezeLLM (
#2318
)
2024-01-03 09:52:29 -08:00