This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
75acdaa4b6
vllm
/
csrc
/
quantization
History
Alexander Matveev
75acdaa4b6
[Kernel] Increase precision of GPTQ/AWQ Marlin kernel (
#6795
)
2024-07-27 17:52:33 -04:00
..
aqlm
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00
awq
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00
compressed_tensors
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00
cutlass_w8a8
[Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (
#6852
)
2024-07-27 02:27:44 +00:00
fp8
[Bugfix][Kernel] Promote another index to int64_t (
#6838
)
2024-07-26 18:41:04 +00:00
gptq
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00
gptq_marlin
[Kernel] Increase precision of GPTQ/AWQ Marlin kernel (
#6795
)
2024-07-27 17:52:33 -04:00
marlin
[Kernel][Core] Add AWQ support to the Marlin kernel (
#6612
)
2024-07-21 19:41:42 -04:00
squeezellm
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00