This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
5c6c54d67a
vllm
/
csrc
/
quantization
History
Luka Govedič
8d59dbb000
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
...
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
2024-08-06 18:17:08 +00:00
..
aqlm
[Kernel] Squash a few more warnings (
#6914
)
2024-07-30 13:50:42 -04:00
awq
[CI/Build] Suppress divide-by-zero and missing return statement warnings (
#7001
)
2024-08-05 16:00:01 -04:00
compressed_tensors
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00
cutlass_w8a8
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
2024-08-06 18:17:08 +00:00
fp8
[CI/Build] Suppress divide-by-zero and missing return statement warnings (
#7001
)
2024-08-05 16:00:01 -04:00
gguf
[Core] Support loading GGUF model (
#5191
)
2024-08-05 17:54:23 -06:00
gptq
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00
gptq_marlin
[CI/Build] Suppress divide-by-zero and missing return statement warnings (
#7001
)
2024-08-05 16:00:01 -04:00
marlin
[Misc] Disambiguate quantized types via a new ScalarType (
#6396
)
2024-08-02 13:51:58 -07:00
squeezellm
[Kernel] Squash a few more warnings (
#6914
)
2024-07-30 13:50:42 -04:00