This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
23f322297f
vllm
/
csrc
/
quantization
History
Dipika Sikka
23f322297f
[Misc] Remove
SqueezeLLM
(
#8220
)
2024-09-06 16:29:03 -06:00
..
aqlm
[Kernel] fix types used in aqlm and ggml kernels to support dynamo (
#7596
)
2024-08-16 14:00:11 -07:00
awq
[CI/Build] Suppress divide-by-zero and missing return statement warnings (
#7001
)
2024-08-05 16:00:01 -04:00
compressed_tensors
[Kernel] Replaced
blockReduce[...]
functions with
cub::BlockReduce
(
#7233
)
2024-08-21 20:18:00 -04:00
cutlass_w8a8
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
2024-08-06 18:17:08 +00:00
fp8
[Kernel] Replaced
blockReduce[...]
functions with
cub::BlockReduce
(
#7233
)
2024-08-21 20:18:00 -04:00
gguf
[Kernel] fix types used in aqlm and ggml kernels to support dynamo (
#7596
)
2024-08-16 14:00:11 -07:00
gptq
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00
gptq_marlin
[Misc] Use scalar type to dispatch to different
gptq_marlin
kernels (
#7323
)
2024-08-12 14:40:13 -04:00
machete
[Bugfix] Don't build machete on cuda <12.0 (
#7757
)
2024-08-22 08:28:52 -04:00
marlin
[Misc] Disambiguate quantized types via a new ScalarType (
#6396
)
2024-08-02 13:51:58 -07:00