This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
73202dbe77
vllm
/
csrc
/
quantization
History
bnellnm
73202dbe77
[Kernel][Misc] register ops to prevent graph breaks (
#6917
)
...
Co-authored-by: Sage Moore <sage@neuralmagic.com>
2024-09-11 12:52:19 -07:00
..
aqlm
[Kernel] fix types used in aqlm and ggml kernels to support dynamo (
#7596
)
2024-08-16 14:00:11 -07:00
awq
[CI/Build] Suppress divide-by-zero and missing return statement warnings (
#7001
)
2024-08-05 16:00:01 -04:00
compressed_tensors
[Kernel] Replaced
blockReduce[...]
functions with
cub::BlockReduce
(
#7233
)
2024-08-21 20:18:00 -04:00
cutlass_w8a8
[Kernel] Add per-tensor and per-token AZP epilogues (
#5941
)
2024-08-06 18:17:08 +00:00
fp8
[Kernel] Replaced
blockReduce[...]
functions with
cub::BlockReduce
(
#7233
)
2024-08-21 20:18:00 -04:00
gguf
[Kernel] fix types used in aqlm and ggml kernels to support dynamo (
#7596
)
2024-08-16 14:00:11 -07:00
gptq
[Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (
#5047
)
2024-06-09 16:23:30 -04:00
gptq_marlin
[Kernel][Misc] register ops to prevent graph breaks (
#6917
)
2024-09-11 12:52:19 -07:00
machete
[Bugfix] Don't build machete on cuda <12.0 (
#7757
)
2024-08-22 08:28:52 -04:00
marlin
[Misc] Disambiguate quantized types via a new ScalarType (
#6396
)
2024-08-02 13:51:58 -07:00