This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
02cc3b51a7
vllm
/
csrc
/
quantization
/
marlin
/
sparse
History
Simon Mo
e9d3aa04f6
Revert "[Kernel] Marlin_24: Ensure the mma.sp instruction is using the ::ordered_metadata modifier (introduced with PTX 8.5)" (
#5149
)
2024-05-30 22:00:26 -07:00
..
common
Revert "[Kernel] Marlin_24: Ensure the mma.sp instruction is using the ::ordered_metadata modifier (introduced with PTX 8.5)" (
#5149
)
2024-05-30 22:00:26 -07:00
LICENSE
Add GPTQ Marlin 2:4 sparse structured support (
#4790
)
2024-05-16 12:56:15 -04:00
marlin_24_cuda_kernel.cu
Marlin 24 prefill performance improvement (about 25% better on average) (
#4983
)
2024-05-23 02:39:27 -04:00