This website requires JavaScript.
Explore
Help
Register
Sign In
squall
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
2,881
Commits
1
Branch
0
Tags
24
MiB
e5dc713c23
Commit Graph
3 Commits
Author
SHA1
Message
Date
Michael Goin
873edda6cf
[Misc] Support FP8 MoE for compressed-tensors (
#8588
)
2024-09-25 09:43:36 -07:00
ElizaWszola
a091e2da3e
[Kernel] Enable 8-bit weights in Fused Marlin MoE (
#8032
)
...
Co-authored-by: Dipika <dipikasikka1@gmail.com>
2024-09-16 09:47:19 -06:00
Dipika Sikka
6cd5e5b07e
[Misc] Fused MoE Marlin support for GPTQ (
#8217
)
2024-09-09 23:02:52 -04:00