squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
c3fab5f769
vllm/csrc/moe
History
ElizaWszola 05d686432f
[Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 
Co-authored-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Dipika Sikka <ds3822@columbia.edu>
2024-10-04 12:34:44 -06:00
..
marlin_kernels [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00
marlin_moe_ops.cu [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00
moe_ops.h [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) 2024-06-09 16:23:30 -04:00
topk_softmax_kernels.cu [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) 2024-06-09 16:23:30 -04:00
torch_bindings.cpp [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00