vllm/csrc/moe
ElizaWszola a928ded995
[Kernel] Split Marlin MoE kernels into multiple files (#8661)
Co-authored-by: mgoin <michael@neuralmagic.com>
2024-09-24 09:31:42 -07:00
..
marlin_kernels [Kernel] Split Marlin MoE kernels into multiple files (#8661) 2024-09-24 09:31:42 -07:00
marlin_moe_ops.cu [Kernel] Split Marlin MoE kernels into multiple files (#8661) 2024-09-24 09:31:42 -07:00
marlin_moe_ops.h [Kernel] Enable 8-bit weights in Fused Marlin MoE (#8032) 2024-09-16 09:47:19 -06:00
moe_ops.h [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) 2024-06-09 16:23:30 -04:00
topk_softmax_kernels.cu [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) 2024-06-09 16:23:30 -04:00
torch_bindings.cpp [Kernel] Enable 8-bit weights in Fused Marlin MoE (#8032) 2024-09-16 09:47:19 -06:00