vllm/csrc/moe
ElizaWszola a091e2da3e
[Kernel] Enable 8-bit weights in Fused Marlin MoE (#8032)
Co-authored-by: Dipika <dipikasikka1@gmail.com>
2024-09-16 09:47:19 -06:00
..
marlin_moe_ops.cu [Kernel] Enable 8-bit weights in Fused Marlin MoE (#8032) 2024-09-16 09:47:19 -06:00
marlin_moe_ops.h [Kernel] Enable 8-bit weights in Fused Marlin MoE (#8032) 2024-09-16 09:47:19 -06:00
moe_ops.h [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) 2024-06-09 16:23:30 -04:00
topk_softmax_kernels.cu [Kernel][Misc] Use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#5047) 2024-06-09 16:23:30 -04:00
torch_bindings.cpp [Kernel] Enable 8-bit weights in Fused Marlin MoE (#8032) 2024-09-16 09:47:19 -06:00