squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
85dc92fc98
vllm/csrc/moe/marlin_kernels
History
ElizaWszola 05d686432f
[Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 
Co-authored-by: Dipika <dipikasikka1@gmail.com>
Co-authored-by: Dipika Sikka <ds3822@columbia.edu>
2024-10-04 12:34:44 -06:00
..
marlin_moe_kernel_ku4.cu [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00
marlin_moe_kernel_ku4.h [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00
marlin_moe_kernel_ku4b8.cu [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00
marlin_moe_kernel_ku4b8.h [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00
marlin_moe_kernel_ku8b128.cu [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00
marlin_moe_kernel_ku8b128.h [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00
marlin_moe_kernel.h [Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973) 2024-10-04 12:34:44 -06:00