vllm/csrc/quantization/cutlass_w8a8
Varun Sundar Rabindranath 6c916ac8a8
[BugFix] [Kernel] Add Cutlass2x fallback kernels (#5744)
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
2024-06-23 21:07:11 +00:00
..
broadcast_load_epilogue_c2x.hpp [Kernel] Refactor CUTLASS kernels to always take scales that reside on the GPU (#5137) 2024-06-01 06:45:32 +00:00
broadcast_load_epilogue_c3x.hpp [Kernel] Fix CUTLASS 3.x custom broadcast load epilogue (#5516) 2024-06-14 09:30:15 -07:00
common.hpp [BugFix] [Kernel] Add Cutlass2x fallback kernels (#5744) 2024-06-23 21:07:11 +00:00
scaled_mm_c2x.cu [BugFix] [Kernel] Add Cutlass2x fallback kernels (#5744) 2024-06-23 21:07:11 +00:00
scaled_mm_c3x.cu [Kernel] Update Cutlass int8 kernel configs for SM80 (#5275) 2024-06-20 13:33:21 +00:00
scaled_mm_entry.cu [Bugfix] Fix the CUDA version check for FP8 support in the CUTLASS kernels (#5715) 2024-06-20 18:36:10 +00:00