vllm/csrc/quantization/cutlass_w8a8
Varun Sundar Rabindranath 93548eb37e
[Kernel] Enable FP8 Cutlass for Ada Lovelace (#6950)
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
2024-07-31 14:40:22 -07:00
..
broadcast_load_epilogue_c2x.hpp [Kernel] Refactor CUTLASS kernels to always take scales that reside on the GPU (#5137) 2024-06-01 06:45:32 +00:00
broadcast_load_epilogue_c3x.hpp [Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (#6852) 2024-07-27 02:27:44 +00:00
common.hpp [BugFix] [Kernel] Add Cutlass2x fallback kernels (#5744) 2024-06-23 21:07:11 +00:00
scaled_mm_c2x_sm80_dispatch.cuh [Kernel] Tuned FP8 Kernels for Ada Lovelace (#6677) 2024-07-29 09:42:35 -06:00
scaled_mm_c2x_sm89_fp8_dispatch.cuh [Kernel] Tuned int8 kernels for Ada Lovelace (#6848) 2024-07-29 20:24:58 -06:00
scaled_mm_c2x_sm89_int8_dispatch.cuh [Kernel] Tuned int8 kernels for Ada Lovelace (#6848) 2024-07-29 20:24:58 -06:00
scaled_mm_c2x.cu [Kernel] Tuned int8 kernels for Ada Lovelace (#6848) 2024-07-29 20:24:58 -06:00
scaled_mm_c2x.cuh [Kernel] Tuned FP8 Kernels for Ada Lovelace (#6677) 2024-07-29 09:42:35 -06:00
scaled_mm_c3x.cu [Bugfix] Fix compute datatype for cutlass 3.x epilogues (#5931) 2024-06-28 17:10:34 +00:00
scaled_mm_entry.cu [Kernel] Enable FP8 Cutlass for Ada Lovelace (#6950) 2024-07-31 14:40:22 -07:00