vllm/csrc/quantization/cutlass_w8a8
Varun Sundar Rabindranath 766435e660
[Kernel] Tuned FP8 Kernels for Ada Lovelace (#6677)
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
2024-07-29 09:42:35 -06:00
..
broadcast_load_epilogue_c2x.hpp [Kernel] Refactor CUTLASS kernels to always take scales that reside on the GPU (#5137) 2024-06-01 06:45:32 +00:00
broadcast_load_epilogue_c3x.hpp [Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (#6852) 2024-07-27 02:27:44 +00:00
common.hpp [BugFix] [Kernel] Add Cutlass2x fallback kernels (#5744) 2024-06-23 21:07:11 +00:00
scaled_mm_c2x_sm80_dispatch.cuh [Kernel] Tuned FP8 Kernels for Ada Lovelace (#6677) 2024-07-29 09:42:35 -06:00
scaled_mm_c2x_sm89_dispatch.cuh [Kernel] Tuned FP8 Kernels for Ada Lovelace (#6677) 2024-07-29 09:42:35 -06:00
scaled_mm_c2x.cu [Kernel] Tuned FP8 Kernels for Ada Lovelace (#6677) 2024-07-29 09:42:35 -06:00
scaled_mm_c2x.cuh [Kernel] Tuned FP8 Kernels for Ada Lovelace (#6677) 2024-07-29 09:42:35 -06:00
scaled_mm_c3x.cu [Bugfix] Fix compute datatype for cutlass 3.x epilogues (#5931) 2024-06-28 17:10:34 +00:00
scaled_mm_entry.cu [Kernel] Turn off CUTLASS scaled_mm for Ada Lovelace (#6384) 2024-07-14 13:37:19 +00:00