vllm/csrc/quantization/cutlass_w8a8
Tyler Michael Smith ccd4f129e8
[Kernel] Add GPU architecture guards to the CUTLASS w8a8 kernels to reduce binary size (#5157)
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
2024-06-05 10:44:15 -07:00
..
broadcast_load_epilogue_c2x.hpp [Kernel] Refactor CUTLASS kernels to always take scales that reside on the GPU (#5137) 2024-06-01 06:45:32 +00:00
broadcast_load_epilogue_c3x.hpp [Kernel] Refactor CUTLASS kernels to always take scales that reside on the GPU (#5137) 2024-06-01 06:45:32 +00:00
common.hpp [Kernel] Add w8a8 CUTLASS kernels (#4749) 2024-05-16 18:32:50 -04:00
scaled_mm_dq_c2x.cu [Kernel] Add GPU architecture guards to the CUTLASS w8a8 kernels to reduce binary size (#5157) 2024-06-05 10:44:15 -07:00
scaled_mm_dq_c3x.cu [Kernel] Add GPU architecture guards to the CUTLASS w8a8 kernels to reduce binary size (#5157) 2024-06-05 10:44:15 -07:00
scaled_mm_dq_entry.cu [Build] Guard against older CUDA versions when building CUTLASS 3.x kernels (#5168) 2024-05-31 17:21:38 -07:00