vllm/csrc/quantization/fp8
Luka Govedič 4f93dfe952
[torch.compile] Fuse RMSNorm with quant (#9138)
Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@126.com>
2024-11-08 21:20:08 +00:00
..
amd [Kernel] Squash a few more warnings (#6914) 2024-07-30 13:50:42 -04:00
nvidia [CI/Build] Suppress divide-by-zero and missing return statement warnings (#7001) 2024-08-05 16:00:01 -04:00
common.cu [torch.compile] Fuse RMSNorm with quant (#9138) 2024-11-08 21:20:08 +00:00
common.cuh [torch.compile] Fuse RMSNorm with quant (#9138) 2024-11-08 21:20:08 +00:00
fp8_marlin.cu [CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (#8845) 2024-10-03 22:55:25 -04:00