vllm/benchmarks/kernels
SnowDist a22dea54d3
[Model] Support MAP-NEO model (#5081)
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
2024-05-30 19:24:41 -07:00
..
benchmark_aqlm.py [Core]refactor aqlm quant ops (#4351) 2024-04-25 15:03:56 -04:00
benchmark_marlin.py Marlin 24 prefill performance improvement (about 25% better on average) (#4983) 2024-05-23 02:39:27 -04:00
benchmark_mixtral_moe.py [Kernel] Update fused_moe tuning script for FP8 (#4457) 2024-05-01 11:47:38 -07:00
benchmark_paged_attention.py [Model] Support MAP-NEO model (#5081) 2024-05-30 19:24:41 -07:00
benchmark_rope.py [Model] Support MAP-NEO model (#5081) 2024-05-30 19:24:41 -07:00
benchmark_shapes.py Add marlin unit tests and marlin benchmark script (#4815) 2024-05-16 09:36:49 -04:00