youkaichao 8fe8386591 [Kernel] change benchmark script so that result can be directly used; tune moe kernel in A100/H100 with tp=2,4,8 (#3389)		2024-03-14 08:11:48 +00:00
..
benchmark_mixtral_moe.py	[Kernel] change benchmark script so that result can be directly used; tune moe kernel in A100/H100 with tp=2,4,8 (#3389)	2024-03-14 08:11:48 +00:00
benchmark_paged_attention.py	Remove hardcoded device="cuda" to support more devices (#2503)	2024-02-01 15:46:39 -08:00
benchmark_rope.py	Add batched RoPE kernel (#3095)	2024-03-13 13:45:26 -07:00