3 Commits

Author	SHA1	Message	Date
Philipp Moritz	51a08e7d8f	[Kernel] Re-tune Mixtral MoE configurations for FP8 on H100 (#5238)	2024-06-05 10:59:14 -07:00
Woosuk Kwon	27208be66e	[Kernel] Add back batch size 1536 and 3072 to MoE tuning (#5242)	2024-06-04 09:58:47 -07:00
Woosuk Kwon	3a434b07ed	[Kernel] Enhance MoE benchmarking & tuning script (#4921)	2024-06-03 20:06:59 -07:00