4 Commits

Author	SHA1	Message	Date
Kuntai Du	6fc5b0f249	[CI] Fix crashes of performance benchmark (#7500)	2024-08-16 08:08:45 -07:00
Cade Daniel	c32ab8be1a	[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding (#6964)	2024-07-31 00:53:21 +00:00
Kuntai Du	a4feba929b	[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)	2024-07-11 13:28:38 -07:00
Kuntai Du	9e4e6fe207	[CI] the readability of benchmarking and prepare for dashboard (#5571) ... [CI] Improve the readability of performance benchmarking results and prepare for upcoming performance dashboard (#5571)	2024-06-17 11:41:08 -07:00