2 Commits

Author	SHA1	Message	Date
Ronen Schaffer	4caf7044e0	Include tokens from prompt phase in counter_generation_tokens (#2802)	2024-02-22 14:00:12 -08:00
Ronen Schaffer	e433c115bc	Fix vllm:prompt_tokens_total metric calculation (#2869)	2024-02-18 23:55:41 -08:00