Thomas Parnell 1d7c940d74 Add option to completion API to truncate prompt tokens (#3144)		2024-04-05 10:15:42 -07:00
..
__init__.py	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00
api_server.py	[Frontend][Bugfix] allow using the default middleware with a root path (#3788)	2024-04-02 01:20:28 -07:00
cli_args.py	[Doc] Add docs about OpenAI compatible server (#3288)	2024-03-18 22:05:34 -07:00
protocol.py	Add option to completion API to truncate prompt tokens (#3144)	2024-04-05 10:15:42 -07:00
serving_chat.py	[Misc] Include matched stop string/token in responses (#2976)	2024-03-25 17:31:32 -07:00
serving_completion.py	Add option to completion API to truncate prompt tokens (#3144)	2024-04-05 10:15:42 -07:00
serving_engine.py	Add option to completion API to truncate prompt tokens (#3144)	2024-04-05 10:15:42 -07:00