vllm/vllm/engine
Travis Johnson 3f8d42c81f
Pipeline Parallel: Guard for KeyErrors at request abort (#6587)
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
2024-07-19 19:18:19 -07:00
..
output_processor Pipeline Parallel: Guard for KeyErrors at request abort (#6587) 2024-07-19 19:18:19 -07:00
__init__.py Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00
arg_utils.py [Core] Allow specifying custom Executor (#6557) 2024-07-20 01:25:06 +00:00
async_llm_engine.py Pipeline Parallel: Guard for KeyErrors at request abort (#6587) 2024-07-19 19:18:19 -07:00
async_timeout.py [Bugfix] AsyncLLMEngine hangs with asyncio.run (#5654) 2024-06-19 13:57:12 -07:00
llm_engine.py [Core] Allow specifying custom Executor (#6557) 2024-07-20 01:25:06 +00:00
metrics.py [Bugfix] Fix Ray Metrics API usage (#6354) 2024-07-17 19:40:10 +00:00