squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Core] Fix invalid args to _process_request (#9201)

Browse Source 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
This commit is contained in:
Russell Bryant 2024-10-10 00:10:09 -04:00 committed by GitHub
parent d5fbb8706d
commit cf25b93bdd
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
vllm/engine/multiprocessing/client.py
View File

@ -606,7 +606,8 @@ class MQLLMEngineClient:
and request_id is not None) and request_id is not None)
return self._process_request(prompt, pooling_params, request_id, return self._process_request(prompt, pooling_params, request_id,
lora_request, trace_headers, priority) lora_request, trace_headers, None,
priority)
async def _process_request( async def _process_request(
self, self,