squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[bugfix] make args.stream work (#6831)

Browse Source
This commit is contained in:
Wang Ran (汪然) 2024-07-27 17:07:02 +08:00 committed by GitHub
parent 925de97e05
commit a57d75821c
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
examples/api_client.py
View File

@ -31,7 +31,10 @@ def post_http_request(prompt: str,
"max_tokens": 16, "max_tokens": 16,
"stream": stream, "stream": stream,
} }
response = requests.post(api_url, headers=headers, json=pload, stream=True) response = requests.post(api_url,
headers=headers,
json=pload,
stream=stream)
return response return response