squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[BugFix] Fix log message about default max model length (#5284)

Browse Source
This commit is contained in:
Nick Hill 2024-06-05 14:53:16 -07:00 committed by GitHub
parent faf71bcd4b
commit 3d33e372a1
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/config.py
View File

@ -1223,7 +1223,7 @@ def _get_and_verify_max_len(
logger.warning( logger.warning(
"The model's config.json does not contain any of the following " "The model's config.json does not contain any of the following "
"keys to determine the original maximum length of the model: " "keys to determine the original maximum length of the model: "
"%d. Assuming the model's maximum length is %d.", possible_keys, "%s. Assuming the model's maximum length is %d.", possible_keys,
default_max_len) default_max_len)
derived_max_model_len = default_max_len derived_max_model_len = default_max_len