squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Frontend][Bugfix] Fix preemption_mode -> preemption-mode for CLI arg in arg_utils.py (#5688)

Browse Source
This commit is contained in:
Michael Goin 2024-06-19 14:41:42 -04:00 committed by GitHub
parent 3ee5c4bca5
commit afed90a034
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/engine/arg_utils.py
View File

@ -577,7 +577,7 @@ class EngineArgs:
'This should be a JSON string that will be ' 'This should be a JSON string that will be '
'parsed into a dictionary.') 'parsed into a dictionary.')
parser.add_argument( parser.add_argument(
'--preemption_mode', '--preemption-mode',
type=str, type=str,
default=None, default=None,
help='If \'recompute\', the engine performs preemption by block ' help='If \'recompute\', the engine performs preemption by block '