squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Minor] Fix the path typo in loader.py: save_sharded_states.py -> save_sharded_state.py (#5151)

Browse Source 
Signed-off-by: Ye Cao <caoye.cao@alibaba-inc.com>
This commit is contained in:
Ye Cao 2024-06-02 01:11:22 +08:00 committed by GitHub
parent f081c3ce4b
commit c354072828
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/model_loader/loader.py
View File

@ -386,7 +386,7 @@ class ShardedStateLoader(BaseModelLoader):
Model loader that directly loads each worker's model state dict, which
enables a fast load path for large tensor-parallel models where each worker
only needs to read its own shard rather than the entire checkpoint. See
`examples/save_sharded_states.py` for creating a sharded checkpoint.
`examples/save_sharded_state.py` for creating a sharded checkpoint.
"""
DEFAULT_PATTERN = "model-rank-{rank}-part-{part}.safetensors"