squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Minor] Fix the path typo in loader.py: save_sharded_states.py -> save_sharded_state.py (#5151)

Browse Source 
Signed-off-by: Ye Cao <caoye.cao@alibaba-inc.com>
This commit is contained in:
Ye Cao 2024-06-02 01:11:22 +08:00 committed by GitHub
parent f081c3ce4b
commit c354072828
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/model_loader/loader.py
View File

@ -386,7 +386,7 @@ class ShardedStateLoader(BaseModelLoader):
Model loader that directly loads each worker's model state dict, which Model loader that directly loads each worker's model state dict, which
enables a fast load path for large tensor-parallel models where each worker enables a fast load path for large tensor-parallel models where each worker
only needs to read its own shard rather than the entire checkpoint. See only needs to read its own shard rather than the entire checkpoint. See
`examples/save_sharded_states.py` for creating a sharded checkpoint. `examples/save_sharded_state.py` for creating a sharded checkpoint.
""" """
DEFAULT_PATTERN = "model-rank-{rank}-part-{part}.safetensors" DEFAULT_PATTERN = "model-rank-{rank}-part-{part}.safetensors"