squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Miner fix of type hint (#2340)

Browse Source
This commit is contained in:
ljss 2024-01-04 13:27:56 +08:00 committed by GitHub
parent 2e0b6e7757
commit aee8ef661a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/engine/ray_utils.py
View File

@ -55,7 +55,7 @@ def initialize_cluster(
parallel_config: ParallelConfig, parallel_config: ParallelConfig,
engine_use_ray: bool = False, engine_use_ray: bool = False,
ray_address: Optional[str] = None, ray_address: Optional[str] = None,
) -> Tuple[str, Optional["PlacementGroup"]]: ) -> Optional["PlacementGroup"]:
"""Initialize the distributed cluster probably with Ray. """Initialize the distributed cluster probably with Ray.
Args: Args: