squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Bugfix] Ignore ray reinit error when current platform is ROCm or XPU (#10375)

Browse Source 
Signed-off-by: Hollow Man <hollowman@opensuse.org>
This commit is contained in:
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 2024-11-18 05:29:26 +02:00 committed by GitHub
parent c4e464333e
commit 47826cacf0
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/executor/ray_utils.py
View File

@ -234,7 +234,7 @@ def initialize_ray_cluster(
if current_platform.is_rocm() or current_platform.is_xpu(): if current_platform.is_rocm() or current_platform.is_xpu():
# Try to connect existing ray instance and create a new one if not found # Try to connect existing ray instance and create a new one if not found
try: try:
ray.init("auto") ray.init("auto", ignore_reinit_error=True)
except ConnectionError: except ConnectionError:
logger.warning( logger.warning(
"No existing RAY instance detected. " "No existing RAY instance detected. "