squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Minor Fix] Use cupy-cuda11x in CUDA 11.8 build (#3256)

Browse Source
This commit is contained in:
陈序 2024-03-14 00:43:24 +08:00 committed by GitHub
parent ba8dc958a3
commit 739c350c19
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
setup.py
View File

@ -431,6 +431,12 @@ def get_requirements() -> List[str]:
else: else:
with open(get_path("requirements.txt")) as f: with open(get_path("requirements.txt")) as f:
requirements = f.read().strip().split("\n") requirements = f.read().strip().split("\n")
if nvcc_cuda_version <= Version("11.8"):
# replace cupy-cuda12x with cupy-cuda11x for cuda 11.x
for i in range(len(requirements)):
if requirements[i].startswith("cupy-cuda12x"):
requirements[i] = "cupy-cuda11x"
break
return requirements return requirements