squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Docs][TPU] Add installation tip for TPU (#5761)

Browse Source
This commit is contained in:
Woosuk Kwon 2024-06-21 23:09:40 -07:00 committed by GitHub
parent 0cbc1d2b4f
commit 8c00f9c15d
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 18 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

18
docs/source/getting_started/tpu-installation.rst
View File

@ -73,3 +73,21 @@ Next, build vLLM from source. This will only take a few seconds:
.. code-block:: console .. code-block:: console
$ VLLM_TARGET_DEVICE="tpu" python setup.py develop $ VLLM_TARGET_DEVICE="tpu" python setup.py develop
.. tip::
If you encounter the following error:
.. code-block:: console
from torch._C import * # noqa: F403
ImportError: libopenblas.so.0: cannot open shared object file: No such file or directory
You can install OpenBLAS with the following command:
.. code-block:: console
$ sudo apt-get install libopenblas-base libopenmpi-dev libomp-dev