Unable to find Punica extension issue during source code installation (#4494)

Co-authored-by: Simon Mo <simon.mo@hey.com>
2024-05-01 08:42:09 +08:00 · 2024-05-01 08:42:09 +08:00 · ee37328da0
commit ee37328da0
parent 6ad58f42c5
1 changed files with 1 additions and 0 deletions
--- a/docs/source/getting_started/installation.rst
+++ b/docs/source/getting_started/installation.rst
@ -53,6 +53,7 @@ You can also build and install vLLM from source:

    $ git clone https://github.com/vllm-project/vllm.git
    $ cd vllm
+    $ # export VLLM_INSTALL_PUNICA_KERNELS=1 # optionally build for multi-LoRA capability
    $ pip install -e .  # This may take 5-10 minutes.

 .. tip::