Unable to find Punica extension issue during source code installation (#4494)
Co-authored-by: Simon Mo <simon.mo@hey.com>
This commit is contained in:
parent
6ad58f42c5
commit
ee37328da0
@ -53,6 +53,7 @@ You can also build and install vLLM from source:
|
|||||||
|
|
||||||
$ git clone https://github.com/vllm-project/vllm.git
|
$ git clone https://github.com/vllm-project/vllm.git
|
||||||
$ cd vllm
|
$ cd vllm
|
||||||
|
$ # export VLLM_INSTALL_PUNICA_KERNELS=1 # optionally build for multi-LoRA capability
|
||||||
$ pip install -e . # This may take 5-10 minutes.
|
$ pip install -e . # This may take 5-10 minutes.
|
||||||
|
|
||||||
.. tip::
|
.. tip::
|
||||||
|
|||||||
Loading…
Reference in New Issue
Block a user