From 208cb34c812585ce387d7aff82678a3776a66756 Mon Sep 17 00:00:00 2001 From: Seth Kimmel Date: Tue, 22 Oct 2024 15:43:25 -0700 Subject: [PATCH] [Doc]: Update tensorizer docs to include vllm[tensorizer] (#7889) Co-authored-by: Kaunil Dhruv --- docs/source/serving/tensorizer.rst | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/docs/source/serving/tensorizer.rst b/docs/source/serving/tensorizer.rst index a4469650..96a93db9 100644 --- a/docs/source/serving/tensorizer.rst +++ b/docs/source/serving/tensorizer.rst @@ -9,4 +9,7 @@ shorter Pod startup times and CPU memory usage. Tensor encryption is also suppor For more information on CoreWeave's Tensorizer, please refer to `CoreWeave's Tensorizer documentation `_. For more information on serializing a vLLM model, as well a general usage guide to using Tensorizer with vLLM, see -the `vLLM example script `_. \ No newline at end of file +the `vLLM example script `_. + +.. note:: + Note that to use this feature you will need to install `tensorizer` by running `pip install vllm[tensorizer]`.