From f0f2e5638ef4858b00b137bea1c3f8312e48efa6 Mon Sep 17 00:00:00 2001 From: youkaichao Date: Sun, 10 Nov 2024 17:49:40 -0800 Subject: [PATCH] [doc] improve debugging code (#10206) Signed-off-by: youkaichao --- docs/source/getting_started/debugging.rst | 3 +++ 1 file changed, 3 insertions(+) diff --git a/docs/source/getting_started/debugging.rst b/docs/source/getting_started/debugging.rst index 91978065..d40222bf 100644 --- a/docs/source/getting_started/debugging.rst +++ b/docs/source/getting_started/debugging.rst @@ -75,6 +75,9 @@ If GPU/CPU communication cannot be established, you can use the following Python print("PyTorch GLOO is successful!") + if world_size <= 1: + exit() + # Test vLLM NCCL, with cuda graph from vllm.distributed.device_communicators.pynccl import PyNcclCommunicator