vllm/vllm/triton_utils/importing.py
Thomas Parnell 9a7e2d0534
[Bugfix] Allow vllm to still work if triton is not installed. (#6786)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
2024-07-29 14:51:27 -07:00

12 lines
288 B
Python

from importlib.util import find_spec
from vllm.logger import init_logger
logger = init_logger(__name__)
HAS_TRITON = find_spec("triton") is not None
if not HAS_TRITON:
logger.info("Triton not installed; certain GPU-related functions"
" will be not be available.")