vllm/vllm
2023-11-20 23:56:48 -08:00
..
core [Fix] Fix bugs in scheduler (#1727) 2023-11-20 16:10:50 -08:00
engine fix RAM OOM when load large models in tensor parallel mode. (#1395) 2023-11-20 19:02:42 -08:00
entrypoints Migrate linter from pylint to ruff (#1665) 2023-11-20 11:58:01 -08:00
model_executor [FIX] Fix the case when input_is_parallel=False for ScaledActivation (#1737) 2023-11-20 23:56:48 -08:00
transformers_utils Migrate linter from pylint to ruff (#1665) 2023-11-20 11:58:01 -08:00
worker fix RAM OOM when load large models in tensor parallel mode. (#1395) 2023-11-20 19:02:42 -08:00
__init__.py Bump up to v0.2.2 (#1689) 2023-11-18 21:57:07 -08:00
block.py [Quality] Add code formatter and linter (#326) 2023-07-03 11:31:55 -07:00
config.py fix RAM OOM when load large models in tensor parallel mode. (#1395) 2023-11-20 19:02:42 -08:00
logger.py [Fix] Fix duplicated logging messages (#1524) 2023-10-31 09:04:47 -07:00
outputs.py docs: add description (#1553) 2023-11-03 09:14:52 -07:00
py.typed Add py.typed so consumers of vLLM can get type checking (#1509) 2023-10-30 14:50:47 -07:00
sampling_params.py Support Min P Sampler (#1642) 2023-11-17 16:20:49 -08:00
sequence.py [BugFix] Define __eq__ in SequenceGroupOutputs (#1389) 2023-10-17 01:09:44 -07:00
utils.py Migrate linter from pylint to ruff (#1665) 2023-11-20 11:58:01 -08:00