vllm/vllm
2024-01-08 13:13:08 -08:00
..
core Changed scheduler to use deques instead of lists (#2290) 2024-01-07 09:48:07 -08:00
engine Changed scheduler to use deques instead of lists (#2290) 2024-01-07 09:48:07 -08:00
entrypoints Ensure metrics are logged regardless of requests (#2347) 2024-01-05 05:24:42 -08:00
model_executor [Minor] Remove unused code in attention (#2384) 2024-01-08 13:13:08 -08:00
transformers_utils [Minor] Delete Llama tokenizer warnings (#2146) 2023-12-16 22:05:18 -08:00
worker Fix eager mode performance (#2377) 2024-01-08 10:11:06 -08:00
__init__.py Bump up to v0.2.7 (#2337) 2024-01-03 17:35:56 -08:00
block.py [Quality] Add code formatter and linter (#326) 2023-07-03 11:31:55 -07:00
config.py Enable CUDA graph for GPTQ & SqueezeLLM (#2318) 2024-01-03 09:52:29 -08:00
logger.py [Fix] Fix duplicated logging messages (#1524) 2023-10-31 09:04:47 -07:00
outputs.py docs: add description (#1553) 2023-11-03 09:14:52 -07:00
py.typed Add py.typed so consumers of vLLM can get type checking (#1509) 2023-10-30 14:50:47 -07:00
sampling_params.py [Minor] Fix typo and remove unused code (#2305) 2024-01-02 19:23:15 -08:00
sequence.py [FIX] Fix class naming (#1803) 2023-11-28 14:08:01 -08:00
utils.py Use NCCL instead of ray for control-plane communication to remove serialization overhead (#2221) 2024-01-03 11:30:22 -08:00