Woosuk Kwon 518369d78c Implement lazy model loader (#2044)		2023-12-12 22:21:45 -08:00
..
core	[FIX] Fix formatting error	2023-11-29 00:40:19 +00:00
engine	Merge EmbeddedLLM/vllm-rocm into vLLM main (#1836)	2023-12-07 23:16:52 -08:00
entrypoints	Fix completion API echo and logprob combo (#1992)	2023-12-10 13:20:30 -08:00
model_executor	Implement lazy model loader (#2044)	2023-12-12 22:21:45 -08:00
transformers_utils	Fix Baichuan tokenizer error (#1874)	2023-11-30 18:35:50 -08:00
worker	Fix peak memory profiling (#2031)	2023-12-12 22:01:53 -08:00
__init__.py	Bump up to v0.2.4 (#2034)	2023-12-11 11:49:39 -08:00
block.py	[Quality] Add code formatter and linter (#326)	2023-07-03 11:31:55 -07:00
config.py	Change the load format to pt for Mixtral (#2028)	2023-12-11 10:32:17 -08:00
logger.py	[Fix] Fix duplicated logging messages (#1524)	2023-10-31 09:04:47 -07:00
outputs.py	docs: add description (#1553)	2023-11-03 09:14:52 -07:00
py.typed	Add py.typed so consumers of vLLM can get type checking (#1509)	2023-10-30 14:50:47 -07:00
sampling_params.py	add custom server params (#1868)	2023-12-03 12:59:18 -08:00
sequence.py	[FIX] Fix class naming (#1803)	2023-11-28 14:08:01 -08:00
utils.py	Fix peak memory profiling (#2031)	2023-12-12 22:01:53 -08:00