vllm/vllm
2024-04-23 07:49:08 +00:00
..
attention [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) 2024-04-22 21:32:44 -07:00
core [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) 2024-04-22 21:32:44 -07:00
distributed [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) 2024-04-22 21:32:44 -07:00
engine [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) 2024-04-22 21:32:44 -07:00
entrypoints [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) 2024-04-22 21:32:44 -07:00
executor [Core] Some simplification of WorkerWrapper changes (#4183) 2024-04-23 07:49:08 +00:00
lora [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) 2024-04-22 21:32:44 -07:00
model_executor [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) 2024-04-22 21:32:44 -07:00
spec_decode [Typing] Mypy typing part 2 (#4043) 2024-04-17 17:28:43 -07:00
transformers_utils [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) 2024-04-22 21:32:44 -07:00
usage [mypy] Add mypy type annotation part 1 (#4006) 2024-04-12 14:35:50 -07:00
worker [Core] Some simplification of WorkerWrapper changes (#4183) 2024-04-23 07:49:08 +00:00
__init__.py Bump version of 0.4.1 (#4177) 2024-04-19 01:00:22 -07:00
_custom_ops.py [Misc] Add indirection layer for custom ops (#3913) 2024-04-10 20:26:07 -07:00
block.py Add Automatic Prefix Caching (#2762) 2024-03-02 00:50:01 -08:00
config.py Make initialization of tokenizer and detokenizer optional (#3748) 2024-04-21 22:06:46 +00:00
logger.py [Core] add an option to log every function call to for debugging hang/crash in distributed inference (#4079) 2024-04-18 16:15:12 -07:00
outputs.py [BugFix] Fix handling of stop strings and stop token ids (#3672) 2024-04-11 15:34:12 -07:00
py.typed Add py.typed so consumers of vLLM can get type checking (#1509) 2023-10-30 14:50:47 -07:00
sampling_params.py Support eos_token_id from generation_config.json (#4182) 2024-04-19 04:13:36 +00:00
sequence.py [Misc] fix docstrings (#4191) 2024-04-19 08:18:33 +00:00
test_utils.py [Core][Refactor] move parallel_utils into vllm/distributed (#3950) 2024-04-10 15:33:30 -07:00
utils.py [Core][Distributed] use absolute path for library file (#4271) 2024-04-22 17:21:48 -07:00