vllm/vllm
Murali Andoorveedu c5832d2ae9
[Core] Pipeline Parallel Support (#4412)
Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
2024-07-02 10:58:08 -07:00
..
attention [Bugfix] Add explicit end_forward calls to flashinfer (#6044) 2024-07-01 23:08:58 +00:00
core [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
distributed [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
engine [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
entrypoints [VLM] Remove image_input_type from VLM config (#5852) 2024-07-02 07:57:09 +00:00
executor [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
inputs [VLM] Remove image_input_type from VLM config (#5852) 2024-07-02 07:57:09 +00:00
logging [MISC] Rework logger to enable pythonic custom logging configuration to be provided (#4273) 2024-05-01 17:34:40 -07:00
lora [misc][cuda] use nvml to avoid accidentally cuda initialization (#6007) 2024-06-30 20:07:34 -07:00
model_executor [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
multimodal [VLM] Remove image_input_type from VLM config (#5852) 2024-07-02 07:57:09 +00:00
spec_decode [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
transformers_utils [VLM] Remove image_input_type from VLM config (#5852) 2024-07-02 07:57:09 +00:00
usage [Misc] Add vLLM version getter to utils (#5098) 2024-06-13 11:21:39 -07:00
worker [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
__init__.py [Misc] Add vLLM version getter to utils (#5098) 2024-06-13 11:21:39 -07:00
_custom_ops.py [Kernel] Adding bias epilogue support for cutlass_scaled_mm (#5560) 2024-06-26 15:16:00 +00:00
_ipex_ops.py [Kernel][CPU] Add Quick gelu to CPU (#5717) 2024-06-21 06:39:40 +00:00
block.py [core][misc] remove logical block (#5882) 2024-06-27 13:34:55 -07:00
config.py [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
envs.py [Bugfix] adding chunking mechanism to fused_moe to handle large inputs (#6029) 2024-07-01 21:08:29 +00:00
logger.py [Misc] add logging level env var (#5045) 2024-05-24 23:49:49 -07:00
outputs.py [Core] Optimize block_manager_v2 vs block_manager_v1 (to make V2 default) (#5602) 2024-07-01 20:10:37 -07:00
pooling_params.py [Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734) 2024-05-11 11:30:37 -07:00
py.typed Add py.typed so consumers of vLLM can get type checking (#1509) 2023-10-30 14:50:47 -07:00
sampling_params.py [BugFix] Fix min_tokens behaviour for multiple eos tokens (#5849) 2024-06-27 11:31:11 -07:00
sequence.py [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
tracing.py [Misc] Add OpenTelemetry support (#4687) 2024-06-19 01:17:03 +09:00
utils.py [misc][cuda] use nvml to avoid accidentally cuda initialization (#6007) 2024-06-30 20:07:34 -07:00
version.py bump version to v0.5.0.post1 (#5522) 2024-06-13 19:42:06 -07:00