vllm/vllm
2024-07-03 00:32:35 -07:00
..
attention [hardware][misc] introduce platform abstraction (#6080) 2024-07-02 20:12:22 -07:00
core [Model] Jamba support (#4115) 2024-07-02 23:11:29 +00:00
distributed [Core] Pipeline Parallel Support (#4412) 2024-07-02 10:58:08 -07:00
engine [BugFix] Avoid unnecessary Ray import warnings (#6079) 2024-07-03 14:09:40 +08:00
entrypoints [VLM][Frontend] Proper Image Prompt Formatting from OpenAI API (#6091) 2024-07-02 23:41:23 -07:00
executor [misc][distributed] error on invalid state (#6092) 2024-07-02 23:37:29 -07:00
inputs [Core] Dynamic image size support for VLMs (#5276) 2024-07-02 20:34:00 -07:00
logging [MISC] Rework logger to enable pythonic custom logging configuration to be provided (#4273) 2024-05-01 17:34:40 -07:00
lora [hardware][misc] introduce platform abstraction (#6080) 2024-07-02 20:12:22 -07:00
model_executor [Bugfix] Fix compute_logits in Jamba (#6093) 2024-07-03 00:32:35 -07:00
multimodal [Core] Dynamic image size support for VLMs (#5276) 2024-07-02 20:34:00 -07:00
platforms [hardware][misc] introduce platform abstraction (#6080) 2024-07-02 20:12:22 -07:00
spec_decode [Model] Jamba support (#4115) 2024-07-02 23:11:29 +00:00
transformers_utils [Core] Dynamic image size support for VLMs (#5276) 2024-07-02 20:34:00 -07:00
usage [Misc] Add vLLM version getter to utils (#5098) 2024-06-13 11:21:39 -07:00
worker [Core] Dynamic image size support for VLMs (#5276) 2024-07-02 20:34:00 -07:00
__init__.py [Misc] Add vLLM version getter to utils (#5098) 2024-06-13 11:21:39 -07:00
_custom_ops.py [Kernel] Adding bias epilogue support for cutlass_scaled_mm (#5560) 2024-06-26 15:16:00 +00:00
_ipex_ops.py [Kernel][CPU] Add Quick gelu to CPU (#5717) 2024-06-21 06:39:40 +00:00
block.py [core][misc] remove logical block (#5882) 2024-06-27 13:34:55 -07:00
config.py [BugFix] Avoid unnecessary Ray import warnings (#6079) 2024-07-03 14:09:40 +08:00
envs.py [Bugfix] adding chunking mechanism to fused_moe to handle large inputs (#6029) 2024-07-01 21:08:29 +00:00
logger.py [Misc] add logging level env var (#5045) 2024-05-24 23:49:49 -07:00
outputs.py [Core] Optimize block_manager_v2 vs block_manager_v1 (to make V2 default) (#5602) 2024-07-01 20:10:37 -07:00
pooling_params.py [Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734) 2024-05-11 11:30:37 -07:00
py.typed Add py.typed so consumers of vLLM can get type checking (#1509) 2023-10-30 14:50:47 -07:00
sampling_params.py [BugFix] Fix min_tokens behaviour for multiple eos tokens (#5849) 2024-06-27 11:31:11 -07:00
sequence.py [Core] Dynamic image size support for VLMs (#5276) 2024-07-02 20:34:00 -07:00
tracing.py [Misc] Add OpenTelemetry support (#4687) 2024-06-19 01:17:03 +09:00
utils.py [misc][distributed] error on invalid state (#6092) 2024-07-02 23:37:29 -07:00
version.py bump version to v0.5.0.post1 (#5522) 2024-06-13 19:42:06 -07:00