..
attention
[Bugfix] Add explicit end_forward calls to flashinfer ( #6044 )
2024-07-01 23:08:58 +00:00
core
[Core] Optimize block_manager_v2 vs block_manager_v1 (to make V2 default) ( #5602 )
2024-07-01 20:10:37 -07:00
distributed
[misc][cuda] use nvml to avoid accidentally cuda initialization ( #6007 )
2024-06-30 20:07:34 -07:00
engine
[VLM] Remove image_input_type from VLM config ( #5852 )
2024-07-02 07:57:09 +00:00
entrypoints
[VLM] Remove image_input_type from VLM config ( #5852 )
2024-07-02 07:57:09 +00:00
executor
[Hardware][Intel] OpenVINO vLLM backend ( #5379 )
2024-06-28 13:50:16 +00:00
inputs
[VLM] Remove image_input_type from VLM config ( #5852 )
2024-07-02 07:57:09 +00:00
logging
[MISC] Rework logger to enable pythonic custom logging configuration to be provided ( #4273 )
2024-05-01 17:34:40 -07:00
lora
[misc][cuda] use nvml to avoid accidentally cuda initialization ( #6007 )
2024-06-30 20:07:34 -07:00
model_executor
[VLM] Remove image_input_type from VLM config ( #5852 )
2024-07-02 07:57:09 +00:00
multimodal
[VLM] Remove image_input_type from VLM config ( #5852 )
2024-07-02 07:57:09 +00:00
spec_decode
[Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker ( #5348 )
2024-07-01 00:33:05 -07:00
transformers_utils
[VLM] Remove image_input_type from VLM config ( #5852 )
2024-07-02 07:57:09 +00:00
usage
[Misc] Add vLLM version getter to utils ( #5098 )
2024-06-13 11:21:39 -07:00
worker
[VLM] Remove image_input_type from VLM config ( #5852 )
2024-07-02 07:57:09 +00:00
__init__.py
[Misc] Add vLLM version getter to utils ( #5098 )
2024-06-13 11:21:39 -07:00
_custom_ops.py
[Kernel] Adding bias epilogue support for cutlass_scaled_mm ( #5560 )
2024-06-26 15:16:00 +00:00
_ipex_ops.py
[Kernel][CPU] Add Quick gelu to CPU ( #5717 )
2024-06-21 06:39:40 +00:00
block.py
[core][misc] remove logical block ( #5882 )
2024-06-27 13:34:55 -07:00
config.py
[VLM] Remove image_input_type from VLM config ( #5852 )
2024-07-02 07:57:09 +00:00
envs.py
[Bugfix] adding chunking mechanism to fused_moe to handle large inputs ( #6029 )
2024-07-01 21:08:29 +00:00
logger.py
[Misc] add logging level env var ( #5045 )
2024-05-24 23:49:49 -07:00
outputs.py
[Core] Optimize block_manager_v2 vs block_manager_v1 (to make V2 default) ( #5602 )
2024-07-01 20:10:37 -07:00
pooling_params.py
[Model][Misc] Add e5-mistral-7b-instruct and Embedding API ( #3734 )
2024-05-11 11:30:37 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking ( #1509 )
2023-10-30 14:50:47 -07:00
sampling_params.py
[BugFix] Fix min_tokens behaviour for multiple eos tokens ( #5849 )
2024-06-27 11:31:11 -07:00
sequence.py
[VLM] Remove image_input_type from VLM config ( #5852 )
2024-07-02 07:57:09 +00:00
tracing.py
[Misc] Add OpenTelemetry support ( #4687 )
2024-06-19 01:17:03 +09:00
utils.py
[misc][cuda] use nvml to avoid accidentally cuda initialization ( #6007 )
2024-06-30 20:07:34 -07:00
version.py
bump version to v0.5.0.post1 ( #5522 )
2024-06-13 19:42:06 -07:00
98d6682cd1