Alexander Matveev 7c7714d856 [Core][Bugfix][Perf] Introduce MQLLMEngine to avoid asyncio OH (#8157) ... Co-authored-by: Nick Hill <nickhill@us.ibm.com> Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com> Co-authored-by: Simon Mo <simon.mo@hey.com>		2024-09-18 13:56:58 +00:00
..
_static	[Docs] Add RunLLM chat widget (#6857)	2024-07-27 09:24:46 -07:00
_templates/sections	[Doc] Guide for adding multi-modal plugins (#6205)	2024-07-10 14:55:34 +08:00
assets	[Doc] add visualization for multi-stage dockerfile (#4456)	2024-04-30 17:41:59 +00:00
automatic_prefix_caching	[Doc] Add an automatic prefix caching section in vllm documentation (#5324)	2024-06-11 10:24:59 -07:00
community	Add NVIDIA Meetup slides, announce AMD meetup, and add contact info (#8319)	2024-09-09 23:21:00 -07:00
dev	[Core][Bugfix][Perf] Introduce MQLLMEngine to avoid asyncio OH (#8157)	2024-09-18 13:56:58 +00:00
getting_started	[doc] improve installation doc (#8550)	2024-09-17 16:24:06 -07:00
models	[Model] support minicpm3 (#8297)	2024-09-14 14:50:26 +00:00
performance_benchmark	[Doc] fix 404 link (#7966)	2024-08-28 13:54:23 -07:00
quantization	[Misc] Remove SqueezeLLM (#8220)	2024-09-06 16:29:03 -06:00
serving	[Documentation][Spec Decode] Add documentation about lossless guarantees in Speculative Decoding in vLLM (#7962)	2024-09-05 16:25:29 -04:00
conf.py	[model] Support for Llava-Next-Video model (#7559)	2024-09-10 22:21:36 -07:00
generate_examples.py	Add example scripts to documentation (#4225)	2024-04-22 16:36:54 +00:00
index.rst	[misc] Add Torch profiler support (#7451)	2024-08-21 15:39:26 -07:00