jon-chuang a046f86397 [Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208) ... Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>		2024-08-12 22:47:41 +00:00
..
_static	[Docs] Add RunLLM chat widget (#6857)	2024-07-27 09:24:46 -07:00
_templates/sections	[Doc] Guide for adding multi-modal plugins (#6205)	2024-07-10 14:55:34 +08:00
assets	[Doc] add visualization for multi-stage dockerfile (#4456)	2024-04-30 17:41:59 +00:00
automatic_prefix_caching	[Doc] Add an automatic prefix caching section in vllm documentation (#5324)	2024-06-11 10:24:59 -07:00
community	Add Skywork AI as Sponsor (#7314)	2024-08-08 13:59:57 -07:00
dev	[Bugfix] Fix broadcasting logic for multi_modal_kwargs (#6836)	2024-07-31 10:38:45 +08:00
getting_started	[Doc] building vLLM with VLLM_TARGET_DEVICE=empty (#7403)	2024-08-11 14:38:17 -07:00
models	[Core][VLM] Support image embeddings as input (#6613)	2024-08-12 16:16:06 +08:00
performance_benchmark	[Doc] Add documentations for nightly benchmarks (#6412)	2024-07-25 11:57:16 -07:00
quantization	[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208)	2024-08-12 22:47:41 +00:00
serving	[Models] Support Qwen model with PP (#6974)	2024-08-01 12:40:43 -07:00
conf.py	[Doc] Mock new dependencies for documentation (#7245)	2024-08-07 06:43:03 +00:00
generate_examples.py	Add example scripts to documentation (#4225)	2024-04-22 16:36:54 +00:00
index.rst	[Docs] Update readme (#7316)	2024-08-11 17:13:37 -07:00