Eric Xihui Lin 8e192ff967 [Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) ... Co-authored-by: beagleski <yunanzhang@microsoft.com> Co-authored-by: bapatra <bapatra@microsoft.com> Co-authored-by: Barun Patra <codedecde@users.noreply.github.com> Co-authored-by: Michael Goin <michael@neuralmagic.com>		2024-05-24 22:00:52 -07:00
..
attention	[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799)	2024-05-24 22:00:52 -07:00
core	[Core][Bugfix]: fix prefix caching for blockv2 (#4764)	2024-05-24 10:07:09 -07:00
distributed	[Core][1/N] Support send/recv in PyNCCL Groups (#4988)	2024-05-23 09:54:48 -07:00
engine	[Core] Eliminate parallel worker per-step task scheduling overhead (#4894)	2024-05-23 06:17:27 +09:00
entrypoints	[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799)	2024-05-24 22:00:52 -07:00
executor	[Core] Eliminate parallel worker per-step task scheduling overhead (#4894)	2024-05-23 06:17:27 +09:00
logging	[MISC] Rework logger to enable pythonic custom logging configuration to be provided (#4273)	2024-05-01 17:34:40 -07:00
lora	[Model] LoRA gptbigcode implementation (#3949)	2024-05-22 13:58:59 -07:00
model_executor	[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799)	2024-05-24 22:00:52 -07:00
spec_decode	[Core] Eliminate parallel worker per-step task scheduling overhead (#4894)	2024-05-23 06:17:27 +09:00
transformers_utils	[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799)	2024-05-24 22:00:52 -07:00
usage	[Frontend] Separate OpenAI Batch Runner usage from API Server (#4851)	2024-05-17 00:42:41 +09:00
worker	[Core] Eliminate parallel worker per-step task scheduling overhead (#4894)	2024-05-23 06:17:27 +09:00
__init__.py	[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)	2024-05-11 11:30:37 -07:00
_custom_ops.py	[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799)	2024-05-24 22:00:52 -07:00
block.py	Add Automatic Prefix Caching (#2762)	2024-03-02 00:50:01 -08:00
config.py	[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)	2024-05-22 13:28:20 -07:00
envs.py	[Misc]: allow user to specify port in distributed setting (#4914)	2024-05-20 17:45:06 +00:00
logger.py	[Misc] centralize all usage of environment variables (#4548)	2024-05-02 11:13:25 -07:00
outputs.py	[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)	2024-05-11 11:30:37 -07:00
pooling_params.py	[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)	2024-05-11 11:30:37 -07:00
py.typed	Add py.typed so consumers of vLLM can get type checking (#1509)	2023-10-30 14:50:47 -07:00
sampling_params.py	[Core]: Option To Use Prompt Token Ids Inside Logits Processor (#4985)	2024-05-23 22:04:24 +00:00
sequence.py	[Core][2/N] Model runner refactoring part 2. Combine prepare prefill / decode to a single API (#4681)	2024-05-15 14:00:10 +09:00
utils.py	[Misc] Load FP8 kv-cache scaling factors from checkpoints (#4893)	2024-05-22 13:28:20 -07:00