youkaichao 482045ee77 [hardware][misc] introduce platform abstraction (#6080)		2024-07-02 20:12:22 -07:00
..
fused_moe	[ Misc ] Refactor MoE to isolate Fp8 From Mixtral (#5970)	2024-07-02 21:54:35 +00:00
ops	[Mypy] Part 3 fix typing for nested directories for most of directory (#4161)	2024-04-22 21:32:44 -07:00
quantization	[hardware][misc] introduce platform abstraction (#6080)	2024-07-02 20:12:22 -07:00
__init__.py	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00
activation.py	[Kernel][CPU] Add Quick gelu to CPU (#5717)	2024-06-21 06:39:40 +00:00
layernorm.py	[Model] Add Gemma 2 (#5908)	2024-06-27 13:33:56 -07:00
linear.py	[ Misc ] Refactor w8a8 to use process_weights_after_load (Simplify Weight Loading) (#5940)	2024-06-30 23:06:27 +00:00
logits_processor.py	[CORE] Quantized lm-head Framework (#4442)	2024-07-02 22:25:17 +00:00
pooler.py	[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)	2024-05-11 11:30:37 -07:00
rejection_sampler.py	[Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348)	2024-07-01 00:33:05 -07:00
rotary_embedding.py	Support Deepseek-V2 (#4650)	2024-06-28 13:24:57 -07:00
sampler.py	[Hardware][Intel] OpenVINO vLLM backend (#5379)	2024-06-28 13:50:16 +00:00
spec_decode_base_sampler.py	[Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348)	2024-07-01 00:33:05 -07:00
typical_acceptance_sampler.py	[Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348)	2024-07-01 00:33:05 -07:00
vocab_parallel_embedding.py	[CORE] Quantized lm-head Framework (#4442)	2024-07-02 22:25:17 +00:00