vllm/vllm/model_executor/layers
2024-07-10 17:05:26 -07:00
..
fused_moe [Kernel] reloading fused_moe config on the last chunk (#6210) 2024-07-08 08:00:38 -07:00
ops [Mypy] Part 3 fix typing for nested directories for most of directory (#4161) 2024-04-22 21:32:44 -07:00
quantization [ Misc ] Support Fp8 via llm-compressor (#6110) 2024-07-07 20:42:11 +00:00
__init__.py Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00
activation.py [Kernel][CPU] Add Quick gelu to CPU (#5717) 2024-06-21 06:39:40 +00:00
layernorm.py [Model] Add Gemma 2 (#5908) 2024-06-27 13:33:56 -07:00
linear.py [Doc] Remove comments incorrectly copied from another project (#6286) 2024-07-10 17:05:26 -07:00
logits_processor.py [CORE] Quantized lm-head Framework (#4442) 2024-07-02 22:25:17 +00:00
pooler.py [Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734) 2024-05-11 11:30:37 -07:00
rejection_sampler.py [Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348) 2024-07-01 00:33:05 -07:00
rotary_embedding.py Support Deepseek-V2 (#4650) 2024-06-28 13:24:57 -07:00
sampler.py [Hardware][Intel] OpenVINO vLLM backend (#5379) 2024-06-28 13:50:16 +00:00
spec_decode_base_sampler.py [Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348) 2024-07-01 00:33:05 -07:00
typical_acceptance_sampler.py [Speculative Decoding 2/2 ] Integrate typical acceptance sampler into Spec Decode Worker (#5348) 2024-07-01 00:33:05 -07:00
vocab_parallel_embedding.py [CORE] Quantized lm-head Framework (#4442) 2024-07-02 22:25:17 +00:00