vllm/vllm/worker
2024-03-10 19:49:14 -07:00
..
__init__.py Change the name to vLLM (#150) 2023-06-17 03:07:40 -07:00
cache_engine.py [Neuron] Support inference with transformers-neuronx (#2569) 2024-02-28 09:34:34 -08:00
model_runner.py Re-enable the 80 char line width limit (#3305) 2024-03-10 19:49:14 -07:00
neuron_worker.py Re-enable the 80 char line width limit (#3305) 2024-03-10 19:49:14 -07:00
worker.py [Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103) 2024-03-08 23:32:46 -08:00