Sage Moore ce4f5a29fb Add Automatic Prefix Caching (#2762) ... Co-authored-by: ElizaWszola <eliza@neuralmagic.com> Co-authored-by: Michael Goin <michael@neuralmagic.com>		2024-03-02 00:50:01 -08:00
..
spec_decode	[Speculative decoding 2/9] Multi-step worker for draft model (#2424)	2024-01-21 16:31:47 -08:00
__init__.py	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00
cache_engine.py	[Neuron] Support inference with transformers-neuronx (#2569)	2024-02-28 09:34:34 -08:00
model_runner.py	Add Automatic Prefix Caching (#2762)	2024-03-02 00:50:01 -08:00
neuron_worker.py	[Neuron] Support inference with transformers-neuronx (#2569)	2024-02-28 09:34:34 -08:00
worker.py	[Minor] Small fix to make distributed init logic in worker looks cleaner (#2905)	2024-02-18 14:39:00 -08:00