vllm/vllm/engine/output_processor
2024-06-15 04:45:31 +00:00
..
__init__.py [Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894) 2024-04-16 13:09:21 -07:00
interfaces.py [Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309) 2024-04-26 13:02:02 +00:00
multi_step.py [Misc] Various simplifications and typing fixes (#5368) 2024-06-11 10:29:02 +08:00
single_step.py [mypy] Enable type checking for test directory (#5017) 2024-06-15 04:45:31 +00:00
stop_checker.py [Bugfix] Remove the last EOS token unless explicitly specified (#5077) 2024-05-28 17:15:35 -07:00
util.py [Core] Consolidate prompt arguments to LLM engines (#4328) 2024-05-28 13:29:31 -07:00