vllm/vllm/model_executor/guided_decoding
Yihuan Bu 654bc5ca49
Support for guided decoding for offline LLM (#6878)
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
2024-08-04 03:12:09 +00:00
..
__init__.py Support for guided decoding for offline LLM (#6878) 2024-08-04 03:12:09 +00:00
guided_fields.py Support for guided decoding for offline LLM (#6878) 2024-08-04 03:12:09 +00:00
lm_format_enforcer_decoding.py Support for guided decoding for offline LLM (#6878) 2024-08-04 03:12:09 +00:00
outlines_decoding.py Support for guided decoding for offline LLM (#6878) 2024-08-04 03:12:09 +00:00
outlines_logits_processors.py [ Frontend ] Multiprocessing for OpenAI Server with zeromq (#6883) 2024-08-02 18:27:28 -07:00