vllm/cacheflow
2023-06-05 23:44:50 +08:00
..
core Fix various issues of async servers (#135) 2023-06-05 23:44:50 +08:00
entrypoints Fix various issues of async servers (#135) 2023-06-05 23:44:50 +08:00
model_executor Add activation registry (#126) 2023-05-25 00:09:07 -07:00
server Fix various issues of async servers (#135) 2023-06-05 23:44:50 +08:00
worker Add contributing guideline and mypy config (#122) 2023-05-23 17:58:51 -07:00
__init__.py Add throughput benchmarking script (#133) 2023-05-28 03:20:05 -07:00
block.py Add docstrings to some modules and classes (#100) 2023-05-14 22:32:38 -07:00
config.py Fix various issues of async servers (#135) 2023-06-05 23:44:50 +08:00
logger.py Add a system logger (#85) 2023-05-08 23:03:35 -07:00
outputs.py OpenAI Compatible Frontend (#116) 2023-05-23 21:39:50 -07:00
sampling_params.py Enable LLaMA fast tokenizer (#132) 2023-05-28 02:51:42 -07:00
sequence.py Fix various issues of async servers (#135) 2023-06-05 23:44:50 +08:00
utils.py OpenAI Compatible Frontend (#116) 2023-05-23 21:39:50 -07:00