squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
c45f3c3ab6
vllm/cacheflow/http_frontend
History
Woosuk Kwon 7a7929abe8
Implement preemption via recomputation & Refactor scheduling logic (#12)
2023-03-30 14:51:46 -07:00
..
fastapi_frontend.py Implement preemption via recomputation & Refactor scheduling logic (#12) 2023-03-30 14:51:46 -07:00
gradio_webserver.py FastAPI-based working frontend (#10) 2023-03-29 14:48:56 +08:00
test_cli_client.py FastAPI-based working frontend (#10) 2023-03-29 14:48:56 +08:00