Hanzhi Zhou 31bff69151 Make _prepare_sample non-blocking and use pinned memory for input buffers (#2207)		2023-12-19 16:52:46 -08:00
..
__init__.py	Change the name to vLLM (#150)	2023-06-17 03:07:40 -07:00
cache_engine.py	[Build] Avoid building too many extensions (#1624)	2023-11-23 16:31:19 -08:00
model_runner.py	Make _prepare_sample non-blocking and use pinned memory for input buffers (#2207)	2023-12-19 16:52:46 -08:00
worker.py	Remove dependency on CuPy (#2152)	2023-12-17 01:49:07 -08:00