vllm/tests
2024-04-03 14:13:49 -07:00
..
async_engine [CI] Try introducing isort. (#3495) 2024-03-25 07:59:47 -07:00
basic_correctness [Test] Make model tests run again and remove --forked from pytest (#3631) 2024-03-28 21:06:40 -07:00
core [3/N] Refactor scheduler for chunked prefill scheduling (#3550) 2024-04-03 14:13:49 -07:00
distributed [Core][Test] move local_rank to the last arg with default value(#3711) 2024-03-28 21:19:45 -07:00
engine Asynchronous tokenization (#2879) 2024-03-15 23:37:01 +00:00
entrypoints [BugFix][Frontend] Fix completion logprobs=0 error (#3731) 2024-03-29 09:38:21 -07:00
kernels [Kernel] Layernorm performance optimization (#3662) 2024-03-30 14:26:38 -07:00
lora [Kernel] support non-zero cuda devices in punica kernels (#3636) 2024-03-27 00:37:42 +00:00
metrics Re-enable the 80 char line width limit (#3305) 2024-03-10 19:49:14 -07:00
models [CI/Build] Make Marlin Tests Green (#3753) 2024-03-30 19:18:34 -07:00
prefix_caching [Core][Bugfix]Refactor block manager for better testability (#3492) 2024-03-27 23:59:28 -07:00
prompts [BugFix] Fix input positions for long context with sliding window (#2088) 2023-12-13 12:28:13 -08:00
quantization [Misc] Add support for new autogptq checkpoint_format (#3689) 2024-04-01 19:32:01 -04:00
samplers [Test] Make model tests run again and remove --forked from pytest (#3631) 2024-03-28 21:06:40 -07:00
spec_decode [Speculative decoding] Adding configuration object for speculative decoding (#3706) 2024-04-03 00:40:57 +00:00
tokenization [Misc] Some minor simplifications to detokenization logic (#3670) 2024-04-01 13:22:06 -07:00
worker [Speculative decoding] Adding configuration object for speculative decoding (#3706) 2024-04-03 00:40:57 +00:00
__init__.py [Small] Formatter only checks lints in changed files (#1528) 2023-10-31 15:39:38 -07:00
conftest.py [Misc] [CI/Build] Speed up block manager CPU-only unit tests ~10x by opting-out of GPU cleanup (#3783) 2024-04-02 00:49:51 +00:00
test_cache_block_hashing.py [CI] Try introducing isort. (#3495) 2024-03-25 07:59:47 -07:00
test_config.py Fix assertion failure in Qwen 1.5 with prefix caching enabled (#3373) 2024-03-14 13:56:57 -07:00
test_logits_processor.py Migrate logits computation and gather to model_runner (#3233) 2024-03-20 23:25:01 +00:00
test_regression.py [BugFix] Fix GC bug for LLM class (#2882) 2024-02-14 22:17:44 -08:00
test_sampling_params.py [Bugfix] fix crash if max_tokens=None (#2570) 2024-01-23 22:38:55 -08:00
test_sequence.py [2/N] Chunked prefill data update (#3538) 2024-03-28 10:06:01 -07:00