vllm/tests/spec_decode
2024-03-20 14:46:05 -07:00
..
__init__.py [Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103) 2024-03-08 23:32:46 -08:00
test_batch_expansion.py [Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103) 2024-03-08 23:32:46 -08:00
test_metrics.py Re-enable the 80 char line width limit (#3305) 2024-03-10 19:49:14 -07:00
test_multi_step_worker.py [1/n][Chunked Prefill] Refactor input query shapes (#3236) 2024-03-20 14:46:05 -07:00
test_spec_decode_worker.py Re-enable the 80 char line width limit (#3305) 2024-03-10 19:49:14 -07:00
test_utils.py [Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103) 2024-03-08 23:32:46 -08:00
utils.py [Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103) 2024-03-08 23:32:46 -08:00