vllm/tests/spec_decode
Thomas Parnell c2a8ac75e0
[CI/Build] Add E2E tests for MLPSpeculator (#5791)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
2024-06-26 00:04:08 +00:00
..
e2e [CI/Build] Add E2E tests for MLPSpeculator (#5791) 2024-06-26 00:04:08 +00:00
__init__.py [Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (#3103) 2024-03-08 23:32:46 -08:00
test_batch_expansion.py [mypy] Enable type checking for test directory (#5017) 2024-06-15 04:45:31 +00:00
test_dynamic_spec_decode.py [Speculative Decoding] Add ProposerWorkerBase abstract class (#5252) 2024-06-05 14:53:05 -07:00
test_metrics.py [Speculative decoding 7/9] Speculative decoding end-to-end correctness tests. (#3951) 2024-04-23 08:02:36 +00:00
test_multi_step_worker.py [mypy] Enable type checking for test directory (#5017) 2024-06-15 04:45:31 +00:00
test_ngram_worker.py [Speculative Decoding] Add ProposerWorkerBase abstract class (#5252) 2024-06-05 14:53:05 -07:00
test_spec_decode_worker.py [Model] MLPSpeculator speculative decoding support (#4947) 2024-06-20 20:23:12 -04:00
test_utils.py [Model] MLPSpeculator speculative decoding support (#4947) 2024-06-20 20:23:12 -04:00
utils.py [mypy] Enable type checking for test directory (#5017) 2024-06-15 04:45:31 +00:00