81ede99ca4
Removing the block manager v1. This is the initial piece of prefix-caching-centric design. In order to achieve prefix-caching-centric design, we need to simplify the code path so that we only use v2 block manager (which has much higher performance on prefix caching). |
||
|---|---|---|
| .. | ||
| adding_model.rst | ||
| enabling_multimodal_inputs.rst | ||
| engine_args.rst | ||
| lora.rst | ||
| performance.rst | ||
| spec_decode.rst | ||
| supported_models.rst | ||
| vlm.rst | ||