81ede99ca4
Removing the block manager v1. This is the initial piece of prefix-caching-centric design. In order to achieve prefix-caching-centric design, we need to simplify the code path so that we only use v2 block manager (which has much higher performance on prefix caching). |
||
|---|---|---|
| .. | ||
| _static | ||
| _templates/sections | ||
| assets | ||
| automatic_prefix_caching | ||
| community | ||
| dev | ||
| getting_started | ||
| models | ||
| performance_benchmark | ||
| quantization | ||
| serving | ||
| conf.py | ||
| generate_examples.py | ||
| index.rst | ||