4 Commits

Author	SHA1	Message	Date
youkaichao	20cfcdec99	[Core][Optimization] change python dict to pytorch tensor for blocks to swap (#4659)	2024-05-08 12:07:05 -07:00
SangBin Cho	0f8a91401c	[Core] Ignore infeasible swap requests. (#4557)	2024-05-02 14:31:20 -07:00
SangBin Cho	67b4221a61	[Core][5/N] Fully working chunked prefill e2e (#3884)	2024-04-10 17:56:48 -07:00
SangBin Cho	18de883489	[Chunked Prefill][4/n] Chunked prefill scheduler. (#3853)	2024-04-05 10:17:58 -07:00