4 Commits

Author	SHA1	Message	Date
Varun Sundar Rabindranath	c2ec430ab5	[Core] Multi-Step + Single Step Prefills via Chunked Prefill code path (#8378) ... Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>	2024-09-27 13:32:07 -07:00
Tyler Michael Smith	71d21c73ab	[Bugfix] Fixup advance_step.cu warning (#8815)	2024-09-26 16:23:45 -07:00
William Lin	a6c0f3658d	[multi-step] add flashinfer backend (#7928)	2024-09-12 11:16:22 -07:00
Alexander Matveev	e76466dde2	[Core] draft_model_runner: Implement prepare_inputs on GPU for advance_step (#6338)	2024-07-17 14:30:28 -07:00