3 Commits

Author	SHA1	Message	Date
Zhuohan Li	ba0bfd40e2	TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181)	2023-10-02 15:36:09 -07:00
Zhuohan Li	947b794146	[Sampler] Vectorized sampling (simplified) (#1048) ... Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>	2023-09-22 17:48:04 -07:00
Zhuohan Li	002800f081	Align vLLM's beam search implementation with HF generate (#857)	2023-09-04 17:29:42 -07:00