4 Commits

Author	SHA1	Message	Date
Noam Gat	555bdcc5a3	Added logits processor API to sampling params (#1469)	2023-11-03 14:12:15 -07:00
Woosuk Kwon	d3a5bd9fb7	Fix sampler test (#1379)	2023-10-16 12:57:26 -07:00
Zhuohan Li	ba0bfd40e2	TP/quantization/weight loading refactor part 1 - Simplify parallel linear logic (#1181)	2023-10-02 15:36:09 -07:00
Zhuohan Li	947b794146	[Sampler] Vectorized sampling (simplified) (#1048) ... Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>	2023-09-22 17:48:04 -07:00