4 Commits

Author	SHA1	Message	Date
Zhuohan Li	4298374265	Add docstrings for LLMServer and related classes and examples (#142)	2023-06-07 18:25:20 +08:00
Woosuk Kwon	337871c6fd	Enable LLaMA fast tokenizer (#132)	2023-05-28 02:51:42 -07:00
Woosuk Kwon	e86717833d	Incrementally decode output tokens (#121)	2023-05-23 20:46:32 -07:00
Woosuk Kwon	c3442c1f6f	Refactor system architecture (#109)	2023-05-20 13:06:59 -07:00