Commit Graph

7 Commits

Author SHA1 Message Date
Woosuk Kwon
707ec647bb
Add copyright headers for HF models (#103) 2023-05-14 21:54:32 -07:00
Woosuk Kwon
42f1042e1c
Enhance SamplingParams (#96) 2023-05-11 15:45:30 -07:00
Woosuk Kwon
55f8b0a5de
Implement presence and frequency penalties (#95) 2023-05-10 23:39:12 -07:00
Woosuk Kwon
9f88db35da
Support top-k sampling (#94) 2023-05-10 12:51:36 -07:00
Woosuk Kwon
ae356774ab
Avoid sorting waiting queue & Minor code cleaning (#93) 2023-05-10 01:57:07 -07:00
Woosuk Kwon
add055e151
Enhance model loader (#83) 2023-05-09 15:46:42 -07:00
Woosuk Kwon
7c041ab578
Refactor system architecture (#82) 2023-05-09 15:30:12 -07:00