6 Commits

Author	SHA1	Message	Date
Tri Dao	f95c2fc108	[Gen] Remove commented code	2023-01-07 19:06:39 -08:00
Tri Dao	b48599002a	[Gen] Add timing option	2023-01-07 19:05:09 -08:00
Tri Dao	e02fd588aa	[Gen] Implement top-k and top-p sampling	2023-01-07 17:00:02 -08:00
Tri Dao	a668890fcd	[Gen] Add option to run generation with FT attention kernel	2023-01-03 22:10:31 -08:00
Tri Dao	a6ec1782dc	Bump to v0.2.6	2022-12-27 22:05:20 -08:00
Tri Dao	63670fd84a	Implement generation for GPT	2022-12-27 21:01:50 -08:00