4 Commits

Author	SHA1	Message	Date
Jee Li	8af890a865	Enable more models to inference based on LoRA (#3382) ... Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>	2024-03-25 18:09:31 -07:00
Or Sharir	ae0ccb4017	Add missing kernel for CodeLlama-34B on A/H100 (no tensor parallelism) when using Multi-LoRA. (#3350)	2024-03-13 12:18:25 -07:00
Woosuk Kwon	929b4f2973	Add LoRA support for Gemma (#3050)	2024-02-28 13:03:28 -08:00
Antoni Baum	9b945daaf1	[Experimental] Add multi-LoRA support (#1804) ... Co-authored-by: Chen Shen <scv119@gmail.com> Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com> Co-authored-by: Avnish Narayan <avnish@anyscale.com>	2024-01-23 15:26:37 -08:00