Terry 2a543d6efe Add LoRA support for Mixtral (#2831) ... * add mixtral lora support * formatting * fix incorrectly ported logic * polish tests * minor fixes and refactoring * minor fixes * formatting * rename and remove redundant logic * refactoring * refactoring * minor fix * minor refactoring * fix code smell		2024-02-14 00:55:45 +01:00
..
async_engine	[Experimental] Add multi-LoRA support (#1804)	2024-01-23 15:26:37 -08:00
distributed	Implement custom all reduce kernels (#2192)	2024-01-27 12:46:35 -08:00
engine	Migrate linter from pylint to ruff (#1665)	2023-11-20 11:58:01 -08:00
entrypoints	Support Batch Completion in Server (#2529)	2024-01-24 17:11:07 -08:00
kernels	[Minor] More fix of test_cache.py CI test failure (#2750)	2024-02-06 11:38:38 -08:00
lora	Add LoRA support for Mixtral (#2831)	2024-02-14 00:55:45 +01:00
models	Add StableLM3B model (#2372)	2024-01-16 20:32:40 -08:00
prefix_caching	[Experimental] Prefix Caching Support (#1669)	2024-01-17 16:32:10 -08:00
prompts	[BugFix] Fix input positions for long context with sliding window (#2088)	2023-12-13 12:28:13 -08:00
samplers	Remove hardcoded device="cuda" to support more devices (#2503)	2024-02-01 15:46:39 -08:00
worker	Remove hardcoded device="cuda" to support more devices (#2503)	2024-02-01 15:46:39 -08:00
__init__.py	[Small] Formatter only checks lints in changed files (#1528)	2023-10-31 15:39:38 -07:00
conftest.py	[BUGFIX] Fix the path of test prompts (#2273)	2023-12-26 10:37:21 -08:00
test_regression.py	[Bugfix] fix crash if max_tokens=None (#2570)	2024-01-23 22:38:55 -08:00
test_sampling_params.py	[Bugfix] fix crash if max_tokens=None (#2570)	2024-01-23 22:38:55 -08:00