squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Add Yi model to quantization support (#1600)

Browse Source
This commit is contained in:
forpanyang 2023-11-10 03:47:14 +08:00 committed by GitHub
parent fd58b73a40
commit ab9e8488d5
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/model_executor/model_loader.py
View File

@ -41,6 +41,7 @@ _MODEL_REGISTRY = {
_MODEL_CLASSES_SUPPORT_QUANTIZATION = [ _MODEL_CLASSES_SUPPORT_QUANTIZATION = [
LlamaForCausalLM, LlamaForCausalLM,
MistralForCausalLM, MistralForCausalLM,
YiForCausalLM,
] ]