squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Add Nemotron to PP_SUPPORTED_MODELS (#6863)

Browse Source
This commit is contained in:
Michael Goin 2024-07-27 18:05:17 -04:00 committed by GitHub
parent 75acdaa4b6
commit b1366a9534
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/config.py
View File

@ -39,6 +39,7 @@ _PP_SUPPORTED_MODELS = [
"Phi3ForCausalLM", "Phi3ForCausalLM",
"GPT2LMHeadModel", "GPT2LMHeadModel",
"MixtralForCausalLM", "MixtralForCausalLM",
"NemotronForCausalLM",
] ]