squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Bugfix] Allow token ID-only inputs in Qwen2-Audio (#10536)

Browse Source 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
This commit is contained in:
Cyrus Leung 2024-11-22 02:09:43 +08:00 committed by GitHub
parent c51e397fe8
commit e7a8341c7c
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/model_executor/models/qwen2_audio.py
View File

@ -212,7 +212,7 @@ def input_processor_for_qwen2_audio(
return token_inputs( return token_inputs(
prompt_token_ids=new_input_ids, prompt_token_ids=new_input_ids,
prompt=inputs['prompt'], prompt=inputs.get("prompt"),
multi_modal_data=multi_modal_data, multi_modal_data=multi_modal_data,
) )