squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Bugfix][Hardware][Intel CPU] Fix unpassed multi_modal_kwargs for CPU runner (#5956)

Browse Source
This commit is contained in:
Isotr0py 2024-06-28 20:03:41 +08:00 committed by GitHub
parent 74d55c065b
commit 0d0e3a42ac
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/worker/cpu_model_runner.py
View File

@ -355,6 +355,7 @@ class CPUModelRunner(ModelRunnerBase[CPUModelInput]):
input_positions=input_positions, input_positions=input_positions,
attn_metadata=attn_metadata, attn_metadata=attn_metadata,
sampling_metadata=sampling_metadata, sampling_metadata=sampling_metadata,
multi_modal_kwargs=multi_modal_kwargs,
) )
@torch.inference_mode() @torch.inference_mode()