squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Misc] remove duplicate definition of seq_lens_tensor in model_runner.py (#5129)

Browse Source
This commit is contained in:
Hyunsung Lee 2024-05-30 22:56:19 +09:00 committed by GitHub
parent f758505c73
commit d79d9eaaff
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 0 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
vllm/worker/model_runner.py
View File

@ -518,9 +518,6 @@ class ModelRunner:
else: else:
multi_modal_input = None multi_modal_input = None
seq_lens_tensor = torch.tensor(seq_lens,
dtype=torch.int,
device=self.device)
query_lens_tensor = torch.tensor(query_lens, query_lens_tensor = torch.tensor(query_lens,
dtype=torch.long, dtype=torch.long,
device=self.device) device=self.device)