squall/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Bugfix] fix detokenizer shallow copy (#5919)

Browse Source
This commit is contained in:
Aurick Qiao 2024-10-22 18:38:12 -04:00 committed by GitHub
parent 17c79f3c36
commit 23b899a8e6
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
vllm/transformers_utils/detokenizer.py
View File

@ -90,7 +90,7 @@ class Detokenizer:
prefix_offset = next_iter_prefix_offset
read_offset = next_iter_read_offset
if prev_tokens is None:
prev_tokens = next_iter_tokens
prev_tokens = next_iter_tokens.copy()
else:
prev_tokens.extend(next_iter_tokens)